Blog

Your blog category

AWS Inferentia and AWS Trainium deliver lowest cost to deploy Llama 3 models in Amazon SageMaker JumpStart

Today, we’re excited to announce the availability of Meta Llama 3 inference on AWS Trainium and AWS Inferentia based instances in Amazon SageMaker JumpStart. The Meta Llama 3 models are a collection of pre-trained and fine-tuned generative text models. Amazon Elastic Compute Cloud (Amazon EC2) Trn1 and Inf2 instances, powered by AWS Trainium and AWS […]

AWS Inferentia and AWS Trainium deliver lowest cost to deploy Llama 3 models in Amazon SageMaker JumpStart Read More »

Simple guide to training Llama 2 with AWS Trainium on Amazon SageMaker

Large language models (LLMs) are making a significant impact in the realm of artificial intelligence (AI). Their impressive generative abilities have led to widespread adoption across various sectors and use cases, including content generation, sentiment analysis, chatbot development, and virtual assistant technology. Llama2 by Meta is an example of an LLM offered by AWS. Llama

Simple guide to training Llama 2 with AWS Trainium on Amazon SageMaker Read More »

The European Union is investigating Meta’s election policies

The EU has officially opened a significant investigation into Meta for its alleged failures to remove election disinformation. While the European Commission’s statement doesn’t explicitly mention Russia, Meta confirmed to Engadget the EU probe targets the country’s Doppelganger campaign, an online disinformation operation pushing pro-Kremlin propaganda. Bloomberg’s sources also said the probe was focused on

The European Union is investigating Meta’s election policies Read More »

Cohere Command R and R+ are now available in Amazon SageMaker JumpStart

This blog post is co-written with Pradeep Prabhakaran from Cohere.  Today, we are excited to announce that Cohere Command R and R+ foundation models are available through Amazon SageMaker JumpStart to deploy and run inference. Command R/R+ are the state-of-the-art retrieval augmented generation (RAG)-optimized models designed to tackle enterprise-grade workloads. In this post, we walk through how

Cohere Command R and R+ are now available in Amazon SageMaker JumpStart Read More »

Apple’s OLED iPad Pro may come packing an M4 chip and an emphasis on AI

Apple’s “Let Loose” iPad event is just over a week away, and the rumors in the leadup are starting to get interesting. According to Bloomberg’s Mark Gurman, the much-anticipated OLED iPad Pro may arrive not with the new M3 chip as we’ve all been expecting, but the next-gen M4 instead. In the Power On newsletter

Apple’s OLED iPad Pro may come packing an M4 chip and an emphasis on AI Read More »

Databricks DBRX is now available in Amazon SageMaker JumpStart

Today, we are excited to announce that the DBRX model, an open, general-purpose large language model (LLM) developed by Databricks, is available for customers through Amazon SageMaker JumpStart to deploy with one click for running inference. The DBRX LLM employs a fine-grained mixture-of-experts (MoE) architecture, pre-trained on 12 trillion tokens of carefully curated data and

Databricks DBRX is now available in Amazon SageMaker JumpStart Read More »

Samsung’s Galaxy S24 Ultra falls to a new low, plus the rest of the week’s best tech deals

Another week is coming to a close, which means it’s time for another roundup of good tech deals. This week’s highlights include a new low on Samsung’s Galaxy S24 Ultra, which is $200 off and down to $1,100 for an unlocked model. That’s not exactly cheap, no, but any savings should be welcome for what

Samsung’s Galaxy S24 Ultra falls to a new low, plus the rest of the week’s best tech deals Read More »

Deploy a Hugging Face (PyAnnote) speaker diarization model on Amazon SageMaker as an asynchronous endpoint

Speaker diarization, an essential process in audio analysis, segments an audio file based on speaker identity. This post delves into integrating Hugging Face’s PyAnnote for speaker diarization with Amazon SageMaker asynchronous endpoints. We provide a comprehensive guide on how to deploy speaker segmentation and clustering solutions using SageMaker on the AWS Cloud. You can use

Deploy a Hugging Face (PyAnnote) speaker diarization model on Amazon SageMaker as an asynchronous endpoint Read More »

Scroll to Top