Meta’s most advanced large language models (LLMs) give AWS customers more choices when building, deploying, and scaling generative AI applications.
Sept 25, 2024: This article has been updated to reflect the general availability of Llama 3.2 from Meta—the company’s latest, most advanced collection of multilingual large language models (LLMs)—in Amazon Bedrock and Amazon SageMaker, as well as via Amazon Elastic Compute Cloud (Amazon EC2) using AWS Trainium and Inferentia.
The next generation of Llama models from technology company Meta, including its first ever multimodal models, are available today on Amazon Web Services (AWS) in Amazon Bedrock and Amazon SageMaker. They are also available via Amazon Elastic Compute Cloud (Amazon EC2) using AWS Trainium and Inferentia.
The Llama 3.2 collection builds on the success of previous Llama models to offer new, updated, and highly differentiated models, including small and medium-sized vision LLMs that support image reasoning and lightweight, text-only models optimized for on-device use cases. The new models are designed to be more accessible and efficient, with a focus on responsible innovation and safety. Llama Guard 3 Vision, fine-tuned for content safety classification, is also available today in Amazon SageMaker JumpStart. Here are the highlights:
Meta’s first multimodal vision models, Llama 3.2 11B Vision and Llama 3.2 90B Vision
- Largest models in the Llama 3.2 collection.
- Support image understanding and visual reasoning use cases.
- Excellent for analyzing visual data, such as charts and graphs, to deliver more accurate answers and insights.
- Well suited for image captioning, visual question answering, image-text retrieval, document processing, and multimodal chatbots, as well as long-form text generation, multilingual translation, coding, math, and advanced reasoning.
Llama 3.2 1B and Llama 3.2 3B, optimized for edge and mobile devices
- Lightweight, text-only.
- Processing can be performed in the cloud or locally, so responses feel instantaneous.
- Ideal for highly personalized applications spanning text generation and summarization, sentiment analysis, customer service applications, rewriting, multilingual knowledge retrieval, and mobile AI-powered writing assistants.
Llama Guard 3 11B Vision: fine-tuned for content safety classification
- Only available in Amazon SageMaker JumpStart
- Llama Guard 3 11B Vision can be used to safeguard content for both LLM inputs (prompt classification) and LLM responses (response classification).
- Specifically designed to support image reasoning use cases and optimized to detect harmful multimodal (text and image) prompts and text responses to these prompts.
According to Meta, Llama 3.2 models have been evaluated on over 150 benchmark datasets, demonstrating competitive performance with leading foundation models. Similar to Llama 3.1, all of the models support a 128K context length and multilingual dialogue use cases across eight languages, spanning English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.
Visit the AWS News blog for more information on Llama 3.2, and read on for detail on the existing capabilities of Meta’s collection of Llama models, which Llama 3.2 builds on, and how AWS customers have already been using Llama models.
Source from: Amazon.com
Disclaimer: The information set forth above is provided by Amazon.com independently of 9696.me. 9696.me makes no representation and warranties as to the quality and reliability of the seller and products.
