AWS Introduces Trainium2 Chips, Apple Explores AI Partnership for Performance Boost
Dec 3, 2024, 06:42 PM
Amazon Web Services (AWS) has announced the general availability of its Trainium2 chips, designed for building large language models (LLMs), with the next iteration, Trainium3, set to be released in late 2025 using 3nm technology. Apple Inc. has revealed its deep AI partnership with AWS, stating that it uses AWS's custom AI chips, including Trainium and Graviton, for its search services. Apple is also evaluating the potential of Trainium2 chips for pre-training its AI models, expecting a significant performance boost. Additionally, Anthropic, an AI startup, has already implemented Trainium2 chips for some inference tasks of its Claude 3.5 Haiku model, achieving 60% faster responses, and plans to train its next-generation models on AWS's new 'Rainier' training cluster.
View original story
No • 50%
Yes • 50%
No • 50%
Yes • 50%
Yes • 50%
No • 50%
Other • 25%
Claude 4 • 25%
Claude 3 • 25%
Claude 5 • 25%
35% - 40% • 25%
Less than 30% • 25%
More than 40% • 25%
30% - 35% • 25%
Top 6-10 • 25%
Top 1 • 25%
Top 2-5 • 25%
Below Top 10 • 25%
Oracle • 25%
Other • 25%
SoftBank • 25%
Microsoft • 25%
Other outcome • 25%
Switches to Google Cloud • 25%
Switches to AWS • 25%
Remains exclusive with Microsoft • 25%
Less than 50% • 25%
More than 90% • 25%
70% to 90% • 25%
50% to 70% • 25%
Other • 25%
Search Services • 25%
Voice Assistants • 25%
Image Recognition • 25%