Loading...
Market
Story
AWS Introduces Trainium2 Chips, Apple Explores AI Partnership for Performance Boost
Dec 3, 2024, 06:42 PM
Amazon Web Services (AWS) has announced the general availability of its Trainium2 chips, designed for building large language models (LLMs), with the next iteration, Trainium3, set to be released in late 2025 using 3nm technology. Apple Inc. has revealed its deep AI partnership with AWS, stating that it uses AWS's custom AI chips, including Trainium and Graviton, for its search services. Apple is also evaluating the potential of Trainium2 chips for pre-training its AI models, expecting a significant performance boost. Additionally, Anthropic, an AI startup, has already implemented Trainium2 chips for some inference tasks of its Claude 3.5 Haiku model, achieving 60% faster responses, and plans to train its next-generation models on AWS's new 'Rainier' training cluster.
View original story
Similar markets
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Google • 25%
Microsoft • 25%
Meta • 25%
Other • 25%
Performance • 25%
Cost-effectiveness • 25%
Energy efficiency • 25%
Other • 25%
Google • 25%
Meta • 25%
Microsoft • 25%
Other • 25%
Less than 10% • 25%
10%-20% • 25%
20%-30% • 25%
More than 30% • 25%
Significantly better • 25%
Slightly better • 25%
Comparable • 25%
Worse • 25%
Databricks • 25%
AWS • 25%
Other AI-focused companies • 25%
None • 25%