AWS Introduces Trainium2 Chips, Apple Explores AI Partnership for Performance Boost

Dec 3, 2024, 06:42 PM

Amazon Web Services (AWS) has announced the general availability of its Trainium2 chips, designed for building large language models (LLMs), with the next iteration, Trainium3, set to be released in late 2025 using 3nm technology. Apple Inc. has revealed its deep AI partnership with AWS, stating that it uses AWS's custom AI chips, including Trainium and Graviton, for its search services. Apple is also evaluating the potential of Trainium2 chips for pre-training its AI models, expecting a significant performance boost. Additionally, Anthropic, an AI startup, has already implemented Trainium2 chips for some inference tasks of its Claude 3.5 Haiku model, achieving 60% faster responses, and plans to train its next-generation models on AWS's new 'Rainier' training cluster.