Loading...
Market
First major application area for Infini-attention by 2024
5
Resolution / Starting Odds
Natural Language Processing • 25%
Autonomous Vehicles • 25%
Healthcare • 25%
Financial Services • 25%
Market analysis reports and tech news outlets
Story
Google Unveils 'Infini-attention' for Unlimited Context in LLMs
Apr 20, 2024, 03:52 PM
Google has introduced a groundbreaking technique in machine learning called 'Infini-attention', which enables handling of unlimited context in language models while maintaining a fixed-size memory footprint. This advancement, detailed in their latest papers 'Mixture of Depths' and 'Efficient Infinite Context Transformers with Infini-attention', aims to enhance the processing capabilities of pre-trained language models (LLMs) by applying local attention to input chunks and sequentially retaining relevant information. The development is seen as a significant step towards achieving very long context lengths, sufficient for most industry use cases.
View original story
Similar markets
Chatbots • 25%
Autonomous vehicles • 25%
Healthcare AI • 25%
Other AI applications • 25%
Natural Language Processing • 25%
Machine Learning Platforms • 25%
AI-optimized Hardware • 25%
Automated Machine Learning • 25%
Healthcare • 25%
Automotive • 25%
Financial Services • 25%
Retail • 25%
Machine Learning • 33%
Natural Language Processing • 33%
Computer Vision • 34%
Healthcare • 25%
Automotive • 25%
Financial Services • 25%
Telecommunications • 25%
Healthcare • 25%
Finance • 25%
Automotive • 25%
Education • 25%
Finance • 20%
Healthcare • 20%
Automotive • 20%
Telecommunications • 20%
Education • 20%
Domestic tasks • 25%
Industrial automation • 25%
Healthcare assistance • 25%
Research and development • 25%
OpenAI • 25%
Google • 25%
Microsoft • 25%
Other • 25%
Natural Language Processing • 33%
Machine Learning • 33%
Robotics • 33%
AI for news writing • 25%
AI for content curation • 25%
AI for audience engagement • 25%
AI for ad targeting • 25%
Consumer Electronics • 20%
Automotive • 20%
Data Centers • 20%
Mobile Devices • 20%
AI Research • 20%