Loading...
Market
What will be the primary use case for ModernBERT in published research by end of 2025?
2
Resolution / Starting Odds
Text Classification • 25%
Information Retrieval • 25%
Sentiment Analysis • 25%
Other • 25%
Review of published research papers and abstracts in NLP journals
Story
ModernBERT Released: State-of-the-Art Encoder Model with 8,192 Token Support, 2 Trillion Tokens, and 2-3x Faster Processing
Dec 19, 2024, 04:51 PM
ModernBERT, a new family of state-of-the-art encoder-only models, has been released by AnswerAI and LightOn. This updated version of BERT features a sequence length of 8,192 tokens and is designed for improved performance in tasks such as classification and retrieval. Trained on 2 trillion tokens, ModernBERT is reported to be twice as fast as DeBERTaV3 on short contexts and three times faster than NomicBERT and GTE on long contexts. The model is available in two sizes: ModernBERT-base with 149 million parameters and ModernBERT-large with 395 million parameters. This release marks a significant upgrade to traditional BERT models, which have not seen a major overhaul in over six years.
View original story
Similar markets
Chatbots • 25%
Content generation • 25%
Data analysis • 25%
Other • 25%
Customer service chatbots • 25%
Content generation • 25%
Personalized recommendations • 25%
Other • 25%
Validating data formats • 25%
Automating data entry • 25%
Building dynamic user interfaces • 25%
Other • 25%
Customer service automation • 25%
Content creation • 25%
Data analysis • 25%
Other applications • 25%
Chatbots • 25%
Content Creation • 25%
Data Analysis • 25%
Other • 25%
Healthcare • 25%
Finance • 25%
Education • 25%
Other • 25%
Data Classification • 25%
Chatbots • 25%
Content Generation • 25%
Other • 25%
Education • 25%
Healthcare • 25%
Finance • 25%
Other • 25%
Training Transformers • 25%
Inference with Sentence Transformers • 25%
Deploying Diffusers models • 25%
Other • 25%
Job Search • 25%
Educational Assistance • 25%
Real-time Search • 25%
Other • 25%
Chatbots • 25%
Content creation • 25%
Customer support • 25%
Educational tools • 25%
Deep Learning • 25%
Computer Vision • 25%
Autonomous Vehicles • 25%
Robotics • 25%
Natural Language Processing • 25%
Computer Vision • 25%
Recommendation Systems • 25%
Other AI Applications • 25%