Loading...
Loading...
Browse all stories on DeepNewz
VisitRLEF adopted by 3 major AI labs for coding LLMs by mid-2025?
Yes • 50%
No • 50%
Official announcements or publications by major AI labs such as OpenAI, DeepMind, or Google AI
Meta AI Advances Coding LLMs with RLEF, Llama 3.1 Outperforms GPT-4 on CodeContests
Oct 4, 2024, 01:57 PM
Meta AI has introduced a significant advancement in coding large language models (LLMs) with the development of Reinforcement Learning with Execution Feedback (RLEF). This technique integrates execution feedback at training time to enhance performance at inference time. The approach has been successfully applied to fine-tune Llama 3.1 models, with the 8B model surpassing GPT-4 on DeepMind’s CodeContests and the 70B model achieving state-of-the-art results. Additionally, the method has been validated through extensive evaluations, including on SWE-bench, demonstrating its effectiveness in improving LLMs for code generation tasks. The evaluations were conducted using a cloud-based infrastructure that speeds up evaluations by 30x.
View original story
Yes • 50%
No • 50%
OpenAI • 25%
Google DeepMind • 25%
Microsoft • 25%
Meta AI • 25%
OpenAI GPT • 25%
Anthropic Claude • 25%
Cohere • 25%
Other • 25%
Yes • 50%
No • 50%
Tech industry • 25%
Healthcare • 25%
Finance • 25%
Education • 25%
Google • 25%
Meta • 25%
Amazon • 25%
Other • 25%
Meta AI • 25%
OpenAI • 25%
DeepMind • 25%
Other • 25%
Other • 25%
Llama 3.1 8B • 25%
GPT-4 • 25%
Llama 3.1 70B • 25%