NVIDIA Unveils Nemotron-4 340B with 340B Parameters, Tops HuggingFace RewardBench

Jun 14, 2024, 04:23 PM

NVIDIA has announced the release of Nemotron-4 340B, a family of open models designed to generate synthetic data for training large language models (LLMs) for commercial applications. The models can be used across various sectors including healthcare, finance, manufacturing, and retail. Nemotron-4 340B, which features 340 billion parameters, matches the performance of OpenAI's GPT-4 for chat applications and synthetic data generation. This dense LLM includes 4k parameters, and NVIDIA does not claim ownership of any outputs generated. Furthermore, it ranks first on the HuggingFace RewardBench leaderboard and is optimized for generative AI training.