IBM Unveils Open-Source Granite 3.0 AI Models with Dense and MoE Architectures Under Apache License

Oct 21, 2024, 04:12 AM

IBM has released new open-source AI models tailored for enterprise use, as competition in generative AI intensifies. The company introduced the Granite 3.0 family of large language models (LLMs), which include both Dense and Mixture of Experts architectures. The Dense models have 8 billion and 2 billion parameters, while the Mixture of Experts models have 3 billion and 1 billion parameters. All models are released under the permissive Apache 2.0 license and are designed to deliver high performance in benchmarks. These models are expected to transform operations for businesses adopting AI solutions. Additionally, IBM announced a partnership with Ollama to make Granite 3.0 models available.