Introducing Mellum2: A 12B Mixture-of-Experts Model by JetBrains

JetBrains announced the release of Mellum2, a 12‑billion‑parameter language model built on a Mixture‑of‑Experts architecture. The model aims to boost efficiency and performance on text generation tasks and is made available to the community via Hugging Face.

Summary written by Kernelia from the original article by Hugging Face Blog. The story and its rights belong to its author.