Mistral hinted at the release of its new Large 3 and Pixtral Large models, available via API-only for now, leaving the AI community eager for open weights and greater accessibility.
The update came to light after the company released two new models—the Mistral Large 2411 and Pixtral Large 2411—on the Mistral console.
Moreover, the codename suggests that Mistral might officially release these models, with more information on November 24, 2024. This is in line with the naming scheme of previous models, as the Mistral Large 2407, was released on July 24, 2024.
A newer version of Pixtral, Mistral’s multimodal model was also spotted in the list. Titled Pixtral Large 2411, it is also possible that Mistral is launching another model on the same date.
Apart from that, Mistral hasn’t revealed any details yet. While they recently released a small language model called Mistral 3B in October, users have had to wait longer for an update to their larger, flagship model. Similarly, a 12 billion parameter Pixtral model was released in September of this year, and a ‘large’ Pixtral model indicates a massive upgrade to the model.
Mistral’s most recent large model achieved an 84.0% accuracy on the MMLU benchmark, a new record for performance and cost efficiency in open models. It also provides neck-to-neck competition in code generation and reasoning with GPT 4o and Llama 3.
The Pixtral12B model, with its 128k context window, showcases strong multimodal capabilities and scored 52.5% in the MMLU benchmark, surpassing many of its competitors in the small model segment.
Along with dense models, Mistral’s portfolio features two mixtures of experts and MoE models—the Mixtral 8x7B and the 8x22B.
Currently, Mistral is valued at $6 billion, and their latest fundraising in July amounted to $640 million dollars.
It’s interesting how Mistral’s new models will compete in the open source world, which is currently heating up, thanks to models from Alibaba, and Tencent from China shaking up the open source ecosystem.
The post Mistral Teases Release of Multimodal Models—Mistral Large 3 and Pixtral Large appeared first on Analytics India Magazine.
