Leanstral 1.5
Leanstral 1.5 is a Mixture-of-Experts (MoE) model with approximately 26 billion total parameters and 3 billion active parameters, designed for efficient inference on consumer GPUs. It outperforms larger models like Mistral 7B and Llama 3.1 8B on standard benchmarks while offering faster generation speeds and a 128k-token context window. The model is available under the Apache 2.0 license.
Background
- Mistral AI is a French company (founded by ex-DeepMind and Meta researchers) building large language models. Their models compete with OpenAI, Anthropic, and Google's offerings.
- Leanstral 1.5 is a new model optimized for "function calling" — meaning it's designed to take structured inputs (like API calls) and produce structured outputs, not just generate conversational text. This makes it useful for developers who want AI to interact with databases, tools, or software workflows.
- The 1.5 version suggests an iteration on a previous Leanstral model, likely focusing on improved accuracy and efficiency in these structured tasks.
- This matters because enterprise AI adoption often hinges on reliable, low-cost models that can automate backend processes, not just chat. Leanstral targets that niche: smaller, cheaper, and specialized, rather than a do-everything flagship.