Mixtral 8x7B
Sparse mixture-of-experts (MoE) model with open weights under Apache 2.0; beats Llama 2 70B on most benchmarks.
Today, the team is proud to release Mixtral 8x7B, a high-quality sparse mixture of experts model (SMoE) with open weights.
Official source
Mixtral of expertsmistral.ai · published