Qwen2.5-Max
Large mixture-of-experts (MoE) model pretrained on over 20 trillion tokens, in the API and Qwen Chat.
Concurrently, we are developing Qwen2.5-Max, a large-scale MoE model that has been pretrained on over 20 trillion tokens and further post-trained with curated Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF) methodologies.
Official source
Qwen2.5-Max: Exploring the Intelligence of Large-scale MoE Modelqwen.ai · published