huggingface/transformers v5.20.0: Release v5.20.0
Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text.
ProofCode ↗
Key points
- Ling 3.0 Flash is a hybrid Mixture-of-Experts language model from InclusionAI.
- Its decoder groups five Kimi Delta Attention (KDA) layers with one Multi-head Latent Attention (MLA) layer.
- It is natively supported in Transformers as BailingHybridForCausalLM, so it loads without trustremotecode=True.
- Kolibri 1 is Aleph Alpha's mixture-of-experts reasoning model, focused on German and English.
Sources (1)
- [1]huggingface/transformers v5.20.0: Release v5.20.0GitHub: huggingface/transformers · Oct 15, 06:05 PM
Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text.
Ling 3.0 Flash is a hybrid Mixture-of-Experts language model from InclusionAI.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
- Oct 15, 2026StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
- Oct 15, 2026Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
- Oct 15, 2026Welcome FLUX.3 Image Klein in Diffusers
- Oct 14, 2026A 35B multimodal model running on a phone with ~3GB memory? MiniCPM-V 4.7 demo is pretty wild
- Oct 14, 2026mistralai/Timestral-209M
