SGLang

Timeline

1. Oct 19, 2026 · Open-source release · 1 source
   NVIDIA Open Sources Run:ai Under Apache 2.0 for Kubernetes GPU Orchestration
   NVIDIA has released the full NVIDIA Run:ai platform as open source software.
2. Oct 19, 2026 · Open-source release · 1 source
   sgl-project/sglang v0.5.22
   | Model | Type | Cookbook |
3. Oct 18, 2026 · Opinion / analysis · 1 source
   Agens Volundr 32B v1: we fixed what you flagged in the Preview. 0/50 loops, session continuation, and an MIT engine that runs it with 262K context (measured to 239K) within a 16 GB budget
   WHAT v1 FIXES FROM THE PREVIEW
4. Oct 17, 2026 · Tutorial / explainer · 14 sources
   Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
   In this post, we show how to run the latest frontier-class model — Muse Spark Open, with nearly a trillion parameters — right from your desk, using the latest version of MLX, released today.
5. Oct 17, 2026 · Tutorial / explainer · 1 source
   justxor/deepseek-local-guide-ru: 🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, O
   🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки Language: Shell.
6. Oct 17, 2026 · Open-source release · 2 sources
   StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
   StepFun has released Step 5 Preview as open weights.
7. Oct 16, 2026 · Open-source release · 5 sources
   Welcome Beam: a 501B open model you can own, customize, and scale
   Beam is focused on coding and agentic use cases.
8. Oct 16, 2026 · Open-source release · 2 sources
   [Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source)
   We're excited to share ORL (On-Policy Residual Learning), our new research on making diffusion language models (dLLMs) significantly faster without sacrificing generation quality.
9. Oct 16, 2026 · Opinion / analysis · 1 source
   DeepSeek V4.1 Flash on 4x DGX Spark: my numbers vs Patrick Moorhead's results via Wccftech.
   A couple of weeks ago I read this Wccftech article about Patrick Moorhead's 4 Spark setup.
10. Oct 14, 2026 · Open-source release · 4 sources
    Fish Audio Drama 3 Technical Report
    We introduce Fish Audio Drama 3, an open-source speech generation model that turns text into directed performances, built on a 35B-parameter mixture-of-experts backbone that activates 3B parameters per token.
11. Oct 14, 2026 · Research paper · 1 source
    Delta Tokenizer: Reference-Identical Tokenization of Session Deltas and Segment-Parallelism for Long Prompts on Multicore CPUs
    We present Delta Tokenizer, a CPU tokenization front end that tokenizes only the delta between a request and the previous request of the same session.
12. Oct 14, 2026 · Model release · 3 sources
    Run fast, private agents on-device with LFM2.5-24B-A2B
    Best-in-class agent: Competitive with Qwen3.6-35B-A3B, a model with ~50% more total and active parameters, on agentic and tool-use tasks, scoring 48.09 on LiveClaw versus 38.19.
13. Oct 13, 2026 · Research paper · 1 source
    AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding
    We present AlignPred, a codec that combines local alignment with predictive coding under a configurable KV reconstruction-error budget.
14. Oct 13, 2026 · Model release · 2 sources
    Z.ai GLM-Legal Beats Claude Fable 5 and Kimi K3 on Harvey LAB
    GLM-Legal is a legal AI model from Z.ai, built on GLM-5.3-Flash and trained for agentic legal work.
15. Oct 12, 2026 · Research paper · 2 sources
    Alibaba Qwen Introduces QwenGyre: Elastic Reinforcement Learning RL for XLong-Horizon Agents
    Alibaba’s Qwen team has introduced QwenGyre, an elastic reinforcement learning RL framework for extreme-long-horizon agent training.
16. Oct 12, 2026 · Opinion / analysis · 1 source
    openbmb/MiniCPM-V-4.7-1B
    "MiniCPM-V 4.7 is the latest model in the MiniCPM-V series, available in a 1B variant.
17. Oct 12, 2026 · Model release · 1 source
    openbmb/MiniCPM-V-4.7-35B-A3B
    With our Lookahead Expert Scheduling (LES) technique introduced alongside MiniCPM-V 4.7, combined with fine-grained layer-wise quantization and DSpark speculative sampling integration, MiniCPM-V 4.7 35B-A3B becomes the first open-source MoE model to run smoothly on-device without compromising performance, achieving a decoding speed of 13+ tokens/s on iPhone 17 Pro Max.
18. Oct 12, 2026 · Research paper · 1 source
    Logit Leakage through Floating-Point Bias Addition
    Language model APIs can expose token-specific biases while withholding logits and token probabilities.
19. Oct 12, 2026 · Opinion / analysis · 1 source
    graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names
    A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can read it in a loop.
20. Oct 12, 2026 · Research paper · 1 source
    A Production-Grade, High-Efficiency Agentic RL Framework for Frontier LLMs with Validated Recipes
    To address these challenges, we present LoongSage, an agent-native, fully asynchronous RL framework with a lightweight core of roughly 14K lines of code.
21. Oct 12, 2026 · Research paper · 1 source
    Hashrope: A Persistent Data Structure for Mechanisms of LLM Context Management
    Serving stacks for large language models manage context through four recurring mechanisms: incremental edits to a growing context, branching and snapshotting for tree search, identification of reusable prefixes for KV-cache reuse, and encoding of repeated segments.
22. Oct 11, 2026 · Model release · 3 sources
    Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
    Following last week’s release of Clef and Clef-flash, Cloudflare’s open-weight decision models, we decided to bring forth more gifts.
23. Oct 11, 2026 · Opinion / analysis · 1 source
    Taming the AI Hardware Cambrian Explosion — Abdul Dakkak, Modular
    Abdul Dakkak, chief scientist at Modular, explains why today's AI software stack is a mess, with vLLM, SGLang, TensorRT-LLM and llama.cpp each patching around different hardware, and how Modular rebuilt the stack from the ground up.
24. Oct 7, 2026 · Research paper · 1 source
    Dual-QK: Sharp Queries and Flat Keys for Prunable 2-bit KV Caches
    We introduce Dual-QK, which uses paired non-orthogonal query and key transforms to address this conflict.
25. Oct 6, 2026 · Open-source release · 1 source
    unslothai/unsloth v0.1.903-beta: New Browser + Voice Cloning
    This release adds a browser inside Unsloth (browser use coming very soon), so files, web pages and pages the model writes open right beside your chat.
26. Oct 6, 2026 · Research paper · 2 sources
    VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs
    Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense, fixed-size patch tokens.
27. Oct 2, 2026 · Open-source release · 1 source
    sgl-project/sglang v0.5.21
    | Model | Type | Cookbook |
28. Sep 28, 2026 · Opinion / analysis · 1 source
    How GLM5.3 Sparse Attention Affects HBM Memory Usage
    How Sparse Attention Affects DRAM/NAND Memory
29. Sep 18, 2026 · Open-source release · 1 source
    sgl-project/sglang v0.5.20
    | Model | Type | PRs | Cookbook |
30. Sep 5, 2026 · Open-source release · 1 source
    sgl-project/sglang v0.5.19
    | Model | Type | PRs | Cookbook |

Often appears with