sgl-project/sglang v0.5.20

Key points

• Masks now run under overlap scheduling: on Qwen3-8B, decode throughput is 17% higher at batch 1 and 52% higher at batch 64 than the previous implementation.1
• DSpark under PD with decode context parallelism. A DCP1 prefill can now transfer its DSpark draft KV to a DCP-N decode, so hybrid models such as Kimi-Linear run DSpark in disaggregated, context-parallel serving.1
• Responses API storage is opt-in. /v1/responses no longer retains results in memory unless the server starts with --enable-response-store.1
• SGLang Simulator. A CPU-only simulator runs the real scheduler, radix cache, and hierarchical cache with a latency predictor in place of the model forward.1

Sources (1)

• [1]sgl-project/sglang v0.5.20
  GitHub: sgl-project/sglang · Sep 18, 10:41 PM

  | Model | Type | PRs | Cookbook |

  Masks now run under overlap scheduling: on Qwen3-8B, decode throughput is 17% higher at batch 1 and 52% higher at batch 64 than the previous implementation.

Extractive summary: sentences quoted from the sources.