AnalysisOpinion / analysisEfficiency & Inference · Large Language Models1 source · Oct 18, 2026

Agens Volundr 32B v1: we fixed what you flagged in the Preview. 0/50 loops, session continuation, and an MIT engine that runs it with 262K context (measured to 239K) within a 16 GB budget

WHAT v1 FIXES FROM THE PREVIEW

Proof1 community thread

Key points

  • Repetition loops on SWE-bench tasks: 36/50 → 0/50.
  • "No prefix caching, it re-reads the whole history every turn." - SGLang build: v1 adds session continuation, so follow-up turns reuse the model's state instead of re-prefilling.
  • GGUF: uses llama-server's stock --ctx-checkpoints prompt cache, with no custom server code.
  • Same GPU, same v1 INT4 weights and drafter, single stream: Agens Engine decodes 1.4–1.6× faster than our own SGLang build (up to 1.8× on code with thinking).

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 17, 2026Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming
  2. Oct 17, 2026Nemotron 3.5 Bolt, Muse Spark Open, and a Fast LFM2.5 24B
  3. Oct 16, 2026Welcome Beam: a 501B open model you can own, customize, and scale
  4. Oct 15, 2026QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases
  5. Oct 15, 2026NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal Reasoning
  6. Oct 15, 2026StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context

Related