Long context

Timeline

1. Oct 19, 2026 · Open-source release · 1 source
   sgl-project/sglang v0.5.22
   | Model | Type | Cookbook |
2. Oct 19, 2026 · Model release · 2 sources
   Nemotron 3.5 Bolt, Muse Spark Open, and a Fast LFM2.5 24B
   Nemotron 3.5, with a closer look at Bolt and its “native 2-bit” quantization
3. Oct 19, 2026 · Model release · 5 sources
   Introducing Timestral
   Timestral, Mistral’s first family of time-series foundation models, delivers state-of-the-art probabilistic, multivariate forecasts with just 209M parameters, outperforming larger models on key benchmarks while supporting past and future covariates.
4. Oct 19, 2026 · Opinion / analysis · 1 source
   Qwen 3.8 Flash Next optimized for two CMP 170hx GPUs
   I've been working on optimizing Qwen 3.8 Flash Next on my local setup with two CMP 170HX cards and finally got to a place where I feel like the results are worth sharing.
5. Oct 18, 2026 · Opinion / analysis · 1 source
   TinyFish Makes Search Free: What It Really Costs an AI Agent to Read the Web
   An AI agent that reads the web pays 2 kinds of cost.
6. Oct 18, 2026 · Opinion / analysis · 1 source
   Agens Volundr 32B v1: we fixed what you flagged in the Preview. 0/50 loops, session continuation, and an MIT engine that runs it with 262K context (measured to 239K) within a 16 GB budget
   WHAT v1 FIXES FROM THE PREVIEW
7. Oct 18, 2026 · Open-source release · 1 source
   vllm-project/vllm v0.32.0
   This release features 814 commits from 363 contributors (121 new)!
8. Oct 17, 2026 · Opinion / analysis · 1 source
   2 gaming PCs + an M4 Pro MacBook over Ethernet + 2 iPhone 17 Pro Maxes over USB-C: Qwen3.8 Flash Next at 37-39 tok/s at 60k context (262k layout in the works)
   Qwen 3.8 Flash Next is a 48-layer mixture-of-experts model with 512 experts per layer, and even at 3-bit it’s far bigger than my 24 GB MacBook.
9. Oct 17, 2026 · Tutorial / explainer · 14 sources
   Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio
   In this post, we show how to run the latest frontier-class model — Muse Spark Open, with nearly a trillion parameters — right from your desk, using the latest version of MLX, released today.
10. Oct 17, 2026 · Opinion / analysis · 1 source
    Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming
    I have been working on implementing adaptive KV streaming and RDNA 4 / ROCm optimizations for llama.cpp to enable running Qwen3.8-27B (IQ4XS weights, Q80/Q40 KV cache) with its full 262,144-token context window on a single 16 GB RX 9070 XT GPU at 80+ t/s decode.
11. Oct 17, 2026 · Opinion / analysis · 1 source
    model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp
    Kolibri is Aleph Alpha's mixture-of-experts (MoE) reasoning model, with a focus on German and English.
12. Oct 17, 2026 · Open-source release · 2 sources
    StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
    StepFun has released Step 5 Preview as open weights.
13. Oct 16, 2026 · Open-source release · 5 sources
    Welcome Beam: a 501B open model you can own, customize, and scale
    Beam is focused on coding and agentic use cases.
14. Oct 16, 2026 · Research paper · 2 sources
    DLite: History-free Speculative Decoding for Agentic AI
    In this paper, we identify the growing historical context as a common source of both problems and introduce DLite, a history-free speculative decoding framework for agentic AI.
15. Oct 16, 2026 · Research paper · 1 source
    Tool Recommendation for Multi-Step Agents: Finding Every Tool a Task Needs
    We present Tool Recommendation, a deployed system that gives an agent all of them, hundreds of times more than a typical MCP server exposes, through a fixed interface of three tools.
16. Oct 16, 2026 · Research paper · 1 source
    LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction
    We present LonGaussian, a streaming feed-forward framework that reconstructs compact, globally renderable Gaussian scenes from long image sequences with known intrinsics and unknown camera poses.
17. Oct 16, 2026 · Research paper · 1 source
    LongForge: Measuring and Improving Long-Context Instruction Data via Evidence-Assertion Reasoning Graphs
    We formalize data quality as a property of the alignment structure among document, question, and answer, and build LongForge, which pairs an analyzer that measures long-context data with a synthesizer that generates it.
18. Oct 16, 2026 · Research paper · 1 source
    WebCoder: Scaling General Frontend Development with Artifact-Grounded Agentic Reinforcement Learning
    We introduce WebCoder, a general frontend development agent trained with artifact-grounded agentic reinforcement learning.
19. Oct 16, 2026 · Research paper · 1 source
    Prism Attention: Proposal-Refined Index Sharing Mechanism for Efficient LLMs Inference
    Long-context decoding in large language models (LLMs) is increasingly bottlenecked by the memory and computation required to attend over an ever-growing Key-Value (KV) cache at each autoregressive step.
20. Oct 15, 2026 · Research paper · 1 source
    Graph Serializations for Reasoning LLMs: A Study Across Knowledge Extraction and Structural Reasoning
    We evaluate 15 graph representation formats across nine frontier LLM configurations on ontology-based knowledge extraction and structural graph reasoning tasks.
21. Oct 15, 2026 · Open-source release · 1 source
    anthropics/claude-code v2.1.301
    Added CLAUDECODERETRYWATCHDOGMAXUSAGELIMITWAITMS so unattended retry mode (CLAUDECODERETRYWATCHDOG) ends a request at a usage limit that resets too far away instead of waiting
22. Oct 15, 2026 · Opinion / analysis · 1 source
    I turned a transformer into a game console that runs Pong, Tetris, Space Invaders and 116 more games.
    I turned a CHIP-8 game console into a decoder-only transformer.
23. Oct 15, 2026 · Open-source release · 1 source
    huggingface/transformers v5.20.0: Release v5.20.0
    Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text.
24. Oct 15, 2026 · Research paper · 1 source
    Librarian Agents: Training LLMs to Curate Long-Context Workspaces that Anticipate Future Queries
    To instantiate this capability, we introduce Librarian Agents, a framework in which a builder agent transforms raw documents into a hierarchical filesystem of synthetic files and reference links, which forms a workspace tailored for a downstream answering agent.
25. Oct 15, 2026 · Research paper · 1 source
    Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing
    External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state.
26. Oct 15, 2026 · Research paper · 1 source
    DropKV: Decoupling Residual-Output Perturbation for Near-Optimal KV-Cache Eviction
    Key-value (KV) cache management has become a critical bottleneck for scaling Large Language Models (LLMs) to long-context scenarios due to linear memory growth.
27. Oct 15, 2026 · Research paper · 1 source
    Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning
    Long-context language models support ever longer context windows, and evaluations typically treat context length as the main indicator of difficulty.
28. Oct 15, 2026 · Model release · 12 sources
    Gemini 4 Argon: Built to solve your hardest problems
    Gemini 4 Argon: Built to solve your hardest problems
29. Oct 15, 2026 · Model release · 3 sources
    Apertus 1.5 Release Notes
    Apertus 1.5 is a continued pretraining of the first generation model: adding 4 trillion tokens of text and multimodal training data to the 8B model and 2 trillion tokens to the 70B model, for a total of 19T and 17T, respectively.
30. Oct 15, 2026 · Research paper · 2 sources
    When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers for Context-Parallel Prefill
    Reusing the attention KV cache across requests is a standard way to cut prefill cost in long-context LLM serving, and production systems increasingly back the per-engine cache with a remote tier shared by every engine.

Often appears with