System X: An LLM Decision Model That Replies from Its Own KV Cache
The present study introduces System X, a large language model (LLM) decision model that adds a text-reply option to the LLM-as-Jev readout.
ProofPaper ↗
Key points
- Decision models return probabilities over supplied options, but a deployed agent may also need to reply in words.
- Qwen3-0.6B has been fine-tuned with LoRA on Reason-9k and Bitext reply rows.
- Scoring options on copies of the prompt cache matches full-sequence scoring to within 1.4e-6 in probability.
- System X v4 uses Qwen3-1.7B, rebalanced data and teacher-rewritten reply targets.
Sources (1)
- [1]System X: An LLM Decision Model That Replies from Its Own KV CachearXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 18, 06:40 PM
The present study introduces System X, a large language model (LLM) decision model that adds a text-reply option to the LLM-as-Jev readout.
Decision models return probabilities over supplied options, but a deployed agent may also need to reply in words.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 18, 2026MOSAIC: Multi-Objective Search for Allocating Inference Cache Across LLM Decoder Layers
- Oct 17, 2026Pair-Aware Optimization: Coordinating Exploration and Refinement for Jailbreaking LLM Agents
- Oct 17, 2026TideKV: Delayed KV Eviction via Layer-Wise Chunked Prefill for Memory-Efficient Long-Context LLM Inference
- Oct 16, 2026Liquid AI Releases d1-ultra: A Multimodal Decision Model That Scores 65 on the AA Decision Index
- Oct 16, 2026Welcome Beam: a 501B open model you can own, customize, and scale
- Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
