ResearchResearch paperReinforcement Learning · Large Language Models · Reasoning & Planning1 source · Oct 18, 2026

What Can't Jev Decide? Probing the Limits of One-Pass Decision Models

Jev and its open replicas choose among the options a caller supplies with a single forward pass, fast enough to decide inside an agent loop.

Key points

  • We ask what such a model cannot decide, and find a simple limit: Jev cannot make a decision that an LLM makes only by writing out intermediate steps.
  • On a benchmark that varies one factor at a time, Jev finds and selects records without error up to 20k tokens and 64 options, but once the answer depends on two or more updates of one user, accuracy falls, to 53-80% at sixteen updates, because similar records interfere.
  • On real decision items graded by how many thinking tokens a reference LLM needs, Jev answers 97.5% of the items that one forward pass of that LLM solves, but only 74% of the others.
  • The open models we evaluate share these limits.

Sources (1)

  • [1]What Can't Jev Decide? Probing the Limits of One-Pass Decision Models
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 18, 12:50 AM
    Jev and its open replicas choose among the options a caller supplies with a single forward pass, fast enough to decide inside an agent loop.
    We ask what such a model cannot decide, and find a simple limit: Jev cannot make a decision that an LLM makes only by writing out intermediate steps.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 18, 2026Elevatormusic/DeepSeek-V4.1-Flash-1017-EXL3-TensorFold-2x-DGX-Spark: DeepSeek-V4.1-Flash-1017 EXL3 2.9bpw on 2x NVIDIA DGX Spark (GB10) with TensorFold: 2.1-2.3x the vLLM kit's decode speed.
  2. Oct 18, 2026ATEST: Adaptive Resource-Aware Test-Time Scaling for LLM Inference
  3. Oct 17, 2026Good Judgment, Bad Advice: Decision-Model Controllers Raise Agent Cost Without Improving Success
  4. Oct 16, 2026Hugging Face ❤️ TorchTPU: TPUs, Natively
  5. Oct 15, 2026Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
  6. Oct 15, 2026SAG2: Embedding-Free Multi-Hop Retrieval with BM25 and JEV

Related