NIOCIS: Typed-Decision Next-Hop Routing with Node-Conditioned Option Spaces for Tool-Use Agents

Key points

• Tool-use agents pay per decision: at each hop a language model re-reads the state and thinks for seconds, though its actions are finite and decisions recur.1
• A small model reads a calibrated distribution over them in one pass, emitting no text.1
• On 1,615 production security-operations episodes we measure what the layer replaces, returns and is bounded by.1
• Tuning: jpt-4b reaches 9.9% zero-shot and 31.9% fine-tuned, a gap an exact paired test does not resolve (p=0.68), at 244 ms.1

Sources (1)

• [1]NIOCIS: Typed-Decision Next-Hop Routing with Node-Conditioned Option Spaces for Tool-Use Agents
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 08:10 AM

  We present NIOCIS, a routing layer that folds execution logs into a loop-collapsed action graph (forward transitions plus recovery back-edges) answering one typed question: which declared option at a state, plus stop, does the fleet take next?

  Tool-use agents pay per decision: at each hop a language model re-reads the state and thinks for seconds, though its actions are finite and decisions recur.

Extractive summary: sentences quoted from the sources.