ToolBottleneckBench: Measuring Tool-Agent Performance under Controlled Pressures and Fixed Harness Budgets
We present ToolBottleneckBench, a benchmark that measures tool-agent performance under controlled pressures and fixed harness budgets.
ProofPaper ↗
Key points
- The success score of a tool agent reflects both its model and the budgets of the harness that runs it.
- Synthetic enterprise tasks stay fixed while one pressure varies: the registered tool catalog, the visible tool menu, the certified workflow, or the encoding of returned records.
- Across 21 model and harness configurations, the visible menu is the only one of the three pressures that act on the model with a large penalty, and this penalty tracks truncation at the completion cap.
- We recommend reporting pressure effects with the harness budgets under which they were measured.
Sources (1)
- [1]ToolBottleneckBench: Measuring Tool-Agent Performance under Controlled Pressures and Fixed Harness BudgetsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 15, 01:59 AM
We present ToolBottleneckBench, a benchmark that measures tool-agent performance under controlled pressures and fixed harness budgets.
The success score of a tool agent reflects both its model and the budgets of the harness that runs it.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 15, 2026VLA-$Δ$: Learning Physical State Transition for Vision-Language-Action Models
- Oct 14, 2026CausalEvo: Causal Skill Self-Evolution for Health LLM Agents
- Oct 14, 2026mistralai/Timestral-209M
- Oct 14, 2026ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models
- Oct 13, 2026Run fast, private agents on-device with LFM2.5-24B-A2B
- Oct 13, 2026Gemini 4 Argon: Built to solve your hardest problems