Evolving Agent Interfaces
We introduce Agent S4, an autonomous computer-use scientist that builds Evolving Agent Interfaces from task experience.
ProofPaper ↗
Key points
- Computer-use agents are limited by the interfaces humans give them.
- We argue that interface design should itself be an agent capability.
- A meta-agent examines task agents' trajectories on synthetic training tasks, without success labels, and constructs and revises interfaces and usage knowledge in a repository.
- On OSWorld V2, Agent S4, with Qwen3.8-27B and the evolved repository of interfaces, sets a new state of the art in open-source computer-use agents, reaching 21.3% binary score, 3.8 times the same model with fixed interfaces.
Sources (2)
- [1]Evolving Agent InterfacesHugging Face Daily Papers · Oct 20, 12:00 AM
We introduce Agent S4, an autonomous computer-use scientist that builds Evolving Agent Interfaces from task experience.
Computer-use agents are limited by the interfaces humans give them.
- [2]Evolving Agent InterfacesarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 05:47 PM · same content
Extractive summary: sentences quoted from the sources.
Before this
- Oct 19, 2026Launch HN: Laminar (YC S24) – RL-trained model that finds errors in agent traces
- Oct 19, 2026The Model Swap Workshop: GPT-5.5 vs Kimi vs DeepSeek vs Mistral
- Oct 19, 2026MiniMax M3.1 Flash shows China's AI price race has no floor in sight
- Oct 19, 2026HarnessPro: Recursive Harness Self-Improvement with Pareto Optimization for Performance-Cost Trade-offs
- Oct 19, 2026Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
- Oct 18, 2026Explore or Confirm? LLM Agents Misallocate Measurements Under Noise