Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and Rules
Coding agents such as Claude Code also follow text files that developers write for them: a project file, skills the agent may choose to open, and rules that load automatically when the agent reads matching files.
ProofPaper ↗
Key points
- We call these files the agent's harness.
- Developers add to it whenever they correct the agent, but one success proves little: the same agent can pass a task once and fail it the next time.
- We present Cortex, a tool that tests changes to the harness instead of trusting them.
- We tested Cortex with Claude Haiku 4.5 on a repository built for the purpose, with conventions the model tends to break, one area with nothing to learn, and a script playing the developer.
Sources (2)
- [1]Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and RulesarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 9, 06:29 PM
Coding agents such as Claude Code also follow text files that developers write for them: a project file, skills the agent may choose to open, and rules that load automatically when the agent reads matching files.
We call these files the agent's harness.
- [2]Cortex: Measurement-Gated Evolution and Pruning of Coding-Agent Skills and RulesHugging Face Daily Papers · Oct 9, 12:00 AM · same content
Extractive summary: sentences quoted from the sources.
Before this
- Oct 8, 2026anthropics/claude-code v2.1.295
- Oct 8, 2026Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competition
- Oct 8, 2026Building on our commitment to American scientific discovery
- Oct 7, 2026[AINews] Claude Haiku 5.5 — better than GPT-6 Luna at the same pricing
- Oct 7, 2026anthropics/claude-code v2.1.293
- Oct 7, 2026Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses