MemDev-Bench: Does Memory Help Code Agents?Benchmarking Memory Systems over Real Repository Histories
In this paper, we present MemDev-Bench to evaluate how memory systems affect code agents over diverse repository histories.
ProofPaper ↗
Key points
- Code agents increasingly work on evolving real repositories, and memory systems aim to help them reuse earlier experience.
- However, such experience is diverse and evolving, so it remains unclear how memory systems organize it and thereby affect code agents.
- Based on MemDev-Bench, our systematic evaluation of memory systems across diverse development scenarios yields three main findings.
- These results suggest that future memory systems should preserve process information and reassess memory applicability against current task context.
Sources (1)
- [1]MemDev-Bench: Does Memory Help Code Agents?Benchmarking Memory Systems over Real Repository HistoriesarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 02:39 AM
In this paper, we present MemDev-Bench to evaluate how memory systems affect code agents over diverse repository histories.
Code agents increasingly work on evolving real repositories, and memory systems aim to help them reuse earlier experience.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026Meet Drex Max: Nace AI’s Multimodal Decision Model for Computer-Use Agents with a Score 67.59
- Oct 19, 2026TEX: Test-Time Scaling Testing Agents via Execution-based Cross-Validation
- Oct 19, 2026VibeTraining-Bench: Data-Trainer-Harness Co-Design for Iterative System Improvement
- Oct 19, 2026MiniMax M3.1 Flash shows China's AI price race has no floor in sight
- Oct 19, 2026Maestro: Agentic Formal Proof Development by Coordination
- Oct 18, 2026Auto-MD-bench: Evaluating Autoresearch Agents for Real-World Medical Tasks