Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing
External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state.
ProofPaper ↗
Key points
- Existing frameworks typically place a general-purpose large language model behind framework-specific prompts.
- We present Hy-Memory-30B-A3B, a compact long-term-memory writer trained across Mem0, MemOS, and Hy-Memory.
- Memory On-Policy Distillation teaches framework-specific write protocols on student-generated states; Memory RL then optimizes downstream answerability using dense per-chunk probes, attributed cross-chunk rewards, over-storage controls, and chunk-level GRPO.
- Carrying policy-written banks across windows keeps training aligned with deployment.
Sources (1)
- [1]Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory WritingarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 15, 04:46 PM
External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state.
Existing frameworks typically place a general-purpose large language model behind framework-specific prompts.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 15, 2026StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
- Oct 15, 2026SCOPE: Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation
- Oct 15, 2026Skill-Decoupled On-Policy Expert Distillation for Unified Vision-Language Models
- Oct 15, 2026Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
- Oct 14, 2026RM-OPD: On-Policy Distillation for Generative Reward Models
- Oct 14, 2026More Methods, Better Agents? A Reality Check on Self-Distillation in Agentic Reinforcement Learning