ResearchResearch paperLarge Language Models1 source · Oct 15, 2026

Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing

External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state.

Key points

  • Existing frameworks typically place a general-purpose large language model behind framework-specific prompts.
  • We present Hy-Memory-30B-A3B, a compact long-term-memory writer trained across Mem0, MemOS, and Hy-Memory.
  • Memory On-Policy Distillation teaches framework-specific write protocols on student-generated states; Memory RL then optimizes downstream answerability using dense per-chunk probes, attributed cross-chunk rewards, over-storage controls, and chunk-level GRPO.
  • Carrying policy-written banks across windows keeps training aligned with deployment.

Sources (1)

  • [1]Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 15, 04:46 PM
    External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state.
    Existing frameworks typically place a general-purpose large language model behind framework-specific prompts.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 15, 2026StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context
  2. Oct 15, 2026SCOPE: Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation
  3. Oct 15, 2026Skill-Decoupled On-Policy Expert Distillation for Unified Vision-Language Models
  4. Oct 15, 2026Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
  5. Oct 14, 2026RM-OPD: On-Policy Distillation for Generative Reward Models
  6. Oct 14, 2026More Methods, Better Agents? A Reality Check on Self-Distillation in Agentic Reinforcement Learning

Related