Proof Before Reuse: showing agents only what later sessions reproduced keeps a poisoned skill out of procedural memory [R]

Key points

• One learning session is poisoned (a new file, an unrelated line, or one line fused into the real fix), followed by three clean sessions on the same task.1
• Arms: no memory, replay of the recorded edits, naive memory (every passing session kept, the skill chosen by Mem0's search), and proof before reuse (a skill is served only after two later sessions reproduce its change and pass its test, and the agent is shown only the lines those sessions also wrote).1
• Proof before reuse exposed it in 0/30, including the case where the fused poison passed step-level checks and only line-level filtering removed it.1
• Open question: is line-level reproduction a reasonable trust signal for learned skills, or does it just reward whatever the clean sessions happen to repeat?1

Sources (1)

• [1]Proof Before Reuse: showing agents only what later sessions reproduced keeps a poisoned skill out of procedural memory [R]
  r/MachineLearning (top, daily) · Oct 18, 04:14 PM

  Small case study on poisoning in agent procedural memory, with all data released.

  One learning session is poisoned (a new file, an unrelated line, or one line fused into the real fix), followed by three clean sessions on the same task.

Extractive summary: sentences quoted from the sources.