Can Agents Keep Secrets They Were Never Told? Benchmarking Latent Privacy Risks Across Sessions with MemJoin
In this paper, we introduce MemJoin, a privacy benchmark of 288 synthetic analysis cases in which the complete history entails a sensitive relation, but every individual session is insufficient.
ProofPaper ↗
Key points
- To support sustained interactions and personalized assistance, agents use long-term memory to retain and combine user information across sessions.
- Reusing such memories can lead an agent to state a sensitive relation while completing an ordinary task that does not require it.
- We evaluate six memory systems with the same answer-generating model, alongside full-history and no-history controls.
- These findings show why checking attribute visibility alone is insufficient to evaluate what records from different sessions reveal together.
Sources (1)
- [1]Can Agents Keep Secrets They Were Never Told? Benchmarking Latent Privacy Risks Across Sessions with MemJoinarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 17, 01:20 AM
In this paper, we introduce MemJoin, a privacy benchmark of 288 synthetic analysis cases in which the complete history entails a sensitive relation, but every individual session is insufficient.
To support sustained interactions and personalized assistance, agents use long-term memory to retain and combine user information across sessions.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 17, 2026HSPR: Recovering Software-Agent Benchmark Scores via Hierarchical Posterior Inference
- Oct 16, 2026Acceptance Is Not Speed: Length Inflation in Training-Free Lossy Speculative Decoding
- Oct 16, 2026Momentum: Persistent Dynamics for Video World Models
- Oct 16, 2026sparqlite: SPARQL 1.1 inside SQLite, written in Rust
- Oct 15, 2026Accelerating the search for antimicrobial peptides with Google Antigravity
- Oct 15, 2026The Density of Thought: Predicting and Steering Reasoning in Large Language Models