Vulnerability Analysis for Safe Multi-Agent Reinforcement
Safe Multi-Agent Reinforcement Learning (SMARL) aims to learn cooperative control policies under prescribed safety constraints.
ProofPaper ↗
Key points
- Al- though existing SMARL methods focus on enforcing safety during policy optimization, their vulnerability remains largely unexplored.
- This paper investigates inference-time observation attacks against SMARL, where an adversary perturbs the observations of a subset of agents, thereby altering the actions produced by their policies.
- We propose MinMax Attack, an attack framework that jointly selects adversarial target actions for compromised agents while accounting for the Cooperative Resistance of benign agents.
- Experiments across multiple safety-critical multi-agent benchmarks and representative state-of-the-art SMARL algorithms show that MinMax Attack induces substantially higher safety costs than existing attack baselines while preserving task reward, thereby reducing its detectability and achieving both attack effectiveness and stealthiness.
Sources (1)
- [1]Vulnerability Analysis for Safe Multi-Agent ReinforcementarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 09:09 PM
Safe Multi-Agent Reinforcement Learning (SMARL) aims to learn cooperative control policies under prescribed safety constraints.
Al- though existing SMARL methods focus on enforcing safety during policy optimization, their vulnerability remains largely unexplored.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 19, 2026You Are the Trigger: Speaker-Activated Backdoors
- Oct 19, 2026How Deepgram optimized voice AI at scale with AWS Trainium
- Oct 19, 2026Training Natural Schemers: RL Can Amplify Oversight-Conditional Behavior
- Oct 18, 2026Google Open-Sources Harness2, a Recursive Agent Harnessing Framework
- Oct 18, 2026Auto-MD-bench: Evaluating Autoresearch Agents for Real-World Medical Tasks
- Oct 18, 2026Think Visually Across Space and Time: Grounded Reasoning for Video Segmentation