Separating Prompt Harmfulness from Interaction Safety via Partial Generation
LLM-based information systems need safety guardrails.
ProofPaper ↗
Key points
- If the prompt looks harmful, the system rejects it before any answer is generated.
- Prompt-level labels treat harm as a property of the query.
- Second, we show that prompt harmfulness and interaction safety differ.
- Of the prompts that make any model respond harmfully, only 3.5% do so for all seven LLMs. Third, we show that partial responses carry most of the signal.
Sources (1)
- [1]Separating Prompt Harmfulness from Interaction Safety via Partial GenerationarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 12, 01:23 PM
LLM-based information systems need safety guardrails.
If the prompt looks harmful, the system rejects it before any answer is generated.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 12, 2026Redesigning source control at Anthropic
- Oct 12, 2026Autoregressive Decoding as a Martingale: Characterizing the Stochastic Dynamics of LLM Generation
- Oct 11, 2026Every Model That Can Be Run On 10-16GB VRAM Ranked
- Oct 11, 2026RSIPO: Recursive Self-Improving Policy Optimization for Agentic Reinforcement Learning via Skill-Policy Co-Evolution
- Oct 10, 2026SocraticRepair: Planning-Guided Socratic Tutoring for Program Debugging and Misconception Repair
- Oct 10, 2026Beyond Adjacent Layers: Graph-Guided Layer Fusion for Compressing Large Language Models