Multiple Turns, Short Horizons: Measuring Effective-Horizon Compression in Jailbreaks

Key points

• We define the effective horizon as the shortest remaining query sequence that recovers the same attack progress.1
• Empirically, we find that roughly half of the original query sequence is sufficient on average to recover the same attack progress.1
• We show that this shorter history can recover the best point reached during an unsuccessful attack and provide a better starting point for continuing the attack.1
• We further find that short reward-propagation windows preserve calibrated defense performance close to full-trajectory returns.1

Sources (1)

• [1]Multiple Turns, Short Horizons: Measuring Effective-Horizon Compression in Jailbreaks
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 16, 04:44 AM

  Multi-turn jailbreaks use feedback from a victim large language model to adapt their queries over several turns.

  We define the effective horizon as the shortest remaining query sequence that recovers the same attack progress.

Extractive summary: sentences quoted from the sources.