A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics

Key points

• Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion.1
• Through a systematic diagnosis, we show that the camera and human estimates each remain self-consistent, and that the drift appears when they are combined at mismatched scales.1
• Each is recovered at its own scale, so a mismatch between the two can turn camera motion into human drift that grows with camera displacement and becomes severe in broadcast dance videos.1
• Combined with physical constraints, the correction yields stable world-space reconstruction for choreography modeling, scene editing, data generation, and virtual reshooting.1

Sources (2)

• [1]A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 14, 07:50 AM

  We introduce the K-Pop stress test, broadcast dance videos that combine fast, large camera motion with dense multi-person choreography.

  Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion.

• [2]A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics
  Hugging Face Daily Papers · Oct 14, 12:00 AM · same content

Extractive summary: sentences quoted from the sources.