SceneRig: An Agentic System for Simulation-Ready 3D Scene Reconstruction from Single Images

Key points

• Simulation is a powerful tool for robotics, but building diverse, simulation-ready scenes at scale remains difficult.1
• Reconstructing scenes from single images is a promising alternative, but visual similarity alone is insufficient: objects must also be recovered, accurately placed, and physically grounded.1
• SceneRig combines geometric, visual, and physical tools to reconstruct a faithful 3D scene.1
• Furthermore, SceneRig is effective for downstream robotics: its scenes predict real-robot policy outcomes more accurately than the baseline method and more reliably support replay of recorded manipulations without trajectory adaptation.1

Sources (1)

• [1]SceneRig: An Agentic System for Simulation-Ready 3D Scene Reconstruction from Single Images
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 05:39 PM

  We present SceneRig, an agentic system that turns a single image into an editable, simulation-ready scene.

  Simulation is a powerful tool for robotics, but building diverse, simulation-ready scenes at scale remains difficult.

Extractive summary: sentences quoted from the sources.