NeoWorld-3: From Pixels to Code-Defined Physical Worlds
We present NeoWorld-3, a coding-agent framework that reconstructs interactive 3D worlds from visual observations via tunable, executable programs.
ProofPaper ↗
Key points
- Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver.
- At its core, NeoSDK provides the underlying computational engine for low-level geometries, part composition, differentiable parameter refinement, and physics validation.
- Evaluations across object-level and scene-level reconstruction benchmarks demonstrate that NeoWorld-3 achieves state-of-the-art geometric fidelity and physical readiness.
- Crucially, manipulation trajectories planned within our reconstructed twins achieve successful zero-shot execution on a physical dual-arm robot, completing the Real-Sim-Real loop.
Sources (1)
- [1]NeoWorld-3: From Pixels to Code-Defined Physical WorldsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 06:05 AM
We present NeoWorld-3, a coding-agent framework that reconstructs interactive 3D worlds from visual observations via tunable, executable programs.
Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026Do Diffusion LLMs Scale? Testing Mercury 3 + Decide
- Oct 20, 2026OverSeer: Multi-Agent World Models Beyond What Agents See
- Oct 19, 2026Structured outputs for Anthropic Claude models on Amazon Bedrock
- Oct 19, 2026Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM
- Oct 19, 2026TorchNeuron: running HF models on AWS Trainium is easier than ever
- Oct 18, 2026Painting Change Map as guidance for generating painting processes