WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions

Key points

• Given the same initial observation and low-level action sequence, WorldOracle asks whether a predicted rollout reproduces what happens in the real world, including physical consequences and task-state transitions.1
• We evaluate models along four complementary dimensions: physical state correctness, interaction spatial alignment, key interaction area fidelity, and multi-view action coherence.1
• Experiments on seven representative ACWMs reveal distinct model strengths and failure modes.1
• WorldOracle provides a systematic foundation for measuring and advancing action-conditioned world modeling for manipulation.1

Sources (1)

• [1]WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 13, 05:52 PM

  We introduce WorldOracle, a benchmark specifically designed to evaluate action-conditioned world models (ACWMs) against paired real-world executions.

  Given the same initial observation and low-level action sequence, WorldOracle asks whether a predicted rollout reproduces what happens in the real world, including physical consequences and task-state transitions.

Extractive summary: sentences quoted from the sources.