Holi-World: Building Holistic World Intelligence from Human-Ego Experience

Key points

• Human egocentric experience offers a rich foundation for learning how the world is organized and how it changes through interaction.1
• To sup- port learning at scale, HOLIWORLD-Foundry combines complementary static and dynamic perception to automatically construct world records that connect persistent scene structure and evolving object states with interaction histories and supporting observations.1
• Independent human annotations of heldout recordings form HOLIWORLD-Bench, supporting evaluation of both annotation quality and learned spatial and temporal understanding.1
• Experiments on ScanNet, ScanNet++, Aria Digital Twin, and HOLIWORLD-Bench demonstrate strong performance in static perception and dynamic tracking, while training on HOLIWORLD-Data substantially improves HOLIWORLD-VL-4B's spatial and temporal reasoning on HOLI- WORLD-Bench and EgoDynamic4D.1

Sources (2)

• [1]Holi-World: Building Holistic World Intelligence from Human-Ego Experience
  Hugging Face Daily Papers · Oct 19, 12:00 AM

  We introduce HOLI-WORLD, an integrated ecosystem connecting experience capture, world representation, automated data construction, model learning, and independent evaluation.

  Human egocentric experience offers a rich foundation for learning how the world is organized and how it changes through interaction.

• [2]Holi-World: Building Holistic World Intelligence from Human-Ego Experience
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 03:10 PM · same content

Extractive summary: sentences quoted from the sources.