InfiniDream: Open-Ended Photorealistic 3D Worlds Through Procedural Generation

Key points

• Procedural generation plays a key role in synthetic data creation and game development, offering greater controllability, editability, and diversity than static mesh representations.1
• However, VLM-based code generation often produces relatively simple 3D assets, while sophisticated photorealistic procedural systems require extensive manual development.1
• First, we propose Symbolically Constrained Asset Generation, which leverages existing procedural algorithms to create novel, photorealistic assets while preserving editability and seed-based diversity.1
• Second, we develop an end-to-end text-to-world pipeline that combines semantic scene planning with Deterministic Frustum-Guided Grid Placement to construct large-scale 3D worlds with precise object placement, procedural population, and animation.1

Sources (2)

• [1]InfiniDream: Open-Ended Photorealistic 3D Worlds Through Procedural Generation
  Hugging Face Daily Papers · Oct 19, 12:00 AM

  We introduce InfiniDream, a VLM-driven framework for open-ended procedural 3D world generation.

  Procedural generation plays a key role in synthetic data creation and game development, offering greater controllability, editability, and diversity than static mesh representations.

• [2]InfiniDream: Open-Ended Photorealistic 3D Worlds Through Procedural Generation
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 05:59 PM · same content

Extractive summary: sentences quoted from the sources.