SplatFlux: Feed-Forward 4D Gaussian Reconstruction and Generation from Video Latents

Key points

• Our key observation is that observed videos and conditionally generated content can be represented in the same pretrained video latent space, allowing both tasks to be formulated as latent-to-4DGS decoding.1
• To construct compact and temporally coherent 4D scenes, SplatFlux introduces a static-dynamic decoupled 4D Gaussian representation that explicitly predicts dynamic probabilities for Gaussian primitives.1
• This representation separates static scene structures from moving regions, enabling complete 4D scene construction in a feed-forward manner through static aggregation and dynamic motion interpolation.1
• Extensive experiments across 3D and 4D reconstruction and generation demonstrate that SplatFlux achieves state-of-the-art performance.1

Sources (1)

• [1]SplatFlux: Feed-Forward 4D Gaussian Reconstruction and Generation from Video Latents
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 02:12 PM

  This work presents SplatFlux, a feed-forward latent-to-4DGS framework for both video-based 4D reconstruction and conditional 4D generation.

  Our key observation is that observed videos and conditionally generated content can be represented in the same pretrained video latent space, allowing both tasks to be formulated as latent-to-4DGS decoding.

Extractive summary: sentences quoted from the sources.