WAVE-0: Bridging VLA Policies and WAMs with Lightweight Latent Future Prediction

Key points

• World action models (WAMs) incorporate future prediction, yet most rely on costly video generation, while latent alternatives either use predicted futures only as auxiliary targets or infer latent actions from suboptimal visual transitions through costly large-scale video pretraining.1
• We introduce WAVE-0 (World-model-Augmented VLA Execution), a framework that bridges VLAs and WAMs through a lightweight latent world model.1
• By connecting the semantic understanding of pretrained VLAs with explicit future prediction, WAVE-0 allows anticipated action consequences to directly guide action generation.1
• Built on a pretrained VLA, its 257M world model translates VLM-generated latent action plans into predicted future representations that condition the action expert, unifying latent planning, future prediction, and action generation.1

Sources (2)

• [1]WAVE-0: Bridging VLA Policies and WAMs with Lightweight Latent Future Prediction
  Hugging Face Daily Papers · Oct 13, 12:00 AM

  Vision-language-action (VLA) policies excel at generalist robotic manipulation but generate actions without explicitly modeling their environmental consequences.

  World action models (WAMs) incorporate future prediction, yet most rely on costly video generation, while latent alternatives either use predicted futures only as auxiliary targets or infer latent actions from suboptimal visual transitions through costly large-scale video pretraining.

• [2]WAVE-0: Bridging VLA Policies and WAMs with Lightweight Latent Future Prediction
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 13, 03:37 PM · same content

Extractive summary: sentences quoted from the sources.