SimPT: An Automated Simulation Framework for Intervention-Based VLA Post-Training

Key points

• Human-in-the-loop (HIL) post-training improves vision-language-action (VLA) policies through expert corrections, but costly human supervision and repeated real-robot evaluation limit algorithm exploration and development.1
• To automatically determine intervention timing and recovery strategies, we develop an Agent-Compiled Progress Graph that tracks task progress using privileged simulator state and retains stable snapshots during policy execution.1
• We implement and compare four post-training methods, RECAP, HG-DAgger, DPO+SFT, and FlowPRO, across seven RoboTwin manipulation tasks.1
• Using SimPT, we develop RECAP-CF-LPF, a refinement of RECAP that combines cross-fitting and low-pass filtering of value predictions.1

Sources (1)

• [1]SimPT: An Automated Simulation Framework for Intervention-Based VLA Post-Training
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 21, 03:53 AM

  We introduce SimPT (Simulation-based Post-Training), a simulation framework that automates intervention-based VLA post-training by integrating policy rollouts, corrective data collection, policy training, and standalone evaluation.

  Human-in-the-loop (HIL) post-training improves vision-language-action (VLA) policies through expert corrections, but costly human supervision and repeated real-robot evaluation limit algorithm exploration and development.

Extractive summary: sentences quoted from the sources.