RoboValue: A Fine-Grained Sim-and-Real Benchmark for Unified Evaluation of Robotic Value Models

Key points

• Robotic value models assess task execution from visual observations and instructions, providing feedback for policy learning and execution monitoring.1
• Diagnostic trajectories and instruction variations test whether value judgments accurately reflect task requirements and changes throughout execution.1
• RoboValue-Dataset covers 15 simulation and 20 real-world manipulation tasks, providing expert demonstrations for training and annotated trajectories for fine-grained evaluation.1
• We evaluate representative robotic value models in zero-shot and one-shot settings under standard conditions and separate shifts in robot embodiment and environment.1

Sources (2)

• [1]RoboValue: A Fine-Grained Sim-and-Real Benchmark for Unified Evaluation of Robotic Value Models
  Hugging Face Daily Papers · Oct 19, 12:00 AM

  We introduce RoboValue, a fine-grained sim-and-real benchmark for unified evaluation of robotic value models.

  Robotic value models assess task execution from visual observations and instructions, providing feedback for policy learning and execution monitoring.

• [2]RoboValue: A Fine-Grained Sim-and-Real Benchmark for Unified Evaluation of Robotic Value Models
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 04:19 PM · same content

Extractive summary: sentences quoted from the sources.