GPT-6 Astra Is a Native Visuo-Tactile Policy for Contact-Rich Manipulation
Recent advances in multimodal models have enabled GPT-6 Astra to perform robotic manipulation through in-context learning.
ProofPaper ↗
Key points
- We provide, to our knowledge, the first demonstration that Astra directly interprets vision-based tactile images and uses their contact cues for manipulation.
- Tactile RGB images enter through its existing visual interface, enabling few-shot closed-loop control on nineteen simulated UniVTAC and OpenViTac tasks with 210 sampled scene seeds per setting.
- Trajectory analysis reveals active probing, cautious grasping, contact-guided alignment, and recovery, alongside difficulties with tangential loading and corrective execution.
- Our findings challenge the exclusivity of specialist policies in contact-rich manipulation and show that fine-grained vision can partially compensate for missing touch.
Sources (1)
- [1]GPT-6 Astra Is a Native Visuo-Tactile Policy for Contact-Rich ManipulationarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 19, 05:59 PM
Recent advances in multimodal models have enabled GPT-6 Astra to perform robotic manipulation through in-context learning.
We provide, to our knowledge, the first demonstration that Astra directly interprets vision-based tactile images and uses their contact cues for manipulation.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 19, 2026Advancing Coding in Low-Resource Programming Languages
- Oct 19, 2026Cognitively Decoupled Meta-Induction for Out-of-Distribution Generalization
- Oct 19, 2026ACE-Brain-0.6: Scaling Spatial Grounding for Physical Foundation Models
- Oct 19, 2026OpenVLHarness: Real World Visual Agentic Tool-Use with Multimodal Memory
- Oct 19, 2026Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
- Oct 19, 2026Holi-World: Building Holistic World Intelligence from Human-Ego Experience