Think-Capture: Active 3D Geometry Acquisition for Spatial Reasoning in Vision-Language Models
We present Think-Capture, a query-conditioned framework that first identifies task-critical objects and then acquires their geometry on demand.
ProofPaper ↗
Key points
- Vision-Language Models (VLMs) excel at 2D recognition but often fail to maintain consistent 3D relations across sparse viewpoints, leading to spatial hallucinations under occlusion and perspective changes.
- A 3D toolkit lifts zero-shot masks into a common coordinate frame, and a Symbolic 3D State Abstraction compresses object and camera states into structured text.
- Hierarchical Group Relative Policy Optimization (GRPO) trains the VLM on cases in which geometry either helps or misleads, teaching it when to use tool evidence and when to fall back on visual cues.
- Think-Capture-4B reaches 54.4% on MindCube-Tiny (+21.5 points over its backbone), 39.1% on the MMSI-Bench positional subset (+7.9), and 42.8% on ViewSpatial (+5.2).
Sources (1)
- [1]Think-Capture: Active 3D Geometry Acquisition for Spatial Reasoning in Vision-Language ModelsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 21, 05:42 AM
We present Think-Capture, a query-conditioned framework that first identifies task-critical objects and then acquires their geometry on demand.
Vision-Language Models (VLMs) excel at 2D recognition but often fail to maintain consistent 3D relations across sparse viewpoints, leading to spatial hallucinations under occlusion and perspective changes.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0
- Oct 20, 2026Voxtral 3
- Oct 20, 2026[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
- Oct 19, 2026NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation
- Oct 19, 2026From Cause to Effect: Generating Intermediate Event Chains in Videos
- Oct 19, 2026XGLASS: X-Ray, Gaze and Language Assisted Slice Sequencing for CT Volumes