OV-Foam: How 3D Representations Shape Semantic Feature Lifting
Existing feature lifting approaches for open-vocabulary segmentation rely on simple backprojection to assign features to primitives.
ProofPaper ↗
Key points
- In the case of 3D Gaussian splatting reconstruction, the primitives overlap heavily, leading to suboptimal reconstructions, governed by many primitives per ray.
- Motivated by this insight, we propose OV-Foam, which uses PowerFoam as the underlying representation.
- This representation uses a power-diagram to partition the scene, resulting in zero overlap between primitives and a substantial reduction in primitives per ray, which ultimately simplifies the lifting problem and allows for closer-to-optimal feature assignment.
- We show that the space partitioning primitives of OV-Foam reach near-optimal assignment, and our experiments demonstrate improved open-vocabulary segmentation over Gaussian baselines.
Sources (1)
- [1]OV-Foam: How 3D Representations Shape Semantic Feature LiftingarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 12:38 PM
Existing feature lifting approaches for open-vocabulary segmentation rely on simple backprojection to assign features to primitives.
In the case of 3D Gaussian splatting reconstruction, the primitives overlap heavily, leading to suboptimal reconstructions, governed by many primitives per ray.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026Differentiable Task-Driven Coded Aperture Camera Design with 3D Gaussian Scene Representations
- Oct 20, 2026World2HOSI: A Multi-Expert Harness for Long-Horizon Human-Object-Scene Interaction Generation
- Oct 20, 2026RLSplat: Resource-Linear Budget Control for Feed-forward 3D Gaussian Splatting
- Oct 19, 2026Counting Contributions, Not Views: Occlusion-Aware Densification for 3D Gaussian Splatting
- Oct 19, 2026Learning Geometry-Aware Planning Representations for Monocular Flight with Cross-Modal Supervision
- Oct 19, 2026Rethinking Sparse-View 3D Gaussian Splatting: A Few-Shot Learning Perspective on Overfitting Prevention