ResearchResearch paperTraining & Scaling · Efficiency & Inference · Interpretability1 source · Oct 10, 2026

Disentangling Marginal Capacity from Geometry in Optimal-Transport Label Transfer

Optimal transport (OT) is widely used to align distributions and transfer labels between unpaired source and target data, but source-target composition shifts can cause rare classes to be systematically under-predicted even with high transport confidence.

Key points

  • We identify a source of this failure in the transport marginal: under the standard uniform weighting of source points, each class has transport capacity proportional to its source frequency, which can be insufficient to meet its target demand even when separated well in the embedding space.
  • We show that displaced mass is preferentially absorbed by high-capacity classes rather than geometrically similar classes, producing confident errors that are difficult to detect from the transport plan.
  • Downstream read-outs, entropic smoothing, and marginal relaxation provide limited recovery, whereas matching the transport marginal to the target composition substantially improves label transfer.
  • Correcting the marginal also separates a coverage-dependent component of error from residual error associated with class separability, showing that transport capacity and representation geometry are distinct sources of transfer error.

Sources (1)

  • [1]Disentangling Marginal Capacity from Geometry in Optimal-Transport Label Transfer
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 10, 12:13 PM
    Optimal transport (OT) is widely used to align distributions and transfer labels between unpaired source and target data, but source-target composition shifts can cause rare classes to be systematically under-predicted even with high transport confidence.
    We identify a source of this failure in the transport marginal: under the standard uniform weighting of source points, each class has transport capacity proportional to its source frequency, which can be insufficient to meet its target demand even when separated well in the embedding space.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 10, 2026BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries
  2. Oct 9, 2026Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation
  3. Oct 9, 2026Learning Representations to Guide Pixel Diffusion Transformers
  4. Oct 9, 2026Latent World Action Model for GUI Agents
  5. Oct 9, 2026Surfing the Activation Wave: Analyzing the Information and Geometry of LLM Hidden States for Speculative Decoding
  6. Oct 9, 2026Rethinking Relative Policy Differences Transfer of On-Policy Distillation

Related