ResearchResearch paperRobotics & Embodied AI1 source · Oct 11, 2026

Inverse Garment Design with Visual Agents

We study the problem of inverse garment design, reconstructing simulation-ready 3D outfits with arbitrary layers from a single image, with visual agents.

Key points

  • Unlike differentiable optimization that is time-consuming, or feed-forward methods limited by training data, we introduce DressAgent, a hierarchical agentic system that recovers garment sewing patterns through planning and closed-loop refinement grounded in physical simulation.
  • To this end, we first present an enhanced representation based on GarmentCode for diverse styles and arbitrary dressing layers, and build the first multi-layer sewing pattern dataset with over 15K outfits for supervision and benchmarking.
  • Inverse design then proceeds coarse to fine: In layer planning and coarse estimation, agents infer layer order and relations, peel each layer into its own view, and estimate coarse patterns.
  • We also design an agentic generation method for high-fidelity textures.

Sources (1)

  • [1]Inverse Garment Design with Visual Agents
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 11, 12:55 PM
    We study the problem of inverse garment design, reconstructing simulation-ready 3D outfits with arbitrary layers from a single image, with visual agents.
    Unlike differentiable optimization that is time-consuming, or feed-forward methods limited by training data, we introduce DressAgent, a hierarchical agentic system that recovers garment sewing patterns through planning and closed-loop refinement grounded in physical simulation.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 11, 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards
  2. Oct 11, 2026Imperfect Verifiers, Exact Targets: Inference-Time Scaling for Continuous Generation
  3. Oct 11, 2026Data-Centric Recursive Self-Improvement for Navigation via Policy-Synchronized Language-Action Dual Bootstrapping
  4. Oct 9, 2026Latent World Action Model for GUI Agents
  5. Oct 9, 2026Rethinking Relative Policy Differences Transfer of On-Policy Distillation
  6. Oct 9, 2026InstantFusion: A Shared Latent Interface for Heterogeneous Image Generators

Related