ResearchResearch paperReinforcement Learning1 source · Oct 11, 2026

DiffNash: Finding Nash Equilibrium in High-Dimensional Continuous Action Spaces with Diffusion Policies

Computing equilibria in high-dimensional continuous games requires learning and representing rich, multi-modal strategy distributions, something conventional neural policies struggle to achieve.

Key points

  • Diffusion models offer a natural solution, but standard diffusion training requires direct samples from a fixed target distribution, which are generally unavailable under iterative game-solving updates.
  • We propose a diffusion-based framework for equilibrium computation that enables diffusion-based variants of Online Mirror Descent (OMD) and Fictitious Play (FP).
  • Our approach derives a reweighted score-matching objective that trains diffusion policies without requiring direct samples from each updated policy.
  • We evaluate our approach on forest protection games and continuous Colonel Blotto games, reducing the Nash gap over the strongest baseline by 35.6% and 24.7%, respectively, with minimal hyperparameter tuning.

Sources (1)

  • [1]DiffNash: Finding Nash Equilibrium in High-Dimensional Continuous Action Spaces with Diffusion Policies
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 11, 09:33 PM
    Computing equilibria in high-dimensional continuous games requires learning and representing rich, multi-modal strategy distributions, something conventional neural policies struggle to achieve.
    Diffusion models offer a natural solution, but standard diffusion training requires direct samples from a fixed target distribution, which are generally unavailable under iterative game-solving updates.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 11, 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards
  2. Oct 11, 2026Imperfect Verifiers, Exact Targets: Inference-Time Scaling for Continuous Generation
  3. Oct 10, 2026We Have Been Interpreting Diffusion Transformer Backbone Behaviors Wrong
  4. Oct 9, 2026Finite-Sample Guarantees for Fully Discrete Conditional Diffusion Models
  5. Oct 9, 2026Transformer-based In-Context Score Operator Learning for Diffusion Models
  6. Oct 9, 2026AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation

Related