A Bethe-Ansatz Source of Early Token Correlations: A marginal-preserving construction for parallel proposals
Parallel token proposals in language-model decoding need a joint law, not merely accurate token marginals.
ProofPaper ↗
Key points
- We construct a family of coordinate-Bethe-ansatz laws from the periodic XXZ chain and compare each with its maximum-entropy pairwise projection at identical one- and two-site moments.
- A nonlinear readout transfers a nonzero gap into the first two token positions while preserving their separate marginals.
- At $Δ=1.5$ the deterministic binary token laws differ by 0.02654573 in total variation.
- Exact speculative verification then gives a strict accepted-prefix advantage for a constructed target and a neighborhood within targets sharing its first-token marginal.
Sources (1)
- [1]A Bethe-Ansatz Source of Early Token Correlations: A marginal-preserving construction for parallel proposalsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 12, 01:38 PM
Parallel token proposals in language-model decoding need a joint law, not merely accurate token marginals.
We construct a family of coordinate-Bethe-ansatz laws from the periodic XXZ chain and compare each with its maximum-entropy pairwise projection at identical one- and two-site moments.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 12, 2026RelLedger: Relational Information Governance for LLM Agent Organizations
- Oct 12, 2026AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers
- Oct 12, 2026AI models may be capable of self-replicating without access to a datacenter
- Oct 12, 2026DuoDiscover: Scaling Autonomous Discovery Beyond the Evaluation Bottleneck
- Oct 11, 2026AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards
- Oct 10, 2026BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries