No-Regret Language Generation

Key points

• We also formulate an agnostic variant that allows arbitrary demonstrations that may not be compatible with any languages.1
• For both settings, we introduce tree-based mistake-forcing dimensions that exactly characterize finite-horizon minimax complexity and establish necessary and sufficient conditions for no-regret generation.1
• Our characterizations reveal a rich spectrum of generation rates: up to constant rescaling, every admissible nondecreasing profile is attainable in both the realizable and agnostic settings.1
• Finally, we connect generation complexity to online prediction: for language classes of finite Littlestone dimension \(d\), we obtain realizable mistake bounds of \(O(d\log(1+T/d))\) and agnostic regret bounds of \(O(\sqrt{dT\log(1+T/d)})\).1

Sources (1)

• [1]No-Regret Language Generation
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 16, 03:42 PM

  We introduce no-regret generation, which requires a generator to make a sublinear number of mistakes uniformly over all demonstration sequences and compatible target languages.

  We also formulate an agnostic variant that allows arbitrary demonstrations that may not be compatible with any languages.

Extractive summary: sentences quoted from the sources.