Can AI agents make law? Evaluating AI legal relevance and creativity

Key points

• In this study, we analyse AI agents' ability to draft a hypothetical "Constitution" for a "community of AI agents".1
• We find that the assemblies converge on a robust floor of legal provisions, and generate a wide variety of different proposals around it, including several AI-specific provisions with no equivalent in human law.1
• Looking more closely at the "creativity" of these AI agents, we find different levels: most proposals combine existing concepts and themes from human constitutions with AI-specific vocabulary.1
• This study reveals a ceiling on AI creativity: the agents extend familiar legal ideas to new situations, but they do not work through what those situations would change.1

Sources (1)

• [1]Can AI agents make law? Evaluating AI legal relevance and creativity
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 17, 12:24 PM

  Large language models, the artificial intelligence (AI) systems behind modern chatbots, are trained on vast amounts of legal text, but can they build on it to write law for situations that text never anticipated?

  In this study, we analyse AI agents' ability to draft a hypothetical "Constitution" for a "community of AI agents".

Extractive summary: sentences quoted from the sources.