Competence-Aware Orchestration for LLM-Based Multi-Agent Systems

Key points

• This problem matters because more collaboration is not always better--richer coordination may help on difficult cases, but it also incurs additional token cost and redundant interactions.1
• We propose a two-stage competence-aware framework for automatic MAS orchestration.1
• It first models the LLM backbone's task-conditioned competence for the current query, and then uses this signal to adapt role activation and the communication graph.1
• Experiments with six LLM backbones of varying competence levels further show that our method adjusts collaboration according to the inferred competence: for higher-competence backbones, it improves average accuracy from 87.22 to 89.97 while reducing token cost by 36.26%; for lower-competence backbones, it yields a further average gain of 4.58 points over existing methods.1

Sources (1)

• [1]Competence-Aware Orchestration for LLM-Based Multi-Agent Systems
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 9, 07:33 AM

  LLM-based multi-agent systems (MAS) have emerged as a promising paradigm for enhancing complex reasoning through role specialization and collaboration, yet a key challenge remains: how can collaboration be adapted to a backbone's competence on the current query?

  This problem matters because more collaboration is not always better--richer coordination may help on difficult cases, but it also incurs additional token cost and redundant interactions.

Extractive summary: sentences quoted from the sources.