PresenceBench: An Exploratory Evaluation of Large Language Model Adaptation to User State

Key points

• We introduce PresenceBench, an instrument for measuring it.1
• PresenceBench evaluates how the intelligence layer uses a supplied state, not how that state is sensed, and breaks the capability into measurable properties.1
• Receptivity: does the model take up the state and give a better response than with no signal?1
• Specificity: does any improvement depend on the correct state, rather than on extra structured context?1

Sources (1)

• [1]PresenceBench: An Exploratory Evaluation of Large Language Model Adaptation to User State
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 16, 03:33 PM

  Presence-aware intelligence is the capacity of an AI system's intelligence layer to adapt appropriately to the functional state of the person it serves (here readiness, flow, and stability) while preserving task quality and safety.

  We introduce PresenceBench, an instrument for measuring it.

Extractive summary: sentences quoted from the sources.