ResearchResearch paperMultimodal Models · Speech & Audio · Robotics & Embodied AI1 source · Oct 16, 2026

Framing Spatial Hearing within the Free Energy Principle: A Hierarchical Model of Perceptual Learning

Spatial hearing relies on dynamic internal representations to decode spatial information from ever-changing acoustic conditions.

Key points

  • A fundamental example is sound localisation, where listeners infer the direction of an invisible sound.
  • We characterise how listeners' beliefs evolve across trials, in which they estimated sound direction and received subsequent visual feedback on each trial.
  • Listeners are described by a hierarchical generative model where visual feedback drives gradient descent on VFE, updating beliefs over three independent quantities: lateral and polar localisation precisions and hemifield disambiguation.
  • This work establishes spatial hearing as a tractable domain for FEP and motivates future closed-loop experiments with full action-perception cycles.

Sources (1)

Extractive summary: sentences quoted from the sources.

Related