Hear-to-Hear: Uncertainty-Aware, Head-Tracked Interaction for Personalized Spatial Audio

Yu-Chen Tsai, Lung-Pan Cheng

The 39th Annual ACM Symposium on User Interface Software and Technology, 2026

BibTeX
@inproceedings{tsai_hear-to-hear_2026,
 title = {Hear-to-Hear: Uncertainty-Aware, Head-Tracked Interaction for Personalized Spatial Audio},
 author = {Tsai, Yu-Chen and Cheng, Lung-Pan},
 booktitle = {Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology},
 articleno = {153},
 doi = {10.1145/3830398.3830661},
 year = {2026}
}

Abstract

Selecting a personalized head-related transfer function (HRTF) is essential for accurate spatial audio, but remains challenging due to substantial user variation and noisy subjective feedback. We present a real-time, uncertainty-aware perceptual interaction loop for HRTF personalization: after each paired comparison, the system updates a posterior belief over candidate HRTFs and immediately adapts the next query to maximize informativeness. Our system couples Bayesian preference learning with real-time head-tracked binaural rendering, enabling head motion to actively inform comparisons. In a controlled within-subject psychophysical study, uncertainty-aware interaction (with optional head tracking) provides directional posterior evidence for localization improvements-primarily suggestive reductions in azimuth error and front-back confusions concentrated in the front hemisphere-alongside participant-level heterogeneity and a partially mitigated elevation trade-off, rather than uniformly decisive effects across all metrics.