论文标题
感知呼吸：带有呼吸指导的多模式唱歌辅导界面
Sensing the Breath: A Multimodal Singing Tutoring Interface with Breath Guidance
论文作者
论文摘要
呼吸是唱歌表演中的重要组成部分，在大多数与唱歌有关的音乐界面中仍未研究。在本文中，我们提出了一个多模式系统，该系统检测学习者的歌声和呼吸状态并提供实时视觉辅导反馈。具体而言，呼吸探测器是带压力传感器和柔性织物的可穿戴带。它可以监视腹部，背部腰部和双肋骨的实时身体运动。开发了一种呼吸可视化算法，以显示实时呼吸状态，以及交互式得分接口上的唱歌音高轮廓。用户研究表明，我们的系统不仅可以帮助用户在唱歌过程中获得更深的呼吸，还可以提高声带训练的音调准确性，尤其是对于那些有音乐背景的人。
Breath is a significant component in singing performance, which is still underresearched in most singing-related music interfaces. In this paper, we present a multimodal system that detects the learner's singing pitch and breathing states and provides real-time visual tutoring feedback. Specifically, the breath detector is a wearable belt with pressure sensors and flexible fabric. It monitors real-time body movement of the abdomen, back waist, and twin ribs. A breath visualization algorithm is developed to display real-time breath states, together with the singing pitch contours on an interactive score interface. User studies show that our system can help users not only gain deeper breath during singing but also improve pitch accuracy in vocal training, especially for those with some musical background.
