SpeechCompass：通过多麦克风定位增强移动字幕的说话人分离与方向指引
SpeechCompass: Enhancing Mobile Captioning with Diarization and Directional Guidance via Multi-Microphone Localization
AI总结：
SpeechCompass通过多麦克风实时语音定位和低功耗微控制器硬件，在移动语音转文字中实现说话人分离与方向指引，解决了群组对话中的挑战，用户研究验证了其价值。
摘要：
移动设备上的语音转文字功能已被证明对听力和言语无障碍、语言翻译、记笔记和会议记录很有帮助。然而，我们的基础大规模调查（n=263）显示，无法区分和指示说话人方向使得它们在群组对话中面临挑战。SpeechCompass通过实时、多麦克风语音定位解决了这一局限，其中语音方向允许在用户界面中进行视觉分离和指引（例如箭头）。我们引入了高效的实时音频定位算法和定制的声音感知硬件，该硬件在低功耗微控制器和四个集成麦克风上运行，我们在技术评估中对其进行了表征。在大规模调查（n=494）的启发下，我们对群组对话进行了一项面对面研究，参与者为八名移动语音转文字的频繁用户，他们对五种可视化风格提供了反馈。说话人分离和可视化定位的价值在参与者中是一致的，每个人都认同方向指引对群组对话的价值和潜力。
英文摘要：
Speech-to-text capabilities on mobile devices have proven helpful for hearing and speech accessibility, language translation, note-taking, and meeting transcripts. However, our foundational large-scale survey (n=263) shows that the inability to distinguish and indicate speaker direction makes them challenging in group conversations. SpeechCompass addresses this limitation through real-time, multi-microphone speech localization, where the direction of speech allows visual separation and guidance (e.g., arrows) in the user interface. We introduce efficient real-time audio localization algorithms and custom sound perception hardware running on a low-power microcontroller and four integrated microphones, which we characterize in technical evaluations. Informed by a large-scale survey (n=494), we conducted an in-person study of group conversations with eight frequent users of mobile speech-to-text, who provided feedback on five visualization styles. The value of diarization and visualizing localization was consistent across participants, with everyone agreeing on the value and potential of directional guidance for group conversations.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
