AudioInsight:从语音中检测与社交焦虑相关的社交情境
AudioInsight: Detecting Social Contexts Relevant to Social Anxiety from Speech
AI总结:
本研究提出AudioInsight方法,利用环境音频和深度学习检测社交威胁情境(互动人数与评价性威胁),在虚拟互动数据上实现高准确率,为社交焦虑的个性化数字干预提供支持。
摘要:
在社交互动过程中,理解情境的复杂性至关重要,尤其是对于社交焦虑个体而言。虽然先前的研究发现,社交互动的存在可以从环境音频中检测出来,但社交情境内部的细微差别——这些差别影响互动引发焦虑的程度——在很大程度上仍未得到探索。作为对自我报告等传统且繁琐方法的替代,本研究提出了一种新颖的方法,利用环境音频片段来检测社交威胁情境。我们关注两个关键维度:互动伙伴的数量(双人互动 vs. 群体互动)和评价性威胁的程度(明确评价性 vs. 非明确评价性)。基于一项基于Zoom的社交互动研究数据(N=45名社交焦虑大学生,占总数N=52中的大多数),我们采用深度学习方法实现了强大的检测性能。在样本范围内的5折交叉验证(CV)下,我们的模型区分双人互动与群体互动的准确率达到90%,检测评价性威胁的准确率为83%。使用留一组交叉验证时,准确率分别为82%和77%。虽然由于疫情限制,我们的数据基于虚拟互动,但我们的方法具有扩展到多样化现实世界场景的潜力。这项研究强调了被动感知和人工智能在区分复杂社交情境方面的潜力,并可能最终推动情境感知数字干预的能力,以提供个性化的心理健康支持。
英文摘要:
During social interactions, understanding the intricacies of the context can be vital, particularly for socially anxious individuals. While previous research has found that the presence of a social interaction can be detected from ambient audio, the nuances within social contexts, which influence how anxiety provoking interactions are, remain largely unexplored. As an alternative to traditional, burdensome methods like self-report, this study presents a novel approach that harnesses ambient audio segments to detect social threat contexts. We focus on two key dimensions: number of interaction partners (dyadic vs. group) and degree of evaluative threat (explicitly evaluative vs. not explicitly evaluative). Building on data from a Zoom-based social interaction study (N=52 college students, of whom the majority N=45 are socially anxious), we employ deep learning methods to achieve strong detection performance. Under sample-wide 5-fold Cross Validation (CV), our model distinguished dyadic from group interactions with 90\% accuracy and detected evaluative threat at 83\%. Using a leave-one-group-out CV, accuracies were 82\% and 77\%, respectively. While our data are based on virtual interactions due to pandemic constraints, our method has the potential to extend to diverse real-world settings. This research underscores the potential of passive sensing and AI to differentiate intricate social contexts, and may ultimately advance the ability of context-aware digital interventions to offer personalized mental health support.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。