arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.09285cs.SD
收藏

远距离聆听:通过毫米波传感窃听面对面对话

Who Speaks What from Afar: Eavesdropping In-Person Conversations via mmWave Sensing

Shaoying Wang, Hansong Zhou, Yukun Yuan, Xiaonan Zhang

AI总结:

本文提出了一种通过毫米波传感远程窃听多参与者面对面对话的方法,利用物体振动差异实现语音识别和质量增强。

摘要:

多参与者会议在各种领域中发生,如商务谈判和医疗咨询,在这些会议中,敏感信息如商业秘密、商业策略和患者状况经常被讨论。先前的研究表明,拥有毫米波雷达的攻击者可以在房间外检测到微小的语音引起的振动,从而窃听会议内容。然而,这些窃听攻击无法区分多参与者会议中不同人的语音内容,导致潜在的误解和决策不佳。在本文中,我们回答了“谁说什么”的问题。通过利用无处不在的物体引入的空间多样性,我们提出了一种攻击系统,使攻击者能够远程窃听面对面对话,而无需事先知识,如身份、参与人数或座位安排。由于面对面会议的参与者通常坐在不同位置,他们的语音会在附近的物体上引起不同的振动模式。为此,我们设计了一种噪声鲁棒的无监督方法,通过检测频率域中的语音引起的振动差异来区分参与者。同时,探讨了一种基于深度学习的框架,将物体信号结合以提高语音质量。我们通过广泛的实验验证了语音分类和信号增强的证明概念攻击。实验结果表明,我们的攻击可以在会议房间中有几个参与者时达到高达0.99的语音分类准确率。同时,我们的攻击在所有现实世界场景中都表现出一致的语音质量增强,包括雷达与物体之间不同的距离。

英文摘要:

Multi-participant meetings occur across various domains, such as business negotiations and medical consultations, during which sensitive information like trade secrets, business strategies, and patient conditions is often discussed. Previous research has demonstrated that attackers with mmWave radars outside the room can overhear meeting content by detecting minute speech-induced vibrations on objects. However, these eavesdropping attacks cannot differentiate which speech content comes from which person in a multi-participant meeting, leading to potential misunderstandings and poor decision-making. In this paper, we answer the question ``who speaks what''. By leveraging the spatial diversity introduced by ubiquitous objects, we propose an attack system that enables attackers to remotely eavesdrop on in-person conversations without requiring prior knowledge, such as identities, the number of participants, or seating arrangements. Since participants in in-person meetings are typically seated at different locations, their speech induces distinct vibration patterns on nearby objects. To exploit this, we design a noise-robust unsupervised approach for distinguishing participants by detecting speech-induced vibration differences in the frequency domain. Meanwhile, a deep learning-based framework is explored to combine signals from objects for speech quality enhancement. We validate the proof-of-concept attack on speech classification and signal enhancement through extensive experiments. The experimental results show that our attack can achieve the speech classification accuracy of up to $0.99$ with several participants in a meeting room. Meanwhile, our attack demonstrates consistent speech quality enhancement across all real-world scenarios, including different distances between the radar and the objects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑