发表机构
Graduate School of Informatics, Kyoto University（京都大学信息学研究科）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本文提出TEIDAN多语言多模态三方对话语料库，涵盖日英双语，计划扩展至更多语言，可支持多方对话建模等相关研究。
AI 中文摘要
多方互动是人类交流的核心场景，也是必须参与群体对话的人机交互系统的必要目标。然而现有语料库往往聚焦于会议、任务导向互动、文本互动或模拟场景，支持自发面对面三方讨论跨语言比较的资源较少。本文提出TEIDAN，一个多语言多模态语料库，目前包含日语和英语的三方对话。TEIDAN采用个人领夹麦克风、麦克风阵列和面向参与者的摄像头录制三人小组讨论开放式话题的过程，并为两种语言部分提供基于IPU的转写文本。早期研究使用日语部分的子集作为多方对话建模的特定任务基准；相比之下，本文将TEIDAN作为涵盖日语和英语的语料库资源，计划扩展至更多语言。我们描述了收集设计、参与者、录制设置、转写格式和语料库统计数据，并提供初步分析以说明TEIDAN如何支持轮流发言、受话者识别以及人机交互和人-机交互中的多模态对齐研究。
英文摘要
Multi-party interaction is a central setting for human communication and a necessary target for human-agent interaction systems that must participate in group conversation. Yet available corpora often focus on meetings, task-oriented interaction, text-based interaction, or acted scenarios, and fewer resources support cross-linguistic comparison of spontaneous face-to-face triadic discussion. This paper presents TEIDAN, a multilingual multimodal corpus that currently consists of Japanese and English three-party conversations. TEIDAN records groups of three participants discussing open-ended topics with individual pin microphones, a microphone array, and participant-facing cameras, and provides IPU-based transcripts for both language portions. Earlier studies used subsets of the Japanese portion for task-specific benchmarks in multi-party dialogue modeling; in contrast, this paper presents TEIDAN as a corpus resource spanning both Japanese and English, with planned expansion to additional languages. We describe the collection design, participants, recording setup, transcription format, and corpus statistics, and provide preliminary analyses to illustrate how TEIDAN can support research on turn-taking, addressee recognition, and multimodal grounding in human-human and human-agent interaction.
Comments8 pages, 1 figure, 3 tables. To appear in the Companion Proceedings of the 28th ACM International Conference on Multimodal Interaction (ICMI Companion '26)
