arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2608.30260cs.CLcs.AIcs.LG

用韵律预测句法结构

Using Prosody to Predict Syntactic Structure

发表机构乔治城大学 · 加州大学圣迭戈分校 · 麻省理工学院
另 1 家 · 查看机构详情
  • Georgetown University(乔治城大学)
  • UC San Diego(加州大学圣迭戈分校)
  • MIT(麻省理工学院)
  • ETH Zürich(苏黎世联邦理工学院)

机构由 AI 辅助整理,请以论文原文为准。

Junghyun Min, Alex Warstadt, Tamar I. Regev, Tiago Pimentel, Ethan Gotlieb Wilcox

首次发表
浏览论文内容

中文总结 AI 辅助

该研究从信息论视角提出通用框架,利用多模态语言模型量化韵律与句法的互信息,发现韵律可降低自然对话中10.2%的句法不确定性,为相关理论提供实证支持。

中文摘要 AI 辅助

尽管韵律承载着句法结构的关键线索已被广泛认可,但这两个领域之间对应关系的程度与性质仍存在争议。我们从信息论视角研究句法-韵律界面,将韵律特征与句法表征之间的相互作用量化为互信息。我们提出了一种通用框架,用于使用多模态语言模型在大型语音-文本语料库上估计该量。该框架与结构无关且具有模块化特点,可用于测量单个韵律特征或结构组件的贡献。我们针对两种特征(词长和词间停顿)在两个领域(英语有声读物和自然对话)中评估句法-韵律关系。结果表明,韵律包含可测量的句法信息,在自然对话中,韵律特征可将句法不确定性降低多达10.2%。我们的发现为句法-韵律界面的几种理论解释提供了新的实证支持。

英文摘要

While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two domains remains contested. We investigate the syntax-prosody interface through an information-theoretic lens, quantifying the interaction between prosodic features and syntactic representations as their mutual information. We provide a general-purpose framework for estimating this quantity over large speech-text corpora using multimodal language models. Our framework is structure-agnostic and modular, insofar as it can be used to measure the contributions of individual prosodic features or components of structure. We evaluate the syntax-prosody relationship for two features (word duration and inter-word pauses) across two domains--read audiobooks and spontaneous conversations--both in English. Our results demonstrate that prosody contains measurable syntactic information, with prosodic features reducing syntactic uncertainty in spontaneous conversations by up to 10.2%. Our findings offer new empirical support for several theoretical accounts of the syntax-prosody interface.

补充信息

↑