arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.23388cs.CLcs.AIcs.SDeess.AS
收藏

Task-Lens: 基于跨任务效用的低资源印度语言语音数据集分析

Task-Lens: Cross-Task Utility Based Speech Dataset Profiling for Low-Resource Indian Languages

SBI Lab, IIIT Delhi(IIIT德里生物信息实验室)

Swati Sharma, Divya V. Sharma, Anubha Gupta

AI总结:

Task-Lens通过跨任务分析评估印度语音数据集的效用,揭示数据集在多个下游任务中的潜力及不足,帮助优先发展未被满足的任务和语言的数据集。

摘要:

随着对包容性语音技术的需求增加,多语言数据集在自然语言处理(NLP)研究中的需求也相应增加。然而,对现有任务特定资源在低资源语言中的有限意识阻碍了研究。这一挑战在语言多样性国家,如印度尤为突出。现有印度语音数据集的跨任务分析可以缓解数据稀缺问题。这涉及调查数据集在多个下游任务中的效用,而不是专注于单一任务。以往的调查通常对单一任务的数据集进行分类,留下全面的跨任务分析成为开放机会。因此,我们提出Task-Lens,一个跨任务调查,评估50个涵盖26种语言的印度语音数据集在九个下游语音任务中的准备情况。首先,我们分析哪些数据集包含适合特定任务的元数据和属性。其次,我们提出任务对齐的增强方法,以解锁数据集的全部下游潜力。最后,我们识别出当前资源严重不足的任务和印度语言。我们的发现表明,许多印度语音数据集包含未被利用的元数据,可以支持多个下游任务。通过揭示跨任务联系和缺口,Task-Lens使研究人员能够探索现有数据集的更广泛适用性,并优先考虑未被满足的任务和语言的数据集创建。

英文摘要:

The rising demand for inclusive speech technologies amplifies the need for multilingual datasets for Natural Language Processing (NLP) research. However, limited awareness of existing task-specific resources in low-resource languages hinders research. This challenge is especially acute in linguistically diverse countries, such as India. Cross-task profiling of existing Indian speech datasets can alleviate the data scarcity challenge. This involves investigating the utility of datasets across multiple downstream tasks rather than focusing on a single task. Prior surveys typically catalogue datasets for a single task, leaving comprehensive cross-task profiling as an open opportunity. Therefore, we propose Task-Lens, a cross-task survey that assesses the readiness of 50 Indian speech datasets spanning 26 languages for nine downstream speech tasks. First, we analyze which datasets contain metadata and properties suitable for specific tasks. Next, we propose task-aligned enhancements to unlock datasets to their full downstream potential. Finally, we identify tasks and Indian languages that are critically underserved by current resources. Our findings reveal that many Indian speech datasets contain untapped metadata that can support multiple downstream tasks. By uncovering cross-task linkages and gaps, Task-Lens enables researchers to explore the broader applicability of existing datasets and to prioritize dataset creation for underserved tasks and languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑