家庭助手的意图检测与槽位填充:孟加拉语和西尔赫蒂语的数据集与分析
Intent Detection and Slot Filling for Home Assistants: Dataset and Analysis for Bangla and Sylheti
AI总结:
本研究首次构建了涵盖正式孟加拉语、口语孟加拉语和西尔赫蒂语的意图检测与槽位填充数据集(984样本,10意图),并验证了GPT-3.5在低资源口语任务上的鲁棒性,意图检测F1达0.94。
摘要:
随着语音助手在我们技术先进的社会中巩固其地位,仍然需要满足多样化的语言环境,包括低资源语言的口语形式。我们的研究首次引入了针对正式孟加拉语、口语孟加拉语和西尔赫蒂语的意图检测和槽位填充综合数据集,共包含984个样本,涵盖10种独特意图。我们的分析揭示了大型语言模型在处理数据不足的下游任务时的鲁棒性。GPT-3.5模型在口语孟加拉语的意图检测中取得了令人印象深刻的F1分数0.94,在槽位填充中取得了0.51。
英文摘要:
As voice assistants cement their place in our technologically advanced society, there remains a need to cater to the diverse linguistic landscape, including colloquial forms of low-resource languages. Our study introduces the first-ever comprehensive dataset for intent detection and slot filling in formal Bangla, colloquial Bangla, and Sylheti languages, totaling 984 samples across 10 unique intents. Our analysis reveals the robustness of large language models for tackling downstream tasks with inadequate data. The GPT-3.5 model achieves an impressive F1 score of 0.94 in intent detection and 0.51 in slot filling for colloquial Bangla.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。