arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.04853cs.CL
收藏

DravidianMultiModality:泰米尔语和马拉雅拉姆语多模态情感分析数据集

DravidianMultiModality: A Dataset for Multi-modal Sentiment Analysis in Tamil and Malayalam

National University of Ireland Galway(爱尔兰国立高威大学);Amrita Vishwa Vidyapeetham(阿姆里塔大学);Indian Institute of Information Technology and Management-Kerala(喀拉拉邦印度信息技术与管理学院);Universiti Pendidikan Sultan Idris(苏丹依德理斯教育大学)

Bharathi Raja Chakravarthi, Jishnu Parameswaran P. K, Premjith B, K. P Soman, Rahul Ponnusamy, Prasanna Kumar Kumaresan, Kingston Pal Thamburaj, John P. McCrae

摘要:

人类的交流本质上是多模态和异步的。分析人类情感和情绪是人工智能的一个新兴领域。我们看到社交媒体上越来越多的关于产品和其他主题的本地语言多模态内容。然而,没有太多的多模态资源可用于资源不足的德拉威语。我们的研究旨在为资源不足的泰米尔语和马拉雅拉姆语创建一个多模态情感分析数据集。首先,我们从YouTube上下载了泰米尔语和马拉雅拉姆语的产品或电影评论视频。接下来,我们在注释器的帮助下为视频创建标题。然后,我们标记的情感视频,并验证了注释者之间的协议使用Fleiss的Kappa。这是第一个多模态情感分析数据集泰米尔语和马拉雅拉姆语的志愿者注释。

英文摘要:

Human communication is inherently multimodal and asynchronous. Analyzing human emotions and sentiment is an emerging field of artificial intelligence. We are witnessing an increasing amount of multimodal content in local languages on social media about products and other topics. However, there are not many multimodal resources available for under-resourced Dravidian languages. Our study aims to create a multimodal sentiment analysis dataset for the under-resourced Tamil and Malayalam languages. First, we downloaded product or movies review videos from YouTube for Tamil and Malayalam. Next, we created captions for the videos with the help of annotators. Then we labelled the videos for sentiment, and verified the inter-annotator agreement using Fleiss's Kappa. This is the first multimodal sentiment analysis dataset for Tamil and Malayalam by volunteer annotators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑