arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.08895cs.LGcs.CYcs.SI

ReINTEL: A Multimodal Data Challenge for Responsible Information Identification on Social Network Sites

University of Engineering and Technology, Vietnam National University(越南国家大学工程技术大学);Umeå University(于默奥大学);University of Sydney(悉尼大学);ReML.AI - Reliable Machine Learning Lab, International(ReML.AI——国际可靠机器学习实验室);Hanoi University of Science, Vietnam National University(越南国家大学河内科学大学);University of Glasgow(格拉斯哥大学)

Duc-Trong Le, Xuan-Son Vu, Nhu-Dung To, Huu-Quang Nguyen, Thuy-Trinh Nguyen, Linh Le, Anh-Tuan Nguyen, Minh-Duc Hoang, Nghia Le, Huyen Nguyen, Hoang D. Nguyen

英文摘要:

This paper reports on the ReINTEL Shared Task for Responsible Information Identification on social network sites, which is hosted at the seventh annual workshop on Vietnamese Language and Speech Processing (VLSP 2020). Given a piece of news with respective textual, visual content and metadata, participants are required to classify whether the news is `reliable' or `unreliable'. In order to generate a fair benchmark, we introduce a novel human-annotated dataset of over 10,000 news collected from a social network in Vietnam. All models will be evaluated in terms of AUC-ROC score, a typical evaluation metric for classification. The competition was run on the Codalab platform. Within two months, the challenge has attracted over 60 participants and recorded nearly 1,000 submission entries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑