本文概述了 2024 ALTA 共享任务,旨在检测人机混合文章中的机器生成文本,并介绍了任务设置、评估标准及参与系统的结果。
摘要:
ALTA 共享任务自 2010 年起每年举办。2024 年的任务旨在混合设置下检测机器生成文本,该文本可能包含人类文本部分和机器生成部分。本文介绍了该任务、评估标准及参与系统的结果。
英文摘要:
The ALTA shared tasks have been running annually since 2010. In 2024, the purpose of the task is to detect machine-generated text in a hybrid setting where the text may contain portions of human text and portions machine-generated. In this paper, we present the task, the evaluation criteria, and the results of the systems participating in the shared task.
Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications
University of Mannheim(曼海姆大学);GESIS – Leibniz Institute for the Social Sciences(GESIS——莱布尼茨社会科学研究所);Fraunhofer ISI(弗劳恩霍夫系统与创新研究所);Stuttgart Media University(斯图加特传媒大学)
Overview of SCIDOCA 2025 Shared Task on Citation Prediction, Discovery, and Placement
RIKEN Center for Advanced Intelligence Project (AIP), Japan(日本先进情报项目研究所);The Institute of Statistical Mathematics, Japan(日本统计数学研究所);Japan Advanced Institute of Science and Technology(日本先进科学技术研究所)
AGRR-2019: A Corpus for Gapping Resolution in Russian
ABBYY(ABBYY公司);Charles University(查理大学);Moscow Institute of Physics and Technology(莫斯科物理技术学院);Sberbank(俄罗斯联邦储蓄银行);National Research University Higher School of Economics(国家研究型高等经济大学)
Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthiness
SiteGround;Amazon(亚马逊);Qatar Computing Research Institute, HBKU(哈马德·本·哈利法大学卡塔尔计算研究所);Qatar University(卡塔尔大学);College of Humanities and Social Sciences, HBKU(哈马德·本·哈利法大学人文与社会科学学院);Sofia University “St Kliment Ohridski”(索非亚大学“圣克里门特·奥赫里德斯基”)
GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly Reviews
International Laboratory on Learning Systems(国际学习系统实验室);MILA - Quebec AI Institute(MILA - 魁北克人工智能研究所);McGill University(麦吉尔大学);Université Paris-Saclay(巴黎萨克雷大学);CNRS, CentraleSupélec(法国国家科学研究中心、中央高等电力学院)
MuTSE: A Human-in-the-Loop Multi-use Text Simplification Evaluator
University of Bucharest(布加勒斯特大学);Universitatea Creștină "Dimitrie Cantemir"(迪米特里耶·坎泰米尔基督教大学);Cu Drag si Sport SRL(Cu Drag si Sport 有限责任公司);Softbinator Technologies(Softbinator 科技公司)