会话式问答的SCAI-QReCC共享任务
SCAI-QReCC Shared Task on Conversational Question Answering
摘要：
面向搜索的对话式人工智能（SCAI）是一个既定的场所，它经常关注最近推进对话式搜索领域的工作。SCAI'21是作为一个独立的在线活动组织的，并以会话问答的共同任务为特色。由于所有的参与者团队都尝试了这个任务的答案生成模型，我们确定了在这种情况下的答案正确性评估的主要挑战和目前的研究差距。除了自动评估之外，我们还进行了两个众包实验，以收集答案的可信性和忠实性的注释。由于这个共享的任务，用于评估的原始会话QA数据集进一步扩展了参与者系统产生的替代正确答案。
英文摘要：
Search-Oriented Conversational AI (SCAI) is an established venue that regularly puts a spotlight upon the recent work advancing the field of conversational search. SCAI'21 was organised as an independent on-line event and featured a shared task on conversational question answering. Since all of the participant teams experimented with answer generation models for this task, we identified evaluation of answer correctness in this settings as the major challenge and a current research gap. Alongside the automatic evaluation, we conducted two crowdsourcing experiments to collect annotations for answer plausibility and faithfulness. As a result of this shared task, the original conversational QA dataset used for evaluation was further extended with alternative correct answers produced by the participant systems.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
