arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.04701cs.CL
收藏

HEAD-QA:用于复杂推理的医疗保健数据集

HEAD-QA: A Healthcare Dataset for Complex Reasoning

Universidade da Coruña, CITIC(拉科鲁尼亚大学,CITIC)

David Vilares, Carlos Gómez-Rodríguez

摘要:

我们提出了HEAD-QA,一个多选择问答测试平台,以鼓励研究复杂的推理。这些问题来自西班牙医疗保健系统中获得专业职位的考试,即使对于高度专业化的人来说也具有挑战性。然后,我们考虑单语(西班牙语)和跨语言(英语)实验与信息检索和神经技术。我们证明:(i)HEAD-QA对目前的方法提出了挑战,(ii)结果远远落后于人类的表现,表明其作为未来工作基准的有用性。

英文摘要:

We present HEAD-QA, a multi-choice question answering testbed to encourage research on complex reasoning. The questions come from exams to access a specialized position in the Spanish healthcare system, and are challenging even for highly specialized humans. We then consider monolingual (Spanish) and cross-lingual (to English) experiments with information retrieval and neural techniques. We show that: (i) HEAD-QA challenges current methods, and (ii) the results lag well behind human performance, demonstrating its usefulness as a benchmark for future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑