arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.09465cs.CL
收藏

WebSRC:一个基于网络的结构化阅读理解数据集

WebSRC: A Dataset for Web-Based Structural Reading Comprehension

Shanghai Jiao Tong University(上海交通大学)

Xingyu Chen, Zihan Zhao, Lu Chen, Danyang Zhang, Jiabao Ji, Ao Luo, Yuxuan Xiong, Kai Yu

摘要:

网络搜索是人类获取信息的重要途径,但对机器来说,理解网页内容仍然是一个巨大的挑战。本文介绍了网络环境下的结构化阅读理解任务。给定一个网页和一个关于它的问题,任务是从网页中找到答案。这个任务要求系统不仅要理解文本的语义,还要理解网页的结构。此外,我们提出了一个新的基于Web的结构化阅读理解数据集WebSRC。WebSRC由40万个问答对组成,这些问答对是从6.4K个网页中收集的。除了QA对,我们的数据集中还提供了相应的HTML源代码、屏幕截图和元数据。WebSRC中的每个问题都需要对网页有一定的结构理解才能回答,答案要么是网页上的文本跨度,要么是/否。我们还研究了结构信息和视觉特征的有用性。我们的数据集和基线已在https://x-lance.github.io/WebSRC/上公开。

英文摘要:

Web search is an essential way for humans to obtain information, but it's still a great challenge for machines to understand the contents of web pages. In this paper, we introduce the task of structural reading comprehension (SRC) on web. Given a web page and a question about it, the task is to find the answer from the web page. This task requires a system not only to understand the semantics of texts but also the structure of the web page. Moreover, we proposed WebSRC, a novel Web-based Structural Reading Comprehension dataset. WebSRC consists of 400K question-answer pairs, which are collected from 6.4K web pages. Along with the QA pairs, corresponding HTML source code, screenshots, and metadata are also provided in our dataset. Each question in WebSRC requires a certain structural understanding of a web page to answer, and the answer is either a text span on the web page or yes/no. We evaluate various baselines on our dataset to show the difficulty of our task. We also investigate the usefulness of structural information and visual features. Our dataset and baselines have been publicly available at https://x-lance.github.io/WebSRC/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑