Web页面中扁平和嵌套数据记录的提取
Extraction of Flat and Nested Data Records from Web Pages
摘要：
本文研究了从给定网页中识别和提取扁平和嵌套数据记录的问题。随着万维网上可用的信息源的爆炸式增长，识别相关信息片段变得越来越困难，因为网页通常混杂有不相关的内容，如广告、导航面板、版权通知等，围绕网页的主要内容。因此，挖掘这些数据区域和数据记录以便从这些网页中提取信息以提供增值服务是有用的。现有的从网页中挖掘数据区域和数据记录的自动技术由于其性能差而仍然不能令人满意。本文提出了一种新的方法，自动识别和提取网页中的扁平和嵌套的数据记录。它包括两个步骤：（1）基于视觉线索信息的数据区域识别与提取。(2)从网页的数据区域自动识别和提取平面和嵌套数据记录。对于第一步，提出了一种新的更有效的方法，该方法利用视觉线索找到由所有类型的标签形成的数据区域。对于第二步，提出了一种更有效和高效的方法，即基于视觉线索的Web数据提取（VCED），该方法从数据区域中提取每个记录，并基于每个记录中存在的数据项的数量和所覆盖的区域的视觉线索信息来识别它是平面数据记录还是嵌套数据记录。我们的实验结果表明，该技术是有效的，优于现有的技术。
英文摘要：
This paper studies the problem of identification and extraction of flat and nested data records from a given web page. With the explosive growth of information sources available on the World Wide Web, it has become increasingly difficult to identify the relevant pieces of information, since web pages are often cluttered with irrelevant content like advertisements, navigation-panels, copyright notices etc., surrounding the main content of the web page. Hence, it is useful to mine such data regions and data records in order to extract information from such web pages to provide value-added services. Currently available automatic techniques to mine data regions and data records from web pages are still unsatisfactory because of their poor performance. In this paper a novel method to identify and extract the flat and nested data records from the web pages automatically is proposed. It comprises of two steps : (1) Identification and Extraction of the data regions based on visual clues information. (2) Identification and extraction of flat and nested data records from the data region of a web page automatically. For step1, a novel and more effective method is proposed, which finds the data regions formed by all types of tags using visual clues. For step2, a more effective and efficient method namely, Visual Clue based Extraction of web Data (VCED), is proposed, which extracts each record from the data region and identifies it whether it is a flat or nested data record based on visual clue information the area covered by and the number of data items present in each record. Our experimental results show that the proposed technique is effective and better than existing techniques.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
