Web内容抽取--过去的元分析和未来的思考
Web Content Extraction - a Meta-Analysis of its Past and Thoughts on its Future
摘要:
在本文中,我们提出了一个元分析的几个Web内容提取算法,并提出建议,为未来的内容提取在Web上。首先,我们发现,几乎所有的Web内容提取器不考虑一个非常大的,不断增长的,现代网页的一部分。第二,这是很好的理解,包装感应提取器往往打破Web的变化,启发式/功能工程提取器被认为是免疫网站的演变,但我们发现,这是不是这样:启发式内容提取器的性能也往往会随着时间的推移,由于网站形式和做法的演变而降低。最后,我们对未来的工作,解决这些和其他调查结果的建议。
英文摘要:
In this paper, we present a meta-analysis of several Web content extraction algorithms, and make recommendations for the future of content extraction on the Web. First, we find that nearly all Web content extractors do not consider a very large, and growing, portion of modern Web pages. Second, it is well understood that wrapper induction extractors tend to break as the Web changes; heuristic/feature engineering extractors were thought to be immune to a Web site's evolution, but we find that this is not the case: heuristic content extractor performance also tends to degrade over time due to the evolution of Web site forms and practices. We conclude with recommendations for future work that address these and other findings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。