纪念品及其内容的获取规则
Rules of Acquisition for Mementos and Their Content
摘要：
从网页中提取文本有很多应用，包括网页爬行优化和文档聚类。虽然已经有很多关于从实时网页获取内容的文章，但存档网页的内容获取（称为纪念品）仍然是一项相对较新的业务。在对近70万个网页进行研究的过程中，我们遇到了获取纪念品和从中提取文本的问题。通过HTTP获取纪念品内容预计是一个相对无痛的练习，但我们已经发现了相反的情况。我们还发现，HTML的解析，已经知道是有问题的，可以更复杂的，当一个人试图提取的纪念品的文本在许多网络档案，由于涉及不同的纪念品呈现行为的问题，以及在他们的纪念品的HTML的年龄。为了让其他人在许多网络档案中获得纪念品，我们在这里记录了这些经历。
英文摘要：
Text extraction from web pages has many applications, including web crawling optimization and document clustering. Though much has been written about the acquisition of content from live web pages, content acquisition of archived web pages, known as mementos, remains a relatively new enterprise. In the course of conducting a study with almost 700,000 web pages, we encountered issues acquiring mementos and extracting text from them. The acquisition of memento content via HTTP is expected to be a relatively painless exercise, but we have found cases to the contrary. We also find that the parsing of HTML, already known to be problematic, can be more complex when one attempts to extract the text of mementos across many web archives, due to issues involving different memento presentation behaviors, as well as the age of the HTML in their mementos. For the benefit of others acquiring mementos across many web archives, we document those experiences here.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
