arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.21097cs.CL
收藏

WCXB:一个多类型网络内容提取基准

WCXB: A Multi-Type Web Content Extraction Benchmark

Murrough Foley

Murrough Foley

AI总结:

本文提出WCXB基准,包含2008个网页,涵盖七种结构不同的页面类型,通过五阶段流程生成真实标注,评估13种提取系统,发现现有文章-only基准无法发现结构化页面的盲区。

摘要:

网络内容提取——从网页中隔离主要内容以排除周围模板内容——是搜索引擎索引、检索增强生成、NLP数据集构建和大语言模型训练的前提。该领域的进展受到现有评估基准的限制,这些基准规模小(100-800页)、仅限于新闻文章或基于超过十年前的网页。我们介绍了网络内容提取基准(WCXB),包含来自1613个域的2008个网页,涵盖七种结构不同的页面类型:文章、论坛、产品、集合、列表、文档和服务页面。该数据集包括1497页的开发集和511页的测试集,具有匹配的页面类型分布。真实标注通过五阶段流程生成:LLM辅助草稿、自动化验证、四轮前沿模型审查、片段和质量验证脚本以及人工审查。我们评估了13种提取系统——11种启发式和2种神经网络——发现尽管顶级系统在文章上(F1=0.93)表现良好,但在结构化页面类型上性能差异显著(F1=0.41-0.84),揭示了现有文章-only基准无法发现的盲区。该数据集以CC-BY-4.0许可证发布,包含HTML源文件、真实标注、页面类型标签和基线结果。

英文摘要:

Web content extraction - isolating a page's main content from surrounding boilerplate - is a prerequisite for search indexing, retrieval-augmented generation, NLP dataset construction, and large language model training. Progress in this area has been constrained by the limitations of existing evaluation benchmarks, which are small (100-800 pages), restricted to news articles, or based on web pages from over a decade ago. We introduce the Web Content Extraction Benchmark (WCXB), a dataset of 2,008 web pages from 1,613 domains spanning seven structurally distinct page types: articles, forums, products, collections, listings, documentation, and service pages. The dataset includes a 1,497-page development set and a 511-page held-out test set with matched page type distributions. Ground truth annotations were produced through a five-stage pipeline: LLM-assisted drafting, automated verification, four-pass frontier model review, snippet and quality verification scripts, and human review. We evaluate 13 extraction systems - 11 heuristic and 2 neural - and find that while top systems converge on articles (F1 = 0.93), performance diverges sharply on structured page types (F1 = 0.41-0.84), revealing blind spots invisible to existing article-only benchmarks. The dataset is released under CC-BY-4.0 with HTML source files, ground truth annotations, page type labels, and baseline results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑