Billiger.de Products：一个双语实体匹配基准
Billiger.de Products: A Bilingual Entity Matching Benchmark
浏览论文内容
中文总结 AI 辅助
本文提出一个覆盖十三类消费品的德英双语实体匹配基准，验证显示其难度高于现有英语基准，且多数匹配器在英语版本上得分更高。
中文摘要 AI 辅助
现有的产品匹配基准主要包含英语产品数据，且通常由单一产品类别（如电子产品）主导。本文介绍了 this http URL Products，一个涵盖十三个消费品类别（包括服装和家具等难以处理的类别）的德英双语实体匹配基准。该基准数据来源于德国价格比较平台 this http URL。遵循 WDC Products 的设计，该基准提供了多种变体，这些变体在边缘案例的比例、开发集的大小以及训练期间未见实体的比例上有所不同。每个报价的英译对齐版本保持了所有配对、划分和标签不变，而跨语言测试集则在单个配对中结合了德语和英语记录。我们使用六个监督匹配器和零样本 GPT-5.2 在两种语言版本和跨语言测试集上验证了该基准。验证显示了该基准的难度。将英语版本基准上的结果与德语版本上的结果进行比较表明，大多数匹配器在英语版本上的平均得分更高。对于 RoBERTa 和 HierGAT，差异最大，而零样本 LLM 运行对语言基本不敏感。将基于 PLM 的匹配器在 this http URL Products 英语版本上取得的 F1 分数与它们在现有英语基准（如 WDC Products 和 Abt-Buy）上的表现进行比较，表明 this http URL Products 比这些基准更难。
英文摘要
Existing product matching benchmarks primarily contain English-language product data and are often dominated by a single product category, such as electronics. This paper introduces Billiger.de Products, a bilingual German and English entity matching benchmark covering thirteen consumer product categories, including difficult-to-handle categories such as clothing and furniture. The benchmark data originates from the German price comparison platform billiger.de. Following the design of WDC Products, the benchmark offers multiple variants that differ in the fraction of corner cases, the size of the development set, and the fraction of entities unseen during training. An aligned English translation of every offer keeps all pairs, splits, and labels fixed, while cross-language test sets combine German and English records within individual pairs. We validate the benchmark using six supervised matchers and zero-shot GPT-5.2 on both language versions and the cross-language test sets. The validation shows the difficulty of the benchmark. The comparison of the results on the English version of the benchmark to the results on the German version shows that most matchers score on average higher on the English version. The difference is largest for RoBERTa and HierGAT, while the zero-shot LLM runs are largely insensitive to the language. Comparing the F1 scores achieved by PLM-based matchers on the English version of Billiger.de Products with their performance on existing English-language benchmarks, such as WDC Products and Abt-Buy, shows that Billiger.de Products is more difficult than these benchmarks.
发表机构
- University of Mannheim（曼海姆大学）
- solute GmbH（solute有限公司）
机构由 AI 辅助整理，请以论文原文为准。
