arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

WebKurator.de平台:结合区域与主题的网页策划

The WebKurator.de Platform: Combined Regional and Topical Web Curation

Michael Dinzinger, Natanael Arndt, Ben Böck, Jelena Mitrović, Michael Granitzer

arXiv 2609.03971首次发表:更新:

发表机构

University of Passau; Deutsche Nationalbibliothek; IT:U Austria(帕绍大学; 德国国家图书馆; IT:U 奥地利)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

针对现有网页策划方法地理与主题分类交织的局限,推出WebKurator.de平台,采用二维策划模型,基于含554万网站的德国印记数据集构建,可通过用户建议扩展。

AI 中文摘要

对网页的系统性策划,仍是旨在保存文化和区域相关内容的国家图书馆及记忆机构面临的核心挑战。现有的基于目录的方法(如Curlie)采用以主题为中心的一维层级结构,其中地理方面与主题及语言类别相互交织。为解决这一局限,我们推出WebKurator.de平台,这是一个用于结合区域与主题网页策划的协作平台,最初聚焦于德国网页。WebKurator引入了明确区分主题分类与地理标注的二维策划模型,系统集成了基于大语言模型(LLM)的主题分类、基于印记(imprint)的地址提取及地理编码功能,并支持用户建议与审核。该平台基于德国印记数据集(German Imprints Dataset)构建,这是一个包含554万个网站的大规模集合,其中314万个网站包含印记页面,我们已成功为这些页面提取并地理编码了邮政地址。在这些地址中,258万个(占比85.17%)位于德国且已分配主题标签,这些网站构成了WebKurator.de的初始基础,可通过用户建议持续扩展。

英文摘要

The systematic curation of the Web remains a central challenge for national libraries and memory institutions that aim to preserve culturally and regionally relevant content. Existing directory-based approaches such as Curlie implement a predominantly topic-centric, one-dimensional hierarchy, where geographic aspects are intertwined with topical and linguistic categories. To address this limitation, we present WebKurator.de, a collaborative platform for combined regional and topical web curation, initially focused on the German web. WebKurator introduces a two-dimensional curation model that explicitly separates topical categorization and geographic annotation. The system integrates LLM-based topic classification and imprint-based address extraction with geocoding, and supports user suggestions together with moderated review. The platform is bootstrapped from the German Imprints Dataset, a large-scale collection of 5.54 million websites. Among them, 3.14 million contain imprint pages, for which we successfully extracted and geocoded postal addresses. Of these, 2.58 million (85.17%) are located in Germany and also have an assigned topic label. These websites form the initial foundation of WebKurator.de and can be continuously extended through user suggestions.

DOI:10.1145/3795513.3807433

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑