Digitized historical archives are large, heterogeneous cultural heritage repositories, but access methods for such archives face challenges such as noisy optical character recognition (OCR) output and rigid keyword-based retrieval, which limit retrieval quality. In this work, we present an end-to-end archival processing and retrieval framework that integrates large language models (LLMs) into the archival pipeline. Our system introduces two core components: (i) an LLM-based OCR refinement module that improves text quality, and (ii) a semantic retrieval and cross-encoder reranking pipeline supporting natural-language question answering via retrieval-augmented generation (RAG). Our evaluations are done on a historical archival dataset of 500,000 Swiss newspaper segments spanning over three centuries (1762 to 2001). Experiments are conducted across 384 natural-language test queries. Our results highlight that LLM refinements reduce OCR errors by up to 44.52% (CER) and 60.95% (WER). More importantly, this is accompanied by downstream information retrieval improvements. Compared to traditional keyword baselines, our reranking pipeline increases NDCG@10 by 31.9% (from 65.99% to 87.05%) and achieves statistically significant gains in both answer correctness and context relevance. These results demonstrate that integrating LLMs with established document processing and retrieval pipelines can elevate digital libraries from static repositories to interactive, semantically searchable archival systems.
Cultural Analytics for Good: Building Inclusive Evaluation Frameworks for Historical IR
School of Computer Science, University College Dublin(都柏林大学学院计算机学院);Indian Institute of Science Education and Research, Kolkata(印度科学教育研究所加尔各答分校);School of English, Drama and Film, University College Dublin(都柏林大学学院英语、戏剧与电影学院);GESIS – Leibniz Institute for the Social Sciences, Cologne(科隆盖西-莱布尼茨社会科学研究所)
Automating Historical Insight Extraction from Large-Scale Newspaper Archives via Neural Topic Modeling
Department of Computer Science , University of Luxembourg , 2, place de l’Université , 4365 , Esch-Belval Esch-sur-Alzette , Luxembourg;Centre for Contemporary \& Digital History (C 2 DH) , University of Luxembourg , 11 Porte des Sciences , 4366 , Esch-Belval Esch-sur-Alzette , Luxembourg
P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Task
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)