AI 中文总结
该研究发布Naver-News-KO韩语新闻摘要数据集,含27400个文档与摘要对,介绍了数据收集等情况,给出语料库统计、与其他语料库对比结果,还提供提取参考点和微调基线及训练脚本,为下游工作提供可引用参考。
AI 中文摘要
我们发布了Naver-News-KO,这是一个韩语新闻摘要数据集,包含2022年7月十天内从Naver新闻收集的27400个(文档,摘要)对,分为两个类别(经济和信息技术/科学;77/23分割),训练/验证/测试分区为22194 / 2466 / 2740,每条记录的文档到摘要字符压缩率平均为6.03倍。该数据集自2023年1月起在Hugging Face Hub上公开托管,截至2026年5月,每月下载量约为33000次;在此基础上微调的社区维护韩语摘要模型包括Gemma-2B-ko和Gemma2-9B变体。本技术报告记录了收集协议、列模式和分割构建;报告了语料库级统计数据;将该资源与其他韩语摘要语料库进行了定位;提供了Lead-3提取参考点和两个可重现的微调基线,并附带发布时的训练脚本;阐明了资源的许可和预期使用范围。目的是为已经使用此数据集的下游工作提供可引用的参考,而非提出新的基准。
英文摘要
We release Naver-News-KO, a Korean news summarization dataset of 27,400 (document, summary) pairs collected from Naver News over a ten-day window in July 2022 across two categories (Economy and IT/Science; 77/23 split), with train/validation/test partitions of 22,194 / 2,466 / 2,740 and a mean per-record document-to-summary character-compression ratio of 6.03x. The dataset has been publicly hosted on the Hugging Face Hub since January 2023 and, as of May 2026, receives approximately 33,000 downloads per month; community-maintained Korean summarization models fine-tuned on it include Gemma-2B-ko and Gemma2-9B variants. This technical report (i) documents the collection protocol, the column schema, and the split construction, (ii) reports corpus-level statistics (length distributions, compression ratio, and a measured 16.8% near-duplicate title-Jaccard overlap between test and train that users should be aware of), (iii) positions the resource against other open Korean summarization corpora, (iv) provides a Lead-3 extractive reference point (ROUGE-1 55.1, ROUGE-L 50.6) and two reproducible fine-tuned baselines -- KoBART (R-1 56.6, BERTScore-F1 81.5) and Gemma-2B-ko with LoRA (R-1 55.3, BERTScore-F1 78.3) -- with release-time training scripts, and (v) clarifies the licensing and intended-use scope of the resource. The goal is to provide a citable reference for downstream work that already uses this dataset, not to propose a new benchmark.
CommentsTechnical report; 7 pages, 1 figure, 4 tables. Dataset: https://huggingface.co/datasets/daekeun-ml/naver-news-summarization-ko