arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.06097cs.CLcs.AIcs.IR
收藏

大型语言模型能否替代人工标注?——面向无人机投递的细粒度中文地址实体识别数据集案例研究

Can LLM Substitute Human Labeling? A Case Study of Fine-grained Chinese Address Entity Recognition Dataset for UAV Delivery

City University of Hong Kong(香港城市大学);City University of Hong Kong Shenzhen Research Institute(香港城市大学深圳研究院)

Yuxuan Yao, Sichun Luo, Haohan Zhao, Guanzhi Deng, Linqi Song

AI总结:

本研究构建了CNER-UAV细粒度中文地址实体识别数据集,包含约12,000条样本,由人类专家和大型语言模型标注,并评估了经典NER模型,探讨了LLM替代人工标注的可行性。

摘要:

我们提出了CNER-UAV,一个专门为无人机投递系统中的地址解析任务设计的细粒度中文命名实体识别数据集。该数据集涵盖五个不同类别,能够支持NER模型的全面训练与评估。为构建此数据集,我们从真实无人机投递系统获取数据,并进行了严格的数据清洗和脱敏处理,以确保隐私和数据完整性。最终数据集包含约12,000条标注样本,由人类专家和大型语言模型共同完成标注。我们在该数据集上评估了经典NER模型,并提供了深入分析。数据集和模型已在https://github.com/zhhvvv/CNER-UAV公开提供。

英文摘要:

We present CNER-UAV, a fine-grained \textbf{C}hinese \textbf{N}ame \textbf{E}ntity \textbf{R}ecognition dataset specifically designed for the task of address resolution in \textbf{U}nmanned \textbf{A}erial \textbf{V}ehicle delivery systems. The dataset encompasses a diverse range of five categories, enabling comprehensive training and evaluation of NER models. To construct this dataset, we sourced the data from a real-world UAV delivery system and conducted a rigorous data cleaning and desensitization process to ensure privacy and data integrity. The resulting dataset, consisting of around 12,000 annotated samples, underwent human experts and \textbf{L}arge \textbf{L}anguage \textbf{M}odel annotation. We evaluated classical NER models on our dataset and provided in-depth analysis. The dataset and models are publicly available at \url{https://github.com/zhhvvv/CNER-UAV}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑