arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.18463cs.CL
收藏

生物医学三元组抽取中的大型语言模型基准测试

Benchingmaking Large Langage Models in Biomedical Triple Extraction

University of Minnesota Twin Cities(明尼苏达大学双城分校)

Mingchen Li, Huixue Zhou, Rui Zhang

AI总结:

针对生物医学三元组抽取领域LLM应用探索不足及缺乏高质量数据集的问题,本文比较了多种LLM的性能,并提出了涵盖更广泛关系类型的专家标注数据集GIT。

摘要:

生物医学三元组抽取系统旨在自动提取生物医学实体及实体间的关系。将大型语言模型(LLM)应用于三元组抽取的探索仍相对不足。在本研究中,我们主要关注句子级别的生物医学三元组抽取。此外,缺乏高质量的生物医学三元组抽取数据集阻碍了开发稳健三元组抽取系统的进展。为了应对这些挑战,我们首先比较了各种大型语言模型的性能。此外,我们提出了GIT,这是一个专家标注的生物医学三元组抽取数据集,涵盖了更广泛的关系类型。

英文摘要:

Biomedical triple extraction systems aim to automatically extract biomedical entities and relations between entities. The exploration of applying large language models (LLM) to triple extraction is still relatively unexplored. In this work, we mainly focus on sentence-level biomedical triple extraction. Furthermore, the absence of a high-quality biomedical triple extraction dataset impedes the progress in developing robust triple extraction systems. To address these challenges, initially, we compare the performance of various large language models. Additionally, we present GIT, an expert-annotated biomedical triple extraction dataset that covers a wider range of relation types.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑