PhysBERT:一种面向物理科学文献的文本嵌入模型
PhysBERT: A Text Embedding Model for Physics Scientific Literature
AI总结:
针对物理领域专业内容给NLP信息提取带来的挑战,研究推出首个物理专属文本嵌入模型PhysBERT,经大规模物理文献预训练和监督数据微调,在物理相关任务上性能超越通用模型。
摘要:
物理学领域的专业语言与复杂概念,给自然语言处理(NLP)的信息提取工作带来了巨大挑战。文本嵌入模型是高效NLP应用的核心,它将文本转换为稠密向量表示,以实现高效的信息检索与语义分析。本研究推出了PhysBERT,这是首个专门面向物理学的文本嵌入模型。该模型在经筛选的120万篇arXiv物理论文语料上进行预训练,并通过监督数据微调,在包括特定物理子领域微调有效性在内的物理学专属任务上,表现优于主流通用模型。
英文摘要:
The specialized language and complex concepts in physics pose significant challenges for information extraction through Natural Language Processing (NLP). Central to effective NLP applications is the text embedding model, which converts text into dense vector representations for efficient information retrieval and semantic analysis. In this work, we introduce PhysBERT, the first physics-specific text embedding model. Pre-trained on a curated corpus of 1.2 million arXiv physics papers and fine-tuned with supervised data, PhysBERT outperforms leading general-purpose models on physics-specific tasks including the effectiveness in fine-tuning for specific physics subdomains.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。