arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.04630cs.CL
收藏

映射Web of Science:一个大规模图和文本数据集的LLM嵌入方法

Mapping the Web of Science, a large-scale graph and text-based dataset with LLM embeddings

Tim Kunt Digital Data and Information for Society, Science, and Culture, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany(Zuse Institute Berlin);Annika Buchholz Digital Data and Information for Society, Science, and Culture, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany(Zuse Institute Berlin);Imene Khebouri Digital Data and Information for Society, Science, and Culture, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany(Zuse Institute Berlin);Thorsten Koch Software and Algorithms for Discrete Optimization, Technische Universität Berlin, Straße des 17. Juni 135, 10623 Berlin, Germany Applied Optimization, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany(Technische Universität Berlin, Zuse Institute Berlin);Ida Litzel Digital Data and Information for Society, Science, and Culture, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany(Zuse Institute Berlin);Thi Huong Vu Digital Data and Information for Society, Science, and Culture, Zuse Institute Berlin, Takustr. 7, 14195 Berlin, Germany(Zuse Institute Berlin);Institute of Mathematics, Vietnam Academy of Science and Technology, 10072 Hanoi, Vietnam(Vietnam Academy of Science and Technology)

Tim Kunt, Annika Buchholz, Imene Khebouri, Thorsten Koch, Ida Litzel, Thi Huong Vu

AI总结:

通过LLM嵌入方法研究Web of Science数据集,揭示文本的自我结构化景观。

摘要:

大规模文本数据集,如出版物、网站和其他基于文本的媒体,继承了两种不同的特征类型:(1)文本本身,其通过语义传达的信息,以及(2)与其他文本之间的关系,通过链接、引用或共享属性。后者可以描述为图结构,并可以通过一系列已建立的算法进行分类和预测,而前者最近通过使用LLM嵌入模型获得了新的潜力。通过我们的所提出的嵌入方法,我们研究了包含约5600万篇科学出版物的Web of Science数据集,揭示了文本的自我结构化景观。

英文摘要:

Large text data sets, such as publications, websites, and other text-based media, inherit two distinct types of features: (1) the text itself, its information conveyed through semantics, and (2) its relationship to other texts through links, references, or shared attributes. While the latter can be described as a graph structure and can be handled by a range of established algorithms for classification and prediction, the former has recently gained new potential through the use of LLM embedding models. Demonstrating these possibilities and their practicability, we investigate the Web of Science dataset, containing ~56 million scientific publications through the lens of our proposed embedding method, revealing a self-structured landscape of texts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑