Diachronic word embeddings -- vector representations of words over time -- offer remarkable insights into the evolution of language and provide a tool for quantifying sociocultural change from text documents. Prior work has used such embeddings to identify shifts in the meaning of individual words. However, simply knowing that a word has changed in meaning is insufficient to identify the instances of word usage that convey the historical or the newer meaning. In this paper, we link diachronic word embeddings to documents, by situating those documents as leaders or laggards with respect to ongoing semantic changes. Specifically, we propose a novel method to quantify the degree of semantic progressiveness in each word usage, and then show how these usages can be aggregated to obtain scores for each document. We analyze two large collections of documents, representing legal opinions and scientific articles. Documents that are scored as semantically progressive receive a larger number of citations, indicating that they are especially influential. Our work thus provides a new technique for identifying lexical semantic leaders and demonstrates a new link between progressive use of language and influence in a citation network.
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Allen Institute for Artificial Intelligence(艾伦人工智能研究所);Paul G. Allen School of Computer Science & Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院)
Learning Neural Textual Representations for Citation Recommendation
University of Technology Sydney(悉尼科技大学);VNU University of Engineering and Technology, Vietnam National University, Hanoi(河内越南国家大学工程技术大学);Rozetta Institute(Rozetta研究所)
When Large Language Models Meet Citation: A Survey
Macquarie University(麦考瑞大学);Wuhan University(武汉大学);Nanyang Technological University(南洋理工大学);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织Data61);University of New South Wales(新南威尔士大学);The University of Adelaide(阿德莱德大学)
Evaluating Document Representations for Content-based Legal Literature Recommendations
Open Legal Data(开放法律数据);German Research Center for Artificial Intelligence(德国人工智能研究中心);ETH Zurich(苏黎世联邦理工学院);University of Wuppertal(伍珀塔尔大学)
推荐系统帮助法律专业人士找到相关文献来支持他们的案件。尽管它的重要性的专业,法律应用并没有反映在推荐系统和表示学习研究的最新进展。同时,法律推荐系统通常在没有任何公共基准数据集的情况下在小规模用户研究中进行评估。因此,这些研究的重现性有限。为了解决研究与实践之间的差距,我们探索了一套国家的最先进的文件表示方法检索语义相关的美国判例法的任务。我们评估基于文本的(例如,fastText、Transformers)、基于引用的(例如,DeepWalk,Poincaré)和混合方法。我们使用两种银标准对2,964份文件进行了注释,共比较了27种方法。银标准是从Open Case Book和Wikispecies新创建的,可以在开放许可下重复使用,以促进可重复性。我们的实验表明,来自平均fastText单词向量(在法律语料库上训练)的文档表示产生了最好的结果,紧随其后的是庞加莱引用嵌入。以混合方式组合fastText和Poincaré进一步改善了整体结果。除了整体性能外,我们还根据文档长度,引用计数和建议的覆盖范围分析了这些方法。我们在https://github.com/malteos/legal-document-similarity/上公开我们的源代码、模型和数据集。
Towards Verifiable Text Generation with Evolving Memory and Self-Reflection
State Key Laboratory of General Artificial Intelligence, Peking University(北京大学通用人工智能国家重点实验室);School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);Chinese Academy of Sciences(中国科学院);Beijing Institute of Technology(北京理工大学);Baidu Inc(百度公司)
A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models
American Express(美国运通);Singapore Decision Science Center of Excellence, American Express(美国运通新加坡决策科学卓越中心);Global Decision Science, American Express(美国运通全球决策科学部)