Knowledge Graphs (KGs) store human knowledge in the form of entities (nodes) and relations, and are used extensively in various applications. KG embeddings are an effective approach to addressing tasks like knowledge discovery, link prediction, and reasoning. This is often done by allocating and learning embedding tables for all or a subset of the entities. As this scales linearly with the number of entities, learning embedding models in real-world KGs with millions of nodes can be computationally intractable. To address this scalability problem, our model, PathE, only allocates embedding tables for relations (which are typically orders of magnitude fewer than the entities) and requires less than 25% of the parameters of previous parameter efficient methods. Rather than storing entity embeddings, we learn to compute them by leveraging multiple entity-relation paths to contextualise individual entities within triples. Evaluated on four benchmarks, PathE achieves state-of-the-art performance in relation prediction, and remains competitive in link prediction on path-rich KGs while training on consumer-grade hardware. We perform ablation experiments to test our design choices and analyse the sensitivity of the model to key hyper-parameters. PathE is efficient and cost-effective for relationally diverse and well-connected KGs commonly found in real-world applications.
Evolving Beyond Snapshots: Harmonizing Structure and Sequence via Entity State Tuning for Temporal Knowledge Graph Forecasting
Dalian University of Technology(大连理工大学);Shenzhen University of Advanced Technology(深圳先进技术大学);King’s College London(伦敦大学国王学院);Peking University(北京大学);Beijing Institute of Technology(北京理工大学);Shanghai Jiao Tong University(上海交通大学)
本文提出Entity State Tuning框架,通过维持全局状态缓冲区和闭环设计,实现时间知识图谱预测中的持久化和持续进化实体状态,提升长周期预测性能。
Supervised Typing of Big Graphs using Semantic Embeddings
College of William and Mary(威廉与玛丽学院);University of Virginia(弗吉尼亚大学);Eaton Innovation Center(伊顿创新中心);University of Minnesota(明尼苏达大学);Google(谷歌);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Author(作者大学);Authorship Holdings, Ltd.(作者控股有限公司);YetAuthorCo, Inc.(耶特作者公司);University of Umbhali(翁巴利大学);Institute for Clarity in Documentation(文档清晰度研究所);Brookhaven Laboratories(布鲁克海文实验室);NASA Ames Research Center(美国国家航空航天局艾姆斯研究中心);Palmer Research Laboratories(帕尔默研究实验室)
Empowering Locally Deployable Medical Agent via State Enhanced Logical Skills for FHIR-based Clinical Tasks
Department of Computer Science, University of Liverpool(利物浦大学计算机科学系);The Hong Kong Polytechnic University(香港理工大学);Beijing Normal University(北京师范大学);School of Computing, University of Georgia(佐治亚大学计算机学院);Department of Eye and Vision, University of Liverpool(利物浦大学眼科学与视觉系)