Temporal knowledge graphs (TKGs) have been identified as a promising approach to represent the dynamics of facts along the timeline. The extrapolation of TKG is to predict unknowable facts happening in the future, holding significant practical value across diverse fields. Most extrapolation studies in TKGs focus on modeling global historical fact repeating and cyclic patterns, as well as local historical adjacent fact evolution patterns, showing promising performance in predicting future unknown facts. Yet, existing methods still face two major challenges: (1) They usually neglect the importance of historical information in KG snapshots related to the queries when encoding the local and global historical information; (2) They exhibit weak anti-noise capabilities, which hinders their performance when the inputs are contaminated with noise.To this end, we propose a novel \blue{Lo}cal-\blue{g}lobal history-aware \blue{C}ontrastive \blue{L}earning model (\blue{LogCL}) for TKG reasoning, which adopts contrastive learning to better guide the fusion of local and global historical information and enhance the ability to resist interference. Specifically, for the first challenge, LogCL proposes an entity-aware attention mechanism applied to the local and global historical facts encoder, which captures the key historical information related to queries. For the latter issue, LogCL designs four historical query contrast patterns, effectively improving the robustness of the model. The experimental results on four benchmark datasets demonstrate that LogCL delivers better and more robust performance than the state-of-the-art baselines.
AMCEN: An Attention Masking-based Contrastive Event Network for Two-stage Temporal Knowledge Graph Reasoning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Anhui University(安徽大学);Qingdao Academy of Intelligent Industries(青岛智能产业技术研究院);Zhejiang Lab(之江实验室)
Temporal Inductive Path Neural Network for Temporal Knowledge Graph Reasoning
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);University of Macau(澳门大学)
DIRCR: Dual-Inference Rule-Contrastive Reasoning for Solving RAVENs
School of Computer Science, University of Nottingham Ningbo China, China(诺丁汉大学宁波校区计算机科学学院);Nottingham Ningbo China Beacons of Excellence Research and Innovation Institute, China(诺丁汉宁波中国卓越研究与创新研究所);School of Artificial Intelligence, Shenzhen University, China(深圳大学人工智能学院)
NumCoKE: Ordinal-Aware Numerical Reasoning over Knowledge Graphs with Mixture-of-Experts and Contrastive Learning
State Key Laboratory of Cyberspace Security Defense(网络空间安全防御国家重点实验室);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Department of Information Science, Tsinghua University(清华大学信息学院)
Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations
School of Computer Science, University of Nottingham Ningbo China(诺丁汉大学宁波校区计算机科学学院);Institute of Biomedical Engineering, Ningbo institute of materials technology and engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所生物医学工程研究所);School of Electrical & Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院)
Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
Idiap Research Institute(Idiap研究机构);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);National Biomarker Centre (NBC), CRUK Manchester Institute(国家生物标志物中心(NBC),CRUK曼彻斯特研究所)
Language Models Can See Better: Visual Contrastive Decoding For LLM Multimodal Reasoning
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);University of California, Santa Cruz(加州大学圣克鲁兹分校)
Plausibility Is Not Prediction: Contrastive Evidence for LLM-Based Cellular Perturbation Reasoning
Mila - Québec AI Institute(魁北克人工智能研究所);University of Montréal(蒙特利尔大学);HEC Montréal(蒙特利尔HEC商学院);University of Ottawa(渥太华大学);National Research Council of Canada(加拿大国家研究理事会);CIFAR AI Chair(CIFAR人工智能 chair)
CLIPO: Contrastive Learning in Policy Optimization Generalizes RLVR
Qwen Large Model Application Team, Alibaba Institute of Automation, Chinese Academy of Sciences(文勤大模型应用团队,阿里巴巴自动化研究所,中国科学院);Qwen Large Model Application Team, Alibaba(文勤大模型应用团队,阿里巴巴)
Interpretable Contrastive Monte Carlo Tree Search Reasoning
The University of Sydney(悉尼大学);Peking University(北京大学);Xiaohongshu Inc.(小红书公司);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua University(清华大学);The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))