Enhancing Temporal Awareness in LLMs for Temporal Point Processes
School of Computer Science and Technology, Tongji University, Shanghai 201804, China(计算机科学与技术学院,同济大学);College of Cyber Security, Jinan University, Guangzhou 510632, China(网络安全学院,暨南大学);Department of Computer Science, University of Illinois Chicago, Chicago, USA(计算机科学系,伊利诺伊大学芝加哥分校)
Lili Chen, Wensheng Gan, Shuang Liang, Philip S. Yu
Temporal point processes (TPPs) are crucial for analyzing events over time and are widely used in fields such as finance, healthcare, and social systems. These processes are particularly valuable for understanding how events unfold over time, accounting for their irregularity and dependencies. Despite the success of large language models (LLMs) in sequence modeling, applying them to temporal point processes remains challenging. A key issue is that current methods struggle to effectively capture the complex interaction between temporal information and semantic context, which is vital for accurate event modeling. In this context, we introduce TPP-TAL (Temporal Point Processes with Enhanced Temporal Awareness in LLMs), a novel plug-and-play framework designed to enhance temporal reasoning within LLMs. Rather than using the conventional method of simply concatenating event time and type embeddings, TPP-TAL explicitly aligns temporal dynamics with contextual semantics before feeding this information into the LLM. This alignment allows the model to better perceive temporal dependencies and long-range interactions between events and their surrounding contexts. Through comprehensive experiments on several benchmark datasets, it is shown that TPP-TAL delivers substantial improvements in temporal likelihood estimation and event prediction accuracy, highlighting the importance of enhancing temporal awareness in LLMs for continuous-time event modeling. The code is made available at https://github.com/chenlilil/TPP-TAL
University of Cambridge(剑桥大学);ELLIS Institute Tübingen(ELLIS研究所图宾根);MPI-IS(马克斯·普朗克智能系统研究所);Tübingen AI Center(图宾根人工智能中心);Mila(Mila魁北克人工智能研究所);University of Montreal(蒙特利尔大学)
Enhancing the Medical Context-Awareness Ability of LLMs via Multifaceted Self-Refinement Learning
Department of Electronic Engineering, Tsinghua University(清华大学电子工程系);Huawei Noah’s Ark Lab(华为诺亚实验室);College of AI, Tsinghua University(清华大学人工智能学院);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心)
Factual Self-Awareness in Language Models: Representation, Robustness, and Scaling
Ubiquitous Knowledge Processing Lab (UKP Lab)(通用知识处理实验室);Department of Computer Science(计算机科学系);Hessian Center for AI (hessian.AI)(黑森人工智能中心);Technical University of Darmstadt(达姆施塔特技术大学)
Cognitively Layered Data Synthesis for Domain Adaptation of LLMs to Space Situational Awareness
Qian Xuesen Laboratory of Space Technology(钱学森空间技术实验室);China Academy of Space Technology(中国航天科技研究院);State Key Laboratory of Space Information System and Integrated Application(空间信息系统与集成应用国家重点实验室)
Evaluation Awareness Scales Predictably in Open-Weights Large Language Models
Independent(独立研究者);UC Irvine(加州大学尔湾分校);University of Waterloo(滑铁卢大学);UW Madison(威斯康星大学麦迪逊分校);University of Toronto(多伦多大学);Algoverse(Algoverse公司);META;University of Maryland(马里兰大学)
Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs
Renmin University of China(中国人民大学);Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Chinese University of Hong Kong(香港中文大学);Johns Hopkins University(约翰霍普金斯大学);Hong Kong University of Science and Technology(香港科技大学);Tencent(腾讯)
CIAware-Bench: Benchmarking Control Intervention Awareness Across Frontier LLMs
MATS;Mila – Quebec AI Institute(Mila – 魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Astra Fellowship;ELLIS Institute Tübingen, MPI for Intelligent Systems & Tübingen AI Center;LawZero;Google DeepMind(谷歌DeepMind)
FastMem: Fast Memorization of Prompt Improves Context Awareness of Large Language Models
KU Leuven(KU Leuven(天主教鲁汶大学));University of Science and Technology of China(中国科学技术大学);Institute for Advanced Algorithms Research, Shanghai(上海高级算法研究院);National University of Singapore(新加坡国立大学)
Evaluating and Improving Cultural Awareness of Reward Models for LLM Alignment
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China(计算与智能研究所,哈尔滨工业大学,深圳,中国);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国)
Adaptive Pruning for Large Language Models with Structural Importance Awareness
Harbin Engineering University(哈尔滨工程大学);Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen)(深圳未来网络智能研究院(香港中文大学(深圳)));The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Nanyang Technological University(南洋理工大学)