Timo: Towards Better Temporal Reasoning for Language Models
Institute of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
Zhaochen Su, Jun Zhang, Tong Zhu, Xiaoye Qu, Juntao Li, Min Zhang, Yu Cheng
备注:
This paper has been accepted to the COLM 2024 conference
Reasoning about time is essential for Large Language Models (LLMs) to understand the world. Previous works focus on solving specific tasks, primarily on time-sensitive question answering. While these methods have proven effective, they cannot generalize to a wider spectrum of temporal reasoning tasks. Therefore, we propose a crucial question: Can we build a universal framework to handle a variety of temporal reasoning tasks? To that end, we systematically study 38 temporal reasoning tasks. Based on the observation that 19 tasks are directly related to mathematics, we first leverage the available mathematical dataset to set a solid foundation for temporal reasoning. However, the in-depth study indicates that focusing solely on mathematical enhancement falls short of addressing pure temporal reasoning tasks. To mitigate this limitation, we propose a simple but effective self-critic temporal optimization method to enhance the model's temporal reasoning capabilities without sacrificing general task abilities. Finally, we develop Timo, a model designed to excel in temporal reasoning at the 7B and 13B scales. Notably, Timo outperforms the counterpart LLMs by 10.0 and 7.6 in average accuracy scores and achieves the new state-of-the-art (SOTA) performance of comparable size. Extensive experiments further validate our framework's effectiveness and its generalization across diverse temporal tasks. The code is available at https://github.com/zhaochen0110/Timo.
Temporal-Aware Heterogeneous Graph Reasoning with Multi-View Fusion for Temporal Question Answering
1 School of Internet of Things, Nanjing University of Posts;Telecommunications 2 Faculty of Medicine \& Health, University of New South Wales, Sydney, Australia 3 Dept. of Biomedical Engineering \& Biotechnology, Khalifa University, Abu Dhabi 4 Beijing Information Science;Technology University 5 Shortest Path Technology Co., Ltd.
TIME: A Multi-level Benchmark for Temporal Reasoning of LLMs in Real-World Scenarios
State Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机学院,北京大学);Huawei Noah’s Ark Lab(华为诺亚实验室)
Temporal Knowledge Question Answering via Abstract Reasoning Induction
Laboratory for Big Data and Decision, National University of Defense Technology(国防科技大学大数据与决策实验室);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Getting Sick After Seeing a Doctor? Diagnosing and Mitigating Knowledge Conflicts in Event Temporal Reasoning
Hong Kong University of Science and Technology(香港科技大学);University of Southern California(南加州大学);Tencent AI Lab(腾讯AI实验室);University of California, Davis(加州大学戴维斯分校)
DaMO: A Data-Efficient Multimodal Orchestrator for Temporal Reasoning with Video LLMs
College of Artificial Intelligence, National Yang Ming Chiao Tung University(人工智能学院,阳明交通大学);Institute of Population Health Sciences, National Health Research Institutes(人口健康科学研究所,国家健康研究院);Department of Computer Science, National Yang Ming Chiao Tung University(计算机科学系,阳明交通大学)
Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?
Institute of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Shanghai AI Laboratory(上海人工智能实验室);Huazhong University of Science and Technology(华中科技大学);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学)
A Modular Multitask Reasoning Framework Integrating Spatio-temporal Models and LLMs
College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算机与数据科学学院);Institute for Infocomm Research, A*STAR, Singapore(资讯通信研究院);School of Computer Science and Engineering, Beihang University, China(北京航空航天大学计算机科学与工程学院)
Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models
School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院);School of Computing and Artificial Intelligence, Southwest Jiaotong University(西南交通大学计算机与人工智能学院);School of Information Science and Engineering, Chongqing Jiaotong University(重庆交通大学信息科学与工程学院);School of Information Engineering, Chang’an University(长安大学信息工程学院)
Efficient Test-Time Scaling via Temporal Reasoning Aggregation
School of Computer Science and Engineering, Beihang University(北航计算机科学与工程学院);Qingdao Research Institute, Beihang University(北航青岛研究院);Hangzhou Innovation Institute, Beihang University(北航杭州创新研究院)
From Prompts to Pavement Through Time: Temporal Grounding in Agentic Scene-to-Plan Reasoning
Computer Science & Engineering Department, German University in Cairo (GUC), Egypt(德国亚历山大大学(GUC)计算机科学与工程系,埃及);C-DRiVeS Lab: Cognitive Driving Research in Vehicular Systems, Cairo, Egypt(认知驾驶系统实验室,埃及开罗,C-DRiVeS);M.Eng. Robotics Candidate at Deggendorf Institute of Technology, Germany(德国德格多夫技术学院机器人硕士候选人);IAV GmbH, Berlin, Germany(德国柏林IAV GmbH公司)
When Do LLMs Apply the Wrong Law? Diagnosing LLM Failures in Temporal Legal Reasoning
Institute of Science Tokyo(东京科学大学);Osaka University(大阪大学);NII LLMC(日本信息学研究所语言、语言学与媒体中心);Nara Institute of Science and Technology(奈良科学技术研究所);Center of Juris-Informatics, ROIS-DS(日本学术研究推进机构跨学科科学研究中心法学信息学中心)
TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding
South China University of Technology(华南理工大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室(深圳));Bytedance Inc.(字节跳动有限公司)