大模型推理能力

Diagnosing Memorization in Chain-of-Thought Reasoning, One Token at a Time

Huihan Li, You Chen, Siyuan Wang, Yixin He, Ninareh Mehrabi, Rahul Gupta, Xiang Ren

机构 * University of Southern California（南加州大学） ； University of California, San Diego（加州大学圣地亚哥分校） ； Meta ； Amazon AGI（亚马逊人工智能研究院） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(title,abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Language

Xi Chen, Shuo Wang

机构 * Nanyang Technological University（南洋理工大学） ； University of Macau（澳门大学） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 4 figures, 2 tables

TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendation

Yu Xia, Rui Zhong, Zeyu Song, Wei Yang, Junchen Wan, Qingpeng Cai, Chi Lu, Peng Jiang

专题命中 复杂问题求解 ：chain-of-thought(title)；reasoning(abstract)；CoT(abstract)

ContextualLVLM-Agent: A Holistic Framework for Multi-Turn Visually-Grounded Dialogue and Complex Instruction Following

Seungmin Han, Haeun Kwon, Ji-jun Park, Taeyang Yoon

机构 * Dongguk University（东国大学） 纠错

专题命中 复杂问题求解 ：reasoning(abstract)；planning(abstract)；分类 cs.CL

CRISPR-GPT for Agentic Automation of Gene-editing Experiments

Yuanhao Qu, Kaixuan Huang, Ming Yin, Kanghong Zhan, Dyllan Liu, Di Yin, Henry C. Cousins, William A. Johnson, Xiaotong Wang, Mihir Shah, Russ B. Altman, Denny Zhou, Mengdi Wang, Le Cong

专题命中 复杂问题求解 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments Accepted to Nature Biomedical Engineering

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis

Yufeng Zhao, Junnan Liu, Hongwei Liu, Dongsheng Zhu, Yuan Shen, Songyang Zhang, Kai Chen

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Preprint, working in progress

ADAM: An AI Reasoning and Bioinformatics Model for Alzheimer's Disease Detection and Microbiome-Clinical Data Integration

Ziyuan Huang, Vishaldeep Kaur Sekhon, Roozbeh Sadeghian, Maria L. Vaida, Cynthia Jo, Doyle Ward, Vanni Bucci, John P. Haran

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 12 pages, 7 figures

Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters

Shanbo Cheng, Yu Bao, Qian Cao, Luyang Huang, Liyan Kang, Zhicheng Liu, Yu Lu, Wenhao Zhu, Jingwen Chen, Zhichao Huang, Tao Li, Yifu Li, Huiying Lin, Sitong Liu, Ningxin Peng, Shuaijie She, Lu Xu, Nuo Xu, Sen Yang, Runsheng Yu, Yiming Yu, Liehao Zou, Hang Li, Lu Lu, Yuxuan Wang, Yonghui Wu

机构 * ByteDance（字节跳动） 纠错

专题命中 推理评测 ：reasoning(abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

AURA: A Fine-Grained Benchmark and Decomposed Metric for Audio-Visual Reasoning

Siminfar Samakoush Galougah, Rishie Raj, Sanjoy Chowdhury, Sayan Nag, Ramani Duraiswami

专题命中 推理评测 ：reasoning(title,abstract)

Unveiling Trust in Multimodal Large Language Models: Evaluation, Analysis, and Mitigation

Yichi Zhang, Yao Huang, Yifan Wang, Yitong Sun, Chang Liu, Zhe Zhao, Zhengwei Fang, Huanran Chen, Xiao Yang, Xingxing Wei, Hang Su, Yinpeng Dong, Jun Zhu

机构 * Department of Computer Science and Technology, College of AI, Institute for AI, Tsinghua-Bosch Joint ML Center, THBI Lab, BNRist Center, Tsinghua University（计算机科学与技术系、人工智能学院、人工智能研究所、清华-博世联合机器学习中心、THBI实验室、BNRist中心、清华大学） ； Institute of Artificial Intelligence, Beihang University（人工智能研究院、北航） ； RealAI 纠错

专题命中 推理评测 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL、cs.AI

Comments For Appendix, please refer to arXiv:2406.07057

Self-Supervised Prompt Optimization

Jinyu Xiang, Jiayi Zhang, Zhaoyang Yu, Xinbing Liang, Fengwei Teng, Jinhao Tu, Fashen Ren, Xiangru Tang, Sirui Hong, Chenglin Wu, Yuyu Luo

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine

Maxime Griot, Jean Vanderdonckt, Demet Yuksel, Coralie Hemptinne

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2025 main

StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding

Yanlai Yang, Zhuokai Zhao, Satya Narayan Shukla, Aashu Singh, Shlok Kumar Mishra, Lizhu Zhang, Mengye Ren

机构 * Meta AI ； New York University（纽约大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 15 pages, 3 figures

A Survey on Large Language Model Benchmarks

Shiwen Ni, Guhong Chen, Shuaimin Li, Xuanang Chen, Siyi Li, Bingli Wang, Qiyao Wang, Xingjian Wang, Yifan Zhang, Liyang Fan, Chengming Li, Ruifeng Xu, Le Sun, Min Yang

机构 * Shenzhen Key Laboratory for High Performance Data Mining（深圳高性能数据挖掘重点实验室） ； Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究所） ； Southern University of Science and Technology（南方科技大学） ； University of Chinese Academy of Sciences（中国科学院大学） ； University of Science and Technology of China（中国科学技术大学） ； Shanghai University of Electric Power（上海电力大学） ； Shanghai AI Lab（上海人工智能实验室） ； South China University of Technology（华南理工大学） ； Shenzhen University（深圳大学） ； Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所） ； Shenzhen MSU-BIT University（深圳MSU-BIT大学） ； Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）） ； Shenzhen University of Advanced Technology（深圳大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

TComQA: Extracting Temporal Commonsense from Text

Lekshmi R Nair, Arun Sankar, Koninika Pal

机构 * Indian Institute of Technology（印度理工学院） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Journal ref IRRAG@SIGIR 2025

Explainable Knowledge Distillation for Efficient Medical Image Classification

Aqib Nazir Mir, Danish Raza Rizvi

机构 * Dept. of Computer Engineering（计算机工程系） ； Jamia Millia Islamia（Jamia Millia Islamia大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Cross-Modality Masked Learning for Survival Prediction in ICI Treated NSCLC Patients

Qilong Xing, Zikai Song, Bingxin Gong, Lian Yang, Junqing Yu, Wei Yang

机构 * School of Computer Science and Technology（计算机科学与技术学院） ； Department of Radiology, Union Hospital, Tongji Medical College（放射科、同济医学院附属医院） 纠错

专题命中 推理评测 ：planning(abstract)；分类 cs.AI

Comments MICCAI 2025

Leveraging Large Language Models for Explainable Activity Recognition in Smart Homes: A Critical Evaluation

Michele Fiori, Gabriele Civitarese, Priyankar Choudhary, Claudio Bettini

机构 * EveryWare Lab, Dept. of Computer Science, University of Milan（米兰大学计算机科学系EveryWare实验室） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Pub-Guard-LLM: Detecting Retracted Biomedical Articles with Reliable Explanations

Lihu Chen, Shuojie Fu, Gabriel Freedman, Cemre Zor, Guy Martin, James Kinross, Uddhav Vaghela, Ovidiu Serban, Francesca Toni

机构 * Imperial College London（伦敦帝国学院） ； Amazon Web Services（亚马逊网络服务） ； National Health Service（国家健康服务） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments long paper under review

Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models

Haibo Wang, Zhiyang Xu, Yu Cheng, Shizhe Diao, Yufan Zhou, Yixin Cao, Qifan Wang, Weifeng Ge, Lifu Huang

机构 * University of California, Davis（加州大学戴维斯分校） ； Virginia Tech（弗吉尼亚理工大学） ； The Chinese University of Hong Kong（香港中文大学） ； NVIDIA ； Adobe Research（Adobe研究） ； Fudan University（复旦大学） ； Meta AI 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments Accepted by EMNLP 2025 Findings

Comp-X: On Defining an Interactive Learned Image Compression Paradigm With Expert-driven LLM Agent

Yixin Gao, Xin Li, Xiaohan Pan, Runsen Feng, Bingchen Li, Yunpeng Qi, Yiting Lu, Zhengxue Cheng, Zhibo Chen, Jörn Ostermann

专题命中 推理评测 ：reasoning(abstract)

Translating Images to Road Network: A Sequence-to-Sequence Perspective

Jiachen Lu, Ming Nie, Bozhou Zhang, Reyuan Peng, Xinyue Cai, Hang Xu, Feng Wen, Wei Zhang, Li Zhang

机构 * School of Data Science, Fudan University（复旦大学数据科学学院） ； Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments V1 is the ICCV 2023 conference version, and V2 is the extended version

When and What: Diffusion-Grounded VideoLLM with Entity Aware Segmentation for Long Video Understanding

Pengcheng Fang, Yuxia Chen, Rui Guo

专题命中 其他推理 ：reasoning(abstract)

An Empirical Study on How Video-LLMs Answer Video Questions

Chenhui Gou, Ziyu Ma, Zicheng Duan, Haoyu He, Feng Chen, Akide Liu, Bohan Zhuang, Jianfei Cai, Hamid Rezatofighi

专题命中 其他推理 ：reasoning(abstract)