大模型推理能力

Scaling Instruction-Tuned LLMs to Million-Token Contexts via Hierarchical Synthetic Data Generation

Linda He, Jue Wang, Maurice Weber, Shang Zhu, Ben Athiwaratkun, Ce Zhang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 26 pages, 5 figures

A Large-Language Model Framework for Relative Timeline Extraction from PubMed Case Reports

Jing Wang, Jeremy C Weiss

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Journal ref 2025 AMIA Informatics Summit Proceedings, March 10-13, Pittsburgh, PA

VeriMind: Agentic LLM for Automated Verilog Generation with a Novel Evaluation Metric

Bardia Nadimi, Ghali Omar Boutaib, Hao Zheng

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Balancing Rigor and Utility: Mitigating Cognitive Biases in Large Language Models for Multiple-Choice Questions

Hanyang Zhong, Liman Wang, Wenting Cao, Zeyuan Sun

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments This work has been accepted as a full paper at the 2025 Annual Conference of the Cognitive Science Society (CogSci 2025) and will be presented in the form of a poster. The dataset and project website are available at: https://hanyangzhong.github.io/BRU-website/

Reward Generation via Large Vision-Language Model in Offline Reinforcement Learning

Younghwan Lee, Tung M. Luu, Donghoon Lee, Chang D. Yoo

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments 5 pages, ICASSP 2025. First two authors are equally contributed

SortBench: Benchmarking LLMs based on their ability to sort lists

Steffen Herbold

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?

Liqiang Jing, Zhehui Huang, Xiaoyang Wang, Wenlin Yao, Wenhao Yu, Kaixin Ma, Hongming Zhang, Xinya Du, Dong Yu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysis

Haoyang Liu, Shuyu Chen, Ye Zhang, Haohan Wang

专题命中 推理评测 ：self-correction(abstract)；分类 cs.AI、cs.LG

Comments 31 pages, 4 figures

EnrichIndex: Using LLMs to Enrich Retrieval Indices Offline

Peter Baile Chen, Tomer Wolfson, Michael Cafarella, Dan Roth

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments Dataset and code are available at https://peterbaile.github.io/enrichindex/

Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme

Yan Ma, Steffi Chern, Xuyang Shen, Yiran Zhong, Pengfei Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments Code is public and available at: https://github.com/GAIR-NLP/MAYE

CALICO: Part-Focused Semantic Co-Segmentation with Large Vision-Language Models

Kiet A. Nguyen, Adheesh Juvekar, Tianjiao Yu, Muntasir Wahed, Ismini Lourentzou

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments Accepted to CVPR 2025. Project page: https://plan-lab.github.io/calico/

Subversion Strategy Eval: Can language models statelessly strategize to subvert control protocols?

Alex Mallen, Charlie Griffin, Misha Wagner, Alessandro Abate, Buck Shlegeris

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Multi-Meta-RAG: Improving RAG for Multi-Hop Queries using Database Filtering with LLM-Extracted Metadata

Mykhailo Poliakov, Nadiya Shvai

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ICTERI 2024 Posters Track

DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism

Dengchun Li, Naizheng Wang, Zihao Zhang, Haoyang Yin, Lei Duan, Meng Xiao, Mingjie Tang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 22 pages, 7 figures

BEATS: Bias Evaluation and Assessment Test Suite for Large Language Models

Alok Abhishek, Lisa Erickson, Tushar Bandopadhyay

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 32 pages, 33 figures, preprint version

Green MLOps to Green GenOps: An Empirical Study of Energy Consumption in Discriminative and Generative AI Operations

Adrián Sánchez-Mompó, Ioannis Mavromatis, Peizheng Li, Konstantinos Katsaros, Aftab Khan

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments Published to MDPI Information - Artificial Intelligence Section

WinoWhat: A Parallel Corpus of Paraphrased WinoGrande Sentences with Common Sense Categorization

Ine Gevers, Victor De Marez, Luna De Bruyne, Walter Daelemans

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

RGB-Th-Bench: A Dense benchmark for Visual-Thermal Understanding of Vision Language Models

Mehdi Moshtaghi, Siavash H. Khajavi, Joni Pajarinen

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Penrose Tiled Low-Rank Compression and Section-Wise Q&A Fine-Tuning: A General Framework for Domain-Specific Large Language Model Adaptation

Chuan-Wei Kuo, Siyu Chen, Chenqi Yan, Yu Yang Fredrik Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

M-DocSum: Do LVLMs Genuinely Comprehend Interleaved Image-Text in Document Summarization?

Haolong Yan, Kaijun Tan, Yeqing Shen, Xin Huang, Zheng Ge, Xiangyu Zhang, Si Li, Daxin Jiang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Mobile-MMLU: A Mobile Intelligence Language Understanding Benchmark

Sondos Mahmoud Bsharat, Mukul Ranjan, Aidar Myrzakhan, Jiacheng Liu, Bowei Guo, Shengkun Tang, Zhuang Liu, Yuanzhi Li, Zhiqiang Shen

专题命中 推理评测 ：planning(abstract)；分类 cs.CL、cs.AI

Comments An order-invariant and mobile-centric benchmark. Code and data are available at: https://github.com/VILA-Lab/Mobile-MMLU

Advancements in Natural Language Processing: Exploring Transformer-Based Architectures for Text Understanding

Tianhao Wu, Yu Wang, Ngoc Quach

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted by the 5th International Conference on Artificial Intelligence and Industrial Technology Applications (AIITA 2025)

SARGes: Semantically Aligned Reliable Gesture Generation via Intent Chain

Nan Gao, Yihua Bao, Dongdong Weng, Jiayi Zhao, Jia Li, Yan Zhou, Pengfei Wan, Di Zhang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM

Yuqian Yuan, Hang Zhang, Wentong Li, Zesen Cheng, Boqiang Zhang, Long Li, Xin Li, Deli Zhao, Wenqiao Zhang, Yueting Zhuang, Jianke Zhu, Lidong Bing

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments 17 pages, 14 figures, technical report

Adapt-$\infty$: Scalable Continual Multimodal Instruction Tuning via Dynamic Data Selection

Adyasha Maharana, Jaehong Yoon, Tianlong Chen, Mohit Bansal

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments First two authors contributed equally. Code: https://github.com/adymaharana/adapt-inf

Improving Preference Extraction In LLMs By Identifying Latent Knowledge Through Classifying Probes

Sharan Maiya, Yinhong Liu, Ramit Debnath, Anna Korhonen

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments preprint, submitted to ACL ARR 2025, 21 pages, 23 figures

A Modular Dataset to Demonstrate LLM Abstraction Capability

Adam Atanas, Kai Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments 7 pages, 5 figures. Submitted to ACL 2025

Enhancing Trust and Safety in Digital Payments: An LLM-Powered Approach

Devendra Dahiphale, Naveen Madiraju, Justin Lin, Rutvik Karve, Monu Agrawal, Anant Modwal, Ramanan Balakrishnan, Shanay Shah, Govind Kaushal, Priya Mandawat, Prakash Hariramani, Arif Merchant

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 7 figures

Human Preferences for Constructive Interactions in Language Model Alignment

Yara Kyrychenko, Jon Roozenbeek, Brandon Davidson, Sander van der Linden, Ramit Debnath

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 1 Figure, 1 Table, 11 pages

BigO(Bench) -- Can LLMs Generate Code with Controlled Time and Space Complexity?

Pierre Chambon, Baptiste Roziere, Benoit Sagot, Gabriel Synnaeve

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI