语言大模型 / LLM - arXivDaily 专题

2508.19475 2025-09-30 cs.CL cs.AI 90%

Automatic Question & Answer Generation Using Generative Large Language Model (LLM)

Md. Alvee Ehsan, A. S. M Mehedi Hasan, Kefaya Benta Shahnoor, Syeda Sumaiya Tasneem

专题命中评测与基准：LLM(title,abstract)；large language model(title)；language model(title)；分类 cs.CL、cs.AI

2501.13958 2025-09-30 cs.CL cs.AI cs.IR 90%

A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models

Qinggang Zhang, Shengyuan Chen, Yuanchen Bei, Zheng Yuan, Huachi Zhou, Zijin Hong, Hao Chen, Yilin Xiao, Chuang Zhou, Junnan Dong, Yi Chang, Xiao Huang

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2501.05601 2025-09-30 cs.CL cs.LG cs.SE 90%

Exploring Large Language Models for Translating Romanian Computational Problems into English

Adrian Marius Dumitran, Adrian-Catalin Badea, Stefan-Gabriel Muscalu, Angela-Liliana Dumitran, Stefan-Cosmin Dascalescu, Radu-Sebastian Amarie

机构 * University of Bucharest（布加勒斯特大学）； Softbinator ； UiPath ； It Just Works Inc. ； QPillars

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 12 pages

2509.23350 2025-09-30 cs.SD cs.AI 89%

ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following

Jiahao Zhao, Yunjia Li, Wei Li, Kazuyoshi Yoshii

机构 * Graduate School of Informatics, Kyoto University, Japan（京都大学信息科学研究生院）； College of Computer Science and Artificial Intelligence, Fudan University, China（复旦大学计算机科学与人工智能学院）； Graduate School of Engineering, Kyoto University, Japan（京都大学工学研究科）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2509.23061 2025-09-30 cs.PL cs.AI 89%

Local Success Does Not Compose: Benchmarking Large Language Models for Compositional Formal Verification

Xu Xu, Xin Li, Xingwei Qu, Jie Fu, Binhang Yuan

机构 * Shanghai AI Lab（上海人工智能实验室）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2509.23970 2025-09-30 cs.CR 89%

Binary Diff Summarization using Large Language Models

Meet Udeshi, Venkata Sai Charan Putrevu, Prashanth Krishnamurthy, Prashant Anantharaman, Sean Carrick, Ramesh Karri, Farshad Khorrami

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

2509.22703 2025-09-30 cs.CL cs.AI cs.CY 88%

AccessEval: Benchmarking Disability Bias in Large Language Models

Srikant Panda, Amit Agarwal, Hitesh Laxmichand Patel

机构 * Oracle AI

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2509.24888 2025-09-30 cs.CV cs.CL 88%

MMRQA: Signal-Enhanced Multimodal Large Language Models for MRI Quality Assessment

Fankai Jia, Daisong Gan, Zhe Zhang, Zhaochi Wen, Chenchen Dan, Dong Liang, Haifeng Wang

机构 * Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究院，中国科学院）； University of Chinese Academy of Sciences（中国科学院大学）； ShanghaiTech University（上海理工大学）； Southern University of Science and Technology（南方科技大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2509.23579 2025-09-30 cs.CL 88%

Jackal: A Real-World Execution-Based Benchmark Evaluating Large Language Models on Text-to-JQL Tasks

Kevin Frank, Anmol Gulati, Elias Lumer, Sindy Campagna, Vamse Kumar Subbiah

机构 * PricewaterhouseCoopers（普华永道）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 17 pages

2506.02648 2025-09-30 cs.AI 88%

Truly Assessing Fluid Intelligence of Large Language Models through Dynamic Reasoning Evaluation

Yue Yang, MingKang Chen, Qihua Liu, Mengkang Hu, Qiguang Chen, Gengrui Zhang, Shuyue Hu, Guangtao Zhai, Yu Qiao, Yu Wang, Wenqi Shao, Ping Luo

机构 * Shanghai Jiao Tong University（上海交通大学）； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； Harbin Institute of Technology（哈尔滨工业大学）； The University of Hong Kong（香港大学）

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2509.24782 2025-09-30 cs.SE 88%

Large language models for behavioral modeling: A literature survey

Muhammad Laiq

专题命中评测与基准：large language model(title,abstract)；language model(title,abstract)

Comments 9 pages

2410.22376 2025-09-30 cs.LG cs.AI cs.CL cs.CV 87%

Rare-to-Frequent: Unlocking Compositional Generation Power of Diffusion Models on Rare Concepts with LLM Guidance

Dongmin Park, Sebin Kim, Taehong Moon, Minkyu Kim, Kangwook Lee, Jaewoong Cho

机构 * KRAFTON ； Seoul National University（首尔国立大学）； University of Wisconsin-Madison（威斯康星大学麦迪逊分校）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2025 (spotlight)

2411.16594 2025-09-30 cs.AI cs.CL 86%

From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge

Dawei Li, Bohan Jiang, Liangjie Huang, Alimohammad Beigi, Chengshuai Zhao, Zhen Tan, Amrita Bhattacharjee, Yuxuan Jiang, Canyu Chen, Tianhao Wu, Kai Shu, Lu Cheng, Huan Liu

机构 * Arizona State University（亚利桑那州立大学）； University of Illinois Chicago（伊利诺伊大学芝加哥分校）； University of Maryland, Baltimore County（马里兰大学巴尔的摩县分校）； Northwestern University（西北大学）； University of California, Berkeley（加州大学伯克利分校）； Emory University（埃默里大学）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2025

2509.23515 2025-09-30 cs.CL cs.AI 86%

From Human Annotation to Automation: LLM-in-the-Loop Active Learning for Arabic Sentiment Analysis

Dania Refai, Alaa Dalaq, Doaa Dalaq, Irfan Ahmad

机构 * Information and Computer Science Department, KFUPM, Dhahran 31261, Saudi Arabia（信息与计算机科学系，KFUPM，沙特阿拉伯达哈兰）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2509.22715 2025-09-30 cs.CL cs.AI 86%

TRUEBench: Can LLM Response Meet Real-world Constraints as Productivity Assistant?

Jiho Park, Jongyoon Song, Minjin Choi, Kyuho Heo, Taehun Huh, Ji Won Kim

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2025 Findings

2509.25154 2025-09-30 cs.AI 85%

Who's Your Judge? On the Detectability of LLM-Generated Judgments

Dawei Li, Zhen Tan, Chengshuai Zhao, Bohan Jiang, Baixiang Huang, Pingchuan Ma, Abdullah Alnaibari, Kai Shu, Huan Liu

机构 * Arizona State University（亚利桑那州立大学）； Emory University（埃默里大学）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Under review

2507.04952 2025-09-30 cs.CL cs.SE 85%

ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation

Chenchen Zhang, Yuhang Li, Can Xu, Jiaheng Liu, Ao Liu, Changzhi Zhou, Ken Deng, Dengpeng Wu, Guanhua Huang, Kejiao Li, Qi Yi, Ruibin Xiong, Shihui Hu, Yue Zhang, Yuhao Jiang, Zenan Xu, Yuanxing Zhang, Wiggin Zhou, Chayse Zhou, Fengzong Lian

机构 * Tencent Hunyuan Team（腾讯文脉团队）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2509.23510 2025-09-30 cs.AI 85%

Model Consistency as a Cheap yet Predictive Proxy for LLM Elo Scores

Ashwin Ramaswamy, Nestor Demeure, Ermal Rrapaj

机构 * Lawrence Berkeley National Laboratory（劳伦斯伯克利国家实验室）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2509.24706 2025-09-30 cs.RO 85%

LLM-Handover:Exploiting LLMs for Task-Oriented Robot-Human Handovers

Andreea Tulbure, Rene Zurbruegg, Timm Grigat, Marco Hutter

机构 * Robotics System Lab, ETH Zürich（机器人系统实验室，苏黎世联邦理工学院）

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted to IEEE Robotics and Automation Letters (RA-L)

2509.24678 2025-09-30 cs.CL cs.AI cs.LG 85%

Reference-Free Rating of LLM Responses via Latent Information

Leander Girrbach, Chi-Ping Su, Tankred Saanum, Richard Socher, Eric Schulz, Zeynep Akata

机构 * Technical University of Munich, Munich Center for Machine Learning, MDSI（慕尼黑技术大学，慕尼黑机器学习中心，MDSI）； National Yang Ming Chiao Tung University（阳明交通大学）； Helmholtz Munich（海德堡慕尼黑研究所）； Harvard University（哈佛大学）

专题命中评测与基准：LLM(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 21 pages

2509.24507 2025-09-30 cs.SE 85%

SemGuard: Real-Time Semantic Evaluator for Correcting LLM-Generated Code

Qinglin Wang, Zhihong Sun, Ruyun Wang, Tao Huang, Zhi Jin, Ge Li, Chen Lyu

专题命中评测与基准：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by the 40th IEEE/ACM Automated Software Engineering Conference (ASE 2025)

2509.23517 2025-09-30 cs.CV cs.AI 84%

Evaluating point-light biological motion in multimodal large language models

Akila Kadambi, Marco Iacoboni, Lisa Aziz-Zadeh, Srini Narayanan

机构 * Psychiatry and Biobehavioral Sciences, UCLA（乌尔拉克大学精神病学与生物行为科学系）； Brain and Creativity Institute, USC（美国大学脑与创造力研究所）； Google DeepMind, Zurich（谷歌深度Mind瑞士分公司）

专题命中评测与基准：large language model(title)；language model(title)；分类 cs.AI

2503.09598 2025-09-30 cs.CL cs.AI cs.CY 84%

How to Protect Yourself from 5G Radiation? Investigating LLM Responses to Implicit Misinformation

Ruohao Guo, Wei Xu, Alan Ritter

机构 * Georgia Institute of Technology（佐治亚理工学院）

专题命中评测与基准：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2025 main conference

2509.23417 2025-09-30 cs.CL cs.AI 84%

Retrieval-Constrained Decoding Reveals Underestimated Parametric Knowledge in Language Models

Rajaa El Hamdani, Samy Haffoudhi, Nils Holzenberger, Fabian Suchanek, Thomas Bonald, Fragkiskos D. Malliaros

机构 * Télécom Paris, Institut Polytechnique de Paris（巴黎电信学院，巴黎理工学院）； Université Paris-Saclay, CentraleSupélec, Inria（巴黎萨克雷大学，中央理工-SUPÉLEC，Inria）

专题命中评测与基准：language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2505.17127 2025-09-30 cs.CV cs.LG 83%

Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts

Michal Golovanevsky, William Rudman, Michael Lepori, Amir Bar, Ritambhara Singh, Carsten Eickhoff

机构 * Brown University（布朗大学）； Tel Aviv University（特拉维夫大学）； University of Tübingen（图宾根大学）

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；分类 cs.LG

2504.04740 2025-09-30 cs.CV cs.AI 83%

SCRAMBLe : Enhancing Multimodal LLM Compositionality with Synthetic Preference Data

Samarth Mishra, Kate Saenko, Venkatesh Saligrama

机构 * Boston University（波士顿大学）

专题命中评测与基准：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments ICCV 2025 Findings

2403.02910 2025-09-30 cs.CV cs.AI 83%

ImgTrojan: Jailbreaking Vision-Language Models with ONE Image

Xijia Tao, Shuai Zhong, Lei Li, Qi Liu, Lingpeng Kong

机构 * The University of Hong Kong（香港大学）

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；分类 cs.AI

2509.23827 2025-09-30 cs.CV cs.LG 83%

Assessing Visual Privacy Risks in Multimodal AI: A Novel Taxonomy-Grounded Evaluation of Vision-Language Models

Efthymios Tsaprazlis, Tiantian Feng, Anil Ramakrishna, Rahul Gupta, Shrikanth Narayanan

机构 * University of Southern California（南加州大学）； Amazon AGI（亚马逊人工智能实验室）

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；分类 cs.LG

2509.23805 2025-09-30 cs.CL 83%

Open-DeBias: Toward Mitigating Open-Set Bias in Language Models

Arti Rani, Shweta Singh, Nihar Ranjan Sahoo, Gaurav Kumar Nayak

机构 * Mehta Family School of DS & AI, Indian Institute of Technology Roorkee（梅hta家庭数据科学与人工智能学院，印度理工学院罗里克分校）； Computer Science and Engineering, Indian Institute of Technology Bombay（计算机科学与工程，印度理工学院孟买分校）

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 25 pages, 3 figures, supplementary material included. To be published in EMNLP-2025

2509.23088 2025-09-30 cs.CL 83%

The Geometry of Creative Variability: How Credal Sets Expose Calibration Gaps in Language Models

Esteban Garces Arias, Julian Rodemann, Christian Heumann

机构 * Department of Statistics, LMU Munich（统计系，慕尼黑大学）； Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）； CISPA Helmholtz Center for Information Security（信息安全赫尔姆霍兹研究中心）

专题命中评测与基准：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Accepted at the 2nd UncertaiNLP Workshop @ EMNLP 2025

1. 评测与基准 114 篇

Automatic Question & Answer Generation Using Generative Large Language Model (LLM)

A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models

Exploring Large Language Models for Translating Romanian Computational Problems into English

ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following

Local Success Does Not Compose: Benchmarking Large Language Models for Compositional Formal Verification

Binary Diff Summarization using Large Language Models

AccessEval: Benchmarking Disability Bias in Large Language Models

MMRQA: Signal-Enhanced Multimodal Large Language Models for MRI Quality Assessment

Jackal: A Real-World Execution-Based Benchmark Evaluating Large Language Models on Text-to-JQL Tasks

Truly Assessing Fluid Intelligence of Large Language Models through Dynamic Reasoning Evaluation

Large language models for behavioral modeling: A literature survey

Rare-to-Frequent: Unlocking Compositional Generation Power of Diffusion Models on Rare Concepts with LLM Guidance

From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge

From Human Annotation to Automation: LLM-in-the-Loop Active Learning for Arabic Sentiment Analysis

TRUEBench: Can LLM Response Meet Real-world Constraints as Productivity Assistant?

Who's Your Judge? On the Detectability of LLM-Generated Judgments

ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation

Model Consistency as a Cheap yet Predictive Proxy for LLM Elo Scores

LLM-Handover:Exploiting LLMs for Task-Oriented Robot-Human Handovers

Reference-Free Rating of LLM Responses via Latent Information

SemGuard: Real-Time Semantic Evaluator for Correcting LLM-Generated Code

Evaluating point-light biological motion in multimodal large language models

How to Protect Yourself from 5G Radiation? Investigating LLM Responses to Implicit Misinformation

Retrieval-Constrained Decoding Reveals Underestimated Parametric Knowledge in Language Models

Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts

SCRAMBLe : Enhancing Multimodal LLM Compositionality with Synthetic Preference Data

ImgTrojan: Jailbreaking Vision-Language Models with ONE Image

Assessing Visual Privacy Risks in Multimodal AI: A Novel Taxonomy-Grounded Evaluation of Vision-Language Models

Open-DeBias: Toward Mitigating Open-Set Bias in Language Models

The Geometry of Creative Variability: How Credal Sets Expose Calibration Gaps in Language Models