语言大模型 / LLM

A Comprehensive Survey of Contamination Detection Methods in Large Language Models

Mathieu Ravaut, Bosheng Ding, Fangkai Jiao, Hailin Chen, Xingxuan Li, Ruochen Zhao, Chengwei Qin, Caiming Xiong, Shafiq Joty

机构 * Nanyang Technological University（南洋理工大学） ； Institute of Infocomm Research (I2R), A*STAR（信息通信研究所（I2R），A*STAR） ； Salesforce Research（Salesforce研究） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by TMLR in July 2025. 18 pages, 1 figure, 3 tables

Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models

Sangwon Hyun, Shaukat Ali, M. Ali Babar

机构 * The University of Adelaide（阿德莱德大学） ； Simula Research Laboratory（Simula研究实验室） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Application and Evaluation of Large Language Models for Forecasting the Impact of Traffic Incidents

George Jagadeesh, Srikrishna Iyer, Michal Polanowski, Kai Xin Thia

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments This paper has been accepted for publication at the 2025 IEEE 28th International Conference on Intelligent Transportation Systems (ITSC), Gold Coast, Australia, 2025. Copyright IEEE

Performance Evaluation of General Purpose Large Language Models for Basic Linear Algebra Subprograms Code Generation

Daichi Mukunoki, Shun-ichiro Hayashi, Tetsuya Hoshino, Takahiro Katagiri

机构 * Information Technology Center\ University Nagoya, Aichi 466-8601 Email ； Graduate School of Informatics\ University Nagoya, Aichi 466-8601 Email 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 8 pages, 6 tables

PHEONA: An Evaluation Framework for Large Language Model-based Approaches to Computational Phenotyping

Sarah Pungitore, Shashank Yadav, Vignesh Subbian

机构 * Program in Applied Mathematics, The University of Arizona（应用数学项目，亚利桑那大学） ； College of Engineering, The University of Arizona（工程学院，亚利桑那大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 2 figures, 5 tables, accepted at 2025 AMIA Annual Symposium

ChatGPT is not A Man but Das Man: Representativeness and Structural Consistency of Silicon Samples Generated by Large Language Models

Dai Li, Linzhuo Li, Huilian Sophie Qiu

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Autoformalization in the Era of Large Language Models: A Survey

Ke Weng, Lun Du, Sirui Li, Wangyue Lu, Haozhe Sun, Hengyu Liu, Tiancheng Zhang

机构 * Northeastern University（东北大学） ； Ant Research Institute, Ant Group（蚂蚁集团研究院） ； Department of Computer Science, Aalborg University（奥尔堡大学计算机科学系） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

VERBA: Verbalizing Model Differences Using Large Language Models

Shravan Doda, Shashidhar Reddy Javaji, Zining Zhu

机构 * Stevens Institute of Technology（史蒂文斯理工学院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Leveraging Large Language Models for Spontaneous Speech-Based Suicide Risk Detection

Yifan Gao, Jiao Fu, Long Guo, Hong Liu

机构 * College of Computer Science（计算机科学学院） ； National Key Laboratory of Fundamental Science on Synthetic Vision（合成视觉基础科学国家重点实验室） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to Interspeech 2025

How large language models judge and influence human cooperation

Alexandre S. Pires, Laurens Samson, Sennay Ghebreab, Fernando P. Santos

机构 * Institute of Informatics（信息学院） ； University of Amsterdam（阿姆斯特丹大学） ； City of Amsterdam（阿姆斯特丹市） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Software Engineering for Large Language Models: Research Status, Challenges and the Road Ahead

Hongzhou Rao, Yanjie Zhao, Xinyi Hou, Shenao Wang, Haoyu Wang

机构 * Huazhong University of Science and Technology（华中科技大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

On Recipe Memorization and Creativity in Large Language Models: Is Your Model a Creative Cook, a Bad Cook, or Merely a Plagiator?

Jan Kvapil, Martin Fajcik

机构 * Brno University of Technology（布拉格技术大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 13 pages, 5 figures

A Survey of Large Language Models in Psychotherapy: Current Landscape and Future Directions

Hongbin Na, Yining Hua, Zimu Wang, Tao Shen, Beibei Yu, Lilin Wang, Wei Wang, John Torous, Ling Chen

机构 * Australian Artificial Intelligence Institute（澳大利亚人工智能研究所） ； University of Technology Sydney（悉尼科技大学） ； Harvard University（哈佛大学） ； Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学） ； University of Pennsylvania（宾夕法尼亚大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by ACL 2025 Findings

Structuralist Approach to AI Literary Criticism: Leveraging Greimas Semiotic Square for Large Language Models

Fangzhou Dong, Yifan Zeng, Yingpeng Sang, Hong Shen

机构 * School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院） ； School of Engineering and Technology, Central Queensland University（中央昆士兰大学工程与技术学院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted in CogSci 2025

Enterprise Large Language Model Evaluation Benchmark

Liya Wang, David Yi, Damien Jose, John Passarelli, James Gao, Jordan Leventis, Kang Li

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Submitted to MLNLP 2025 at https://csity2025.org/mlnlp/index

Large Language Model Interface for Home Energy Management Systems

François Michelon, Yihong Zhou, Thomas Morstyn

机构 * University of Edinburgh（爱丁堡大学） ； Oxford University（牛津大学） 纠错

专题命中 评测与基准 ：language model(title,abstract)；large language model(title)；LLM(abstract)；prompting(abstract)

Comments 13 pages conference paper

Journal ref Proc. 16th ACM Int. Conf. on Future and Sustainable Energy Systems, e-Energy 2025, pages 590-602, 2025

Self-Critique-Guided Curiosity Refinement: Enhancing Honesty and Helpfulness in Large Language Models via In-Context Learning

Duc Hieu Ho, Chenglin Fan

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text

Arturs Kanepajs, Aditi Basu, Sankalpa Ghose, Constance Li, Akshat Mehta, Ronak Mehta, Samuel David Tucker-Davis, Eric Zhou, Bob Fischer, Jacy Reese Anthis

机构 * Alethic Research ； Texas State University（德克萨斯州立大学） ； Sentience Institute（意识研究所） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

ETM: Modern Insights into Perspective on Text-to-SQL Evaluation in the Age of Large Language Models

Benjamin G. Ascoli, Yasoda Sai Ram Kandikonda, Jinho D. Choi

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Yuhe Liu, Changhua Pei, Longlong Xu, Bohan Chen, Mingze Sun, Zhirui Zhang, Yongqian Sun, Shenglin Zhang, Kun Wang, Haiming Zhang, Jianhui Li, Gaogang Xie, Xidao Wen, Xiaohui Nie, Minghua Ma, Dan Pei

机构 * Tsinghua University \& BNRist Beijing China ； Beijing University of Posts ； Nankai University \& TKL-SEHCI Tianjin China ； Nankai University \& HL-IT Tianjin China ； Microsoft Redmond USA ； Tsinghua University \& BNRist ； Nankai University \& TKL-SEHCI ； Nankai University \& HL-IT ； Microsoft 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Investigating the Effects of Cognitive Biases in Prompts on Large Language Model Outputs

Yan Sun, Stanley Kok

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

AnalogXpert: Automating Analog Topology Synthesis by Incorporating Circuit Design Expertise into Large Language Models

Haoyi Zhang, Shizhao Sun, Yibo Lin, Runsheng Wang, Jiang Bian

机构 * School of Integrated Circuits, Peking University（集成电路学院，北京大学） ； Institute of EDA, Peking University（EDA研究院，北京大学） ； Beijing Advanced Innovation Center for Integrated Circuits（北京集成电路先进创新中心） ； Microsoft Research Asia（微软亚洲研究院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

JBBQ: Japanese Bias Benchmark for Analyzing Social Biases in Large Language Models

Hitomi Yanaka, Namgi Han, Ryoma Kumon, Jie Lu, Masashi Takeshita, Ryo Sekizawa, Taisei Kato, Hiromi Arai

机构 * The University of Tokyo（东京大学） ； Riken（理化学研究所） ； Hokkaido University（北海道大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted to the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP2025) at ACL2025

Graph-MLLM: Harnessing Multimodal Large Language Models for Multimodal Graph Learning

Jiajin Liu, Dongzhe Fan, Jiacheng Shen, Chuanhao Ji, Daochen Zha, Qiaoyu Tan

机构 * New York University Shanghai（纽约大学上海校区） ； University of Chinese Academy of Sciences（中国科学院大学） ； Rice University（德克萨斯大学里德学院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 16 pages, 4 figures

WGSR-Bench: Wargame-based Game-theoretic Strategic Reasoning Benchmark for Large Language Models

Qiyue Yin, Pei Xu, Qiaozhe Li, Shengda Liu, Shengqi Shen, Tong Wang, Yihong Han, Xiaonan Zhao, Likun Yang, Shiyue Cao, Shiyu Qiu, Yuxuan Liu, Shizhao Yu, Lei Cui, Chengxin Yan, Jie Sun, Xiangquan Tang, Kaiqi Huang

机构 * Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 15 pages, 17 figures

CAF-I: A Collaborative Multi-Agent Framework for Enhanced Irony Detection with Large Language Models

Ziqi. Liu, Ziyang. Zhou, Mingxuan. Hu

机构 * Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Position: Theory of Mind Benchmarks are Broken for Large Language Models

Matthew Riemer, Zahra Ashktorab, Djallel Bouneffouf, Payel Das, Miao Liu, Justin D. Weisz, Murray Campbell

机构 * IBM Research（IBM研究院） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments ICML 2025

SoK: Machine Unlearning for Large Language Models

Jie Ren, Yue Xing, Yingqian Cui, Charu C. Aggarwal, Hui Liu

机构 * Michigan State University（密歇根州立大学） ； IBM T. J. Watson Research Center（IBM 托马斯·J·沃森研究中心） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Dialect Normalization using Large Language Models and Morphological Rules

Antonios Dimakis, John Pavlopoulos, Antonios Anastasopoulos

机构 * Archimedes, Athena Research Center, Greece（阿基米德，雅典娜研究中心，希腊） ； Department of Informatics and Telecommunications, NKUA（信息与电信系，NKUA） ； Department of Informatics, Athens University of Economics and Business, Greece（信息系，雅典经济与商业大学，希腊） ； Department of Computer Science, George Mason University（计算机科学系，乔治·梅森大学） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 19 pages, 18 figures, to be published in the Findings of the Association for Computational Linguistics 2025

Hateful Person or Hateful Model? Investigating the Role of Personas in Hate Speech Detection by Large Language Models

Shuzhou Yuan, Ercong Nie, Mario Tawfelis, Helmut Schmid, Hinrich Schütze, Michael Färber

机构 * ScaDS.AI and TU Dresden（ScaDS.AI 和 梵高大学） ； LMU Munich（慕尼黑大学） ； Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心） 纠错

专题命中 评测与基准 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL