语言大模型 / LLM

A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP

Shinnosuke Ono, Issey Sukeda, Takuro Fujii, Kosei Buma, Shunsuke Sasaki

机构 * EQUES Inc.（EQUES公司） ； The University of Tokyo（东京大学） ； University of Tsukuba（筑波大学） 纠错

专题命中 评测与基准 ：language model(title,abstract)；LLM(abstract)；pretraining(abstract)；分类 cs.CL

Comments 15 pages, 9 tables, 5 figures

Rethinking LLM Parametric Knowledge as Post-retrieval Confidence for Dynamic Retrieval and Reranking

Haoxiang Jin, Ronghan Li, Zixiang Lu, Qiguang Miao

专题命中 评测与基准 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Avoiding Over-Personalization with Rule-Guided Knowledge Graph Adaptation for LLM Recommendations

Fernando Spadea, Oshani Seneviratne

机构 * Rensselaer Polytechnic Institute（拉特兰理工学院） 纠错

专题命中 评测与基准 ：LLM(title,abstract)；language model(abstract)；分类 cs.LG

Comments 5 pages, 2 figures, ISWC

VISION: Robust and Interpretable Code Vulnerability Detection Leveraging Counterfactual Augmentation

David Egea, Barproda Halder, Sanghamitra Dutta

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

PatchSeeker: Mapping NVD Records to their Vulnerability-fixing Commits with LLM Generated Commits and Embeddings

Huu Hung Nguyen, Anh Tuan Nguyen, Thanh Le-Cong, Yikun Li, Han Wei Ang, Yide Yin, Frank Liauw, Shar Lwin Khin, Ouh Eng Lieh, Ting Zhang, David Lo

专题命中 评测与基准 ：LLM(title)；large language model(abstract)；language model(abstract)

RealHarm: A Collection of Real-World Language Model Application Failures

Pierre Le Jeune, Jiaen Liu, Luca Rossi, Matteo Dora

专题命中 评测与基准 ：language model(title,abstract)；分类 cs.CL、cs.AI；LLM(journal_ref)

Journal ref ACL Proceedings of the The First Workshop on LLM Security (LLMSEC), pp. 87-100, 2025

Towards Visuospatial Cognition via Hierarchical Fusion of Visual Experts

Qi Feng

机构 * Kyoto University（京都大学） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 26 pages, 19 figures, 4 tables

Debatable Intelligence: Benchmarking LLM Judges via Debate Speech Evaluation

Noy Sternlicht, Ariel Gera, Roy Bar-Haim, Tom Hope, Noam Slonim

机构 * School of Computer Science and Engineering, The Hebrew University of Jerusalem（计算机科学与工程学院，特拉维夫大学） ； IBM Research（IBM研究院） ； The Allen Institute for AI (AI2)（人工智能研究所） 纠错

专题命中 评测与基准 ：LLM(title,abstract)；分类 cs.CL

Comments EMNLP 2025. Code: https://github.com/noy-sternlicht/Debatable-Intelligence

Autonomous Code Evolution Meets NP-Completeness

Cunxi Yu, Rongjian Liang, Chia-Tung Ho, Haoxing Ren

机构 * NVIDIA Research（NVIDIA研究） 纠错

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments 31 pages, 11 figures

Benchmarking Information Retrieval Models on Complex Retrieval Tasks

Julian Killingback, Hamed Zamani

机构 * University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） 纠错

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Cardiverse: Harnessing LLMs for Novel Card Game Prototyping

Danrui Li, Sen Zhang, Sam S. Sohn, Kaidong Hu, Muhammad Usman, Mubbasir Kapadia

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 37 pages, 13 figures, 8 tables. Accepted by EMNLP 2025

All You Need Is A Fuzzing Brain: An LLM-Powered System for Automated Vulnerability Detection and Patching

Ze Sheng, Qingxiao Xu, Jianwei Huang, Matthew Woodcock, Heqing Huang, Alastair F. Donaldson, Guofei Gu, Jeff Huang

专题命中 评测与基准 ：LLM(title,abstract)

Comments 14 pages, 5 figures

BeatFM: Improving Beat Tracking with Pre-trained Music Foundation Model

Ganghui Ru, Jieying Wang, Jiahao Zhao, Yulun Wu, Yi Yu, Nannan Jiang, Wei Wang, Wei Li

机构 * School of Computer Science, Fudan University, Shanghai, China（复旦大学计算机科学学院） ； Naval Medical Center, PLA, China（中国人民解放军海军医疗中心） ； Graduate School of Informatics, Kyoto University, Kyoto, Japan（京都大学信息科学研究生院） ； Graduate School of Advanced Science and Engineering, Hiroshima University, Hiroshima, Japan（广岛大学先进科学与工程研究生院） ； Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China（上海智能信息处理重点实验室） 纠错

专题命中 评测与基准 ：foundation model(title,abstract)

Comments Early draft for discussion only. Undergoing active revision, conclusions subject to change. Do not cite. Formal peer-reviewed version in preparation

ImportSnare: Directed "Code Manual" Hijacking in Retrieval-Augmented Code Generation

Kai Ye, Liangcai Su, Chenxiong Qian

机构 * The University of Hong Kong（香港大学） 纠错

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments This paper has been accepted by the ACM Conference on Computer and Communications Security (CCS) 2025

Biased Tales: Cultural and Topic Bias in Generating Children's Stories

Donya Rooein, Vilém Zouhar, Debora Nozza, Dirk Hovy

机构 * Bocconi University（博科尼大学） ； ETH Zurich（苏黎世联邦理工学院） 纠错

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

No Thoughts Just AI: Biased LLM Hiring Recommendations Alter Human Decision Making and Limit Human Autonomy

Kyra Wilson, Mattea Sim, Anna-Maria Gueorguieva, Aylin Caliskan

机构 * Kyra Wilson（1 Kyra Wilson） ； Mattea Sim（2 Mattea Sim） 纠错

专题命中 评测与基准 ：LLM(title)；分类 cs.CL、cs.AI

Comments Published in Proceedings of the 2025 AAAI/ACM Conference on AI, Ethics, and Society; code available at https://github.com/kyrawilson/No-Thoughts-Just-AI

AgentSentinel: An End-to-End and Real-Time Security Defense Framework for Computer-Use Agents

Haitao Hu, Peng Chen, Yanpeng Zhao, Yuqi Chen

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)

SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs

Hongfei Xia, Hongru Wang, Zeming Liu, Qian Yu, Yuhang Guo, Haifeng Wang

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 18 pages, 7 figures

Generative AI as a Tool for Enhancing Reflective Learning in Students

Bo Yuan, Jiazi Hu

专题命中 评测与基准 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by IEEE TALE 2025

MaRVL-QA: A Benchmark for Mathematical Reasoning over Visual Landscapes

Nilay Pande, Sahiti Yerramilli, Jayant Sravan Tamarapalli, Rynaa Grover

机构 * Waymo ； Google（谷歌） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Trust but Verify! A Survey on Verification Design for Test-time Scaling

V Venktesh, Mandeep Rathee, Avishek Anand

机构 * Stockholm University（斯德哥尔摩大学） ； L3S Research Center（L3S研究中心） ； TU Delft（代尔夫特理工大学） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 18 pages

Meaning-infused grammar: Gradient Acceptability Shapes the Geometric Representations of Constructions in LLMs

Supantho Rakshit, Adele Goldberg

机构 * Princeton University（普林斯顿大学） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 3 figures, Accepted for publication at the Second International Workshop on Construction Grammars and NLP at the 16th International Conference for Computational Semantics (IWCS) 2025

GSTBench: A Benchmark Study on the Transferability of Graph Self-Supervised Learning

Yu Song, Zhigang Hua, Yan Xie, Jingzhe Liu, Bo Long, Hui Liu

机构 * Computer Science and Engineering（计算机科学与工程） ； Michigan State University（密歇根州立大学） ； Meta 纠错

专题命中 评测与基准 ：foundation model(abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

Comments Accepted at CIKM'25

Unleashing the True Potential of LLMs: A Feedback-Triggered Self-Correction with Long-Term Multipath Decoding

Jipeng Li, Zeyu Gao, Yubin Qi, Hande Dong, Weijian Chen, Qiang Lin

机构 * Tencent（腾讯） ； Tsinghua University（清华大学） ； Institute of Dataspace, Hefei Comprehensive National Science Center（数据空间研究所，合肥综合性国家科学中心） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.AI

SheetDesigner: MLLM-Powered Spreadsheet Layout Generation with Rule-Based and Vision-Based Reflection

Qin Chen, Yuanyi Ren, Xiaojun Ma, Mugeng Liu, Han Shi, Dongmei Zhang

机构 * Peking University（北京大学） ； Microsoft（微软） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted to EMNLP 2025 Main Conference

AraHalluEval: A Fine-grained Hallucination Evaluation Framework for Arabic LLMs

Aisha Alansari, Hamzah Luqman

机构 * Information and Computer Science Department, King Fahd University of Petroleum and Minerals（信息与计算机科学系，国王法赫德石油和矿物大学） ； SDAIA-KFUPM Joint Research Center for Artificial Intelligence（SDAIA-KFUPM人工智能联合研究中心） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.CL

CountQA: How Well Do MLLMs Count in the Wild?

Jayant Sravan Tamarapalli, Rynaa Grover, Nilay Pande, Sahiti Yerramilli

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Are Economists Always More Introverted? Analyzing Consistency in Persona-Assigned LLMs

Manon Reusens, Bart Baesens, David Jurgens

机构 * Research Centre for Information Systems Engineering (LIRIS), KU Leuven（信息系统工程研究中心（LIRIS），鲁汶大学） ； Department of Engineering Management, University of Antwerp（工程管理系，安特卫普大学） ； Department of Decision Analytics and Risk, University of Southampton（决策分析与风险系，南安普顿大学） ； School of Information, University of Michigan（信息学院，密歇根大学） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 findings

FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain

Suifeng Zhao, Zhuoran Jin, Sujian Li, Jun Gao

机构 * Key Laboratory of High Confidence Software Technologies, CS, Peking University, China（北京大学高可信软件技术重点实验室） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； State Key Laboratory of Multimedia Information Processing, School of Computer Sciences, Peking University（北京大学多媒体信息处理国家重点实验室） 纠错

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.CL

M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis

Chengyan Wu, Bolei Ma, Yihong Liu, Zheyu Zhang, Ningyuan Deng, Yanshu Li, Baolan Chen, Yi Zhang, Yun Xue, Barbara Plank

专题命中 评测与基准 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments EMNLP 2025