语言大模型 / LLM

2507.20520 2025-07-29 cs.CL cs.AI cs.CE cs.LG cs.RO 90%

AQUA: A Large Language Model for Aquaculture & Fisheries

Praneeth Narisetty, Uday Kumar Reddy Kattamanchi, Lohit Akshant Nimma, Sri Ram Kaushik Karnati, Shiva Nagendra Babu Kore, Mounika Golamari, Tejashree Nageshreddy

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.15956 2025-07-29 cs.CL cs.AI 90%

Do Large Language Models Have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMs

Yanzhu Guo, Simone Conia, Zelin Zhou, Min Li, Saloni Potdar, Henry Xiao

机构 * Apple（苹果公司）； Inria Paris（巴黎国家信息与自动化研究所）； École Polytechnique（巴黎高等理工学院）； Sapienza University of Rome（罗马萨皮恩扎大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments ACL 2025

2503.04036 2025-07-29 cs.CR cs.CL cs.LG 86%

Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge

Xinyue Cui, Johnny Tian-Zheng Wei, Swabha Swayamdipta, Robin Jia

机构 * University of Southern California（南加州大学）

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；pretraining(abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2025 Findings

2502.14133 2025-07-29 cs.CL 85%

Self-Regularization with Sparse Autoencoders for Controllable LLM-based Classification

Xuansheng Wu, Wenhao Yu, Xiaoming Zhai, Ninghao Liu

机构 * University of Georgia（佐治亚大学）； Tencent AI Lab（腾讯AI实验室）

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted by SIGKDD 2025

2507.20118 2025-07-29 physics.comp-ph cs.AI 83%

Iterative Pretraining Framework for Interatomic Potentials

Taoyong Cui, Zhongyao Wang, Dongzhan Zhou, Yuqiang Li, Lei Bai, Wanli Ouyang, Mao Su, Shufei Zhang

机构 * The Chinese University of Hong Kong（香港中文大学）； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； College of Computer Science and Artificial Intelligence（计算机科学与人工智能学院）； Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）

专题命中预训练与数据：pretraining(title,abstract)；foundation model(abstract)；分类 cs.AI

2504.02398 2025-07-29 cs.CL cs.SD eess.AS 83%

Scaling Analysis of Interleaved Speech-Text Language Models

Gallil Maimon, Michael Hassid, Amit Roth, Yossi Adi

机构 * Department of Computer Science and Engineering（计算机科学与工程系）

专题命中预训练与数据：language model(title,abstract)；SLM(abstract)；分类 cs.CL

Comments Accepted at COLM 2025

2504.17562 2025-07-29 cs.CL cs.LG 81%

When Does Metadata Conditioning (NOT) Work for Language Model Pre-Training? A Study with Context-Free Grammars

Rei Higuchi, Ryotaro Kawata, Naoki Nishikawa, Kazusato Oko, Shoichiro Yamaguchi, Sosuke Kobayashi, Seiya Tokui, Kohei Hayashi, Daisuke Okanohara, Taiji Suzuki

机构 * The University of Tokyo（东京大学）； RIKEN AIP（日本研究机构（Advanced Institute for Proprietary Technology））； University of California, Berkeley（加州大学伯克利分校）； Preferred Networks, Inc.（Preferred Networks公司）

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.LG

2507.20925 2025-07-29 cs.LG q-bio.QM 79%

Zero-Shot Learning with Subsequence Reordering Pretraining for Compound-Protein Interaction

Hongzhi Zhang, Zhonglie Liu, Kun Meng, Jiameng Chen, Jia Wu, Bo Du, Di Lin, Yan Che, Wenbin Hu

机构 * School of Computer Science, Wuhan University（武汉大学计算机学院）； Engineering Research Center for Big Data Application in Private Health Medicine of Fujian Universities, Putian University（福建省私人健康医学大数据应用工程研究中心，莆田大学）； Macquarie University（麦考瑞大学）； Wuhan University Shenzhen Research Institute（武汉大学深圳研究院）

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.LG

2503.10789 2025-07-29 cs.CL 79%

Data Caricatures: On the Representation of African American Language in Pretraining Corpora

Nicholas Deas, Blake Vente, Amith Ananthram, Jessica A. Grieser, Desmond Patton, Shana Kleiner, James Shepard, Kathleen McKeown

机构 * Columbia University, Department of Computer Science（哥伦比亚大学计算机科学系）； University of Michigan, Department of Linguistics（密歇根大学语言学系）； University of Pennsylvania, School of Social Policy and Practice, Annenberg School for Communications（宾夕法尼亚大学社会政策与实践学院、安纳伯格通讯学院）； University of Tennessee, Knoxville, Department of English（田纳西大学基洛纳分校英语系）

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL

Comments ACL 2025

2507.20752 2025-07-29 cs.CL cs.LG 79%

Multilingual Self-Taught Faithfulness Evaluators

Carlo Alfano, Aymen Al Marjani, Zeno Jonke, Amin Mantrach, Saab Mansour, Marcello Federico

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2507.19543 2025-07-29 cs.AI cs.MA 78%

Agent WARPP: Workflow Adherence via Runtime Parallel Personalization

Maria Emilia Mazzolenis, Ruirui Zhang

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted at the ICML 2025 Workshop on Multi-Agent Systems in the Era of Foundation Models: Opportunities, Challenges, and Futures. Code repo: https://github.com/emiliamazzo/WARPP/

2505.14683 2025-07-29 cs.CV 78%

Emerging Properties in Unified Multimodal Pretraining

Chaorui Deng, Deyao Zhu, Kunchang Li, Chenhui Gou, Feng Li, Zeyu Wang, Shu Zhong, Weihao Yu, Xiaonan Nie, Ziang Song, Guang Shi, Haoqi Fan

机构 * ByteDance Seed（字节跳动种子）； Shenzhen Institutes of Advanced Technology（深圳先进技术研究院）； Monash University（墨尔本大学）； Hong Kong University of Science and Technology（香港科学与技术大学）； UC Santa Cruz（加州大学圣克ruz分校）

专题命中预训练与数据：pretraining(title,abstract)

Comments 37 pages, 17 figures

2504.13092 2025-07-29 cs.CV 75%

EventVAD: Training-Free Event-Aware Video Anomaly Detection

Yihua Shao, Haojin He, Sijie Li, Siyu Chen, Xinwei Long, Fanhu Zeng, Yuxuan Fan, Muyang Zhang, Ziyang Yan, Ao Ma, Xiaochen Wang, Hao Tang, Yan Wang, Shuyan Li

机构 * Peking University（北京大学）； Guangdong University of Technology（广东工业大学）； The University of Sheffield（谢菲尔德大学）； University of Science and Technology Beijing（北京科技大学）； Tsinghua University（清华大学）； The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））； Nanjing University（南京大学）； University of Trento（特伦特大学）； Queen's University Belfast（贝尔法斯特女王大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；prompting(abstract)

Comments Paper was accepted by ACM MM 2025; Code: https://github.com/YihuaJerry/EventVAD

2507.20156 2025-07-29 cs.CV cs.AI 70%

Trust the Model: Compact VLMs as In-Context Judges for Image-Text Data Quality

Daulet Toibazar, Kesen Wang, Sherif Mohamed, Abdulaziz Al-Badawi, Abdulrahman Alfulayt, Pedro J. Moreno

机构 * Humain Riyadh, KSA（利雅得人类，沙特阿拉伯）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.AI

2412.16708 2025-07-29 cs.IR 67%

Towards More Robust Retrieval-Augmented Generation: Evaluating RAG Under Adversarial Poisoning Attacks

Jinyan Su, Jin Peng Zhou, Zhengxin Zhang, Preslav Nakov, Claire Cardie

专题命中预训练与数据：LLM(abstract)；prompting(abstract)

2411.17762 2025-07-29 cs.CV 67%

MUSE-VL: Modeling Unified VLM through Semantic Discrete Encoding

Rongchang Xie, Chen Du, Ping Song, Chang Liu

专题命中预训练与数据：LLM(abstract)；language model(abstract)

Comments ICCV 2025

2507.20411 2025-07-29 cs.CL 57%

CONCAP: Seeing Beyond English with Concepts Retrieval-Augmented Captioning

George Ibrahim, Rita Ramos, Yova Kementchedjhieva

机构 * Department of Natural Language Processing, MBZUAI（自然语言处理部门，MBZUAI）； INESC-ID, Instituto Superior Técnico, University of Lisbon（INESC-ID，理工学院，里斯本大学）

专题命中预训练与数据：language model(abstract)；分类 cs.CL

Comments Published as a conference paper at COLM 2025

2507.17527 2025-07-29 cs.CL cs.SD eess.AS 57%

Seed LiveInterpret 2.0: End-to-end Simultaneous Speech-to-speech Translation with Your Voice

Shanbo Cheng, Yu Bao, Zhichao Huang, Yu Lu, Ningxin Peng, Lu Xu, Runsheng Yu, Rong Cao, Yujiao Du, Ting Han, Yuxiang Hu, Zeyang Li, Sitong Liu, Shengtao Ma, Shiguang Pan, Jiongchen Xiao, Nuo Xu, Meng Yang, Rong Ye, Yiming Yu, Jun Zhang, Ruofei Zhang, Wanyi Zhang, Wenhao Zhu, Liehao Zou, Lu Lu, Yuxuan Wang, Yonghui Wu

机构 * ByteDance（字节跳动）

专题命中预训练与数据：pretraining(abstract)；分类 cs.CL

Comments Seed-LiveInterpret 2.0 Technical Report

2507.19908 2025-07-29 cs.CV 50%

TrackAny3D: Transferring Pretrained 3D Models for Category-unified 3D Point Cloud Tracking

Mengmeng Wang, Haonan Wang, Yulong Li, Xiangjie Kong, Jiaxin Du, Guojiang Shen, Feng Xia

机构 * Zhejiang University of Technology（浙江工业大学）； RMIT University（皇家墨尔本理工大学）； Zhejiang Key Laboratory of Visual Information Intelligent Processing（浙江省视觉信息智能处理重点实验室）

专题命中预训练与数据：pretraining(abstract)

2506.13629 2025-07-29 cs.CV 50%

FreeQ-Graph: Free-form Querying with Semantic Consistent Scene Graph for 3D Scene Understanding

Chenlu Zhan, Yufei Zhang, Gaoang Wang, Hongwei Wang

机构 * College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）； College of Biomedical Engineering and Instrument Science, Zhejiang University（浙江大学生物医学工程与仪器科学学院）； Zhejiang University-University of Illinois Urbana-Champaign Institute, Zhejiang University（浙江大学-伊利诺伊大学厄巴纳-香槟分校联合学院）

专题命中预训练与数据：LLM(abstract)

2507.19773 2025-07-29 cs.CV 50%

Self-Guided Masked Autoencoder

Jeongwoo Shin, Inseo Lee, Junho Lee, Joonseok Lee

机构 * Seoul National University（首尔国立大学）； Google Research（谷歌研究）

专题命中预训练与数据：pretraining(abstract)

2507.19672 2025-07-29 cs.AI cs.LG stat.ML 91%

Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges

Haoran Lu, Luyang Fang, Ruidong Zhang, Xinliang Li, Jiazhang Cai, Huimin Cheng, Lin Tang, Ziyu Liu, Zeliang Sun, Tao Wang, Yingchuan Zhang, Arif Hassan Zidan, Jinwen Xu, Jincheng Yu, Meizhi Yu, Hanqi Jiang, Xilin Gong, Weidi Luo, Bolun Sun, Yongkai Chen, Terry Ma, Shushan Wu, Yifan Zhou, Junhao Chen, Haotian Xiang, Jing Zhang, Afrar Jahin, Wei Ruan, Ke Deng, Yi Pan, Peilong Wang, Jiahui Li, Zhengliang Liu, Lu Zhang, Lin Zhao, Wei Liu, Dajiang Zhu, Xin Xing, Fei Dou, Wei Zhang, Chao Huang, Rongjie Liu, Mengrui Zhang, Yiwen Liu, Xiaoxiao Sun, Qin Lu, Zhen Xiang, Wenxuan Zhong, Tianming Liu, Ping Ma

机构 * Department of Statistics, University of Georgia（统计学系，佐治亚大学）； School of Computing, University of Georgia（计算学院，佐治亚大学）； Department of Biostatistics, Boston University（生物统计学系，波士顿大学）； Department of Epidemiology & Biostatistics, University of Georgia（流行病学与生物统计学系，佐治亚大学）； School of Computer and Cyber Sciences, Augusta University（计算机与网络科学学院，奥古斯塔大学）； School of Electrical and Computer Engineering, University of Georgia（电气与计算机工程学院，佐治亚大学）； Department of Statistics & Data Science, University of Arizona（统计学与数据科学系，亚利桑那大学）； Kellogg School of Management, Northwestern University（凯洛格管理学院，西北大学）； Department of Statistics, Harvard University（统计学系，哈佛大学）； School of Computer Science, Carnegie Mellon University（计算机科学学院，卡内基梅隆大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；preference optimization(abstract)

Comments 119 pages, 10 figures, 7 tables

2506.00831 2025-07-29 cs.CR cs.AI 89%

A Large Language Model-Supported Threat Modeling Framework for Transportation Cyber-Physical Systems

M Sabbir Salek, Mashrur Chowdhury, Muhaimin Bin Munir, Yuchen Cai, Mohammad Imtiaz Hasan, Jean-Michel Tine, Latifur Khan, Mizanur Rahman

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2504.08490 2025-07-29 cs.SE cs.AI 89%

Adopting Large Language Models to Automated System Integration

Robin D. Pesl

机构 * University of Stuttgart, Stuttgart, Germany（斯图加特大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments This preprint has not undergone peer review (when applicable) or any post-submission improvements or corrections. The Version of Record of this contribution is published in Intelligent Information Systems. CAiSE 2025. Lecture Notes in Business Information Processing, vol 557. Springer, Cham., and is available online at https://doi.org/10.1007/978-3-031-94590-8_37

Journal ref Intelligent Information Systems. CAiSE 2025. Lecture Notes in Business Information Processing, vol 557. Springer, Cham

2507.19909 2025-07-29 cs.SE cs.AI cs.CL cs.LG 89%

The Impact of Fine-tuning Large Language Models on Automated Program Repair

Roman Macháček, Anastasiia Grishina, Max Hort, Leon Moonen

机构 * Simula Research Laboratory（Simula研究实验室）； University of Bern（伯尔尼大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted for publication in the research track of the 41th International Conference on Software Maintenance and Evolution (ICSME 2025)

2507.20956 2025-07-29 cs.CL cs.AI 88%

Mind the Gap: Conformative Decoding to Improve Output Diversity of Instruction-Tuned Large Language Models

Max Peeperkorn, Tom Kouwenhoven, Dan Brown, Anna Jordanous

机构 * School of Computing University of Kent（肯特大学计算机学院）； Leiden Institute of Advanced Computer Science Universiteit Leiden（莱顿先进计算机科学研究所）； Cheriton School of Computer Science University of Waterloo（滑铁卢大学查里顿计算机科学学院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 3 figures

2507.20220 2025-07-29 cs.CV 88%

Motion-example-controlled Co-speech Gesture Generation Leveraging Large Language Models

Bohong Chen, Yumeng Li, Youyi Zheng, Yao-Xiang Ding, Kun Zhou

机构 * State Key Lab of CAD\&CG, Zhejiang University Hangzhou China ； State Key Lab of CAD\&CG, Zhejiang University

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)

Comments SIGGRAPH 2025; Project Page: https://robinwitch.github.io/MECo-Page

2506.15606 2025-07-29 cs.LG cs.AI cs.CL 87%

LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning

Gabriel J. Perin, Runjin Chen, Xuxi Chen, Nina S. T. Hirata, Zhangyang Wang, Junyuan Hong

机构 * University of São Paulo（圣保罗大学）； University of Texas at Austin（德克萨斯大学奥斯汀分校）

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2506.21560 2025-07-29 cs.CL cs.AI 86%

Reinforcement learning fine-tuning of language model for instruction following and math reasoning

Yifu Han, Geo Zhang

机构 * Stanford University（斯坦福大学）

专题命中指令微调：language model(title,abstract)；SFT(abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI

2407.10341 2025-07-29 cs.RO cs.AI cs.LG 84%

Affordance-Guided Reinforcement Learning via Visual Prompting

Olivia Y. Lee, Annie Xie, Kuan Fang, Karl Pertsch, Chelsea Finn

机构 * Stanford University（斯坦福大学）； Cornell University（康奈尔大学）； University of California, Berkeley（加州大学伯克利分校）

专题命中指令微调：prompting(title)；language model(abstract)；foundation model(abstract)；分类 cs.AI、cs.LG

Comments 8 pages, 6 figures. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2025

1. 预训练与数据 21 篇