语言大模型 / LLM

2502.02494 2025-10-22 cs.LG cs.CL 88%

Analyzing Similarity Metrics for Data Selection for Language Model Pretraining

Dylan Sam, Ayan Chakrabarti, Afshin Rostamizadeh, Srikumar Ramalingam, Gui Citovsky, Sanjiv Kumar

机构 * Carnegie Mellon University（卡内基梅隆大学）； Google Research（谷歌研究）

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

2510.18046 2025-10-22 cs.CL cs.AI 86%

Language Models as Semantic Augmenters for Sequential Recommenders

Mahsa Valizadeh, Xiangjue Dong, Rui Tuo, James Caverlee

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2505.04710 2025-10-22 cs.DC 85%

Exploring Influence Factors on LLM Suitability for No-Code Development of End User IoT Applications

Minghe Wang, Alexandra Kapp, Trever Schirmer, Tobias Pfandzelter, David Bermbach

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)

2505.14045 2025-10-22 cs.CL cs.AI 82%

From Unaligned to Aligned: Scaling Multilingual LLMs with Multi-Way Parallel Corpora

Yingli Shen, Wen Lai, Shuo Wang, Ge Gao, Kangyang Luo, Alexander Fraser, Maosong Sun

机构 * Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系）； Technical University of Munich（慕尼黑技术大学）； Munich Center for Machine Learning（慕尼黑机器学习中心）； Minzu University of China（民族大学）； Institute for AI, Tsinghua University（清华大学人工智能研究院）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；pretraining(abstract)

Comments EMNLP 2025 Main Conference (Oral)

2510.18344 2025-10-22 cs.CL 81%

Combining Distantly Supervised Models with In Context Learning for Monolingual and Cross-Lingual Relation Extraction

Vipul Rathore, Malik Hammad Faisal, Parag Singla, Mausam

机构 * Indian Institute of Technology New Delhi（印度理工学院新德里）

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

2510.18244 2025-10-22 cs.CV 78%

BlendCLIP: Bridging Synthetic and Real Domains for Zero-Shot 3D Object Classification with Multimodal Pretraining

Ajinkya Khoche, Gergő László Nagy, Maciej Wozniak, Thomas Gustafsson, Patric Jensfelt

机构 * KTH Royal Institute of Technology（皇家理工学院）； Scania CV AB（斯堪尼亚公司）

专题命中预训练与数据：pretraining(title,abstract)

Comments Under Review

2510.17995 2025-10-22 cs.AI 77%

FABRIC: Framework for Agent-Based Realistic Intelligence Creation

Abhigya Verma, Seganrasan Subramanian, Nandhakumar Kandasamy, Naman Gupta

机构 * ServiceNow

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 51 Pages, 38 Listings, 5 Figures

2410.04039 2025-10-22 cs.CR cs.AI 77%

BlockScan: Detecting Anomalies in Blockchain Transactions

Jiahao Yu, Xian Wu, Hao Liu, Wenbo Guo, Xinyu Xing

机构 * UC Santa Barbara（加州大学圣芭芭拉分校）； Meta AI ； New York University（纽约大学）； sec3 ； Northwestern University（西北大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.AI

2510.18502 2025-10-22 cs.CV cs.AI cs.CL cs.LG 75%

Zero-Shot Vehicle Model Recognition via Text-Based Retrieval-Augmented Generation

Wei-Chia Chang, Yan-Ann Chen

机构 * Yuan Ze University（元智大学）

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by The 38th Conference of Open Innovations Association FRUCT, 2025

2508.11758 2025-10-22 cs.CL cs.AI 73%

Can we Evaluate RAGs with Synthetic Data?

Jonas van Elburg, Peter van der Putten, Maarten Marx

机构 * IRLab, Informatics Institute, UvA, Amsterdam, the Netherlands（IR实验室、信息研究所、乌得勒支大学、阿姆斯特丹、荷兰）； AI Lab, Pegasystems, Amsterdam, the Netherlands（AI实验室、佩加系统的阿姆斯特丹分部）； LIACS, Leiden University, Leiden, the Netherlands（LIACS、莱顿大学、莱顿、荷兰）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted for the SynDAiTE workshop at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD 2025), September 15, 2025 - Porto, Portugal

2510.18345 2025-10-22 cs.CV 50%

GPTFace: Generative Pre-training of Facial-Linguistic Transformer by Span Masking and Weakly Correlated Text-image Data

Yudong Li, Hao Li, Xianxu Hou, Linlin Shen

机构 * Shenzhen University（深圳大学）

专题命中预训练与数据：language model(abstract)

Comments This work was initially drafted in November 2022

2510.17895 2025-10-22 cs.LG cs.AI cs.CL 90%

Hierarchical Federated Unlearning for Large Language Models

Yisheng Zhong, Zhengbang Yang, Zhuangdi Zhu

机构 * George Mason University（乔治·玛莎大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

2510.18143 2025-10-22 cs.AI cs.LG 90%

Learning from Generalization Patterns: An Evaluation-Driven Approach to Enhanced Data Augmentation for Fine-Tuning Small Language Models

Huan Song, Deeksha Razdan, Yiyue Qian, Arijit Ghosh Chowdhury, Parth Patwa, Aman Chadha, Shinan Zhang, Sharlina Keshava, Hannah Marlowe

机构 * AWS Generative AI Innovation Center（AWS生成式AI创新中心）

专题命中指令微调：language model(title,abstract)；small language model(title,abstract)；LLM(abstract,comments)；分类 cs.AI、cs.LG

Comments Neural Information Processing Systems (NeurIPS 2025) Workshop: Evaluating the Evolving LLM Lifecycle

2510.17844 2025-10-22 cs.CL cs.AI cs.MA 90%

Modeling Layered Consciousness with Multi-Agent Large Language Models

Sang Hun Kim, Jongmin Lee, Dongkyu Park, So Young Lee, Yosep Chong

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract,comments)；分类 cs.CL、cs.AI

Comments 20 pages, 4 figures, accepted for presentation at EMNLP 2025 Workshop on Active and Passive LLM Personalization (PALS) OpenReview: https://openreview.net/forum?id=rUtNkYvGJI

2510.18288 2025-10-22 cs.CL 90%

BrailleLLM: Braille Instruction Tuning with Large Language Models for Braille Domain Tasks

Tianyuan Huang, Zepeng Zhu, Hangdi Xing, Zirui Shao, Zhi Yu, Chaoxiong Yang, Jiaxian He, Xiaozhong Liu, Jiajun Bu

机构 * Zhejiang Key Laboratory of Accessible Perception and Intelligent Systems, Zhejiang University（浙江无障碍感知与智能系统重点实验室，浙江大学）； Alibaba Group（阿里巴巴集团）； Worcester Polytechnic Institute（沃斯特理工学院）； Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and DataSecurity（杭州高新技术区（滨江）区块链与数据安全研究院）

专题命中指令微调：instruction tuning(title,abstract)；large language model(title)；language model(title)；分类 cs.CL

Comments Accepted to EMNLP 2025

2510.17919 2025-10-22 cs.CR cs.AI 89%

ParaVul: A Parallel Large Language Model and Retrieval-Augmented Framework for Smart Contract Vulnerability Detection

Tenghui Huang, Jinbo Wen, Jiawen Kang, Siyong Chen, Zhengtao Li, Tao Zhang, Dongning Liu, Jiacheng Wang, Chengjun Cai, Yinqiu Liu, Dusit Niyato

机构 * School of Automation, Guangdong University of Technology（广东科技大學自動化學院）； College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics（南京航空航天大學計算機科學與技術學院）； School of Cyberspace Science and Technology, Beijing Jiaotong University（北京交通大學網絡空間科學與技術學院）； School of Computer Science and Technology, Guangdong University of Technology（廣東科技大學計算機科學與技術學院）； College of Computing and Data Science, Nanyang Technological University（南洋理工大學計算與數據科學學院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2505.21657 2025-10-22 cs.CL cs.AI cs.LG 89%

Explaining Large Language Models with gSMILE

Zeinab Dehghani, Mohammed Naveed Akram, Koorosh Aslansefat, Adil Khan, Yiannis Papadopoulos

机构 * University of Hull（赫尔大学）； Fraunhofer IESE（弗劳恩霍夫研究所）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2509.01328 2025-10-22 cs.CL 88%

Can Large Language Models Master Complex Card Games?

Wei Wang, Fuqing Bie, Junzhe Chen, Dan Zhang, Shiyu Huang, Evgeny Kharlamov, Jie Tang

机构 * Nankai University（南开大学）； Tsinghua University（清华大学）； Beijing University of Posts and Telecommunications（北京邮电大学）； Zhipu AI（智谱AI）； Bosch Center for Artificial Intelligence（博世人工智能中心）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by NeurIPS 2025

2510.18250 2025-10-22 cs.AI 85%

ssToken: Self-modulated and Semantic-aware Token Selection for LLM Fine-tuning

Xiaohan Qin, Xiaoxing Wang, Ning Liao, Cancheng Zhang, Xiangdong Zhang, Mingquan Feng, Jingzhi Wang, Junchi Yan

机构 * Shanghai Jiao Tong University（上海交通大学）； Shanghai Innovation Institute（上海创新研究院）

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；SFT(abstract)

2510.18228 2025-10-22 cs.LG 85%

Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations

Zhendong Mi, Qitao Tan, Grace Li Zhang, Zhaozhuo Xu, Geng Yuan, Shaoyi Huang

机构 * Stevens Institute of Technology（史蒂文斯理工学院）； University of Georgia（佐治亚大学）； Technical University of Darmstadt（达姆施塔特技术大学）

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 10 pages, 5 figures

2510.17847 2025-10-22 cs.CV 85%

CoIDO: Efficient Data Selection for Visual Instruction Tuning via Coupled Importance-Diversity Optimization

Yichen Yan, Ming Zhong, Qi Zhu, Xiaoling Gu, Jinpeng Chen, Huan Li

机构 * The State Key Laboratory of Blockchain and Data Security（区块链与数据安全国家重点实验室）； Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security（杭州高新技术区（滨江）区块链与数据安全研究院）； Hangzhou Dianzi University（杭州电子科技大学）； School of Computer Science (National Pilot Software Engineering School), BUPT（计算机学院（国家级试点软件工程学院），北京邮电大学）

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments 22 pages, 8 figures, 39th Conference on Neural Information Processing Systems (NeurIPS 2025)

2510.18081 2025-10-22 cs.LG cs.AI 79%

Any-Depth Alignment: Unlocking Innate Safety Alignment of LLMs to Any-Depth

Jiawei Zhang, Andrew Estornell, David D. Baek, Bo Li, Xiaojun Xu

机构 * University of Chicago（芝加哥大学）； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）； Massachusetts Institute of Technology（麻省理工学院）

专题命中指令微调：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.AI、cs.LG

2510.18773 2025-10-22 cs.CV 78%

Detection and Simulation of Urban Heat Islands Using a Fine-Tuned Geospatial Foundation Model for Microclimate Impact Prediction

Jannis Fleckenstein, David Kreismann, Tamara Rosemary Govindasamy, Thomas Brunschwiler, Etienne Vos, Mattia Rigotti

机构 * IBM Research – Europe（IBM欧洲研究院）； IBM Research – Africa（IBM非洲研究院）

专题命中指令微调：foundation model(title,abstract)

Comments 10 pages, 9 figures. Accepted at the NeurIPS 2025 Workshop on Tackling Climate Change with Machine Learning

2509.10784 2025-10-22 eess.IV cs.CV 78%

Adapting Medical Vision Foundation Models for Volumetric Medical Image Segmentation via Active Learning and Selective Semi-supervised Fine-tuning

Jin Yang, Daniel S. Marcus, Aristeidis Sotiras

机构 * Mallinckrodt Institute of Radiology（马林克罗德放射医学研究所）； Institute for Informatics, Data Science and Biostatistics（信息学、数据科学与生物统计学研究所）； Department of Radiology, Perelman School of Medicine（放射科，佩尔曼医学院）； Center for AI and Data Science for Integrated Diagnostics (AI2D)（集成诊断人工智能与数据科学中心（AI2D））

专题命中指令微调：foundation model(title,abstract)

Comments 17 pages, 5 figures, 8 tables

2509.06239 2025-10-22 cs.AI 77%

Proof2Silicon: Prompt Repair for Verified Code and Hardware Generation via Reinforcement Learning

Manvi Jha, Jiaxin Wan, Deming Chen

机构 * Electrical and Computer Engineering（电气与计算机工程系）； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2510.18484 2025-10-22 cs.CR 75%

The Attribution Story of WhisperGate: An Academic Perspective

Oleksandr Adamov, Anders Carlsson

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Virus Bulletin Conference 2025

2510.18257 2025-10-22 cs.CL cs.AI 73%

DelvePO: Direction-Guided Self-Evolving Framework for Flexible Prompt Optimization

Tao Tao, Guanghui Zhu, Lang Guo, Hongyi Chen, Chunfeng Yuan, Yihua Huang

机构 * State Key Laboratory for Novel Software Technology（新型软件技术国家重点实验室）

专题命中指令微调：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2506.01480 2025-10-22 cs.CV 67%

Janus-Pro-R1: Advancing Collaborative Visual Comprehension and Generation via Reinforcement Learning

Kaihang Pan, Yang Wu, Wendong Bu, Kai Shen, Juncheng Li, Yingting Wang, Yunfei Li, Siliang Tang, Jun Xiao, Fei Wu, Hang Zhao, Yueting Zhuang

机构 * Zhejiang University（浙江大学）； Ant Group（蚂蚁集团）

专题命中指令微调：large language model(abstract)；language model(abstract)

Comments Accepted by NeurIPS 2025

2510.18723 2025-10-22 cs.CL cs.LG cs.SD eess.AS 62%

Bayesian Low-Rank Factorization for Robust Model Adaptation

Enes Yavuz Ugan, Ngoc-Quan Pham, Alexander Waibel

机构 * Interactive Systems Lab, Karlsruhe Institut of Technology (KIT), Germany（交互系统实验室，卡尔斯鲁厄理工学院（KIT），德国）； InterACT, Carnegie Mellon University (CMU), USA（InterACT，卡内基梅隆大学（CMU），美国）

专题命中指令微调：foundation model(abstract)；分类 cs.CL、cs.LG

Comments Submitted to ICASSP 2026

2510.18053 2025-10-22 cs.LG cs.AI 62%

Adaptive Divergence Regularized Policy Optimization for Fine-tuning Generative Models

Jiajun Fan, Tong Wei, Chaoran Cheng, Yuxin Chen, Ge Liu

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中指令微调：LLM(abstract)；分类 cs.AI、cs.LG

Comments 30 pages

1. 预训练与数据 11 篇