语言大模型 / LLM

2509.20149 2025-10-21 cs.SE 90%

Synergistic Enhancement of Requirement-to-Code Traceability: A Framework Combining Large Language Model based Data Augmentation and an Advanced Encoder

Jianzhang Zhang, Jialong Zhou, Nan Niu, Jinping Hua, Chuang Liu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

2502.09566 2025-10-21 cs.CL cs.LG 90%

Zero-shot generation of synthetic neurosurgical data with large language models

Austin A. Barr, Eddie Guo, Emre Sezgin

机构 * Cumming School of Medicine University of Calgary（卡莱尔大学Cumming医学院）； The Abigail Wexner Research Institute Nationwide Children’s Hospital Department of Pediatrics The Ohio State University College of Medicine（阿比盖尔·韦克斯纳研究所全国儿童医院儿科部俄亥俄州立大学医学院）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments 13 pages, 4 figures, 4 tables (updated version, fixed typos and formatting)

Journal ref Neurosurg Focus 59(1), E17 (2025)

2510.16096 2025-10-21 cs.CL cs.LG 87%

Facts in Stats: Impacts of Pretraining Diversity on Language Model Generalization

Tina Behnia, Puneesh Deora, Christos Thrampoulidis

机构 * University of British Columbia（不列颠哥伦比亚大学）

专题命中预训练与数据：language model(title,abstract)；pretraining(title)；分类 cs.CL、cs.LG

Comments 28 pages, 15 figures

2510.15990 2025-10-21 cs.LG cs.AI cs.CL 87%

Can GRPO Help LLMs Transcend Their Pretraining Origin?

Kangqi Ni, Zhen Tan, Zijie Liu, Pingzhi Li, Tianlong Chen

机构 * cs.unc.edu（北卡罗来纳大学教堂山分校计算机科学系）

专题命中预训练与数据：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2510.08445 2025-10-21 cs.LG cs.AI 84%

Synthetic Series-Symbol Data Generation for Time Series Foundation Models

Wenxuan Wang, Kai Wu, Yujian Betterest Li, Dan Wang, Xiaoyu Zhang

机构 * School of Telecommunications Engineering Xidian University（电子科技大学电信工程学院）； School of Artificial Intelligence Xidian University（电子科技大学人工智能学院）； School of Cyber Engineering Xidian University（电子科技大学网络安全工程学院）

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

Comments 64 pages, 25 figures, 35 tables, NeurIPS 2025 accepted

2506.13174 2025-10-21 cs.LG q-bio.BM 83%

GeoRecon: Graph-Level Representation Learning for 3D Molecules via Reconstruction-Based Pretraining

Shaoheng Yan, Zian Li, Muhan Zhang

专题命中预训练与数据：pretraining(title,abstract)；language model(abstract)；分类 cs.LG

2504.05831 2025-10-21 cs.CL 83%

Leveraging Robust Optimization for LLM Alignment under Distribution Shifts

Mingye Zhu, Yi Liu, Zheren Fu, Yongdong Zhang, Zhendong Mao

机构 * University of Science and Technology of China（中国科学技术大学）； State Key Laboratory of Communication Content Cognition（通信内容认知国家重点实验室）

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments NeurIPS 2025

2510.16548 2025-10-21 cs.LG 83%

NeurIPT: Foundation Model for Neural Interfaces

Zitao Fang, Chenxuan Li, Hongting Zhou, Shuyang Yu, Guodong Du, Ashwaq Qasem, Yang Lu, Jing Li, Junsong Zhang, Sim Kuan Goh

机构 * Xiamen University Malaysia（马来西亚厦门大学）； Columbia University（哥伦比亚大学）； The Hong Kong Polytechnic University（香港理工大学）； Xiamen University（厦门大学）； Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳））

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments Accepted by The Thirty-Ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025). Project Page: https://ZzzitaoFang.github.io/projects/NeurIPT/

2504.10906 2025-10-21 cs.CL 81%

Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes From

Changjiang Gao, Hankun Lin, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Jiajun Chen, Shujian Huang

机构 * National Key Laboratory for Novel Software Technology, Nanjing University（新型软件技术国家重点实验室，南京大学）； China Mobile Research Beijing, China（中国移动北京研究院）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；post-training(abstract)

2411.12164 2025-10-21 cs.LG cs.AI 81%

Diffusion Transformers as Open-World Spatiotemporal Foundation Models

Yuan Yuan, Chonghua Han, Jingtao Ding, Guozhen Zhang, Depeng Jin, Yong Li

机构 * Department of Electronic Engineering, BNRist, Tsinghua University（电子工程系，BNRist，清华大学）

专题命中预训练与数据：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by NeurIPS 2025

2510.16819 2025-10-21 cs.CL 79%

Cross-Genre Authorship Attribution via LLM-Based Retrieve-and-Rerank

Shantanu Agarwal, Joel Barry, Steven Fincke, Scott Miller

机构 * Information Sciences Institute（信息科学研究所）； University of Southern California（南加州大学）

专题命中预训练与数据：LLM(title,abstract)；分类 cs.CL

2510.17014 2025-10-21 cs.CV 78%

Do Satellite Tasks Need Special Pretraining?

Ani Vanyan, Alvard Barseghyan, Hakob Tamazyan, Tigran Galstyan, Vahan Huroyan, Naira Hovakimyan, Hrant Khachatrian

机构 * YerevaNN research lab and YSU（YerevaNN研究实验室和YSU）； Saint Louis University（圣路易斯大学）； University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中预训练与数据：pretraining(title)；foundation model(abstract)

2510.17185 2025-10-21 cs.LG 77%

Robustness in Text-Attributed Graph Learning: Insights, Trade-offs, and New Defenses

Runlin Lei, Lu Yi, Mingguo He, Pengyu Qiu, Zhewei Wei, Yongchao Liu, Chuntao Hong

机构 * Renmin University of China（中国人民大学）； National University of Singapore（新加坡国立大学）； Ant Group（蚂蚁集团）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；SFT(abstract)；分类 cs.LG

2510.17033 2025-10-21 cs.CR 75%

Watermark Robustness and Radioactivity May Be at Odds in Federated Learning

Leixu Huang, Zedian Shao, Teodora Baluta

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 9 pages, 4 figures (not including citation and appendix) submitted to ICLR 2026

2510.02456 2025-10-21 cs.LG cs.AI cs.NA math.NA 73%

Market-Driven Subset Selection for Budgeted Training

Ashish Jha, Valentin Leplat, AH Phan

机构 * Skolkovo Institute of Science and Technology（斯克洛夫诺科学与技术研究所）； Innopolis University（因诺波利斯大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Retitled major revision of the same work (formerly "Market-Based Data Subset Selection -- Principled Aggregation of Multi-Criteria Example Utility"). Abstract and exposition revised; ablations added; theory clarified. Core results unchanged. Supersedes v1; please process as a replacement

2502.09004 2025-10-21 cs.CL cs.CY cs.LG 73%

Hope vs. Hate: Understanding User Interactions with LGBTQ+ News Content in Mainstream US News Media through the Lens of Hope Speech

Jonathan Pofcher, Christopher M. Homan, Randall Sell, Ashiqur R. KhudaBukhsh

机构 * Rochester Institute of Technology（罗切斯特理工学院）； Drexel University（德雷塞尔大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2510.16007 2025-10-21 cs.LG cs.AI 73%

Layer-Aware Influence for Online Data Valuation Estimation

Ziao Yang, Longbo Huang, Hongfu Liu

机构 * Department of Computer Science（计算机科学系）； Brandeis University（布兰迪斯大学）； Institute for Interdisciplinary Information Sciences（交叉信息科学研究院）； Tsinghua University（清华大学）

专题命中预训练与数据：LLM(abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

2510.16987 2025-10-21 cs.CL 70%

Back to Bytes: Revisiting Tokenization Through UTF-8

Amit Moryossef, Clara Meister, Pavel Stepachev, Desmond Elliott

专题命中预训练与数据：language model(abstract)；post-training(abstract)；分类 cs.CL

2510.16320 2025-10-21 cs.CV 67%

Scaling Laws for Deepfake Detection

Wenhao Wang, Longqi Cai, Taihong Xiao, Yuxiao Wang, Ming-Hsuan Yang

机构 * University of Technology Sydney（悉尼技术大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)

2510.17720 2025-10-21 cs.CL cs.AI 62%

PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognition

Nanda Kumar Rengarajan, Jun Yan, Chun Wang

机构 * Concordia University（康科德大学）

专题命中预训练与数据：instruction tuning(abstract)；分类 cs.CL、cs.AI

2510.14947 2025-10-21 cs.RO cs.AI cs.LG cs.SY eess.SY 62%

Architecture Is All You Need: Diversity-Enabled Sweet Spots for Robust Humanoid Locomotion

Blake Werner, Lizhi Yang, Aaron D. Ames

机构 * Caltech MCE（Caltech机械工程系）

专题命中预训练与数据：pretraining(abstract)；分类 cs.AI、cs.LG

Comments 8 pages

2510.17661 2025-10-21 cs.LG 57%

Handling Extreme Class Imbalance: Using GANs in Data Augmentation for Suicide Prediction

Vaishnavi Visweswaraiah, Tanvi Banerjee, William Romine

机构 * Management (Harrisburg University of Science \& Technology), Harrisburg, USA ； Engineering (Wright State University), Fairborn, USA ； Biological Science (Wright State University), Fairborn, USA

专题命中预训练与数据：prompting(abstract)；分类 cs.LG

2510.17504 2025-10-21 cs.CL 57%

Lingua Custodi's participation at the WMT 2025 Terminology shared task

Jingshu Liu, Raheel Qader, Gaëtan Caillaut, Mariam Nakhlé

机构 * Lingua Custodia

专题命中预训练与数据：language model(abstract)；分类 cs.CL

2510.16016 2025-10-21 cs.LG physics.flu-dyn 57%

Transfer learning strategies for accelerating reinforcement-learning-based flow control

Saeed Salehi

机构 * Division of Applied Thermodynamics and Fluid Mechanics, Department of Management and Engineering, Linköping University（应用热力学与流体力学系，管理与工程系，林雪平大学）

专题命中预训练与数据：pretraining(abstract)；分类 cs.LG

2501.09824 2025-10-21 cs.HC 50%

Improving Automated Feedback Systems for Tutor Training in Low-Resource Scenarios through Data Augmentation

Chentianye Xu, Jionghao Lin, Tongshuang Wu, Vincent Aleven, Kenneth R. Koedinger

专题命中预训练与数据：prompting(abstract)

Comments 15 pages, 7 figures

2510.16617 2025-10-21 cs.RO 50%

MoS-VLA: A Vision-Language-Action Model with One-Shot Skill Adaptation

Ruihan Zhao, Tyler Ingebrand, Sandeep Chinchali, Ufuk Topcu

机构 * University of Texas at Austin（德克萨斯大学奥斯汀分校）

专题命中预训练与数据：pretraining(abstract)

2510.17402 2025-10-21 cs.CL cs.AI cs.LG 91%

Leveraging Group Relative Policy Optimization to Advance Large Language Models in Traditional Chinese Medicine

Jiacheng Xie, Shuai Zeng, Yang Yu, Xiaoting Tang, Guanghui An, Dong Xu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；foundation model(abstract)

2503.03313 2025-10-21 cs.LG cs.CL 91%

LLM as GNN: Graph Vocabulary Learning for Text-Attributed Graph Foundation Models

Xi Zhu, Haochen Xue, Ziwei Zhao, Wujiang Xu, Jingyuan Huang, Minghao Guo, Qifan Wang, Kaixiong Zhou, Imran Razzak, Yongfeng Zhang

机构 * Rutgers University（罗格斯大学）； Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)（穆罕默德·本·扎耶德人工智能大学）； University of Science and Technology of China（中国科学技术大学）； Meta AI ； North Carolina State University（北卡罗来纳州立大学）

专题命中指令微调：LLM(title,abstract)；foundation model(title,abstract)；large language model(abstract)；language model(abstract)

2510.07230 2025-10-21 cs.CL 89%

Customer-R1: Personalized Simulation of Human Behaviors via RL-based LLM Agent in Online Shopping

Ziyi Wang, Yuxuan Lu, Yimeng Zhang, Jing Huang, Dakuo Wang

机构 * Northeastern University（东北大学）； Michigan State University（密歇根州立大学）； Amazon（亚马逊）

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

2510.16089 2025-10-21 cs.LG cs.AI 88%

STABLE: Gated Continual Learning for Large Language Models

William Hoy, Nurcin Celik

机构 * Department of Industrial and Systems Engineering, University of Miami（工业与系统工程系，迈阿密大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

1. 预训练与数据 26 篇