语言大模型 / LLM

Large Language Model Scaling Laws for Neural Quantum States in Quantum Chemistry

Oliver Knitter, Dan Zhao, Stefan Leichenauer, Shravan Veerapaneni

机构 * University of Michigan（密歇根大学） ； SandboxAQ ； New York University（纽约大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 16 pages, 5 figures, to be submitted for peer review

Data Scaling Laws for Radiology Foundation Models

Maximilian Ilse, Harshita Sharma, Anton Schwaighofer, Sam Bond-Taylor, Fernando Pérez-García, Olesya Melnichenko, Anne-Marie G. Sykes, Kelly K. Horst, Ashish Khandelwal, Maxwell Reynolds, Maria T. Wetscherek, Noel C. F. Codella, Javier Alvarez-Valle, Korfiatis Panagiotis, Valentina Salvatelli

机构 * Microsoft Health Futures UK（微软健康未来英国） ； Microsoft Health Futures US（微软健康未来美国） ； Mayo Clinic M.D（梅奥诊所） ； Radiology AI Lab, Mayo Clinic M.D（放射学AI实验室，梅奥诊所） ； Microsoft Health & Life Sciences（微软健康与生命科学） ； Cambridge University Hospitals M.D（剑桥大学医院） 纠错

专题命中 预训练与数据 ：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

GPT-4.1 Sets the Standard in Automated Experiment Design Using Novel Python Libraries

Nuno Fachada, Daniel Fernandes, Carlos M. Fernandes, Bruno D. Ferreira-Saraiva, João P. Matos-Carvalho

机构 * Copelabs, Lusófona University（Copelabs与卢斯奥法纳大学） ； Center of Technology and Systems (UNINOVA-CTS) and Associated Lab of Intelligent Systems (LASI)（技术与系统中心（UNINOVA-CTS）及智能系统关联实验室） ； CICANT, Lusófona University（CICANT与卢斯奥法纳大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments The peer-reviewed version of this paper is published in Future Internet at https://doi.org/10.3390/fi17090412. This version is typeset by the author and differs only in pagination and typographical detail

Journal ref Future Internet. 2025; 17(9):412

Agent4FaceForgery: Multi-Agent LLM Framework for Realistic Face Forgery Detection

Yingxin Lai, Zitong Yu, Jun Wang, Linlin Shen, Yong Xu, Xiaochun Cao

专题命中 预训练与数据 ：LLM(title,abstract)

Image Tokenizer Needs Post-Training

Kai Qiu, Xiang Li, Hao Chen, Jason Kuen, Xiaohao Xu, Jiuxiang Gu, Yinyi Luo, Bhiksha Raj, Zhe Lin, Marios Savvides

机构 * Carnegie Mellon University（卡内基梅隆大学） ； Adobe Research（Adobe研究） ； University of Michigan（密歇根大学） 纠错

专题命中 预训练与数据 ：post-training(title,abstract)

Comments 21 pages, 16 figures, 10 tables. arXiv admin note: substantial text overlap with arXiv:2503.08354

WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning

Kuan Li, Zhongwang Zhang, Huifeng Yin, Rui Ye, Yida Zhao, Liwen Zhang, Litu Ou, Dingchu Zhang, Xixi Wu, Jialong Wu, Xinyu Wang, Zile Qiao, Zhen Zhang, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou

专题命中 预训练与数据 ：LLM(abstract)；post-training(abstract)；分类 cs.CL、cs.LG

Comments https://tongyi-agent.github.io/blog/introducing-tongyi-deep-research/

From Surveys to Narratives: Rethinking Cultural Value Adaptation in LLMs

Muhammad Farid Adilazuarda, Chen Cecilia Liu, Iryna Gurevych, Alham Fikri Aji

机构 * MBZUAI ； Technical University of Darmstadt and National Research Center for Applied Cybersecurity ATHENE（德意志技术大学和应用网络安全国家研究中心ATHENE） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Instance-Level Data-Use Auditing of Visual ML Models

Zonghao Huang, Neil Zhenqiang Gong, Michael K. Reiter

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.LG

MEJO: MLLM-Engaged Surgical Triplet Recognition via Inter- and Intra-Task Joint Optimization

Yiyi Zhang, Yuchen Yuan, Ying Zheng, Jialun Pei, Jinpeng Li, Zheng Li, Pheng-Ann Heng

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

AIxcellent Vibes at GermEval 2025 Shared Task on Candy Speech Detection: Improving Model Performance by Span-Level Training

Christian Rene Thelen, Patrick Gustav Blaneck, Tobias Bornheim, Niklas Grieger, Stephan Bialonski

机构 * Department of Medical Engineering and Technomathematics（医学工程与技术学系） ； Institute for Data-Driven Technologies（数据驱动技术研究所） ； FH Aachen University of Applied Sciences（亚琛应用科学大学） ； Academic and Research Department Engineering Hydrology（工程水文学学术与研究部门） ； IT Center RWTH Aachen University（亚琛工业大学IT中心） ； Department for Data Science and AI（数据科学与人工智能部门） ； ORDIX AG（ORDIX公司） ； Department of Information and Computing Sciences（信息与计算科学系） 纠错

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL

Comments 6 pages, 1 figure, 2 tables

Journal ref Proceedings of the 21st Conference on Natural Language Processing (KONVENS 2025): Workshops, pages 398-403, Hannover, Germany

OneRec Technical Report

Guorui Zhou, Jiaxin Deng, Jinghao Zhang, Kuo Cai, Lejian Ren, Qiang Luo, Qianqian Wang, Qigen Hu, Rui Huang, Shiyao Wang, Weifeng Ding, Wuchao Li, Xinchen Luo, Xingmei Wang, Zexuan Cheng, Zixing Zhang, Bin Zhang, Boxuan Wang, Chaoyi Ma, Chengru Song, Chenhui Wang, Di Wang, Dongxue Meng, Fan Yang, Fangyu Zhang, Feng Jiang, Fuxing Zhang, Gang Wang, Guowang Zhang, Han Li, Hengrui Hu, Hezheng Lin, Hongtao Cheng, Hongyang Cao, Huanjie Wang, Jiaming Huang, Jiapeng Chen, Jiaqiang Liu, Jinghui Jia, Kun Gai, Lantao Hu, Liang Zeng, Liao Yu, Qiang Wang, Qidong Zhou, Shengzhe Wang, Shihui He, Shuang Yang, Shujie Yang, Sui Huang, Tao Wu, Tiantian He, Tingting Gao, Wei Yuan, Xiao Liang, Xiaoxiao Xu, Xugang Liu, Yan Wang, Yi Wang, Yiwu Liu, Yue Song, Yufei Zhang, Yunfan Wu, Yunfeng Zhao, Zhanyu Liu

专题命中 预训练与数据 ：LLM(abstract)

Comments Authors are listed alphabetically by their first name

Jailbreaking Large Language Models Through Content Concretization

Johan Wahréus, Ahmed Hussain, Panos Papadimitratos

机构 * Networked Systems Security (NSS) Group（网络系统安全组） ； KTH Royal Institute of Technology（皇家理工学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted for presentation in the Conference on Game Theory and AI for Security (GameSec) 2025

Enhancing LLM-Based Social Bot via an Adversarial Learning Framework

Fanqi Kong, Xiaoyuan Zhang, Xinyu Chen, Yaodong Yang, Song-Chun Zhu, Xue Feng

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Conan-Embedding-v2: Training an LLM from Scratch for Text Embeddings

Shiyu Li, Yang Tang, Ruijie Liu, Shi-Zhe Chen, Xi Chen

机构 * Basic Algorithm Center, PCG, Tencent（基础算法中心、PCG、腾讯） 纠错

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；pretraining(abstract)

Comments EMNLP 2025 Oral

GTA: Supervised-Guided Reinforcement Learning for Text Classification with Large Language Models

Min Zeng, Jingfei Sun, Xueyou Luo, Caiquan Liu, Shiqi Zhang, Li Xie, Xiaoxin Chen

机构 * vivo AI Lab（vivo人工智能实验室） 纠错

专题命中 指令微调 ：large language model(title)；language model(title)；SFT(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2025

ECG-aBcDe: Overcoming Model Dependence, Encoding ECG into a Universal Language for Any LLM

Yong Xia, Jingxuan Li, YeTeng Sun, Jiarui Bu

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 14pages, 6 figures

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning

Yining Huang, Bin Li, Keke Tang, Meilian Chen

机构 * School of Politics and Public Administration, South China Normal University（华南师范大学政治与公共管理学院） ； Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究所） ； University of Chinese Academy of Sciences（中国科学院大学） ； Shenyang institute of computing technology, Chinese academy of sciences（中国科学院沈阳计算技术研究所） 纠错

专题命中 指令微调 ：LLM(title,abstract)；SFT(abstract)；分类 cs.CL、cs.LG

Comments 12 pages

Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study

MSR Avinash

机构 * MSR Avinash（MSR） ； Juspay 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments 8 pages, 3 figures, 2 tables. Primary category: cs.LG (Machine Learning); secondary: cs.AI (Artificial Intelligence). LaTeX source with figures included

RingMo-Aerial: An Aerial Remote Sensing Foundation Model With Affine Transformation Contrastive Learning

Wenhui Diao, Haichen Yu, Kaiyue Kang, Tong Ling, Di Liu, Yingchao Feng, Hanbo Bi, Libo Ren, Xuexue Li, Yongqiang Mao, Xian Sun

机构 * Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院航空信息研究所） ； University of Chinese Academy of Sciences（中国科学院大学） ； Key Laboratory of Target Cognition and Application Technology (TCAT), Aerospace Information Research Institute, Chinese Academy of Sciences（目标认知与应用技术重点实验室（TCAT）） ； Department of Electronic Engineering, Tsinghua University（清华大学电子工程系） 纠错

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI

Defense-to-Attack: Bypassing Weak Defenses Enables Stronger Jailbreaks in Vision-Language Models

Yunhan Zhao, Xiang Zheng, Xingjun Ma

机构 * Fudan University（复旦大学） ； City University of Hong Kong（香港城市大学） 纠错

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE for possible publication

Bi-level Personalization for Federated Foundation Models: A Task-vector Aggregation Approach

Yiyuan Yang, Guodong Long, Qinghua Lu, Liming Zhu, Jing Jiang

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

LLMs for energy and macronutrients estimation using only text data from 24-hour dietary recalls: a parameter-efficient fine-tuning experiment using a 10-shot prompt

Rodrigo M Carrillo-Larco

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

Comments https://github.com/rodrigo-carrillo/LLMs-Macronutrient-Estimation-NHANES-Adolescents

When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning

Mengyi Deng, Xin Li, Tingyu Zhu, Zhicheng Yang, Zhijiang Guo, Wei Wang

专题命中 指令微调 ：SFT(abstract)；preference optimization(abstract)；分类 cs.CL、cs.LG

Towards General Agentic Intelligence via Environment Scaling

Runnan Fang, Shihao Cai, Baixuan Li, Jialong Wu, Guangyu Li, Wenbiao Yin, Xinyu Wang, Xiaobin Wang, Liangcai Su, Zhen Zhang, Shibin Wu, Zhengwei Tao, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou

机构 * Tongyi Lab（通义实验室） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments https://tongyi-agent.github.io/blog/introducing-tongyi-deep-research/

Benchmarking and Improving LVLMs on Event Extraction from Multimedia Documents

Fuyu Xing, Zimu Wang, Wei Wang, Haiyang Zhang

机构 * School of Advanced Technology, Xi’an Jiaotong-Liverpool University（先进技术学院，西安交通大学利物浦大学） 纠错

专题命中 指令微调 ：language model(abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted at INLG 2025. Camera-ready version

A Systematic Evaluation of Parameter-Efficient Fine-Tuning Methods for the Security of Code LLMs

Kiho Lee, Jungkon Kim, Doowon Kim, Hyoungshick Kim

机构 * Samsung Research（三星研究院） ； University of Tennessee, Knoxville（田纳西大学 Knoxville分校） ； Sungkyunkwan University（成均馆大学） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 25 pages

Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder

Qifei Jia, Yu Liu, Yajie Chai, Xintong Yao, Qiming Lu, Yasen Zhang, Runyu Shi, Ying Huang, Guoquan Zhang

机构 * Xiaomi Corporation Beijing, China（小米公司北京） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)

Shaping Explanations: Semantic Reward Modeling with Encoder-Only Transformers for GRPO

Francesco Pappone, Ruggero Marino Lazzaroni, Federico Califano, Niccolò Gentile, Roberto Marras

机构 * AI Sparks（AI火花） ； University of Graz（格拉茨大学） ； Foyer Group（Foyer集团） ； Onepix Academy（Onepix学院） 纠错

专题命中 后训练与偏好优化 ：LLM(abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Scaling Agents via Continual Pre-training

Liangcai Su, Zhen Zhang, Guangyu Li, Zhuo Chen, Chenxi Wang, Maojia Song, Xinyu Wang, Kuan Li, Jialong Wu, Xuanzhong Chen, Zile Qiao, Zhongwang Zhang, Huifeng Yin, Shihao Cai, Runnan Fang, Zhengwei Tao, Wenbiao Yin, Chenxiong Qian, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou

专题命中 后训练与偏好优化 ：large language model(abstract)；language model(abstract)；foundation model(abstract)；post-training(abstract)

Comments https://tongyi-agent.github.io/blog/introducing-tongyi-deep-research/

T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Design

Jiachen Li, Qian Long, Jian Zheng, Xiaofeng Gao, Robinson Piramuthu, Wenhu Chen, William Yang Wang

机构 * UC Santa Barbara（加州大学圣芭芭拉分校） ； UC Los Angeles（加州大学洛杉矶分校） ； Amazon AGI（亚马逊人工智能实验室） ； University of Waterloo（滑铁卢大学） 纠错

专题命中 后训练与偏好优化 ：post-training(title,abstract)；分类 cs.AI

Comments Accepted by ICLR 2025. Project Page: https://t2v-turbo-v2.github.io/