语言大模型 / LLM

MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Mesh

Shuangkang Fang, I-Chao Shen, Yufeng Wang, Yi-Hsuan Tsai, Yi Yang, Shuchang Zhou, Wenrui Ding, Takeo Igarashi, Ming-Hsuan Yang

机构 * Beihang University（北航大学） ； The University of Tokyo（东京大学） ； Atmanity Inc.（Atmanity公司） ； StepFun Inc.（StepFun公司） ； UC Merced（加州大学默塞德分校） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted by ICCV. Project Website: https://sk-fun.fun/MeshLLM

Kronos: A Foundation Model for the Language of Financial Markets

Yu Shi, Zongliang Fu, Shuo Chen, Bohan Zhao, Wei Xu, Changshui Zhang, Jian Li

专题命中 预训练与数据 ：foundation model(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Can Performant LLMs Be Ethical? Quantifying the Impact of Web Crawling Opt-Outs

Dongyang Fan, Vinko Sabolčec, Matin Ansaripour, Ayush Kumar Tarun, Martin Jaggi, Antoine Bosselut, Imanol Schlag

机构 * EPFL（苏黎世联邦理工学院） ； ETH Zürich（苏黎世联邦理工学院） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；pretraining(abstract)

Comments COLM 2025 Camera Ready version

Negation-Aware Test-Time Adaptation for Vision-Language Models

Haochen Han, Alex Jinpeng Wang, Fangming Liu, Jun Zhu

机构 * Department of AI Computing, Pengcheng Laboratory（人工智能计算系，鹏城实验室） ； School of Computer Science and Technology, Central South University（计算机科学与技术学院，中南大学） ； Department of Computer Science and Technology, Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint Center for ML, Tsinghua University（计算机科学与技术系，人工智能研究院，BNRist中心，THBI实验室，清华-博世联合人工智能中心，清华大学） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；post-training(abstract)

Comments This paper will be submitted to the IEEE for possible publication

No LLM Solved Yu Tsumura's 554th Problem

Simon Frieder, William Hart

机构 * University of Oxford（牛津大学） ； University of Cambridge（剑桥大学） 纠错

专题命中 预训练与数据 ：LLM(title,abstract)；分类 cs.LG

Comments 67 pages

Urban In-Context Learning: Bridging Pretraining and Inference through Masked Diffusion for Urban Profiling

Ruixing Zhang, Bo Wang, Tongyu Zhu, Leilei Sun, Weifeng Lv

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation

Vinicius Lima, Dzung T. Phan, Jayant Kalagnanam, Dhaval Patel, Nianjun Zhou

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 25 pages

SmartLLMs Scheduler: A Framework for Cost-Effective LLMs Utilization

Yueyue Liu, Hongyu Zhang, Yuantian Miao

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?

Wenxuan Shen, Mingjia Wang, Yaochen Wang, Dongping Chen, Junjie Yang, Yao Wan, Weiwei Lin

机构 * South China University of Technology（华南理工大学） ； Huazhong University of Science and Technology（华中科技大学） ； University of Maryland（马里兰大学） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments In submission. Project website: https://double-bench.github.io/

Video Is Worth a Thousand Images: Exploring the Latest Trends in Long Video Generation

Faraz Waseem, Muhammad Shahzad

机构 * University Of Reading（阅读大学） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 35 pages, 18 figures, Manuscript submitted to ACM

CLIPPER: Compression enables long-context synthetic data generation

Chau Minh Pham, Yapei Chang, Mohit Iyyer

机构 * University of Maryland, College Park（马里兰大学 College Park 分校） ； University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校） 纠错

专题命中 预训练与数据 ：LLM(abstract)；分类 cs.CL

Comments Accepted to COLM 2025

A Bayesian Hybrid Parameter-Efficient Fine-Tuning Method for Large Language Models

Yidong Chai, Yang Liu, Yonghang Zhou, Jiaheng Xie, Daniel Dajun Zeng

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Memorization in Fine-Tuned Large Language Models

Danil Savine

机构 * PSL University（PSL大学） ； PRAIRIE Research Institute（PRAIRIE研究机构） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Tackling Distribution Shift in LLM via KILO: Knowledge-Instructed Learning for Continual Adaptation

Iing Muttakhiroh, Thomas Fevens

机构 * Concordia University（康科迪亚大学） 纠错

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

Following Route Instructions using Large Vision-Language Models: A Comparison between Low-level and Panoramic Action Spaces

Vebjørn Haug Kåsene, Pierre Lison

机构 * University of Oslo（奥斯陆大学） ； Norwegian Computing Center（挪威计算中心） 纠错

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted to ICNSLP 2025

Towards Revealing the Effectiveness of Small-Scale Fine-tuning in R1-style Reinforcement Learning

Yutong Chen, Jiandong Gao, Ji Wu

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；SFT(abstract)；分类 cs.AI、cs.LG

Comments preprint

ZenFlow: Enabling Stall-Free Offloading Training via Asynchronous Updates

Tingfeng Lan, Yusen Wu, Bin Ma, Zhaoyuan Su, Rui Yang, Tekin Bicer, Masahiro Tanaka, Olatunji Ruwase, Dong Li, Yue Cheng

机构 * University of Virginia（弗吉尼亚大学） ； University of California, Merced（加州大学梅尔塞德斯分校） ； Argonne National Laboratory（阿贡国家实验室） ； Snowflake AI Research（Snowflake人工智能研究） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；prompting(abstract)；分类 cs.LG

Comments 13 pages, 16 figures

LLM-based IR-system for Bank Supervisors

Ilias Aarab

机构 * European Central Bank（欧洲中央银行） 纠错

专题命中 指令微调 ：LLM(title)；分类 cs.AI、cs.LG

Journal ref Journal-ref: Knowledge-Based Systems 310 (2025) 112914

MoKA: Mixture of Kronecker Adapters

Mohammadreza Sadeghi, Mahsa Ghazvini Nejad, MirHamed Jafarzadeh Asl, Yu Gu, Yuanhao Yu, Masoud Asgharian, Vahid Partovi Nia

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Leveraging Vision-Language Models for Visual Grounding and Analysis of Automotive UI

Benjamin Raphael Ernhofer, Daniil Prokhorov, Jannica Langner, Dominik Bollmann

机构 * SPARKS Solutions GmbH（SPARKS解决方案有限公司） 纠错

专题命中 指令微调 ：language model(title)；分类 cs.AI

A Note on Code Quality Score: LLMs for Maintainable Large Codebases

Sherman Wong, Jalaj Bhandari, Leo Zhou Fan Yang, Xylan Xu, Yi Zhuang, Cem Cayiroglu, Payal Bhuptani, Sheela Yadawad, Hung Duong

专题命中 指令微调 ：LLM(abstract)；SFT(abstract)；分类 cs.AI

Comments 24 pages, ICLR format

Light-IF: Endowing LLMs with Generalizable Reasoning via Preview and Self-Checking for Complex Instruction Following

Chenyang Wang, Liang Wen, Shousheng Jia, Xiangzheng Zhang, Liang Xu

专题命中 指令微调 ：SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, 10 figures, 7 tables

BrainECHO: Semantic Brain Signal Decoding through Vector-Quantized Spectrogram Reconstruction for Whisper-Enhanced Text Generation

Jilong Li, Zhenxi Song, Jiaqi Wang, Meishan Zhang, Honghai Liu, Min Zhang, Zhiguo Zhang

机构 * Harbin Institute of Technology, Shenzhen, China（哈尔滨工业大学（深圳）） ； Peng Cheng Laboratory, China（鹏城实验室） 纠错

专题命中 指令微调 ：language model(abstract)；分类 cs.CL、cs.AI

Comments 8 pages (excluding references), accepted by Findings of ACL 2025

Journal ref Findings of the Association for Computational Linguistics: ACL 2025, pages 2762-2778, July 2025, Vienna, Austria

Fine-Tuning Text-to-Speech Diffusion Models Using Reinforcement Learning with Human Feedback

Jingyi Chen, Ju Seung Byun, Micha Elsner, Pichao Wang, Andrew Perrault

机构 * Department of Linguistics（语言学系） ； Department of Computer Science and Engineering（计算机科学与工程系） 纠错

专题命中 指令微调 ：RLHF(abstract)；分类 cs.AI

Comments 4 pages, 1 figure, INTERSPEECH 2025. arXiv admin note: text overlap with arXiv:2405.14632

Journal ref INTERSPEECH 2025

Causally Steered Diffusion for Automated Video Counterfactual Generation

Nikos Spyrou, Athanasios Vlontzos, Paraskevas Pegios, Thomas Melistas, Nefeli Gkouti, Yannis Panagakis, Giorgos Papanastasiou, Sotirios A. Tsaftaris

机构 * Spotify, UK（英国Spotify） 纠错

专题命中 指令微调 ：language model(abstract)；分类 cs.AI

Aligning Constraint Generation with Design Intent in Parametric CAD

Evan Casey, Tianyu Zhang, Shu Ishida, William P. McCarthy, John Roger Thompson, Amir Khasahmadi, Joseph George Lambourne, Pradeep Kumar Jayaraman, Karl D. D. Willis

机构 * Autodesk Research（Autodesk研究院） 纠错

专题命中 指令微调 ：SFT(abstract)；分类 cs.LG

DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework

Tongchun Zuo, Zaiyu Huang, Shuliang Ning, Ente Lin, Chao Liang, Zerong Zheng, Jianwen Jiang, Yuan Zhang, Mingyuan Gao, Xin Dong

机构 * ByteDance Intelligent Creation（字节跳动智能创作） 纠错

专题命中 指令微调 ：language model(abstract)

Comments 18 pages, 12 figures

Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAS

Bingyu Yan, Ziyi Zhou, Xiaoming Zhang, Chaozhuo Li, Ruilin Zeng, Yirui Qi, Tianbo Wang, Litian Zhang

专题命中 后训练与偏好优化 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；preference optimization(abstract)

Energy-Based Reward Models for Robust Language Model Alignment

Anamika Lochab, Ruqi Zhang

机构 * Department of Computer Science（计算机科学系） ； Purdue University（普渡大学） 纠错

专题命中 后训练与偏好优化 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted by COLM 2025

RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation

Tianjiao Li, Mengran Yu, Chenyu Shi, Yanjun Zhao, Xiaojing Liu, Qiang Zhang, Qi Zhang, Xuanjing Huang, Jiayin Wang

机构 * Bilibili Inc.（哔哩哔哩公司） ； Xi’an Jiaotong University（西安交通大学） ； School of Computer Science, Fudan University（复旦大学计算机科学学院） 纠错

专题命中 后训练与偏好优化 ：LLM(abstract)；large language model(abstract)；language model(abstract)；RLHF(abstract)