语言大模型 / LLM

NovoMolGen: Rethinking Molecular Language Model Pretraining

Kamran Chitsaz, Roshan Balaji, Quentin Fournier, Nirav Pravinbhai Bhatt, Sarath Chandar

机构 * Mila – Quebec AI Institute（魁北克AI研究所） ； Wadhwani School of Data Science and AI, IIT Madras（数据科学与人工智能学院，印度理工学院马德拉斯分校） ； The Centre for Integrative Biology and Systems medicinE (IBSE)（整合生物学与系统医学中心） ； IIT Madras Zanzibar（印度理工学院马德拉斯分校（赞赞比尔）） ； Polytechnique Montréal Canada（蒙特利尔理工学院，加拿大） ； CIFAR AI Chair（CIFAR人工智能主席） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title,abstract)；large language model(abstract)；foundation model(abstract)

Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making

Yuanjun Feng, Vivek Choudhary, Yash Raj Shrestha

机构 * University of Lausanne（洛桑大学） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 预训练与数据 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted to EMNLP 2025 (Main Conference)

InteChar: A Unified Oracle Bone Character List for Ancient Chinese Language Modeling

Xiaolei Diao, Zhihan Zhou, Lida Shi, Ting Wang, Ruihua Qi, Hao Xu, Daqian Shi

专题命中 预训练与数据 ：language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Probabilistic Pretraining for Neural Regression

Boris N. Oreshkin, Shiv Tavker, Dmitry Efimov

机构 * Amazon（亚马逊） 纠错

专题命中 预训练与数据 ：pretraining(title)；foundation model(abstract)；分类 cs.LG

ARSP: Automated Repair of Verilog Designs via Semantic Partitioning

Bingkun Yao, Ning Wang, Xiangfeng Liu, Yuxin Du, Yuchen Hu, Hong Gao, Zhe Jiang, Nan Guan

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)

From Linearity to Non-Linearity: How Masked Autoencoders Capture Spatial Correlations

Anthony Bisulco, Rahul Ramesh, Randall Balestriero, Pratik Chaudhari

机构 * University of Pennsylvania（宾夕法尼亚大学） ； Brown University（布朗大学） 纠错

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)

Establishing Task Scaling Laws via Compute-Efficient Model Ladders

Akshita Bhagia, Jiacheng Liu, Alexander Wettig, David Heineman, Oyvind Tafjord, Ananya Harsh Jha, Luca Soldaini, Noah A. Smith, Dirk Groeneveld, Pang Wei Koh, Jesse Dodge, Hannaneh Hajishirzi

机构 * Allen Institute for AI（艾伦人工智能研究所） ； University of Washington（华盛顿大学） ； Princeton University（普林斯顿大学） 纠错

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Comments COLM 2025

HandCraft: Dynamic Sign Generation for Synthetic Data Augmentation

Gaston Gustavo Rios, Pedro Dal Bianco, Franco Ronchetti, Facundo Quiroga, Oscar Stanchi, Santiago Ponte Ahón, Waldo Hasperué

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.LG

Comments 26 pages, 4 figures, 9 tables, code available at https://github.com/okason97/HandCraft

LLM-as-classifier: Semi-Supervised, Iterative Framework for Hierarchical Text Classification using Large Language Models

Doohee You, Andy Parisi, Zach Vander Velden, Lara Dantas Inojosa

机构 * Google（谷歌） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(title)；分类 cs.CL

Comments 20 pages excluding reference list, 2 figures

ALAS: Autonomous Learning Agent for Self-Updating Language Models

Dhruv Atreja

机构 * Dhruv Atreja（独立研究者） 纠错

专题命中 指令微调 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)；SFT(abstract)

TULIP: Adapting Open-Source Large Language Models for Underrepresented Languages and Specialized Financial Tasks

İrem Demirtaş, Burak Payzun, Seçil Arslan

机构 * Data Science & AI, Prometeia SPA（数据科学与人工智能，Prometeia公司） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments IJCAI 2025 - FinLLM Workshop

Decentralized Low-Rank Fine-Tuning of Large Language Models

Sajjad Ghiasvand, Mahnoosh Alizadeh, Ramtin Pedarsani

机构 * Electrical and Computer Engineering Department, UC Santa Barbara（加州大学圣芭芭拉分校电气与计算机工程系） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Generative Foundation Model for Structured and Unstructured Electronic Health Records

Sonish Sivarajkumar, Hang Zhang, Yuelyu Ji, Maneesh Bilalpur, Xizhi Wu, Chenyu Li, Min Gu Kwak, Shyam Visweswaran, Yanshan Wang

专题命中 指令微调 ：foundation model(title,abstract)；large language model(abstract)；language model(abstract)；pretraining(abstract)

CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency

Zhanming Shen, Hao Chen, Yulei Tang, Shaolin Zhu, Wentao Ye, Xiaomeng Hu, Haobo Wang, Gang Chen, Junbo Zhao

机构 * Zhejiang University（浙江大学） ； University of Science and Technology of China（中国科学技术大学） ； Tianjin University（天津大学） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2025 Main

QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance Reasoning

Mohammad AL-Smadi

机构 * Qatar University（卡塔尔大学） 纠错

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；prompting(abstract)

Chemical Language Model Linker: blending text and molecules with modular adapters

Yifan Deng, Spencer S. Ericksen, Anthony Gitter

机构 * Department of Computer Sciences, University of Wisconsin-Madison（威斯康星大学麦迪逊分校计算机科学系） ； Drug Development Core, Small Molecule Screening Facility, University of Wisconsin Carbone Cancer Center, University of Wisconsin-Madison（威斯康星大学卡本纳癌症中心药物开发核心、小分子筛选设施） ； Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison（威斯康星大学麦迪逊分校生物统计学与医学信息学系） 纠错

专题命中 指令微调 ：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

Comments 63 pages, 13 figures

Cyberbullying Detection via Aggression-Enhanced Prompting

Aisha Saeid, Anu Sabu, Girish A. Koushik, Ferrante Neri, Diptesh Kanojia

机构 * NICE Research Group & Institute for People-Centred AI, School of Computer Science & Electronic Engineering, University of Surrey, UK（NICE研究组及以人为本的人工智能研究所、计算机科学与电子工程学院、萨里大学） 纠错

专题命中 指令微调 ：prompting(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to RANLP 2025

RL Is Neither a Panacea Nor a Mirage: Understanding Supervised vs. Reinforcement Learning Fine-Tuning for LLMs

Hangzhan Jin, Sicheng Lv, Sifan Wu, Mohammad Hamdaqa

机构 * PolyTechnique Montreal（蒙特利尔大学） ； Mila（Mila研究院） ； McGill（麦吉尔大学） ； UDeM（UDeM大学） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；post-training(abstract)；SFT(abstract)

VT-LVLM-AR: A Video-Temporal Large Vision-Language Model Adapter for Fine-Grained Action Recognition in Long-Term Videos

Kaining Li, Shuwei He, Zihan Xu

机构 * Xidian University（西电大学） 纠错

专题命中 指令微调 ：language model(title,abstract)；large language model(abstract)

Beyond Human-prompting: Adaptive Prompt Tuning with Semantic Alignment for Anomaly Detection

Pi-Wei Chen, Jerry Chun-Wei Lin, Wei-Han Chen, Jia Ji, Zih-Ching Chen, Feng-Hao Yeh, Chao-Chun Chen

机构 * Silesian University of Technology（西里西亚技术大学） ； National Cheng Kung University（国立成功大学） ； Nvidia AI Technology Center（Nvidia AI技术中心） 纠错

专题命中 指令微调 ：prompting(title)；language model(abstract)；分类 cs.AI

DeepMEL: A Multi-Agent Collaboration Framework for Multimodal Entity Linking

Fang Wang, Tianwei Yan, Zonghao Yang, Minghao Hu, Jun Zhang, Zhunchen Luo, Xiaoying Bai

机构 * School of Computer Science, Peking University（北京大学计算机科学学院） ； School of Information Science and Engineering, Chongqing Jiaotong University（重庆交通大学信息科学与工程学院） ； China Research and Development Academy of Machinery Equipment（机械电子研究发展院） ； Center of Information Research, Academy of Military Science（军事科学信息研究中心） 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

LLMs that Understand Processes: Instruction-tuning for Semantics-Aware Process Mining

Vira Pyrih, Adrian Rebmann, Han van der Aa

机构 * Faculty of Computer Science（计算机科学系） ； University of Vienna（维也纳大学） ； SAP Signavio 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted at IEEE ICPM 2025, 8 pages, 2 figures

Multi-Cache Enhanced Prototype Learning for Test-Time Generalization of Vision-Language Models

Xinyu Chen, Haotian Zhai, Can Zhang, Xiupeng Shi, Ruirui Li

机构 * Shanghai University（上海大学） ； Beijing University of Chemical Technology（北京化工大学） ； University of Minnesota（明尼苏达大学） 纠错

专题命中 指令微调 ：language model(title)；分类 cs.AI

Comments Accepted by ICCV 2025

Research on intelligent generation of structural demolition suggestions based on multi-model collaboration

Zhifeng Yang, Peizong Wu

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Score as Action: Fine-Tuning Diffusion Generative Models by Continuous-time Reinforcement Learning

Hanyang Zhao, Haoxian Chen, Ji Zhang, David D. Yao, Wenpin Tang

机构 * StonyBrook（石溪大学） 纠错

专题命中 指令微调 ：RLHF(abstract)；分类 cs.AI、cs.LG

Comments arXiv admin note: text overlap with arXiv:2409.08400

LearnLM: Improving Gemini for Learning

LearnLM Team, Abhinit Modi, Aditya Srikanth Veerubhotla, Aliya Rysbek, Andrea Huber, Brett Wiltshire, Brian Veprek, Daniel Gillick, Daniel Kasenberg, Derek Ahmed, Irina Jurenka, James Cohan, Jennifer She, Julia Wilkowski, Kaiz Alarakyia, Kevin R. McKee, Lisa Wang, Markus Kunesch, Mike Schaekermann, Miruna Pîslar, Nikhil Joshi, Parsa Mahmoudieh, Paul Jhun, Sara Wiltberger, Shakir Mohamed, Shashank Agarwal, Shubham Milind Phal, Sun Jae Lee, Theofilos Strinopoulos, Wei-Jen Ko, Amy Wang, Ankit Anand, Avishkar Bhoopchand, Dan Wild, Divya Pandya, Filip Bar, Garth Graham, Holger Winnemoeller, Mahvish Nagda, Prateek Kolhar, Renee Schneider, Shaojian Zhu, Stephanie Chan, Steve Yadlowsky, Viknesh Sounderajah, Yannis Assael

机构 * Google（谷歌） 纠错

专题命中 指令微调 ：post-training(abstract)；分类 cs.AI、cs.LG

Do What? Teaching Vision-Language-Action Models to Reject the Impossible

Wen-Han Hsieh, Elvis Hsieh, Dantong Niu, Trevor Darrell, Roei Herzig, David M. Chan

机构 * University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 指令微调 ：instruction tuning(abstract)；分类 cs.AI

Comments 9 pages, 2 figures, 1 table

Fine-Tuning Universal Machine-Learned Interatomic Potentials: A Tutorial on Methods and Applications

Xiaoqing Liu, Kehan Zeng, Zedong Luo, Yangshuai Wang, Teng Zhao, Zhenli Xu

专题命中 指令微调 ：foundation model(abstract)

On the Evolution of Federated Post-Training Large Language Models: A Model Accessibility View

Tao Guo, Junxiao Wang, Fushuo Huo, Laizhong Cui, Song Guo, Jie Gui, Dacheng Tao

机构 * Shenzhen University（深圳大学） ； Guangzhou University（广州大学） ； PolyU ； HKUST（香港科技大学） ； Southeast University（东南大学） ； NTU（南洋理工大学） 纠错

专题命中 后训练与偏好优化 ：large language model(title,abstract)；language model(title,abstract)；post-training(title,abstract)；分类 cs.LG

KG-o1: Enhancing Multi-hop Question Answering in Large Language Models via Knowledge Graph Integration

Nan Wang, Yongqi Fan, yansha zhu, ZongYu Wang, Xuezhi Cao, Xinyan He, Haiyun Jiang, Tong Ruan, Jingping Liu

专题命中 后训练与偏好优化 ：large language model(title,abstract)；language model(title,abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI