语言大模型 / LLM

Small or Large? Zero-Shot or Finetuned? Guiding Language Model Choice for Specialized Applications in Healthcare

Lovedeep Gondara, Jonathan Simkin, Graham Sayle, Shebnum Devji, Gregory Arbour, Raymond Ng

机构 * British Columbia Cancer Registry Provincial Health Services Authority（不列颠哥伦比亚省癌症登记处省级卫生服务局） ； Data Science Institute University of British Columbia（数据科学研究所不列颠哥伦比亚大学） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)；small language model(abstract)

How to inject knowledge efficiently? Knowledge Infusion Scaling Law for Pre-training Large Language Models

Kangtao Lv, Haibin Chen, Yujin Yuan, Langming Liu, Shilei Liu, Yongwei Wang, Wenbo Su, Bo Zheng

机构 * Zhejiang University（浙江大学） ； Taobao & Tmall Group of Alibaba（阿里巴巴集团） ； Shanghai AI Laboratory（上海人工智能实验室） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI

Probability Signature: Bridging Data Semantics and Embedding Structure in Language Models

Junjie Yao, Zhi-Qin John Xu

机构 * Institute of Natural Sciences, MOE-LSC, Shanghai Jiao Tong University（上海交通大学自然科学研究院） ； School of Mathematical Sciences, Shanghai Jiao Tong University（上海交通大学数学科学学院） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；large language model(abstract)；分类 cs.LG

What are Foundation Models Cooking in the Post-Soviet World?

Anton Lavrouk, Tarek Naous, Alan Ritter, Wei Xu

机构 * Georgia Institute of Technology（佐治亚理工学院） 纠错

专题命中 预训练与数据 ：foundation model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 Main Conference

Investigating Security Implications of Automatically Generated Code on the Software Supply Chain

Xiaofan Li, Xing Gao

机构 * Xiaofan Li ； Xing Gao 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision Models

Ada Yi Zhao, Aditya Gunturu, Ellen Yi-Luen Do, Ryo Suzuki

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments To appear at UIST 2025

Beyond Language Barriers: Multi-Agent Coordination for Multi-Language Code Generation

Micheline Bénédicte Moumoula, Serge Lionel Nikiema, Albérick Euraste Djire, Abdoul Kader Kabore, Jacques Klein, Tegawendé F. Bissyande

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Procedural Environment Generation for Tool-Use Agents

Michael Sullivan, Mareike Hartmann, Alexander Koller

机构 * Department of Language Science and Technology（语言科学与技术系） ； Saarland Informatics Campus（萨尔兰信息学校区） ； Saarland University（萨尔兰大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；SFT(abstract)；分类 cs.LG

Comments 16 pages, 3 figures; accepted at EMNLP 2025

EnAnchored-X2X: English-Anchored Optimization for Many-to-Many Translation

Sen Yang, Yu Bao, Yu Lu, Jiajun Chen, Shujian Huang, Shanbo Cheng

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025

Charting a Decade of Computational Linguistics in Italy: The CLiC-it Corpus

Chiara Alzetta, Serena Auriemma, Alessandro Bondielli, Luca Dini, Chiara Fazzone, Alessio Miaschi, Martina Miliani, Marta Sartor

机构 * CNR（意大利国家研究理事会） ； University of Pisa（比萨大学） ； CoLingLab（语言学协作实验室） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Submitted to IJCoL

Unmasking Fake Careers: Detecting Machine-Generated Career Trajectories via Multi-layer Heterogeneous Graphs

Michiharu Yamashita, Thanh Tran, Delvin Ce Zhang, Dongwon Lee

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Comments Accepted at EMNLP 2025 Main

Pretrained deep models outperform GBDTs in Learning-To-Rank under label scarcity

Charlie Hou, Kiran Koshy Thekumparampil, Michael Shavlovsky, Giulia Fanti, Yesh Dattatreya, Sujay Sanghavi

机构 * Department of Electrical and Computer Engineering（电气与计算机工程系） ； Carnegie Mellon University（卡内基梅隆大学） ； Amazon（亚马逊） ； Department of Computer Science（计算机科学系） ； University of Texas at Austin（德克萨斯大学奥斯汀分校） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments Published in TMLR, ICML-MFPL 2023 Workshop Oral, SPIGM@ICML2024

Evaluating Language Translation Models by Playing Telephone

Syeda Jannatus Saba, Steven Skiena

机构 * Stony Brook University（石溪大学） 纠错

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 Main Conference as a long paper

CLOSP: A Unified Semantic Space for SAR, MSI, and Text in Remote Sensing

Daniele Rege Cambrin, Lorenzo Vaiani, Giuseppe Gallipoli, Luca Cagliero, Paolo Garza

机构 * Politecnico di Torino（托斯大学） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL

Mouse-Guided Gaze: Semi-Supervised Learning of Intention-Aware Representations for Reading Detection

Seongsil Heo, Roberto Manduchi

专题命中 预训练与数据 ：pretraining(abstract)；foundation model(comments)

Comments Accepted at NeurIPS 2025 Foundation Models for the Brain and Body NeurIPS 2025 Workshop

Do Code Semantics Help? A Comprehensive Study on Execution Trace-Based Information for Code Large Language Models

Jian Wang, Xiaofei Xie, Qiang Hu, Shangqing Liu, Yi Li

机构 * Singapore Management University（新加坡国立管理学院） ； Nanyang Technological University（南洋理工大学） ； Tianjin University（天津大学） ； State Key Laboratory for Novel Software Technology（新型软件技术国家重点实验室） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；post-training(abstract)

Comments EMNLP2025-findings https://openreview.net/forum?id=d4ICISW2T4

PromptCoT 2.0: Scaling Prompt Synthesis for Large Language Model Reasoning

Xueliang Zhao, Wei Wu, Jian Guan, Zhuocheng Gong, Lingpeng Kong

机构 * The University of Hong Kong（香港大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；SFT(abstract)

Comments Preprint

Can Audio Large Language Models Verify Speaker Identity?

Yiming Ren, Xuenan Xu, Baoxiang Li, Shuai Wang, Chao Zhang

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Nanjing University（南京大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)

Automated Repair of Ambiguous Problem Descriptions for LLM-Based Code Generation

Haoxiang Jia, Robbie Morris, He Ye, Federica Sarro, Sergey Mechtaev

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Playpen: An Environment for Exploring Learning Through Conversational Interaction

Nicola Horst, Davide Mazzaccara, Antonia Schmidt, Michael Sullivan, Filippo Momentè, Luca Franceschetti, Philipp Sadler, Sherzod Hakimov, Alberto Testoni, Raffaella Bernardi, Raquel Fernández, Alexander Koller, Oliver Lemon, David Schlangen, Mario Giulianelli, Alessandro Suglia

机构 * University of Potsdam（波恩大学） ； University of Trento（特伦特大学） ； Saarland University（萨尔大学） ； ETH Zurich（苏黎世联邦理工学院） ； Amsterdam UMC（阿姆斯特丹医疗中心） ； Free University of Bozen Bolzano（博兹纳自由大学） ； University of Amsterdam（阿姆斯特丹大学） ； Heriot-Watt University（赫里奥特-瓦特大学） ； DFKI（德意志联邦研究所） ； UCL（伦敦大学学院） ； University of Edinburgh（爱丁堡大学） 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Comments Accepted at EMNLP 2025 (Main) Source code: https://github.com/lm-playpen/playpen Please send correspodence to: lm-playschool@googlegroups.com

mdok of KInIT: Robustly Fine-tuned LLM for Binary and Multiclass AI-Generated Text Detection

Dominik Macko

机构 * Kempelen Institute of Intelligent Technologies（凯普伦智能技术研究所） 纠错

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 1st rank in both subtasks of the Voight-Kampff Generative AI Detection 2025 shared task (PAN@CLEF 2025)

Journal ref CLEF 2025 Working Notes

Anatomy of a Feeling: Narrating Embodied Emotions via Large Vision-Language Models

Mohammad Saim, Phan Anh Duong, Cat Luong, Aniket Bhanderi, Tianyu Jiang

机构 * University of Cincinnati（辛辛那提大学） 纠错

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL

A Federated Fine-Tuning Paradigm of Foundation Models in Heterogenous Wireless Networks

Jingyi Wang, Zhongyuan Zhao, Qingtian Wang, Zexu Li, Yue Wang, Tony Q. S. Quek

机构 * Wireless AI System Research Team, China Telecom Research Institute（中国电信研究院无线AI系统研究团队） ； The State Key Laboratory of Networking and Switching Technology Beijing University of Posts and Telecommunications（北京邮电大学网络与交换技术国家重点实验室） ； Singapore University of Technology and Design（新加坡科技设计大学） 纠错

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI

LASER: Stratified Selective Sampling for Instruction Tuning with Dedicated Scoring Strategy

Paramita Mirza, Lucas Weber, Fabian Küch

机构 * ScaDS.AI & TU Dresden（ScaDS.AI与德累斯顿技术大学） ； Fraunhofer IIS（弗劳恩霍夫研究所） 纠错

专题命中 指令微调 ：instruction tuning(title)；post-training(abstract)；分类 cs.CL

Comments Accepted at Findings of the Association for Computational Linguistics: EMNLP 2025

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning

Yixin Shen

机构 * Department of Statistics and Data Science（统计与数据科学系） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

UserRL: Training Interactive User-Centric Agent via Reinforcement Learning

Cheng Qian, Zuxin Liu, Akshara Prabhakar, Jielin Qiu, Zhiwei Liu, Haolin Chen, Shirley Kokane, Heng Ji, Weiran Yao, Shelby Heinecke, Silvio Savarese, Caiming Xiong, Huan Wang

机构 * Salesforce AI Research（Salesforce AI研究院） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 指令微调 ：SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 28 Pages, 15 Figures, 6 Tables; Built upon latest UserBench release: arXiv:2507.22034

VisualTrap: A Stealthy Backdoor Attack on GUI Agents via Visual Grounding Manipulation

Ziang Ye, Yang Zhang, Wentao Shi, Xiaoyu You, Fuli Feng, Tat-Seng Chua

机构 * University of Science and Technology of China（中国科学技术大学） ； National University of Singapore（新加坡国立大学） ； East China University of Science and Technology（东华大学） 纠错

专题命中 指令微调 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted in COLM2025

BAP v2: An Enhanced Task Framework for Instruction Following in Minecraft Dialogues

Prashant Jayannavar, Liliang Ren, Marisa Hudspeth, Risham Sidhu, Charlotte Lambert, Ariel Cordes, Elizabeth Kaplan, Anjali Narayan-Chen, Julia Hockenmaier

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； Microsoft（微软） ； University of Massachusetts Amherst（马萨诸塞大学阿姆赫斯特分校） ； Amazon（亚马逊） ； Amazon AGI（亚马逊人工智能实验室） 纠错

专题命中 指令微调 ：LLM(abstract)；分类 cs.CL、cs.AI

Comments major revision; few examples of changes: added contemporary LLMs and new SOTA model, improved readability, expanded related work, etc

OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigation

Noriaki Hirose, Catherine Glossop, Dhruv Shah, Sergey Levine

专题命中 指令微调 ：foundation model(abstract)；分类 cs.LG

Comments 9 pages, 7 figures, 6 tables

Logics-Parsing Technical Report

Xiangyang Chen, Shuzhao Li, Xiuwen Zhu, Yongfan Chen, Fan Yang, Cheng Fang, Lin Qu, Xiaoxiao Xu, Hu Wei, Minggang Wu

机构 * Alibaba Group（阿里巴巴集团） 纠错

专题命中 指令微调 ：language model(abstract)