语言大模型 / LLM

Synthetic Data Generation for Phrase Break Prediction with Large Language Model

Hoyeon Lee, Sejung Son, Ye-Eun Kang, Jong-Hwan Kim

机构 * NAVER Cloud ； NHNSouth Korea ； Yale University（耶鲁大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted at Interspeech 2025

A Multi-Faceted Evaluation Framework for Assessing Synthetic Data Generated by Large Language Models

Yefeng Yuan, Yuhong Liu, Liang Cheng

机构 * Santa Clara University（圣克拉拉大学） ； eBay Inc.（eBay公司） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 1 figure, 4 tables

GRR-CoCa: Leveraging LLM Mechanisms in Multimodal Model Architectures

Jake R. Patock, Nicole Catherine Lewis, Kevin McCoy, Christina Gomez, Canling Chen, Lorenzo Luzi

专题命中 预训练与数据 ：LLM(title)；large language model(abstract)；language model(abstract)；pretraining(abstract)

Comments 12 pages, 2 figures

How do language models learn facts? Dynamics, curricula and hallucinations

Nicolas Zucchet, Jörg Bornschein, Stephanie Chan, Andrew Lampinen, Razvan Pascanu, Soham De

机构 * ETH Zürich（苏黎世联邦理工学院） ； Google DeepMind（谷歌DeepMind） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at the 2nd Conference on Language Modeling (2025)

Journal ref Conference on Language Modeling (2025)

LLM-based Embedders for Prior Case Retrieval

Damith Premasiri, Tharindu Ranasinghe, Ruslan Mitkov

机构 * School of Computing and Communications, Lancaster University, UK（计算与通讯学院，兰卡斯特大学） 纠错

专题命中 预训练与数据 ：LLM(title,abstract)；分类 cs.CL

Comments Accepted in Recent Advancements in Natural Language Processing (RANLP 2025) conference

UrbanPulse: A Cross-City Deep Learning Framework for Ultra-Fine-Grained Population Transfer Prediction

Hongrong Yang, Markus Schlaepfer

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

Incentivised Orchestrated Training Architecture (IOTA): A Technical Primer for Release

Felix Quinque, Alan Aboudib, Szymon Fonau, Rodrigo Lopez Portillo Alcocer, Brian McCrindle, Steffen Cruz

机构 * Macrocosmos AI 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.LG

DR.EHR: Dense Retrieval for Electronic Health Record with Knowledge Injection and Synthetic Data

Zhengyun Zhao, Huaiyuan Ying, Yue Zhong, Sheng Yu

机构 * Tsinghua University（清华大学） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Model and code released upon acceptance

Privacy-Preserving Synthetic Review Generation with Diverse Writing Styles Using LLMs

Tevin Atwal, Chan Nam Tieu, Yefeng Yuan, Zhan Shi, Yuhong Liu, Liang Cheng

机构 * Department of Computer Science and Engineering（计算机科学与工程系） ； Santa Clara University（圣克拉拉大学） ； eBay（eBay公司） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Does visualization help AI understand data?

Victoria R. Li, Johnathan Sun, Martin Wattenberg

机构 * Harvard University（哈佛大学） ； Google Research（谷歌研究） 纠错

专题命中 预训练与数据 ：language model(abstract)；分类 cs.AI、cs.LG

Comments 5 pages, 6 figures

PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding

Jang Hyun Cho, Andrea Madotto, Effrosyni Mavroudi, Triantafyllos Afouras, Tushar Nagarajan, Muhammad Maaz, Yale Song, Tengyu Ma, Shuming Hu, Suyog Jain, Miguel Martin, Huiyu Wang, Hanoona Rasheed, Peize Sun, Po-Yao Huang, Daniel Bolya, Nikhila Ravi, Shashank Jain, Tammy Stark, Shane Moon, Babak Damavandi, Vivian Lee, Andrew Westbury, Salman Khan, Philipp Krähenbühl, Piotr Dollár, Lorenzo Torresani, Kristen Grauman, Christoph Feichtenhofer

专题命中 预训练与数据 ：language model(abstract)；分类 cs.AI、cs.LG

Comments Technical Report

Explaining How Visual, Textual and Multimodal Encoders Share Concepts

Clément Cornet, Romaric Besançon, Hervé Le Borgne

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI

The Moral Gap of Large Language Models

Maciej Skorski, Alina Landowska

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.LG

Comments preprint

Understanding the Supply Chain and Risks of Large Language Model Applications

Yujie Ma, Lili Quan, Xiaofei Xie, Qiang Hu, Jiongchi Yu, Yao Zhang, Sen Chen

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments 26 pages

Fine-Tuned Language Models Generate Stable Inorganic Materials as Text

Nate Gruver, Anuroop Sriram, Andrea Madotto, Andrew Gordon Wilson, C. Lawrence Zitnick, Zachary Ulissi

机构 * NYU（纽约大学） ； Meta FAIR 纠错

专题命中 指令微调 ：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.LG

Comments ICLR 2024. Code available at: https://github.com/facebookresearch/crystal-llm

The TEA-ASLP System for Multilingual Conversational Speech Recognition and Speech Diarization in MLC-SLM 2025 Challenge

Hongfei Xue, Kaixun Huang, Zhikai Zhou, Shen Huang, Shidong Shang

机构 * Tencent Ethereal Audio Lab（腾讯灵云音频实验室） ； Tencent Corporation（腾讯公司） 纠错

专题命中 指令微调 ：SLM(title,abstract)；LLM(abstract)；language model(abstract)

Comments Interspeech 2025 workshop

Visual Adaptive Prompting for Compositional Zero-Shot Learning

Kyle Stein, Arash Mahyari, Guillermo Francia, Eman El-Sheikh

机构 * University of West Florida（乌斯托尔大学） ； Florida Institute for Human and Machine Cognition (IHMC)（佛罗里达人类与机器认知研究所） 纠错

专题命中 指令微调 ：prompting(title,abstract)；language model(abstract)；分类 cs.LG

Learning Temporal Abstractions via Variational Homomorphisms in Option-Induced Abstract MDPs

Chang Li, Yaren Zhang, Haoran Lv, Qiong Cao, Chao Xue, Xiaodong He

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；SFT(abstract)；prompting(abstract)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models

Delong Ran, Xinlei He, Tianshuo Cong, Anyu Wang, Qi Li, Xiaoyun Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments This work has been submitted to the IEEE for possible publication

Hybrid Tokenization Strategy for DNA Language Model using Byte Pair Encoding and K-MER Methods

Ganesh Sapkota, Md Hasibur Rahman

机构 * Missouri University of Science and Technology（密苏里科技大学） 纠错

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL

P-React: Synthesizing Topic-Adaptive Reactions of Personality Traits via Mixture of Specialized LoRA Experts

Yuhao Dan, Jie Zhou, Qin Chen, Junfeng Tian, Liang He

机构 * School of Computer Science and Technology, East China Normal University（东华大学计算机科学与技术学院） ； Shanghai Institute of AI for Education, East China Normal University（东华大学人工智能教育研究所） ； Xiaohongshu Inc.（小红书公司） 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs

Zixiao Wang, Duzhen Zhang, Ishita Agrawal, Shen Gao, Le Song, Xiuying Chen

机构 * Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） ； Shandong University（山东省大学） 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted by ACL 2025 Findings

IntentVCNet: Bridging Spatio-Temporal Gaps for Intention-Oriented Controllable Video Captioning

Tianheng Qiu, Jingchun Gao, Jingyu Li, Huiyi Leong, Xuan Huang, Xi Wang, Xiaocheng Zhang, Kele Xu, Lan Zhang

机构 * University of Science and Technology of China（中国科学技术大学） ； Hefei Institutes of Physical Science,Chinese Academy of Sciences（合肥物理研究所，中国科学院） ； Institute of Artificial Intelligence, Hefei Comprehensive National Science Center（人工智能研究所，合肥综合性国家科学中心） ； State Key Lab. for Novel Software Technology, Nanjing University（新型软件技术国家重点实验室，南京大学） ； University of Chicago（芝加哥大学） ； National University of Defense Technology（国防科技大学） ； Harbin Institute of Technology（哈尔滨工业大学） 纠错

专题命中 指令微调 ：LLM(abstract)；language model(abstract)；prompting(abstract)

Zeroth-Order Fine-Tuning of LLMs in Random Subspaces

Ziming Yu, Pan Zhou, Sike Wang, Jia Li, Mi Tian, Hua Huang

机构 * Beijing Normal University（北京师范大学） ； Singapore Management University（新加坡国立大学） ； TAL Education Group（TAL教育集团） ； Engineering Research Center of Intelligent Technology and Educational Application (MOE)（智能技术与教育应用工程研究中心（教育部）） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments ICCV 2025 camera-ready version

Datasets and Recipes for Video Temporal Grounding via Reinforcement Learning

Ruizhe Chen, Zhiting Fan, Tianze Luo, Heqing Zou, Zhaopeng Feng, Guiyang Xie, Hansheng Zhang, Zhuochen Wang, Zuozhu Liu, Huaijian Zhang

机构 * Bytedance（字节跳动） ； Zhejiang University（浙江大学） 纠错

专题命中 指令微调 ：language model(abstract)；SFT(abstract)；分类 cs.AI

DepthDark: Robust Monocular Depth Estimation for Low-Light Environments

Longjian Zeng, Zunjie Zhu, Rongfeng Lu, Ming Lu, Bolun Zheng, Chenggang Yan, Anke Xue

机构 * Hangzhou Dianzi University（杭州电子科技大学） ； Intel Labs China（英特尔中国实验室） 纠错

专题命中 指令微调 ：foundation model(abstract)；分类 cs.AI

Comments Accepted by ACM MM 2025 conference

Discriminative Finetuning of Generative Large Language Models without Reward Models and Human Preference Data

Siqi Guo, Ilgee Hong, Vicente Balmaseda, Changlong Yu, Liang Qiu, Xin Liu, Haoming Jiang, Tuo Zhao, Tianbao Yang

专题命中 后训练与偏好优化 ：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；preference optimization(abstract)

Comments 18 pages, 7 figures

FinDPO: Financial Sentiment Analysis for Algorithmic Trading through Preference Optimization of LLMs

Giorgos Iacovides, Wuyang Zhou, Danilo Mandic

机构 * Imperial College London（伦敦帝国理工学院） 纠错

专题命中 后训练与偏好优化 ：preference optimization(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

LLM Alignment as Retriever Optimization: An Information Retrieval Perspective

Bowen Jin, Jinsung Yoon, Zhen Qin, Ziqi Wang, Wei Xiong, Yu Meng, Jiawei Han, Sercan O. Arik

机构 * University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； Google Cloud AI Research（谷歌云人工智能研究） ； Google DeepMind（谷歌DeepMind） ； University of Virginia（弗吉尼亚大学） 纠错

专题命中 后训练与偏好优化 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；preference optimization(abstract)

Comments 26 pages

DiagR1: A Vision-Language Model Trained via Reinforcement Learning for Digestive Pathology Diagnosis

Minxi Ouyang, Lianghui Zhu, Yaqing Bao, Qiang Huang, Jingli Ouyang, Tian Guan, Xitong Ling, Jiawen Li, Song Duan, Wenbin Dai, Li Zheng, Xuemei Zhang, Yonghong He

机构 * Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院） ； Department of Pathology, Liuzhou People’s Hospital Affiliated to Guangxi Medical University（广西医科大学柳州市人民医院病理科） ； Department of Immunology, College of Basic Medical Sciences, China Medical University（中国医科大学基础医学学院免疫科） ； Greater Bay Area Center for Medical Device Evaluation and Inspection.NMPA（粤港澳大湾区医疗器械评价和检验中心.NMPA） ； Shenzhen Shengqiang Technology Co., Ltd.（深圳盛强科技有限公司） ； Department of Pathology, Chongqing University Affiliated Three Gorges Hospital（重庆大学附属第三人民医院病理科） 纠错

专题命中 后训练与偏好优化 ：language model(title,abstract)