语言大模型 / LLM - arXivDaily 专题

2505.21598 2025-05-29 cs.CL 88%

Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives

Yajiao Liu, Congliang Chen, Junchi Yang, Ruoyu Sun

机构 * The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））； Shenzhen Research Institute of Big Data（深圳大数据研究院）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments The first version of this paper was submitted to ACL ARR 2025 February Submission

2505.16385 2025-05-23 cs.CL 88%

Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models

Kaiyu He, Tong Zhou, Yubo Chen, Delai Qiu, Shengping Liu, Kang Liu, Jun Zhao

机构 * The Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation, Chinese Academy of Sciences（认知与决策智能复杂系统重点实验室，中国科学院自动化研究所）； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）； University of Science and Technology Beijing（北京科技大学）； Unisound Al Technology Co,Ltd（Unisound人工智能技术有限公司）； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 14 pages, 10 figures

2505.14126 2025-05-21 cs.LG cs.CY cs.HC cs.MA 88%

MAS-KCL: Knowledge component graph structure learning with large language model-based agentic workflow

Yuan-Hao Jiang, Kezong Tang, Zi-Wei Chen, Yuang Wei, Tian-Yi Liu, Jiayi Wu

机构 * Shanghai Institute of Artificial Intelligence for Education, East China Normal University, Shanghai, China（上海教育人工智能研究院，华东师范大学，上海，中国）； School of Computer Science and Technology, East China Normal University, Shanghai, China（华东师范大学计算机科学与技术学院，上海，中国）； Lab of Artificial Intelligence for Education, East China Normal University, Shanghai, China（教育人工智能实验室，华东师范大学，上海，中国）； Graduate School, Shanghai Jiao Tong University, Shanghai, China（上海交通大学研究生院，上海，中国）； School of Information Engineering, Jingdezhen Ceramic University, Jingdezhen, China（景德镇陶瓷大学信息工程学院，景德镇，中国）； School of Computer, Jiangsu University of Science and Technology, Zhenjiang, China（江苏科技大学计算机学院，镇江，中国）； Department of Educational Information Technology, East China Normal University, Shanghai, China（教育信息技术系，华东师范大学，上海，中国）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments In CGI 2025: 42nd Computer Graphics International Conference, Kowloon, Hong Kong, Peper No. 134

2505.13249 2025-05-20 cs.LG 88%

RN-F: A Novel Approach for Mitigating Contaminated Data in Large Language Models

Le Vu Anh, Dinh Duc Nha Nguyen, Phi Long Nguyen

机构 * TinyAI Research（TinyAI研究所）； Center for Environmental Intelligence（环境智能中心）； College of Engineering & Computer Science（工程与计算机科学学院）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 12 pages, 4 figures, 3 tables

2505.10862 2025-05-19 cs.CL 88%

Have Multimodal Large Language Models (MLLMs) Really Learned to Tell the Time on Analog Clocks?

Tairan Fu, Miguel González, Javier Conde, Elena Merino-Gómez, Pedro Reviriego

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 6 pages, 5 figures, 2 tables

2505.08878 2025-05-15 cs.CR cs.AI cs.IT math.IT 88%

Optimized Couplings for Watermarking Large Language Models

Dor Tsur, Carol Xuan Long, Claudio Mayrink Verdun, Hsiang Hsu, Haim Permuter, Flavio P. Calmon

机构 * Ben Gurion University（本· Gurion 大学）； Harvard University（哈佛大学）； JPMorganChase（摩根大通）

专题命中预训练与数据：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.AI

Comments Accepted at ISIT25

2505.03501 2025-05-07 cs.CR cs.CL 88%

BadLingual: A Novel Lingual-Backdoor Attack against Large Language Models

Zihan Wang, Hongwei Li, Rui Zhang, Wenbo Jiang, Kangjie Chen, Tianwei Zhang, Qingchuan Zhao, Guowen Xu

机构 * University of Electronic Science and Technology of China（电子科技大学）； Nanyang Technological University（南洋理工大学）； City University of Hong Kong（香港城市大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2505.03265 2025-05-07 cs.SE cs.AI 88%

Synthline: A Product Line Approach for Synthetic Requirements Engineering Data Generation using Large Language Models

Abdelkarim El-Hajjami, Camille Salinesi

机构 * Paris 1 Panthéon–Sorbonne University（巴黎1 Panthéon–Sorbonne大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2504.21742 2025-05-01 cs.CL 88%

Investigating Literary Motifs in Ancient and Medieval Novels with Large Language Models

Emelie Hallenberg

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2504.16286 2025-04-29 cs.CL 88%

The Paradox of Poetic Intent in Back-Translation: Evaluating the Quality of Large Language Models in Chinese Translation

Li Weigang, Pedro Carvalho Brom

机构 * Computer Science Department University of Brasilia（布拉兹利亚大学计算机科学系）； Math Department Federal Institute of Brasilia（布拉兹利亚联邦学院数学系）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 24 pages, 3 figures

2406.10602 2025-04-28 cs.CL cs.CY 88%

Multilingual Large Language Models and Curse of Multilinguality

Daniil Gurgurov, Tanja Bäumel, Tatiana Anikina

机构 * Universität des Saarlandes（萨尔兰大学）； German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2411.11260 2025-04-11 cs.CL 88%

Large corpora and large language models: a replicable method for automating grammatical annotation

Cameron Morin, Matti Marttinen Larsson

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Journal ref Linguistics Vanguard, 1-10 (2025)

2405.15232 2025-03-11 cs.CV cs.CL 88%

DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perception

Run Luo, Yunshui Li, Longze Chen, Wanwei He, Ting-En Lin, Ziqiang Liu, Lei Zhang, Zikai Song, Xiaobo Xia, Tongliang Liu, Min Yang, Binyuan Hui

机构 * Shenzhen Key Laboratory for High Performance Data Mining, SIAT, CAS（中国科学院深圳先进技术研究院）； University of Chinese Academy of Sciences（中国科学院大学）； Tsinghua University（清华大学）； Huazhong University of Science and Technology（华中科技大学）； University of New South Wales（新南威尔士大学）； National University of Singapore（新加坡国立大学）； University of Science and Technology of China（中国科学技术大学）； The University of Sydney（悉尼大学）； Alibaba Group（阿里巴巴集团）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 25 pages. arXiv admin note: text overlap with arXiv:2401.10208 by other authors

2502.18695 2025-02-27 cs.CY cs.AI cs.SI 88%

Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models

Konstantina Palla, José Luis Redondo García, Claudia Hauff, Francesco Fabbri, Henrik Lindström, Daniel R. Taber, Andreas Damianou, Mounia Lalmas

机构 * Spotify（Spotify（流媒体音乐平台））

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 14 pages, 5 figures

2412.17395 2025-02-19 cs.CL 88%

WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models

Huawen Feng, Pu Zhao, Qingfeng Sun, Can Xu, Fangkai Yang, Lu Wang, Qianli Ma, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

机构 * School of Computer Science and Engineering, South China University of Technology（华南理工大学计算机科学与工程学院）； Microsoft（微软公司）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2408.02416 2025-02-13 cs.CL cs.CR 88%

Why Are My Prompts Leaked? Unraveling Prompt Extraction Threats in Customized Large Language Models

Zi Liang, Haibo Hu, Qingqing Ye, Yaxin Xiao, Haoyang Li

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Source Code: https://github.com/liangzid/PromptExtractionEval

2407.00436 2025-02-11 cs.CL 88%

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

Peiqin Lin, André F. T. Martins, Hinrich Schütze

机构 * LMU Munich（慕尼黑大学）； Munich Center for Machine Learning（慕尼黑机器学习中心）； Instituto Superior Técnico, Universidade de Lisboa（里斯本大学高等技术学院）； Instituto de Telecomunicações（电信研究所）； Unbabel（昂巴贝尔公司）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments NAACL 2025 Findings

2307.07367 2025-02-11 cs.SI cs.AI cs.CY 88%

Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflow

Maria del Rio-Chanona, Nadzeya Laurentsyeva, Johannes Wachs

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

2410.13765 2025-02-07 cs.CL cs.IR 88%

Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval

Yu Xia, Junda Wu, Sungchul Kim, Tong Yu, Ryan A. Rossi, Haoliang Wang, Julian McAuley

机构 * University of California San Diego（加利福尼亚大学圣迭戈分校）； Adobe Research（奥多比研究院）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments NAACL 2025

2406.13718 2025-01-29 cs.CL 88%

Evaluating Large Language Models along Dimensions of Language Variation: A Systematik Invesdigatiom uv Cross-lingual Generalization

Niyati Bafna, Kenton Murray, David Yarowsky

机构 * Johns Hopkins University（约翰斯·霍普金斯大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 21 pages. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

2412.14809 2025-01-27 cs.CL 88%

ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysis

Zeao Tu, Xiangdi Meng, Yu He, Zihan Yao, Tianyu Qi, Jun Liu, Ming Li

机构 * TAL Education Group（好未来教育集团）； Xi’an Jiaotong University（西安交通大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by NAACL 2025 Findings

2412.09460 2025-01-27 cs.CL 88%

The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspective

Javier de la Rosa, Vladislav Mikhailov, Lemei Zhang, Freddy Wetjen, David Samuel, Peng Liu, Rolv-Arild Braaten, Petter Mæhlum, Magnus Breder Birkenes, Andrey Kutuzov, Tita Enstad, Hans Christian Farsethås, Svein Arne Brygfjeld, Jon Atle Gulla, Stephan Oepen, Erik Velldal, Wilfred Østgulen, Liljia Øvrelid, Aslak Sira Myhre

机构 * National Library of Norway（挪威国家图书馆）； University of Oslo（奥斯陆大学）； Norwegian University of Science and Technology（挪威科技大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 17 pages, 5 figures, 8 tables. Accepted at NoDaLiDa/Baltic-HLT 2025

2409.09659 2025-01-22 cs.CL 88%

Leveraging Open-Source Large Language Models for Native Language Identification

Yee Man Ng, Ilia Markov

机构 * Vrije Universiteit Amsterdam（阿姆斯特丹自由大学）； CLTL（语言与技术计算实验室）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2410.13641 2024-12-17 cs.CL 88%

An Active Learning Framework for Inclusive Generation by Large Language Models

Sabit Hassan, Anthony Sicilia, Malihe Alikhani

机构 * School of Computing and Information, University of Pittsburgh（匹兹堡大学计算与信息学院）； Khoury College of Computer Science, Northeastern University（东北大学科里计算机学院）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments COLING, 2025

2402.08966 2024-12-16 cs.CV cs.CL 88%

Pretraining Vision-Language Model for Difference Visual Question Answering in Longitudinal Chest X-rays

Yeongjae Cho, Taehee Kim, Heejun Shin, Sungzoon Cho, Dongmyung Shin

机构 * Seoul National University（首尔大学）； Radisen Co. Ltd.（Radisen公司）

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

2407.06125 2024-12-03 cs.HC cs.AI 88%

Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities

Chayan Tank, Sarthak Pol, Vinayak Katoch, Shaina Mehta, Avinash Anand, Rajiv Ratn Shah

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments 12 pages, 9 figures, 9 tables

2411.18940 2024-12-02 cs.CL 88%

Rephrasing Electronic Health Records for Pretraining Clinical Language Models

Jinghui Liu, Anthony Nguyen

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

2410.01285 2024-11-20 cs.CL 88%

Enhancing Training Data Attribution for Large Language Models with Fitting Error Consideration

Kangxi Wu, Liang Pang, Huawei Shen, Xueqi Cheng

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to the EMNLP 2024 main

2312.07141 2024-11-20 cs.CL 88%

Multilingual large language models leak human stereotypes across language boundaries

Yang Trista Cao, Anna Sotnikova, Jieyu Zhao, Linda X. Zou, Rachel Rudinger, Hal Daume

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2406.11214 2024-11-15 cs.CL 88%

Problematic Tokens: Tokenizer Bias in Large Language Models

Jin Yang, Zhiqiang Wang, Yanbin Lin, Zunduo Zhao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 11th IEEE Special session on Privacy and Security of Big Data (PSBD 2024)

1. 预训练与数据 12486 篇

Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives

Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models

MAS-KCL: Knowledge component graph structure learning with large language model-based agentic workflow

RN-F: A Novel Approach for Mitigating Contaminated Data in Large Language Models

Have Multimodal Large Language Models (MLLMs) Really Learned to Tell the Time on Analog Clocks?

Optimized Couplings for Watermarking Large Language Models

BadLingual: A Novel Lingual-Backdoor Attack against Large Language Models

Synthline: A Product Line Approach for Synthetic Requirements Engineering Data Generation using Large Language Models

Investigating Literary Motifs in Ancient and Medieval Novels with Large Language Models

The Paradox of Poetic Intent in Back-Translation: Evaluating the Quality of Large Language Models in Chinese Translation

Multilingual Large Language Models and Curse of Multilinguality

Large corpora and large language models: a replicable method for automating grammatical annotation

DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perception

Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models

WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models

Why Are My Prompts Leaked? Unraveling Prompt Extraction Threats in Customized Large Language Models

A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models

Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflow

Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval

Evaluating Large Language Models along Dimensions of Language Variation: A Systematik Invesdigatiom uv Cross-lingual Generalization

ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysis

The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspective

Leveraging Open-Source Large Language Models for Native Language Identification

An Active Learning Framework for Inclusive Generation by Large Language Models

Pretraining Vision-Language Model for Difference Visual Question Answering in Longitudinal Chest X-rays

Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities

Rephrasing Electronic Health Records for Pretraining Clinical Language Models

Enhancing Training Data Attribution for Large Language Models with Fitting Error Consideration

Multilingual large language models leak human stereotypes across language boundaries

Problematic Tokens: Tokenizer Bias in Large Language Models