语言大模型 / LLM

MEraser: An Effective Fingerprint Erasure Approach for Large Language Models

Jingxuan Zhang, Zhenhua Xu, Rui Hu, Wenpeng Xing, Xuhong Zhang, Meng Han

机构 * Zhejiang University（浙江大学） ； Indiana University（印第安纳大学） ； Hangzhou City University（杭州市大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments Accepted by ACL 2025, Main Conference, Long Paper

SYNAPSE-G: Bridging Large Language Models and Graph Learning for Rare Event Classification

Sasan Tavakkol, Lin Chen, Max Springer, Abigail Schantz, Blaž Bratanič, Vincent Cohen-Addad, MohammadHossein Bateni

机构 * Google Research（谷歌研究） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Can a Crow Hatch a Falcon? Lineage Matters in Predicting Large Language Model Performance

Takuya Tamura, Taro Yano, Masafumi Enomoto, Masafumi Oyamada

机构 * NEC Corporation（日本电报电话株式会社） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining

Rosie Zhao, Alexandru Meterez, Sham Kakade, Cengiz Pehlevan, Samy Jelassi, Eran Malach

机构 * Harvard University（哈佛大学） ； Kempner Institute（凯普纳研究所） 纠错

专题命中 预训练与数据 ：pretraining(title,abstract)；post-training(title,abstract)；language model(abstract)；分类 cs.LG

Comments COLM 2025

The wall confronting large language models

Peter V. Coveney, Sauro Succi

机构 * Centre for Computational Science, University College London（伦敦大学学院计算科学中心） ； Advanced Research Computing Centre, University College London（伦敦大学学院高级计算中心） ； Institute for Informatics, Faculty of Science, University of Amsterdam（阿姆斯特丹大学科学学院信息学院） ； Italian Institute of Technology（意大利理工学院） ； Physics Department, Harvard University（哈佛大学物理系） ； Mechanical Engineering Department, University College London（伦敦大学学院机械工程系） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Do Large Language Models Understand Morality Across Cultures?

Hadi Mohammadi, Yasmeen F. S. S. Meijer, Efthymia Papadopoulou, Ayoub Bagheri

机构 * Department of Methodology and Statistics, Utrecht University, The Netherlands（方法论与统计学系，乌特雷赫特大学，荷兰） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Geometric Algebra Meets Large Language Models: Instruction-Based Transformations of Separate Meshes in 3D, Interactive and Controllable Scenes

Prodromos Kolyvakis, Manos Kamarianakis, George Papagiannakis

机构 * ORamaVR 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments 10 pages, 4 figures

Applying the Chinese Wall Reverse Engineering Technique to Large Language Model Code Editing

Manatsawin Hanmongkolchai

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

The State of Large Language Models for African Languages: Progress and Challenges

Kedir Yassin Hussen, Walelign Tewabe Sewunetie, Abinew Ali Ayele, Sukairaj Hafiz Imam, Shamsuddeen Hassan Muhammad, Seid Muhie Yimam

机构 * University of Gondar（贡德大学） ； AIMS Research and Innovation Centre（AIMS研究与创新中心） ； Bahir Dar University（巴赫达尔大学） ； Bayero University Kano（卡诺巴耶罗大学） ； Addis Ababa University（亚的斯亚贝巴大学） ； Imperial College London（伦敦帝国学院） ； University of Hamburg（汉堡大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；small language model(abstract)；分类 cs.AI

Large Language Models powered Malicious Traffic Detection: Architecture, Opportunities and Case Study

Xinggong Zhang, Haotian Meng, Qingyang Li, Yunpeng Tan, Lei Zhang

机构 * Peking University（北京大学） ； China Unicom（中国联合网络通信集团有限公司） ； Zhongguancun Lab（中关村实验室） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments accepted

Large Scale Multi-Task Bayesian Optimization with Large Language Models

Yimeng Zeng, Natalie Maus, Haydn Thomas Jones, Jeffrey Tao, Fangping Wan, Marcelo Der Torossian Torres, Cesar de la Fuente-Nunez, Ryan Marcus, Osbert Bastani, Jacob R. Gardner

机构 * Computer and Information Science, UPenn（宾夕法尼亚大学计算机与信息科学系） ； Perelman School of Medicine, UPenn（宾夕法尼亚大学佩雷尔曼医学学校） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Unlocking the Potential of Large Language Models in the Nuclear Industry with Synthetic Data

Muhammad Anwar, Daniel Lau, Mishca de Costa, Issam Hammad

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Journal ref 44th Annual CNS Conference and the 49th Annual CNS/CNA Student Conference, Westin Harbour Castle Hotel, Toronto, ON, Canada, June 8-11, 2025

A Systematic Review of Poisoning Attacks Against Large Language Models

Neil Fendley, Edward W. Staley, Joshua Carney, William Redman, Marie Chau, Nathan Drenkow

机构 * Johns Hopkins University Applied Physics Laboratory（约翰霍普金斯大学应用物理实验室） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 28 Pages including number

Can Watermarking Large Language Models Prevent Copyrighted Text Generation and Hide Training Data?

Michael-Andrei Panaitescu-Liess, Zora Che, Bang An, Yuancheng Xu, Pankayaraj Pathmanathan, Souradip Chakraborty, Sicheng Zhu, Tom Goldstein, Furong Huang

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments 19 pages, 7 figures. Published at AAAI 2025. Code will be available at https://github.com/michael-panaitescu/watermark_copyright_aaai25

Applying Large Language Models to Issue Classification: Revisiting with Extended Data and New Models

Gabriel Aracena, Kyle Luster, Fabio Santos, Igor Steinmacher, Marco A. Gerosa

机构 * Grand Canyon University（大峡谷大学） ； Colorado State University（科罗拉多州立大学） ； Northern Arizona University（北亚利桑那大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 35 pages, 2 figures, 9 tables, Pre-print for Science of Computer Programming

Bootstrapping LLM Robustness for VLM Safety via Reducing the Pretraining Modality Gap

Wenhan Yang, Spencer Stice, Ali Payani, Baharan Mirzasoleiman

机构 * Computer Science Department UCLA（计算机科学系，加州大学洛杉矶分校） ； Cisco Systems Inc.（思科系统公司） 纠错

专题命中 预训练与数据 ：LLM(title,abstract)；pretraining(title,abstract)；language model(abstract)；分类 cs.AI

Exploring Pretraining via Active Forgetting for Improving Cross Lingual Transfer for Decoder Language Models

Divyanshu Aggarwal, Ashutosh Sathe, Sunayana Sitaram

机构 * Microsoft Research India（微软印度研究院） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 12 pages, 11 tables, 12 figures

A Data Synthesis Method Driven by Large Language Models for Proactive Mining of Implicit User Intentions in Tourism

Jinqiang Wang, Huansheng Ning, Tao Zhu, Jianguo Ding

机构 * School of Computer & Communication Engineering, University of Science and Technology Beijing（信息与通信工程学院，北京科技大学） ； School of Computer Science, University of South China（计算机科学学院，南方大学） ； Department of Computer Science, Blekinge institute of Technology（计算机科学系，布莱京厄学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Decoding Neighborhood Environments with Large Language Models

Andrew Cart, Shaohu Zhang, Melanie Escue, Xugui Zhou, Haitao Zhao, Prashanth BusiReddyGari, Beiyu Lin, Shuang Li

机构 * University of North Carolina at Pembroke（北卡罗来纳大学帕科斯克大学） ； Louisiana State University（路易斯安那州立大学） ； University of Oklahoma（俄克拉荷马大学） ； North Carolina A&T State University（北卡罗来纳A&T州立大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.AI

Comments 8 pages

LUSIFER: Language Universal Space Integration for Enhanced Multilingual Embeddings with Large Language Models

Hieu Man, Nghia Trung Ngo, Viet Dac Lai, Ryan A. Rossi, Franck Dernoncourt, Thien Huu Nguyen

机构 * University of Oregon（俄勒冈大学） ； Adobe Research（Adobe研究院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Towards High-Fidelity Synthetic Multi-platform Social Media Datasets via Large Language Models

Henry Tari, Nojus Sereiva, Rishabh Kaushal, Thales Bertaglia, Adriana Iamnitchi

机构 * Maastricht University（马斯特里赫特大学） ； Indira Gandhi Delhi Technical University for Women（印度达累普技术女子大学） ； Utrecht University（乌得勒支大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments arXiv admin note: text overlap with arXiv:2407.08323

Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind

Hongchuan Zeng, Hongshen Xu, Lu Chen, Kai Yu

机构 * X-LANCE Lab, Department of Computer Science and Engineering MoE Key Lab of Artificial Intelligence, SJTU AI Institute Shanghai Jiao Tong University, Shanghai, China（X-LANCE实验室，计算机科学与工程系，MoE人工智能关键实验室，上海交通大学人工智能研究院，上海，中国） ； Suzhou Laboratory, Suzhou, China（苏州实验室，苏州，中国） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 22 pages, 8 figures, 13 tables. Accepted by LREC-COLING 2024

Large Language Models are Qualified Benchmark Builders: Rebuilding Pre-Training Datasets for Advancing Code Intelligence Tasks

Kang Yang, Xinjun Mao, Shangwen Wang, Yanlin Wang, Tanghaoran Zhang, Bo Lin, Yihao Qin, Zhang Zhang, Yao Lu, Kamal Al-Sabahi

机构 * College of Computer, National University of Defense Technology（计算机学院，国防科技大学） ； Sun Yat-sen University（中山大学） ； College of Banking and Financial Studies（金融学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Awarded the ACM SIGSOFT Distinguished Paper Award in ICPC 2025

Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models

Yuhao Wang, Junwei Pan, Pengyue Jia, Wanyu Wang, Maolin Wang, Zhixiang Feng, Xiaotian Li, Jie Jiang, Xiangyu Zhao

机构 * City University of Hong Kong（香港城市大学） ； Tencent Inc.（腾讯公司） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments accepted to SIGIR 2025

Towards Leveraging Large Language Model Summaries for Topic Modeling in Source Code

Michele Carissimi, Martina Saletta, Claudio Ferretti

机构 * Dept. of Informatics, Systems and Communication, University of Milano-Bicocca（信息与通信系统系，米兰-比科卡大学） ； Dept. of Human and Social Sciences, University of Bergamo（人文与社会科学系，贝拉戈莫大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindi

Monojit Choudhury, Shivam Chauhan, Rocktim Jyoti Das, Dhruv Sahnan, Xudong Han, Haonan Li, Aaryamonvikram Singh, Alok Anil Jadhav, Utkarsh Agarwal, Mukund Choudhary, Debopriyo Banerjee, Fajri Koto, Junaid Bhat, Awantika Shukla, Samujjwal Ghosh, Samta Kamboj, Onkar Pandit, Lalit Pradhan, Rahul Pal, Sunil Sahu, Soundar Doraiswamy, Parvez Mullah, Ali El Filali, Neha Sengupta, Gokul Ramakrishnan, Rituraj Joshi, Gurpreet Gosal, Avraham Sheinin, Natalia Vassilieva, Preslav Nakov

机构 * Mohamed Bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） ； Inception ； Cerebras Systems（Cerebras系统公司） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Payload-Aware Intrusion Detection with CMAE and Large Language Models

Yongcheol Kim, Chanjae Lee, Young Yoon

机构 * Neouly Co., Ltd.（Neouly公司） ； NetCoreTech Co., Ltd.（NetCoreTech公司） ； Hongik University（弘益大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Siming Huang, Tianhao Cheng, J. K. Liu, Jiaran Hao, Liuyihan Song, Yang Xu, J. Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Zhaoxiang Zhang, Jie Fu, Qian Liu, Ge Zhang, Zili Wang, Yuan Qi, Yinghui Xu, Wei Chu

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models

Abhilasha Ravichander, Jillian Fisher, Taylor Sorensen, Ximing Lu, Yuchen Lin, Maria Antoniak, Niloofar Mireshghallah, Chandra Bhagavatula, Yejin Choi

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2025

Global Position Aware Group Choreography using Large Language Model

Haozhou Pang, Tianwei Ding, Lanshan He, Qi Gan

机构 * Soul AI 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL