arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

语言大模型 / LLM

大语言模型、预训练、指令微调、后训练和语言模型应用。

2025-11-07 至 2025-11-07 共收录 159 信号源:cs.CL, cs.AI, cs.LG

1. 预训练与数据 14 篇

2511.03823 2025-11-07 cs.CL cs.AI 91%

PLLuM: A Family of Polish Large Language Models

Jan Kocoń, Maciej Piasecki, Arkadiusz Janz, Teddy Ferdinan, Łukasz Radliński, Bartłomiej Koptyra, Marcin Oleksy, Stanisław Woźniak, Paweł Walkowiak, Konrad Wojtasik, Julia Moska, Tomasz Naskręt, Bartosz Walkowiak, Mateusz Gniewkowski, Kamil Szyc, Dawid Motyka, Dawid Banach, Jonatan Dalasiński, Ewa Rudnicka, Bartłomiej Alberski, Tomasz Walkowiak, Aleksander Szczęsny, Maciej Markiewicz, Tomasz Bernaś, Hubert Mazur, Kamil Żyta, Mateusz Tykierko, Grzegorz Chodak, Tomasz Kajdanowicz, Przemysław Kazienko, Agnieszka Karlińska, Karolina Seweryn, Anna Kołos, Maciej Chrabąszcz, Katarzyna Lorenc, Aleksandra Krasnodębska, Artur Wilczek, Katarzyna Dziewulska, Paula Betscher, Zofia Cieślińska, Katarzyna Kowol, Daria Mikoś, Maciej Trzciński, Dawid Krutul, Marek Kozłowski, Sławomir Dadas, Rafał Poświata, Michał Perełkiewicz, Małgorzata Grębowiec, Maciej Kazuła, Marcin Białas, Roman Roszko, Danuta Roszko, Jurgita Vaičenonienė, Andrius Utka, Paweł Levchuk, Paweł Kowalski, Irena Prawdzic-Jankowska, Maciej Ogrodniczuk, Monika Borys, Anna Bulińska, Wiktoria Gumienna, Witold Kieraś, Dorota Komosińska, Katarzyna Krasnowska-Kieraś, Łukasz Kobyliński, Martyna Lewandowska, Marek Łaziński, Mikołaj Łątkowski, Dawid Mastalerz, Beata Milewicz, Agnieszka Anna Mykowiecka, Angelika Peljak-Łapińska, Sandra Penno, Zuzanna Przybysz, Michał Rudolf, Piotr Rybak, Karolina Saputa, Aleksandra Tomaszewska, Aleksander Wawer, Marcin Woliński, Joanna Wołoszyn, Alina Wróblewska, Bartosz Żuk, Filip Żarnecki, Konrad Kaczyński, Anna Cichosz, Zuzanna Deckert, Monika Garnys, Izabela Grabarczyk, Wojciech Janowski, Sylwia Karasińska, Aleksandra Kujawiak, Piotr Misztela, Maria Szymańska, Karolina Walkusz, Igor Siek, Jakub Kwiatkowski, Piotr Pęzik

机构 * Department of Artificial Intelligence, Wrocław University of Science and Technology(沃斯克拉大学人工智能系) NASK National Research Institute(国家研究 institute) National Information Processing Institute(国家信息处理研究所) Institute of Slavic Studies, Polish Academy of Sciences(波兰科学院斯拉夫研究学院) Institute of Computer Science, Polish Academy of Sciences(波兰科学院计算机科学研究所) University of Łódź(卢布林大学)

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);foundation model(abstract);preference optimization(abstract)

Comments 83 pages, 19 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.07236 2025-11-07 eess.SP cs.AI cs.LG q-bio.NC 86%

CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding

Jiquan Wang, Sha Zhao, Zhiling Luo, Yangxuan Zhou, Haiteng Jiang, Shijian Li, Tao Li, Gang Pan

机构 * State Key Laboratory of Brain-machine Intelligence(脑机智能国家重点实验室) College of Computer Science and Technology(计算机科学与技术学院) Alibaba Group(阿里巴巴集团) Department of Neurobiology, Affiliated Mental Health Center & Hangzhou Seventh People’s Hospital, Zhejiang University School of Medicine(神经生物学系、附属心理健康中心及杭州第七人民医院,浙江大学医学院) MOE Frontier Science Center for Brain Science and Brain-machine Integration(教育部脑科学与脑机集成前沿科学中心)

专题命中 预训练与数据 :foundation model(title,abstract);large language model(abstract);language model(abstract);分类 cs.AI、cs.LG

Comments Accepted by The Thirteenth International Conference on Learning Representations (ICLR 2025)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.06991 2025-11-07 cs.AI cs.GT cs.HC 85%

Evaluating LLM-Contaminated Crowdsourcing Data Without Ground Truth

Yichi Zhang, Jinlong Pang, Zhaowei Zhu, Yang Liu

机构 * DIMACS, Rutgers University(Rutgers大学DIMACS研究中心)

专题命中 预训练与数据 :LLM(title,abstract);large language model(abstract);language model(abstract);分类 cs.AI

Comments 32 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04474 2025-11-07 cs.CV 82%

Landslide Hazard Mapping with Geospatial Foundation Models: Geographical Generalizability, Data Scarcity, and Band Adaptability

Wenwen Li, Sizhe Wang, Hyunho Lee, Chenyan Lu, Sujit Roy, Rahul Ramachandran, Chia-Yu Hsu

机构 * School of Geographical Sciences and Urban Planning(地理科学与城市规划学院) Arizona State University(亚利桑那州立大学) School of Computing and Augmented Intelligence(计算与增强智能学院) NASA Marshall Space Flight Center(国家航空航天局马歇尔航天飞行中心)

专题命中 预训练与数据 :foundation model(title,abstract);pretraining(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.21849 2025-11-07 cs.LG cs.AI 81%

TowerVision: Understanding and Improving Multilinguality in Vision-Language Models

André G. Viveiros, Patrick Fernandes, Saul Santos, Sonal Sannigrahi, Emmanouil Zaranis, Nuno M. Guerreiro, Amin Farajian, Pierre Colombo, Graham Neubig, André F. T. Martins

机构 * Instituto Superior Técnico, Universidade de Lisboa(里斯本大学技术高级学院) Instituto de Telecomunicações(电信研究所) Carnegie Mellon University(卡内基梅隆大学) Sword Health(Sword健康) TransPerfect MICS, CentraleSupélec, Université Paris-Saclay(MICS,中央圣艾尔布里大学,巴黎萨克雷大学) ELLIS Unit Lisbon(里斯本ELLIS单位)

专题命中 预训练与数据 :language model(title,abstract);分类 cs.AI、cs.LG

Comments 15 pages, 7 figures, submitted to arXiv October 2025. All models, datasets, and training code will be released at https://huggingface.co/collections/utter-project/towervision

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04601 2025-11-07 cs.CV cs.MM 80%

PixCLIP: Achieving Fine-grained Visual Language Understanding via Any-granularity Pixel-Text Alignment Learning

Yicheng Xiao, Yu Chen, Haoxuan Ma, Jiale Hong, Caorui Li, Lingxiang Wu, Haiyun Guo, Jinqiao Wang

专题命中 预训练与数据 :LLM(abstract);large language model(abstract);language model(abstract);pretraining(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04478 2025-11-07 cs.HC cs.AI 79%

Generate, Evaluate, Iterate: Synthetic Data for Human-in-the-Loop Refinement of LLM Judges

Hyo Jin Do, Zahra Ashktorab, Jasmina Gajcin, Erik Miehling, Martín Santillán Cooper, Qian Pan, Elizabeth M. Daly, Werner Geyer

机构 * IBM Research(IBM研究院)

专题命中 预训练与数据 :LLM(title,abstract);分类 cs.AI

Comments 29 pages, 4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.03806 2025-11-07 cs.LG 79%

FusionDP: Foundation Model-Assisted Differentially Private Learning for Partially Sensitive Features

Linghui Zeng, Ruixuan Liu, Atiquer Rahman Sarkar, Xiaoqian Jiang, Joyce C. Ho, Li Xiong

专题命中 预训练与数据 :foundation model(title,abstract);分类 cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.07879 2025-11-07 cs.CL cs.LG 73%

Datasets, Documents, and Repetitions: The Practicalities of Unequal Data Quality

Alex Fang, Hadi Pouransari, Matt Jordan, Alexander Toshev, Vaishaal Shankar, Ludwig Schmidt, Tom Gunter

机构 * Apple(苹果公司) Stanford(斯坦福大学) UT Austin(德克萨斯大学奥斯汀分校)

专题命中 预训练与数据 :large language model(abstract);language model(abstract);分类 cs.CL、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04426 2025-11-07 cs.CV 71%

HideAndSeg: an AI-based tool with automated prompting for octopus segmentation in natural habitats

Alan de Aguiar, Michaella Pereira Andrade, Charles Morphy D. Santos, João Paulo Gois

机构 * Universidade Federal do ABC (UFABC)(巴西圣安德烈大学联邦ABC分校)

专题命中 预训练与数据 :prompting(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04234 2025-11-07 cs.CL 70%

Reusing Pre-Training Data at Test Time is a Compute Multiplier

Alex Fang, Thomas Voice, Ruoming Pang, Ludwig Schmidt, Tom Gunter

机构 * Apple(苹果公司) Stanford(斯坦福大学)

专题命中 预训练与数据 :large language model(abstract);language model(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04228 2025-11-07 cs.CL cs.LG 62%

REMIND: Input Loss Landscapes Reveal Residual Memorization in Post-Unlearning LLMs

Liran Cohen, Yaniv Nemcovesky, Avi Mendelson

机构 * Technion - Israel Institute of Technology(技术离子-以色列理工学院)

专题命中 预训练与数据 :language model(abstract);分类 cs.CL、cs.LG

Comments Pre-print version under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04155 2025-11-07 cs.LG 57%

Learning to Land Anywhere: Transferable Generative Models for Aircraft Trajectories

Olav Finne Praesteng Larsen, Massimiliano Ruocco, Michail Spitieris, Abdulmajid Murad, Martina Ragosta

专题命中 预训练与数据 :pretraining(abstract);分类 cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.02880 2025-11-07 eess.SP cs.AI cs.CV eess.IV 57%

NEF-NET+: Adapting Electrocardio panorama in the wild

Zehui Zhan, Yaojun Hu, Jiajing Zhan, Wanchen Lian, Wanqing Wu, Jintai Chen

机构 * Information Hub, Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)信息中心) School of Biomedical Engineering, Sun Yat-sen University, Shenzhen(中山大学医学院深圳校区) College of Computer Science and Technology, Zhejiang University, Hangzhou(浙江大学计算机科学与技术学院) Department of Electrical and Electronic Engineering, University of Hong Kong, Pokfulam(香港大学电子与电气工程系)

专题命中 预训练与数据 :pretraining(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏

2. 指令微调 10 篇

2509.10641 2025-11-07 cs.LG cs.AI 90%

Test-Time Warmup for Multimodal Large Language Models

Nikita Rajaneesh, Thomas Zollo, Richard Zemel

机构 * Columbia University(哥伦比亚大学)

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);LLM(abstract);分类 cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.03945 2025-11-07 cs.CL cs.AI 88%

Direct Semantic Communication Between Large Language Models via Vector Translation

Fu-Chun Yang, Jason Eshraghian

机构 * University of California, Santa Cruz(加州大学圣克ruz分校)

专题命中 指令微调 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments 9 pages, 1 figure, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.04650 2025-11-07 cs.LG cs.DC 79%

Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models

Ziyao Wang, Bowei Tian, Yexiao He, Zheyu Shen, Guoheng Sun, Yuhan Liu, Luyang Liu, Meng Liu, Ang Li

机构 * University of Maryland, College Park(马里兰大学彭福分校) Queen Mary University of London(伦敦玛丽女王大学) Google DeepMind(谷歌DeepMind)

专题命中 指令微调 :foundation model(title,abstract);分类 cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04153 2025-11-07 cs.CL cs.AI cs.DB cs.MA 79%

BAPPA: Benchmarking Agents, Plans, and Pipelines for Automated Text-to-SQL Generation

Fahim Ahmed, Md Mubtasim Ahasan, Jahir Sadik Monon, Muntasir Wahed, M Ashraful Amin, A K M Mahbubur Rahman, Amin Ahsan Ali

机构 * Center for Computational & Data Sciences, Independent University, Bangladesh(计算与数据科学中心,独立大学,孟加拉国) University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校) University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

专题命中 指令微调 :LLM(abstract);large language model(abstract);language model(abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04317 2025-11-07 cs.CV 78%

RISE-T2V: Rephrasing and Injecting Semantics with LLM for Expansive Text-to-Video Generation

Xiangjun Zhang, Litong Gong, Yinglin Zheng, Yansong Liu, Wentao Jiang, Mingyi Xu, Biao Wang, Tiezheng Ge, Ming Zeng

专题命中 指令微调 :LLM(title,abstract)

Comments 17 pages, 16 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.14955 2025-11-07 cs.CV cs.AI 77%

RealDPO: Real or Not Real, that is the Preference

Guo Cheng, Danni Yang, Ziqi Huang, Jianlou Si, Chenyang Si, Ziwei Liu

机构 * Shanghai Artificial Intelligence Laboratory(上海人工智能实验室) S-Lab, Nanyang Technological University(南洋理工大学S实验室) University of Electronic Science and Technology of China(电子科技大学) Nanjing University(南京大学) SenseTime Research(商汤科技研究院)

专题命中 指令微调 :post-training(abstract);SFT(abstract);preference optimization(abstract);分类 cs.AI

Comments Code:https://github.com/Vchitect/RealDPO Project Page:https://vchitect.github.io/RealDPO-Project/

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.20110 2025-11-07 cs.CL cs.AI cs.LG 67%

Efficient Model Development through Fine-tuning Transfer

Pin-Jie Lin, Rishab Balasubramanian, Fengyuan Liu, Nikhil Kandpal, Tu Vu

机构 * Virginia Tech(弗吉尼亚理工大学) University of Toronto(多伦多大学) Vector Institute(向量研究所)

专题命中 指令微调 :LLM(abstract);分类 cs.CL、cs.AI、cs.LG

Comments 25 pages, 4 figures, 16 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.17294 2025-11-07 q-bio.QM 67%

Integrating protein sequence embeddings with structure via graph-based deep learning for single-residue property prediction

Kevin Michalewicz, Mauricio Barahona, Barbara Bravi

专题命中 指令微调 :large language model(abstract);language model(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.04139 2025-11-07 cs.CL cs.SD 57%

CantoASR: Prosody-Aware ASR-LALM Collaboration for Low-Resource Cantonese

Dazhong Chen, Yi-Cheng Lin, Yuchen Huang, Ziwei Gong, Di Jiang, Zeying Xie, Yi R., Fung

机构 * The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)) Hong Kong University of Science and Technology(香港科学与技术大学) National Taiwan University, Taiwan(台湾国立台湾大学) Columbia University(哥伦比亚大学) WeBank Co., Ltd., Shenzhen, China(深圳网商银行有限公司)

专题命中 指令微调 :language model(abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.10015 2025-11-07 math.DS math.GR 50%

On the entropies of subshifts of finite type on countable amenable groups

Sebastián Barbieri

专题命中 指令微调 :SFT(abstract)

Comments There is an error in Theorem 4.7. We have added a corrigendum

Journal ref Groups, Geometry and Dynamics, 15(2):607-638, 2021

详情

展开后加载摘要…

URL PDF HTML 收藏

3. 后训练与偏好优化 6 篇

2510.25766 2025-11-07 cs.CL 90%

Decomposition-Enhanced Training for Post-Hoc Attributions In Language Models

Sriram Balasubramanian, Samyadeep Basu, Koustava Goswami, Ryan Rossi, Varun Manjunatha, Roshan Santhosh, Ruiyi Zhang, Soheil Feizi, Nedim Lipka

专题命中 后训练与偏好优化 :language model(title,abstract);LLM(abstract);large language model(abstract);post-training(abstract)

Comments Post-hoc attribution

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.03939 2025-11-07 cs.LG cs.AI cs.CL 87%

RLHF: A comprehensive Survey for Cultural, Multimodal and Low Latency Alignment Methods

Raghav Sharma, Manan Mehta, Sai Tiger Raina

机构 * Northeastern University(东北大学) University of Southern California(南加州大学)

专题命中 后训练与偏好优化 :RLHF(title,abstract);large language model(abstract);language model(abstract);分类 cs.CL、cs.AI、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.13518 2025-11-07 cs.CL cs.AI cs.LG 87%

Selective Preference Optimization via Token-Level Reward Function Estimation

Kailai Yang, Zhiwei Liu, Qianqian Xie, Jimin Huang, Erxue Min, Sophia Ananiadou

机构 * National Centre for Text Mining, The University of Manchester(曼彻斯特大学文本挖掘中心) School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院) Center for Language and Information Research, Wuhan University(武汉大学语言与信息研究中心) The Fin AI(Fin AI公司) Baidu Inc.(百度公司) Archimedes Research(阿基米德研究)

专题命中 后训练与偏好优化 :preference optimization(title,abstract);large language model(abstract);language model(abstract);分类 cs.CL、cs.AI、cs.LG

Comments Accepted by the EMNLP 2025 main conference

Journal ref https://aclanthology.org/2025.emnlp-main.359/

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.11234 2025-11-07 cs.RO cs.CV 82%

Poutine: Vision-Language-Trajectory Pre-Training and Reinforcement Learning Post-Training Enable Robust End-to-End Autonomous Driving

Luke Rowe, Rodrigue de Schaetzen, Roger Girgis, Christopher Pal, Liam Paull

机构 * Mila - Quebec AI Institute(魁北克人工智能研究所) Université de Montréal(蒙特利尔大学) Polytechnique Montréal(蒙特利尔理工学院) CIFAR AI Chair(CIFAR人工智能主席)

专题命中 后训练与偏好优化 :post-training(title);language model(abstract);pretraining(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.13444 2025-11-07 econ.GN q-fin.EC 67%

Balancing Engagement and Polarization: Multi-Objective Alignment of News Content Using LLMs

Mengjie Cheng, Elie Ofek, Hema Yoganarasimhan

专题命中 后训练与偏好优化 :language model(abstract);preference optimization(abstract)

Comments 73 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.03997 2025-11-07 cs.CV 50%

PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selection

Peiyao Wang, Weining Wang, Qi Li

专题命中 后训练与偏好优化 :preference optimization(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏