语言大模型 / LLM - arXivDaily 专题

2411.00691 2025-10-28 cs.CL 89%

Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis

Linda Zeng

机构 * The Harker School（哈克尔学校）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments 17 pages, 4 figures, 11 tables, To be published in the Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024), co-located with EMNLP 2024

2506.03145 2025-10-28 cs.CL cs.AI 86%

Entity-Augmented Neuroscience Knowledge Retrieval Using Ontology and Semantic Understanding Capability of LLM

Pralaypati Ta, Sriram Venkatesaperumal, Keerthi Ram, Mohanasankar Sivaprakasam

专题命中预训练与数据：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2506.21864 2025-10-28 cs.CL cs.AI 85%

DeepOmni: Towards Seamless and Smart Speech Interaction with Adaptive Modality-Specific MoE

Hang Shao, Heting Gao, Yunhang Shen, Jiawei Chen, Zuwei Long, Dong Yang, Ke Li, Xing Sun

机构 * Tencent（腾讯）； Fudan University（复旦大学）

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；SLM(abstract)

Comments Under Review

2505.07019 2025-10-28 cs.CV 85%

A Vision-Language Foundation Model for Leaf Disease Identification

Khang Nguyen Quoc, Lan Le Thi Thu, Luyl-Da Quach

专题命中预训练与数据：foundation model(title,abstract)；language model(abstract)；pretraining(abstract)

2510.22356 2025-10-28 cs.CL 84%

Irony Detection in Urdu Text: A Comparative Study Using Machine Learning Models and Large Language Models

Fiaz Ahmad, Nisar Hussain, Amna Qasim, Momina Hafeez, Muhammad Usman Grigori Sidorov, Alexander Gelbukh

专题命中预训练与数据：large language model(title)；language model(title)；分类 cs.CL

Comments 5 pages, 3 figuers

2510.13481 2025-10-28 cs.LG 83%

Tahakom LLM Guidelines and Recipes: From Pre-training Data to an Arabic LLM

Areej AlOtaibi, Lina Alyahya, Raghad Alshabanah, Shahad Alfawzan, Shuruq Alarefei, Reem Alsabti, Nouf Alsubaie, Abdulaziz Alhuzaymi, Lujain Alkhelb, Majd Alsayari, Waad Alahmed, Omar Talabay, Jalal Alowibdi, Salem Alelyani, Adel Bibi

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.LG

2509.23659 2025-10-28 cs.CL cs.AI 82%

Aligning LLMs for Multilingual Consistency in Enterprise Applications

Amit Agarwal, Hansa Meghwani, Hitesh Laxmichand Patel, Tao Sheng, Sujith Ravi, Dan Roth

机构 * Oracle AI

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；pretraining(abstract)

Comments Accepted at EMNLP 2025

2510.21813 2025-10-28 cs.CV cs.AI cs.LG 82%

SITS-DECO: A Generative Decoder Is All You Need For Multitask Satellite Image Time Series Modelling

Samuel J. Barrett, Docko Sow

机构 * LGND AI ； Tolbi

专题命中预训练与数据：large language model(abstract)；language model(abstract)；foundation model(abstract)；prompting(abstract)

Comments 27 pages, 7 figures

2510.22629 2025-10-28 cs.CL cs.AI 79%

Integrating Linguistics and AI: Morphological Analysis and Corpus development of Endangered Toto Language of West Bengal

Ambalika Guha, Sajal Saha, Debanjan Ballav, Soumi Mitra, Hritwick Chakraborty

专题命中预训练与数据：language model(abstract)；small language model(abstract)；SLM(abstract)；分类 cs.CL、cs.AI

2502.04465 2025-10-28 cs.LG cs.AI cs.SD eess.AS 79%

FocalCodec: Low-Bitrate Speech Coding via Focal Modulation Networks

Luca Della Libera, Francesco Paissan, Cem Subakan, Mirco Ravanelli

机构 * Concordia University（康科德大学）； Mila-Quebec AI Institute（魁北克AI研究院）； Fondazione Bruno Kessler（布鲁诺·凯斯勒基金会）； University of Trento（特伦托大学）； Université Laval（拉瓦尔大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

Comments Accepted at NeurIPS 2025

2510.23066 2025-10-28 cs.IR 78%

Multi-Stage Field Extraction of Financial Documents with OCR and Compact Vision-Language Models

Yichao Jin, Yushuo Wang, Qishuai Zhong, Kent Chiu Jin-Chun, Kenneth Zhu Ke, Donald MacDonald

专题命中预训练与数据：language model(title,abstract)

2510.22694 2025-10-28 cs.CV cs.CL cs.IR 77%

Windsock is Dancing: Adaptive Multimodal Retrieval-Augmented Generation

Shu Zhao, Tianyi Shen, Nilesh Ahuja, Omesh Tickoo, Vijaykrishnan Narayanan

机构 * The Pennsylvania State University（宾夕法尼亚州立大学）； Intel（英特尔）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted at NeurIPS 2025 UniReps Workshop

2510.22099 2025-10-28 cs.CL 77%

Generalization or Memorization: Dynamic Decoding for Mode Steering

Xuanming Zhang

机构 * Stanford University, Palo Alto, USA（斯坦福大学）； Department of Computer Science, University of Wisconsin-Madison, Madison, USA（计算机科学系，威斯康星大学麦迪逊分校）

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

2510.21867 2025-10-28 cs.CV cs.AI 77%

Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs

Haicheng Liao, Bonan Wang, Junxian Yang, Chengyue Wang, Zhengbin He, Guohui Zhang, Chengzhong Xu, Zhenning Li

机构 * State Key Laboratory of Internet of Things for Smart City, University of Macau（物联网智能城市国家重点实验室，澳门大学）； Department of Computer and Information Science, University of Macau（计算机与信息科学系，澳门大学）； Department of Civil and Environmental Engineering, University of Macau（土木与环境工程系，澳门大学）； Senseable City Lab, Massachusetts Institute of Technology（可感知城市实验室，麻省理工学院）； Department of Civil and Environmental Engineering, University of Hawaii（土木与环境工程系，夏威夷大学）

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

2510.21836 2025-10-28 cs.LG 77%

COLA: Continual Learning via Autoencoder Retrieval of Adapters

Jaya Krishna Mandivarapu

机构 * Microsoft（微软）

专题命中预训练与数据：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

2510.22261 2025-10-28 cs.LG cs.AI 73%

Epistemic Deep Learning: Enabling Machine Learning Models to Know When They Do Not Know

Shireen Kudukkil Manchingal

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments PhD thesis

2505.15807 2025-10-28 cs.CL cs.IR cs.LG 73%

The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation

Patrick Kahardipraja, Reduan Achtibat, Thomas Wiegand, Wojciech Samek, Sebastian Lapuschkin

机构 * Department of Artificial Intelligence, Fraunhofer Heinrich Hertz Institute（人工智能系，弗劳恩霍夫海因里希·赫兹研究所）； Department of Electrical Engineering and Computer Science, Technische Universität Berlin（电气工程与计算机科学系，柏林技术大学）； BIFOLD - Berlin Institute for the Foundations of Learning and Data（柏林学习与数据基础研究所）； Centre of eXplainable Artificial Intelligence, Technological University Dublin（可解释人工智能中心，都柏林技术大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at NeurIPS 2025

2510.22594 2025-10-28 cs.AI cs.LG 73%

A Framework for Quantifying How Pre-Training and Context Benefit In-Context Learning

Bingqing Song, Jiaxiang Li, Rong Wang, Songtao Lu, Mingyi Hong

机构 * Department of XXX, University of YYY, Location, Country（XXX系，YYY大学，地点，国家）； School of ZZZ, Institute of WWW, Location, Country（ZZZ学院，WWW研究所，地点，国家）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2507.15857 2025-10-28 cs.LG cs.AI cs.CV cs.RO 73%

Diffusion Beats Autoregressive in Data-Constrained Settings

Mihir Prabhudesai, Mengning Wu, Amir Zadeh, Katerina Fragkiadaki, Deepak Pathak

机构 * Carnegie Mellon University（卡内基梅隆大学）； Lambda

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Project Webpage: https://diffusion-scaling.github.io

2510.14627 2025-10-28 cs.RO cs.CV 67%

GOPLA: Generalizable Object Placement Learning via Synthetic Augmentation of Human Arrangement

Yao Zhong, Hanzhi Chen, Simon Schaefer, Anran Zhang, Stefan Leutenegger

机构 * Technical University of Munich（慕尼黑技术大学）； ETH Zurich（苏黎世联邦理工学院）

专题命中预训练与数据：large language model(abstract)；language model(abstract)

2508.07976 2025-10-28 cs.CL cs.AI 62%

Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RL

Jiaxuan Gao, Wei Fu, Minyang Xie, Shusheng Xu, Chuyi He, Zhiyu Mei, Banghua Zhu, Yi Wu

机构 * IIIS, Tsinghua University（清华大学智能技术学部）； Ant Group（蚂蚁集团）； University of Washington（华盛顿大学）

专题命中预训练与数据：LLM(abstract)；分类 cs.CL、cs.AI

2507.10741 2025-10-28 cs.LG cs.AI 62%

Ground-Compose-Reinforce: Grounding Language in Agentic Behaviours using Limited Data

Andrew C. Li, Toryn Q. Klassen, Andrew Wang, Parand A. Alamdari, Sheila A. McIlraith

机构 * Department of Computer Science, University of Toronto（计算机科学系，多伦多大学）； Vector Institute for Artificial Intelligence（人工智能矢量研究所）； Schwartz Reisman Institute for Technology and Society（技术与社会施瓦茨-雷曼研究所）

专题命中预训练与数据：pretraining(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2025

2507.07543 2025-10-28 cs.CL cs.AI cs.IR 62%

The Cross-Lingual Cost: Retrieval Biases in RAG over Arabic-English Corpora

Chen Amiraz, Yaroslav Fyodorov, Elad Haramaty, Zohar Karnin, Liane Lewin-Eytan

机构 * Technology Innovation Institute（技术创新研究所）

专题命中预训练与数据：pretraining(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ArabicNLP 2025

2510.22141 2025-10-28 cs.CV cs.CL cs.LG cs.RO eess.IV 62%

LOC: A General Language-Guided Framework for Open-Set 3D Occupancy Prediction

Yuhang Gao, Xiang Xiang, Sheng Zhong, Guoyou Wang

专题命中预训练与数据：language model(abstract)；分类 cs.CL、cs.LG

2504.20434 2025-10-28 cs.SE cs.AI 57%

ARCS: Agentic Retrieval-Augmented Code Synthesis with Iterative Refinement

Manish Bhattarai, Miguel Cordova, Minh Vu, Javier Santos, Ismael Boureima, Dan O'Malley

机构 * Los Alamos National Laboratory（洛斯阿拉莫斯国家实验室）

专题命中预训练与数据：LLM(abstract)；分类 cs.AI

2503.02103 2025-10-28 cs.CL 57%

Superficial Self-Improved Reasoners Benefit from Model Merging

Xiangchi Yuan, Chunhui Zhang, Zheyuan Liu, Dachuan Shi, Leyan Pan, Soroush Vosoughi, Wenke Lee

机构 * Georgia Institute of Technology（佐治亚理工学院）； Dartmouth College（达特茅斯学院）； University of Notre Dame（诺丁汉大学）

专题命中预训练与数据：language model(abstract)；分类 cs.CL

Comments EMNLP 2025

2510.22600 2025-10-28 cs.RO cs.AI 57%

RoGER-SLAM: A Robust Gaussian Splatting SLAM System for Noisy and Low-light Environment Resilience

Huilin Yin, Zhaolin Yang, Linchuan Zhang, Gerhard Rigoll, Johannes Betz

机构 * College of Electronic and Information Engineering, Tongji University（同济大学电子与信息工程学院）； Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University（同济大学智能自主系统研究所）； Chair of Human-Machine Communication, Technical University of Munich（慕尼黑技术大学人机通信教授职位）； Professorship of Autonomous Vehicle Systems, Technical University of Munich（慕尼黑技术大学自动驾驶系统教授职位）

专题命中预训练与数据：pretraining(abstract)；分类 cs.AI

Comments 13 pages, 11 figures, under review

2508.12703 2025-10-28 cs.LG cs.SY eess.SY 57%

BUILDA: A Thermal Building Data Generation Framework for Transfer Learning

Thomas Krug, Fabian Raisch, Dominik Aimer, Markus Wirnsberger, Ferdinand Sigg, Benjamin Schäfer, Benjamin Tischler

专题命中预训练与数据：pretraining(abstract)；分类 cs.LG

Comments Proceedings can be accessed at: https://annsim.org/2025-annsim-proceedings/

Journal ref Proceedings of the 2025 Annual Modeling and Simulation Conference (ANNSIM25)

2505.01481 2025-10-28 cs.CV cs.LG 57%

VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations on Synthetic Video Understanding

Zongxia Li, Xiyang Wu, Guangyao Shi, Yubin Qin, Hongyang Du, Fuxiao Liu, Tianyi Zhou, Dinesh Manocha, Jordan Lee Boyd-Graber

机构 * University of Maryland, College Park（马里兰大学学院公园分校）

专题命中预训练与数据：language model(abstract)；分类 cs.LG

Journal ref NeurIPS 2025

2510.22123 2025-10-28 cs.LG stat.ML 57%

Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modeling

Xixian Liu, Rui Jiao, Zhiyuan Liu, Yurou Liu, Yang Liu, Ziheng Lu, Wenbing Huang, Yang Zhang, Yixin Cao

机构 * Fudan University（复旦大学）； Tsinghua University（清华大学）； National University of Singapore（新加坡国立大学）； Renmin University of China（中国人民大学）； Microsoft Research（微软研究院）； Institute of Trustworthy Embodied AI, Fudan University（复旦大学可信具身人工智能研究所）

专题命中预训练与数据：pretraining(abstract)；分类 cs.LG

1. 预训练与数据 31 篇

Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis

Entity-Augmented Neuroscience Knowledge Retrieval Using Ontology and Semantic Understanding Capability of LLM

DeepOmni: Towards Seamless and Smart Speech Interaction with Adaptive Modality-Specific MoE

A Vision-Language Foundation Model for Leaf Disease Identification

Irony Detection in Urdu Text: A Comparative Study Using Machine Learning Models and Large Language Models

Tahakom LLM Guidelines and Recipes: From Pre-training Data to an Arabic LLM

Aligning LLMs for Multilingual Consistency in Enterprise Applications

SITS-DECO: A Generative Decoder Is All You Need For Multitask Satellite Image Time Series Modelling

Integrating Linguistics and AI: Morphological Analysis and Corpus development of Endangered Toto Language of West Bengal

FocalCodec: Low-Bitrate Speech Coding via Focal Modulation Networks

Multi-Stage Field Extraction of Financial Documents with OCR and Compact Vision-Language Models

Windsock is Dancing: Adaptive Multimodal Retrieval-Augmented Generation

Generalization or Memorization: Dynamic Decoding for Mode Steering

Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs

COLA: Continual Learning via Autoencoder Retrieval of Adapters

Epistemic Deep Learning: Enabling Machine Learning Models to Know When They Do Not Know

The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation

A Framework for Quantifying How Pre-Training and Context Benefit In-Context Learning

Diffusion Beats Autoregressive in Data-Constrained Settings

GOPLA: Generalizable Object Placement Learning via Synthetic Augmentation of Human Arrangement

Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RL

Ground-Compose-Reinforce: Grounding Language in Agentic Behaviours using Limited Data

The Cross-Lingual Cost: Retrieval Biases in RAG over Arabic-English Corpora

LOC: A General Language-Guided Framework for Open-Set 3D Occupancy Prediction

ARCS: Agentic Retrieval-Augmented Code Synthesis with Iterative Refinement

Superficial Self-Improved Reasoners Benefit from Model Merging

RoGER-SLAM: A Robust Gaussian Splatting SLAM System for Noisy and Low-light Environment Resilience

BUILDA: A Thermal Building Data Generation Framework for Transfer Learning

VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations on Synthetic Video Understanding

Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modeling