语言大模型 / LLM - arXivDaily 专题

2510.24139 2025-10-29 cs.CL cs.AI 84%

Beyond Line-Level Filtering for the Pretraining Corpora of LLMs

Chanwoo Park, Suyoung Park, Yelim Ahn, Jongmin Kim, Jongyeon Park, Jaejin Lee

专题命中预训练与数据：pretraining(title)；language model(abstract)；small language model(abstract)；分类 cs.CL、cs.AI

Comments submitted to ACL ARR Rolling Review

2510.24159 2025-10-29 astro-ph.GA astro-ph.IM cs.AI cs.LG 81%

Self-supervised Synthetic Pretraining for Inference of Stellar Mass Embedded in Dense Gas

Keiya Hirashima, Shingo Nozaki, Naoto Harada

机构 * Center for Interdisciplinary Theoretical and Mathematical Sciences (iTHEMS) RIKEN（交叉学科理论与数学科学中心（iTHEMS）RIKEN）； Department of Earth and Planetary Sciences（地球与行星科学系）； Department of Astronomy（天文学系）

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.AI、cs.LG

Comments 6 pages, 3 figures, 1 table, accepted for NeurIPS 2025 ML4PS workshop

2510.15870 2025-10-29 cs.CV cs.AI cs.CL 81%

OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM

Hanrong Ye, Chao-Han Huck Yang, Arushi Goel, Wei Huang, Ligeng Zhu, Yuanhang Su, Sean Lin, An-Chieh Cheng, Zhen Wan, Jinchuan Tian, Yuming Lou, Dong Yang, Zhijian Liu, Yukang Chen, Ambrish Dantrey, Ehsan Jahangiri, Sreyan Ghosh, Daguang Xu, Ehsan Hosseini-Asl, Danial Mohseni Taheri, Vidya Murali, Sifei Liu, Yao Lu, Oluwatobi Olabiyi, Yu-Chiang Frank Wang, Rafael Valle, Bryan Catanzaro, Andrew Tao, Song Han, Jan Kautz, Hongxu Yin, Pavlo Molchanov

机构 * NVIDIA

专题命中预训练与数据：LLM(title,abstract)；分类 cs.CL、cs.AI

Comments Technical Report. Code: https://github.com/NVlabs/OmniVinci

2404.13397 2025-10-29 cs.CL cs.AI 73%

Retrieval-Augmented Generation-based Relation Extraction

Sefika Efeoglu, Adrian Paschke

机构 * Electrical Engineering and Computer Science Department, Technische Universitaet Berlin（技术大学柏林电子工程与计算机科学系）； Department of Computer Science, Freie Universitaet Berlin（柏林自由大学计算机科学系）； Data Analytic Center (DANA), Fraunhofer Institute FOKUS（弗劳恩霍夫研究所FOKUS数据分析中心）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments published at the Semantic Web journal. The last version is available: https://doi.org/10.1177/22104968251385519

2510.24019 2025-10-29 cs.SE cs.AI 70%

Lifecycle-Aware code generation: Leveraging Software Engineering Phases in LLMs

Xing Xing, Wei Wang, Lipeng Ma, Weidong Yang, Junjie Zheng

机构 * School of Computer Science, Fudan University（复旦大学计算机科学学院）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.AI

2506.01855 2025-10-29 cs.LG cs.IT math.IT stat.ML 70%

Trade-offs in Data Memorization via Strong Data Processing Inequalities

Vitaly Feldman, Guy Kornowski, Xin Lyu

机构 * Apple（苹果公司）； Weizmann Institute of Science（魏茨曼科学研究院）； UC Berkeley（伯克利大学）

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments Appeared in COLT 2025; this revision includes an improved upper bound in Theorem 3.1, as well as several minor clarifications and modifications

2510.24365 2025-10-29 cs.CL 57%

Text Simplification with Sentence Embeddings

Matthew Shardlow

机构 * Manchester Metropolitan University（曼彻斯特 Metropolitan 大学）

专题命中预训练与数据：LLM(abstract)；分类 cs.CL

2405.07883 2025-10-29 cs.CL 57%

Zero-Shot Tokenizer Transfer

Benjamin Minixhofer, Edoardo Maria Ponti, Ivan Vulić

机构 * University of Cambridge（剑桥大学）； University of Edinburgh（爱丁堡大学）

专题命中预训练与数据：language model(abstract)；分类 cs.CL

Comments NeurIPS 2024

2510.24261 2025-10-29 cs.RO cs.AI cs.CV 57%

DynaRend: Learning 3D Dynamics via Masked Future Rendering for Robotic Manipulation

Jingyi Tian, Le Wang, Sanping Zhou, Sen Wang, Jiayi Li, Gang Hua

机构 * National Key Laboratory of Human-Machine Hybrid Augmented Intelligence（人机混合增强智能国家重点实验室）； National Engineering Research Center for Visual Information and Applications（视觉信息与应用国家工程研究中心）； Institute of Artificial Intelligence and Robotics（人工智能与机器人研究院）； Xi’an Jiaotong University（西安交通大学）

专题命中预训练与数据：pretraining(abstract)；分类 cs.AI

Comments Accepted to NeurIPS 2025

2510.24053 2025-10-29 cs.LG q-bio.QM 57%

Low-N Protein Activity Optimization with FolDE

Jacob B. Roberts, Catherine R. Ji, Isaac Donnell, Thomas D. Young, Allison N. Pearson, Graham A. Hudson, Leah S. Keiser, Mia Wesselkamper, Peter H. Winegar, Janik Ludwig, Sarah H. Klass, Isha V. Sheth, Ezechinyere C. Ukabiala, Maria C. T. Astolfi, Benjamin Eysenbach, Jay D. Keasling

专题命中预训练与数据：language model(abstract)；分类 cs.LG

Comments 18 pages, 4 figures. Preprint. Open-source software available at https://github.com/JBEI/foldy

2510.24703 2025-10-29 physics.med-ph 50%

Cluster Dose Prediction in Carbon Ion Therapy: Using Transfer Learning from a Pretrained Dose Prediction U-Net

Miriam Schwarze, Hui Khee Looe, Björn Poppe, Leo Thomas, Hans Rabus

专题命中预训练与数据：pretraining(abstract)

2405.07046 2025-10-29 cs.CV 50%

RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning

Yunchuan Ma, Laiyun Qing, Guorong Li, Yuankai Qi, Amin Beheshti, Quan Z. Sheng, Qingming Huang

机构 * University of Chinese Academy of Science, Beijing,100190, China（中国科学院大学）； Macquarie University（麦考瑞大学）

专题命中预训练与数据：language model(abstract)

Comments Published in Pattern Recognition

1. 预训练与数据 12 篇