语言大模型 / LLM

Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillation

Muhammad Ali Shafique, Kanwal Mehreen, Muhammad Arham, Maaz Amjad, Sabur Butt, Hamza Farooq

机构 * University of British Columbia（不列颠哥伦比亚大学） ； Texas Tech University（德克萨斯技术大学） ； Institute for the Future of Education, Tecnológico de Monterrey（教育未来研究所，墨西哥蒙特雷技术学院） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to the EMNLP 2025 Workshop on Multilingual Representation Learning (MRL)

VisPile: A Visual Analytics System for Analyzing Multiple Text Documents With Large Language Models and Knowledge Graphs

Adam Coscia, Alex Endert

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Comments Accepted to HICSS 2026. 10 pages, 4 figures. For a demo video, see https://youtu.be/vY6SqkkNeMQ. For a live demo, visit https://adamcoscia.com/papers/vispile/demo/. The source code is available at https://github.com/AdamCoscia/VisPile

On the Reliability of Large Language Models for Causal Discovery

Tao Feng, Lizhen Qu, Niket Tandon, Zhuang Li, Xiaoxi Kang, Gholamreza Haffari

机构 * Monash University（莫纳什大学） ； Microsoft Research, India（微软研究院，印度） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ACL 2025

Weight Initialization and Variance Dynamics in Deep Neural Networks and Large Language Models

Yankun Han

机构 * University of Florida（佛罗里达大学） 纠错

专题命中 预训练与数据 ：large language model(title)；language model(title)；pretraining(abstract)；分类 cs.LG

Comments 8 pages, 6 figures

Getting Your Indices in a Row: Full-Text Search for LLM Training Data for Real World

Ines Altemir Marinas, Anastasiia Kucherenko, Alexander Sternfeld, Andrei Kucharavy

机构 * IC, EPFL（EPFL） 纠错

专题命中 预训练与数据 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Model

Yuting Yang, Gang Mei, Zhengjing Ma, Nengxiong Xu, Jianbing Peng

机构 * School of Engineering and Technology, China University of Geosciences (Beijing)（工程与技术学院，中国地质大学（北京）） ； School of Geological Engineering and Geomatics, Chang'an University（地质工程与测绘学院，长安大学） 纠错

专题命中 预训练与数据 ：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Faver: Boosting LLM-based RTL Generation with Function Abstracted Verifiable Middleware

Jianan Mu, Mingyu Shi, Yining Wang, Tianmeng Yang, Bin Sun, Xing Hu, Jing Ye, Huawei Li

机构 * Huawei（华为） 纠错

专题命中 预训练与数据 ：LLM(title,abstract)；SFT(abstract)；分类 cs.AI

Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language

Stefan Krsteski, Matea Tashkovska, Borjan Sazdov, Hristijan Gjoreski, Branislav Gerazov

专题命中 预训练与数据 ：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Camera-ready version accepted at SlavNLP-2025@ACL

Graph Diffusion Transformers are In-Context Molecular Designers

Gang Liu, Jie Chen, Yihan Zhu, Michael Sun, Tengfei Luo, Nitesh V Chawla, Meng Jiang

机构 * University of Notre Dame（诺丁汉大学） ； MIT-IBM Watson AI Lab, IBM Research（麻省理工-IBM Watson人工智能实验室，IBM研究） 纠错

专题命中 预训练与数据 ：language model(abstract)；foundation model(abstract)；pretraining(abstract)；分类 cs.AI、cs.LG

Comments 29 pages, 16 figures, 17 tables. Model available at: https://huggingface.co/liuganghuggingface/DemoDiff-0.7B

Scalable multilingual PII annotation for responsible AI in LLMs

Bharti Meena, Joanna Skubisz, Harshit Rajgarhia, Nand Dave, Kiran Ganesh, Shivali Dalmia, Abhishek Mukherji, Vasudevan Sundarababu

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrieval

Yu Wang, Tianhao Tan, Yifei Wang

机构 * School of Computing and Information, University of Pittsburgh, PA, USA（计算与信息学院，匹兹堡大学） ； Wuhan University of Technology（武汉理工大学） ； Hunan University（湖南大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to NLPCC 2025 (Springer), to appear November 2025

Repository-Aware File Path Retrieval via Fine-Tuned LLMs

Vasudha Yanuganti, Ishaan Puri, Swapnil Chhatre, Mantinder Singh, Ashok Jallepalli, Hritvik Shrivastava, Pradeep Kumar Sharma

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models

Moon Ye-Bin, Roy Miles, Tae-Hyun Oh, Ismail Elezi, Jiankang Deng

机构 * POSTECH ； Huawei London Research Center（华为伦敦研究中心） ； KAIST（韩国科学技术院） ； Imperial College London（伦敦帝国理工学院） 纠错

专题命中 预训练与数据 ：language model(title)

Detecting and Filtering Unsafe Training Data via Data Attribution with Denoised Representation

Yijun Pan, Taiwei Shi, Jieyu Zhao, Jiaqi W. Ma

机构 * University of Michigan（密歇根大学） ； University of Southern California（南加州大学） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 14 pages

Web Crawler Restrictions, AI Training Datasets \& Political Biases

Paul Bouchaud, Pedro Ramaciotti

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

BaNEL: Exploration Posteriors for Generative Modeling Using Only Negative Rewards

Sangyun Lee, Brandon Amos, Giulia Fanti

机构 * Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 预训练与数据 ：post-training(abstract)；分类 cs.AI、cs.LG

Solving Fokker-Planck-Kolmogorov Equation by Distribution Self-adaptation Normalized Physics-informed Neural Networks

Yi Zhang, Yiting Duan, Xiangjun Wang, Zhikun Zhang

专题命中 预训练与数据 ：pretraining(abstract)

Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models

Hyeonggeun Han, Sehwan Kim, Hyungjun Joo, Sangwoo Hong, Jungwoo Lee

机构 * Seoul National University（首尔国立大学） ； CSE, Konkuk University（计算机科学与工程系，konkuk大学） ； Hodoo AI Labs（Hodoo AI实验室） 纠错

专题命中 预训练与数据 ：prompting(abstract)