语言大模型 / LLM

Robust Transmission of Punctured Text with Large Language Model-based Recovery

Sojeong Park, Hyeonho Noh, Hyun Jong Yang

机构 * Department of Electrical Engineering, Pohang University of Science and Technology, Korea（首尔国立大学） ； Department of Electrical and Computer Engineering, Seoul National University, Korea（首尔国立大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments This work has been submitted to the IEEE for possible publication

Journal ref IEEE Transactions on Vehicular Technology, 2025

MuCPT: Music-related Natural Language Model Continued Pretraining

Kai Tian, Yirong Mao, Wendong Bi, Hanjie Wang, Que Wenhui

机构 * Tsinghua University（清华大学） ； Tencent Inc（腾讯公司） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title,abstract)；large language model(abstract)；分类 cs.CL

A Comprehensive Study of Implicit and Explicit Biases in Large Language Models

Fatima Kazi, Alex Young, Yash Inani, Setareh Rafatirad

机构 * University of California, Davis（加州大学戴维斯分校） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.LG

Patent Language Model Pretraining with ModernBERT

Amirhossein Yousefiramandi, Ciaran Cooney

机构 * Clarivate 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 7 pages, 5 figures, 4 tables

LAUD: Integrating Large Language Models with Active Learning for Unlabeled Data

Tzu-Hsuan Chou, Chun-Nan Chou

机构 * CMoney Technology Corporation（CMoney技术公司） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments 7 pages and one figure

Native Design Bias: Studying the Impact of English Nativeness on Language Model Performance

Manon Reusens, Philipp Borchert, Jochen De Weerdt, Bart Baesens

机构 * Research Centre for Information Systems Engineering (LIRIS), KU Leuven（信息系统工程研究中心（LIRIS），库勒文大学） ； IESEG School of Management（IESEG管理学院） ； Department of Decision Analytics and Risk, University of Southampton（决策分析与风险系，南安普顿大学） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)；pretraining(abstract)

Comments Accepted at ICJNLP-AACL (findings)

Synergizing Multigrid Algorithms with Vision Transformer: A Novel Approach to Enhance the Seismic Foundation Model

Huiwen Wu, Shuo Zhang, Yi Liu, Hongbin Ye

机构 * Research Center for Scientific Data Hub Zhejiang Laboratory（科学数据枢纽研究中心 浙江实验室） ； State Key Laboratory of Mathematical Sciences (SKLMS)（数学科学国家重点实验室） ； State Key Laboratory of Scientific and Engineering Computing (LSEC)（科学与工程计算国家重点实验室） ； Institute of Computational Mathematics and Scientific/Engineering Computing Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China（数学系统科学学院，中国科学院，北京，中国） ； School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, China（中国科学院大学数学科学学院，北京，中国） 纠错

专题命中 预训练与数据 ：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

PRIMUS: Pretraining IMU Encoders with Multimodal Self-Supervision

Arnav M. Das, Chi Ian Tang, Fahim Kawsar, Mohammad Malekzadeh

机构 * Nokia Bell Labs Cambridge, UK（诺基亚贝尔实验室（剑桥，英国）） ； University of Washington, USA（华盛顿大学（美国）） ； University of Glasgow, UK（格拉斯哥大学（英国）） 纠错

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments Presented at ICASSP 2025. Also presented under the title "PRIMUS: Pretraining IMU Encoders with Multimodal and Self-Supervised Learning" at NeurIPS 2024 TSALM Workshop (Time Series in the Age of Large Models)

Ground Truth Generation for Multilingual Historical NLP using LLMs

Clovis Gladstone, Zhao Fang, Spencer Dean Stewart

机构 * ARTFL Project, Romance Languages and Literatures, University of Chicago（ARTFL项目， Romance语言与文学系，芝加哥大学） ； Department of History, University of Chicago（历史系，芝加哥大学） ； Libraries and School of Information Studies, Purdue University（图书馆与信息科学学院，普渡大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 13 pages, 5 tables, 1 figure

Journal ref CHR2025

4D-VLA: Spatiotemporal Vision-Language-Action Pretraining with Cross-Scene Calibration

Jiahui Zhang, Yurui Chen, Yueming Xu, Ze Huang, Yanpeng Zhou, Yu-Jie Yuan, Xinyue Cai, Guowei Huang, Xingyue Quan, Hang Xu, Li Zhang

机构 * School of Data Science, Fudan University（复旦大学数据科学学院） ； Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 预训练与数据 ：pretraining(title,abstract)

ARC Is a Vision Problem!

Keya Hu, Ali Cy, Linlu Qiu, Xiaoman Delores Ding, Runqian Wang, Yeyin Eva Zhu, Jacob Andreas, Kaiming He

机构 * MIT（麻省理工学院） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Technical Report. Project webpage: https://github.com/lillian039/VARC

SMOL-MapSeg: Show Me One Label as prompt

Yunshuang Yuan, Frank Thiemann, Thorsten Dahms, Monika Sester

机构 * IKG 纠错

专题命中 预训练与数据 ：foundation model(abstract)；prompting(abstract)

Collaborative QA using Interacting LLMs. Impact of Network Structure, Node Capability and Distributed Data

Adit Jain, Vikram Krishnamurthy, Yiming Zhang

机构 * Department of Electrical and Computer Engineering, Cornell University（电气与计算机工程系，康奈尔大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；分类 cs.AI