语言大模型 / LLM - arXivDaily 专题

2412.19237 2025-04-22 cs.CV cs.LG 83%

SeaMo: A Season-Aware Multimodal Foundation Model for Remote Sensing

Xuyang Li, Chenyu Li, Gemine Vivone, Danfeng Hong

机构 * Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院 aerospace information research institute）； School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences（中国科学院大学电子电气与通信工程学院）； School of Mathematics and Statistics, Southeast University（东南大学数学与统计学院）； Institute of Methodologies for Environmental Analysis, National Research Council, CNR-IMAA（国家研究理事会环境分析方法研究所）； Graduate School of Frontier Sciences, the University of Tokyo（东京大学前沿科学研究生院）

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

2504.11519 2025-04-17 physics.med-ph cs.CV cs.LG 83%

FACT: Foundation Model for Assessing Cancer Tissue Margins with Mass Spectrometry

Mohammad Farahmand, Amoon Jamzad, Fahimeh Fooladgar, Laura Connolly, Martin Kaufmann, Kevin Yi Mi Ren, John Rudan, Doug McKay, Gabor Fichtinger, Parvin Mousavi

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Journal ref International Journal of Computer Assisted Radiology and Surgery (2025)

2504.05186 2025-04-08 cs.CV cs.LG 83%

Training state-of-the-art pathology foundation models with orders of magnitude less data

Mikhail Karasikov, Joost van Doorn, Nicolas Känzig, Melis Erdal Cesur, Hugo Mark Horlings, Robert Berke, Fei Tang, Sebastian Otálora

专题命中预训练与数据：foundation model(title,abstract)；post-training(abstract)；分类 cs.LG

Comments 10 pages, 3 figures

2407.12481 2025-04-02 cs.CL 83%

Krutrim LLM: A Novel Tokenization Strategy for Multilingual Indic Languages with Petabyte-Scale Data Processing

Rahul Kumar, Shubham Kakde, Divyansh Rajput, Daud Ibrahim, Rishabh Nahata, Pidathala Sowjanya, Deepak Kumarr, Gautam Bhargava, Chandra Khatri

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

2407.12838 2025-03-31 cs.CL cs.DL 83%

Historical Ink: 19th Century Latin American Spanish Newspaper Corpus with LLM OCR Correction

Laura Manrique-Gómez, Tony Montes, Arturo Rodríguez-Herrera, Rubén Manrique

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Journal ref ACL, Proceedings of the 4th International Conference on Natural Language Processing for Digital Humanities, pages 132-139, 2024

2503.20417 2025-03-27 cs.CL 83%

CFunModel: A "Funny" Language Model Capable of Chinese Humor Generation and Processing

Zhenghan Yu, Xinyu Hu, Xiaojun Wan

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 9 pages

2503.19801 2025-03-26 cs.CV cs.AI 83%

SeLIP: Similarity Enhanced Contrastive Language Image Pretraining for Multi-modal Head MRI

Zhiyang Liu, Dong Yang, Minghao Zhang, Hanyu Sun, Hong Wu, Huiying Wang, Wen Shen, Chao Chai, Shuang Xia

专题命中预训练与数据：pretraining(title,abstract)；foundation model(abstract)；分类 cs.AI

2407.15362 2025-03-26 cs.CV cs.AI 83%

A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model

Yingxue Xu, Yihui Wang, Fengtao Zhou, Jiabo Ma, Cheng Jin, Shu Yang, Jinbang Li, Zhengyu Zhang, Chenglong Zhao, Huajun Zhou, Zhenhui Li, Huangjing Lin, Xin Wang, Jiguang Wang, Anjia Han, Ronald Cheong Kin Chan, Li Liang, Xiuming Zhang, Hao Chen

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

Comments 62 pages

2412.21124 2025-03-18 cs.LG math.OC stat.ML 83%

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism

Tim Tsz-Kit Lau, Weijian Li, Chenwei Xu, Han Liu, Mladen Kolar

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments The Second Conference on Parsimony and Learning (CPAL; Proceedings Track), March 2025, Stanford, CA

2406.04927 2025-03-18 eess.AS cs.CL 83%

LLM-based speaker diarization correction: A generalizable approach

Georgios Efstathiadis, Vijay Yadav, Anzar Abbas

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Journal ref Speech Communication, Volume 170, 2025, Page 103224

2411.04986 2025-03-12 cs.CL 83%

The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities

Zhaofeng Wu, Xinyan Velocity Yu, Dani Yogatama, Jiasen Lu, Yoon Kim

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments ICLR 2025

2503.02328 2025-03-05 cs.CL cs.CY cs.HC cs.SI 83%

Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection

Eun Cheol Choi, Ashwin Balasubramanian, Jinhu Qi, Emilio Ferrara

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

2502.11965 2025-03-04 eess.SP cs.AI 83%

A MIMO Wireless Channel Foundation Model via CIR-CSI Consistency

Jun Jiang, Wenjun Yu, Yunfan Li, Yuan Gao, Shugong Xu

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

Comments 6 pages, 2025 ICMLCN accepted

2409.02841 2025-02-26 cs.CL 83%

Historical German Text Normalization Using Type- and Token-Based Language Modeling

Anton Ehrmanntraut

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 27 pages, 3 figures; minor editorial changes

2502.17464 2025-02-26 eess.SP cs.LG q-bio.NC 83%

Large Cognition Model: Towards Pretrained EEG Foundation Model

Chi-Sheng Chen, Ying-Jung Chen, Aidan Hung-Wen Tsai

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

2502.11830 2025-02-21 cs.CL 83%

Text Classification in the LLM Era -- Where do we stand?

Sowmya Vajjala, Shwetali Shimangaud

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Pre-print

2410.16505 2025-02-21 cs.SD cs.LG eess.AS 83%

Do Audio-Language Models Understand Linguistic Variations?

Ramaneswaran Selvakumar, Sonal Kumar, Hemant Kumar Giri, Nishit Anand, Ashish Seth, Sreyan Ghosh, Dinesh Manocha

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments Accepted to NAACL 2025

2502.11831 2025-02-18 cs.CV cs.AI 83%

Intuitive physics understanding emerges from self-supervised pretraining on natural videos

Quentin Garrido, Nicolas Ballas, Mahmoud Assran, Adrien Bardes, Laurent Najman, Michael Rabbat, Emmanuel Dupoux, Yann LeCun

专题命中预训练与数据：pretraining(title)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 24 pages,14 figures, 5 tables

2502.10140 2025-02-17 cs.CL 83%

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages

Daniil Gurgurov, Ivan Vykopal, Josef van Genabith, Simon Ostermann

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Pre-print

2502.08515 2025-02-13 cs.LG 83%

The Paradox of Stochasticity: Limited Creativity and Computational Decoupling in Temperature-Varied LLM Outputs of Structured Fictional Data

Evgenii Evstafev

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.LG

Comments 8 pages, 6 figures

2502.00996 2025-02-04 cs.CL 83%

Self-supervised Analogical Learning using Language Models

Ben Zhou, Sarthak Jain, Yi Zhang, Qiang Ning, Shuai Wang, Yassine Benajiba, Dan Roth

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

2502.00344 2025-02-04 cs.CL 83%

FinchGPT: a Transformer based language model for birdsong analysis

Kosei Kobayashi, Kosuke Matsuzaki, Masaya Taniguchi, Keisuke Sakaguchi, Kentaro Inui, Kentaro Abe

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 12 pages, 4 figures

2412.14528 2025-01-22 cs.CL 83%

Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models

Xiao Cui, Mo Zhu, Yulei Qin, Liang Xie, Wengang Zhou, Houqiang Li

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Accepted by AAAI 2025 (Oral)

2501.04858 2025-01-10 cs.CL 83%

Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization

Sara Bourbour Hosseinbeigi, Sina Asghari, Mohammad Ali Seif Kashani, Mohammad Hossein Shalchian, Mohammad Amin Abbasi

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2412.00395 2024-12-18 cs.LG cs.RO stat.ML 83%

On Foundation Models for Dynamical Systems from Purely Synthetic Data

Martin Ziegler, Andres Felipe Posada-Moreno, Friedrich Solowjow, Sebastian Trimpe

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments 10 pages

2405.09913 2024-12-17 cs.CL 83%

TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data

Yihong Liu, Chunlan Ma, Haotian Ye, Hinrich Schütze

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments COLING 2025

2409.02391 2024-12-10 econ.GN cs.AI q-fin.EC 83%

Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation

Ali Merali

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.AI

2406.15275 2024-12-09 cs.CL 83%

How language models extrapolate outside the training data: A case study in Textualized Gridworld

Doyoung Kim, Jongwon Lee, Jinho Park, Minjoon Seo

专题命中预训练与数据：language model(title,abstract)；prompting(abstract)；分类 cs.CL

2411.15500 2024-11-26 cs.ET cs.CL 83%

MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model

Yifan Wu, Min Zeng, Yang Li, Yang Zhang, Min Li

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2407.17616 2024-11-21 cs.LG 83%

Pretraining a Neural Operator in Lower Dimensions

AmirPouya Hemmasian, Amir Barati Farimani

专题命中预训练与数据：pretraining(title,abstract)；language model(abstract)；分类 cs.LG

1. 预训练与数据 12403 篇

SeaMo: A Season-Aware Multimodal Foundation Model for Remote Sensing

FACT: Foundation Model for Assessing Cancer Tissue Margins with Mass Spectrometry

Training state-of-the-art pathology foundation models with orders of magnitude less data

Krutrim LLM: A Novel Tokenization Strategy for Multilingual Indic Languages with Petabyte-Scale Data Processing

Historical Ink: 19th Century Latin American Spanish Newspaper Corpus with LLM OCR Correction

CFunModel: A "Funny" Language Model Capable of Chinese Humor Generation and Processing

SeLIP: Similarity Enhanced Contrastive Language Image Pretraining for Multi-modal Head MRI

A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism

LLM-based speaker diarization correction: A generalizable approach

The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities

Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detection

A MIMO Wireless Channel Foundation Model via CIR-CSI Consistency

Historical German Text Normalization Using Type- and Token-Based Language Modeling

Large Cognition Model: Towards Pretrained EEG Foundation Model

Text Classification in the LLM Era -- Where do we stand?

Do Audio-Language Models Understand Linguistic Variations?

Intuitive physics understanding emerges from self-supervised pretraining on natural videos

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages

The Paradox of Stochasticity: Limited Creativity and Computational Decoupling in Temperature-Varied LLM Outputs of Structured Fictional Data

Self-supervised Analogical Learning using Language Models

FinchGPT: a Transformer based language model for birdsong analysis

Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models

Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization

On Foundation Models for Dynamical Systems from Purely Synthetic Data

TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data

Scaling Laws for Economic Productivity: Experimental Evidence in LLM-Assisted Translation

How language models extrapolate outside the training data: A case study in Textualized Gridworld

MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model

Pretraining a Neural Operator in Lower Dimensions