arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

语言大模型 / LLM

大语言模型、预训练、指令微调、后训练和语言模型应用。

共收录 12403 信号源:cs.CL, cs.AI, cs.LG

1. 预训练与数据 12403 篇

2408.03119 2024-08-07 cs.CL cs.AI 88%

Evaluating the Translation Performance of Large Language Models Based on Euas-20

Yan Huang, Wei Liu

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments 15 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.12813 2024-07-23 cs.CL cs.AI 88%

Data Generation Using Large Language Models for Text Classification: An Empirical Case Study

Yinheng Li, Rogerio Bonatti, Sara Abdali, Justin Wagle, Kazuhito Koishida

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments Accepted by DMLR @ ICML 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.12141 2024-07-18 cs.CL cs.AI 88%

Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language

Hubert Plisiecki, Piotr Koc, Maria Flakus, Artur Pokropek

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments The Appendix is located at the very bottom of the manuscript

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.07551 2024-07-11 cs.CL cs.AI 88%

Arabic Automatic Story Generation with Large Language Models

Ahmed Oumar El-Shangiti, Fakhraddin Alwajih, Muhammad Abdul-Mageed

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.07237 2024-07-03 cs.CL cs.AI 88%

Distilling Event Sequence Knowledge From Large Language Models

Somin Wadhwa, Oktie Hassanzadeh, Debarun Bhattacharjya, Ken Barker, Jian Ni

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments In Proceedings of 23rd International Semantic Web Conference (ISWC), 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.19853 2024-07-01 cs.CL cs.AI 88%

YuLan: An Open-source Large Language Model

Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun, Zhipeng Chen, Qian Cao, Yihan Wu, Yushuo Chen, Feng Wang, Lei Zhang, Junyi Li, Xiaolei Wang, Lei Wang, Beichen Zhang, Zican Dong, Xiaoxue Cheng, Yuhan Chen, Xinyu Tang, Yupeng Hou, Qiangqiang Ren, Xincheng Pang, Shufang Xie, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ze-Feng Gao, Yueguo Chen, Weizheng Lu, Ji-Rong Wen

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.12656 2024-06-28 cs.CL cs.AI 88%

Identifying and Extracting Rare Disease Phenotypes with Large Language Models

Cathy Shyr, Yan Hu, Paul A. Harris, Hua Xu

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Journal ref J Healthc Inform Res 8, 438-461 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.15996 2024-06-25 cs.CL cs.AI 88%

Memorizing Documents with Guidance in Large Language Models

Bumjin Park, Jaesik Choi

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments IJCAI 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.06455 2024-06-17 cs.AI cs.CL 88%

A Large Language Model Pipeline for Breast Cancer Oncology

Tristen Pool, Dennis Trujillo

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.06962 2024-06-12 cs.CL cs.AI 88%

Evolving Subnetwork Training for Large Language Models

Hanqi Li, Lu Chen, Da Ma, Zijian Wu, Su Zhu, Kai Yu

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments Accepted to ICML 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.11103 2024-06-11 cs.CL cs.LG 88%

ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models

Yuzhao Heng, Chunyuan Deng, Yitong Li, Yue Yu, Yinghao Li, Rongzhi Zhang, Chao Zhang

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.LG

Comments Accepted to ACL 2024 Findings

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.01457 2024-06-05 cs.LG cs.CL cs.CR 88%

Differentially Private Tabular Data Synthesis using Large Language Models

Toan V. Tran, Li Xiong

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.21068 2024-06-03 cs.CL cs.AI 88%

Code Pretraining Improves Entity Tracking Abilities of Language Models

Najoung Kim, Sebastian Schuster, Shubham Toshniwal

专题命中 预训练与数据 :language model(title,abstract);pretraining(title,abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.14057 2024-05-24 cs.CL cs.AI 88%

Your Large Language Models Are Leaving Fingerprints

Hope McGovern, Rickard Stureborg, Yoshi Suhara, Dimitris Alikaniotis

专题命中 预训练与数据 :language model(title,abstract);large language model(title);LLM(abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.06239 2024-05-13 cs.CL cs.AI 88%

SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corpora

Faisal Qarah

专题命中 预训练与数据 :language model(title,abstract);large language model(title);pretraining(abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.18534 2024-05-13 cs.CL cs.AI cs.CR cs.SE 88%

Evaluating and Mitigating Linguistic Discrimination in Large Language Models

Guoliang Dong, Haoyu Wang, Jun Sun, Xinyu Wang

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.17733 2024-04-30 cs.CL cs.AI 88%

Building a Large Japanese Web Corpus for Large Language Models

Naoaki Okazaki, Kakeru Hattori, Hirai Shota, Hiroki Iida, Masanari Ohi, Kazuki Fujii, Taishi Nakamura, Mengsay Loem, Rio Yokota, Sakae Mizuki

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments 17 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.16358 2024-04-24 cs.LG cs.CL cs.IR 88%

An Integrated Data Processing Framework for Pretraining Foundation Models

Yiding Sun, Feng Wang, Yutao Zhu, Wayne Xin Zhao, Jiaxin Mao

专题命中 预训练与数据 :foundation model(title,abstract);pretraining(title,abstract);分类 cs.CL、cs.LG

Comments 6 pages, 2 figures; accepted by SIGIR'24 demo track

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.09783 2024-04-05 cs.CL cs.AI 88%

Investigating Data Contamination in Modern Benchmarks for Large Language Models

Chunyuan Deng, Yilun Zhao, Xiangru Tang, Mark Gerstein, Arman Cohan

专题命中 预训练与数据 :large language model(title);language model(title);pretraining(abstract);prompting(abstract)

Comments NAACL 2024 Version

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.10908 2024-04-02 cs.LG cs.AI 88%

Unlocking Emergent Modularity in Large Language Models

Zihan Qiu, Zeyu Huang, Jie Fu

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.AI、cs.LG

Comments NAACL2024 Main Conference

Journal ref 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.19056 2024-03-29 cs.IR cs.AI cs.CL 88%

MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion

Pengyue Jia, Yiding Liu, Xiangyu Zhao, Xiaopeng Li, Changying Hao, Shuaiqiang Wang, Dawei Yin

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments Accepted to NAACL 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.07645 2024-03-27 cs.CL cs.AI 88%

Othering and low status framing of immigrant cuisines in US restaurant reviews and large language models

Yiwei Luo, Kristina Gligorić, Dan Jurafsky

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments ICWSM '24

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.16540 2024-03-08 cs.CL cs.LG stat.ML 88%

Unsupervised Pretraining for Fact Verification by Language Model Distillation

Adrián Bazaga, Pietro Liò, Gos Micklem

专题命中 预训练与数据 :language model(title,abstract);pretraining(title,abstract);分类 cs.CL、cs.LG

Comments ICLR 2024 Camera Ready

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.06354 2024-03-06 cs.CL cs.AI 88%

Large Language Models to Identify Social Determinants of Health in Electronic Health Records

Marco Guevara, Shan Chen, Spencer Thomas, Tafadzwa L. Chaunzwa, Idalid Franco, Benjamin Kann, Shalini Moningi, Jack Qian, Madeleine Goldstein, Susan Harper, Hugo JWL Aerts, Guergana K. Savova, Raymond H. Mak, Danielle S. Bitterman

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments Peer-reviewed version published at NPJ Digital Medicine: https://www.nature.com/articles/s41746-023-00970-0

Journal ref NPJ Digit Med. 2024 Jan 11;7(1):6

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.15090 2024-02-22 cs.CL cs.AI 88%

STAR: Boosting Low-Resource Information Extraction by Structure-to-Text Data Generation with Large Language Models

Mingyu Derek Ma, Xiaoxuan Wang, Po-Nien Kung, P. Jeffrey Brantingham, Nanyun Peng, Wei Wang

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments To appear at AAAI'24. More info is at https://derek.ma/STAR

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.08577 2024-02-14 cs.CL cs.CR cs.CV cs.LG cs.MM 88%

Test-Time Backdoor Attacks on Multimodal Large Language Models

Dong Lu, Tianyu Pang, Chao Du, Qian Liu, Xianjun Yang, Min Lin

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.11363 2024-02-09 cs.CL cs.LG 88%

AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model

Yongyu Yan, Kui Xue, Xiaoming Shi, Qi Ye, Jingping Liu, Tong Ruan

专题命中 预训练与数据 :language model(title,abstract);pretraining(title,abstract);分类 cs.CL、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.16182 2024-01-30 cs.CL cs.AI 88%

LLaMandement: Large Language Models for Summarization of French Legislative Proposals

Joseph Gesnouin, Yannis Tannier, Christophe Gomes Da Silva, Hatim Tapory, Camille Brier, Hugo Simon, Raphael Rozenberg, Hermann Woehrel, Mehdi El Yakaabi, Thomas Binder, Guillaume Marie, Emilie Caron, Mathile Nogueira, Thomas Fontas, Laure Puydebois, Marie Theophile, Stephane Morandi, Mael Petit, David Creissac, Pauline Ennouchy, Elise Valetoux, Celine Visade, Severine Balloux, Emmanuel Cortes, Pierre-Etienne Devineau, Ulrich Tan, Esther Mac Namara, Su Yang

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI

Comments 21 pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.14196 2024-01-29 cs.SE cs.CL cs.LG 88%

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Y. Wu, Y. K. Li, Fuli Luo, Yingfei Xiong, Wenfeng Liang

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.12246 2024-01-24 cs.CL cs.LG 88%

Orion-14B: Open-source Multilingual Large Language Models

Du Chen, Yi Huang, Xiaopu Li, Yongqiang Li, Yongqiang Liu, Haihui Pan, Leichao Xu, Dacheng Zhang, Zhipeng Zhang, Kun Han

专题命中 预训练与数据 :large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.LG

Comments Authors are alphabetically listed by last names, except the corresponding author who is listed last

详情

展开后加载摘要…

URL PDF HTML 收藏