语言大模型 / LLM - arXivDaily 专题

2412.08846 2024-12-13 cs.CL cs.AI 88%

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology

Minsang Kim, Seungjun Baek

机构 * Korea University（高丽大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2401.15861 2024-12-11 cs.CL cs.AI 88%

BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining

Wen Liang, Youzhi Liang

机构 * Google Research（谷歌研究院）； Stanford University（斯坦福大学）

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI

2411.12240 2024-11-27 cs.CL cs.AI 88%

Evaluating Tokenizer Performance of Large Language Models Across Official Indian Languages

S. Tamang, D. J. Bora

机构 * The Assam Kaziranga University（阿萨姆卡齐兰加大学）

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2403.11793 2024-11-26 cs.CL cs.AI cs.ET cs.SC 88%

Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus

Seungpil Lee, Woochang Sim, Donghyeon Shin, Wongyu Seo, Jiwon Park, Seokki Lee, Sanha Hwang, Sejin Kim, Sundong Kim

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2411.06402 2024-11-12 cs.CL cs.AI 88%

Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models

Sultan Alrashed, Dmitrii Khizbullin, David R. Pugh

专题命中预训练与数据：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.CL、cs.AI

2406.16148 2024-11-08 cs.SD cs.AI cs.LG eess.AS 88%

Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking

Yuwei Zhang, Tong Xia, Jing Han, Yu Wu, Georgios Rizos, Yang Liu, Mohammed Mosuily, Jagmohan Chauhan, Cecilia Mascolo

专题命中预训练与数据：foundation model(title,abstract)；pretraining(title,abstract)；分类 cs.AI、cs.LG

Comments accepted by NeurIPS 2024 Track Datasets and Benchmarks

2411.03340 2024-11-07 cs.CV cs.CL cs.DL cs.LG 88%

Unlocking the Archives: Using Large Language Models to Transcribe Handwritten Historical Documents

Mark Humphries, Lianne C. Leddy, Quinn Downton, Meredith Legace, John McConnell, Isabella Murray, Elizabeth Spence

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 29 Pages, 11 Tables, 2 Figures

2410.20340 2024-10-29 cs.CL cs.AI 88%

Maintaining Informative Coherence: Migrating Hallucinations in Large Language Models via Absorbing Markov Chains

Jiemin Wu, Songning Lai, Ruiqiang Xiao, Tianlang Xue, Jiayu Yang, Yutao Yue

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2410.13298 2024-10-18 cs.CL cs.AI 88%

Advancing Large Language Model Attribution through Self-Improving

Lei Huang, Xiaocheng Feng, Weitao Ma, Liang Zhao, Yuchun Fan, Weihong Zhong, Dongliang Xu, Qing Yang, Hongtao Liu, Bing Qin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024 Main Conference

2410.05661 2024-10-10 cs.LG cs.AI 88%

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models

Siqi Wang, Zhengyu Chen, Bei Li, Keqing He, Min Zhang, Jingang Wang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

2410.03568 2024-10-07 cs.CL cs.LG 88%

Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)

Abrar Rahman, Garry Bowlin, Binit Mohanty, Sean McGunigal

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2301.02458 2024-08-27 cs.CL cs.LG 88%

Topics as Entity Clusters: Entity-based Topics from Large Language Models and Graph Neural Networks

Manuel V. Loureiro, Steven Derby, Tri Kurniawan Wijaya

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 16 pages, 1 figure. Accepted in LREC-COLING 2024

Journal ref https://aclanthology.org/2024.lrec-main.1418/

2402.10892 2024-08-20 cs.CR cs.CL cs.LG 88%

Proving membership in LLM pretraining data via data watermarks

Johnny Tian-Zheng Wei, Ryan Yixiang Wang, Robin Jia

专题命中预训练与数据：LLM(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.LG

Comments Findings of ACL 2024

2311.07032 2024-08-13 cs.CL cs.AI 88%

ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook

Wangtao Sun, Xuanqing Yu, Shizhu He, Jun Zhao, Kang Liu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2023 findings

2408.03119 2024-08-07 cs.CL cs.AI 88%

Evaluating the Translation Performance of Large Language Models Based on Euas-20

Yan Huang, Wei Liu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 8 figures

2407.12813 2024-07-23 cs.CL cs.AI 88%

Data Generation Using Large Language Models for Text Classification: An Empirical Case Study

Yinheng Li, Rogerio Bonatti, Sara Abdali, Justin Wagle, Kazuhito Koishida

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by DMLR @ ICML 2024

2407.12141 2024-07-18 cs.CL cs.AI 88%

Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language

Hubert Plisiecki, Piotr Koc, Maria Flakus, Artur Pokropek

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments The Appendix is located at the very bottom of the manuscript

2407.07551 2024-07-11 cs.CL cs.AI 88%

Arabic Automatic Story Generation with Large Language Models

Ahmed Oumar El-Shangiti, Fakhraddin Alwajih, Muhammad Abdul-Mageed

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2401.07237 2024-07-03 cs.CL cs.AI 88%

Distilling Event Sequence Knowledge From Large Language Models

Somin Wadhwa, Oktie Hassanzadeh, Debarun Bhattacharjya, Ken Barker, Jian Ni

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments In Proceedings of 23rd International Semantic Web Conference (ISWC), 2024

2406.19853 2024-07-01 cs.CL cs.AI 88%

YuLan: An Open-source Large Language Model

Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun, Zhipeng Chen, Qian Cao, Yihan Wu, Yushuo Chen, Feng Wang, Lei Zhang, Junyi Li, Xiaolei Wang, Lei Wang, Beichen Zhang, Zican Dong, Xiaoxue Cheng, Yuhan Chen, Xinyu Tang, Yupeng Hou, Qiangqiang Ren, Xincheng Pang, Shufang Xie, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ze-Feng Gao, Yueguo Chen, Weizheng Lu, Ji-Rong Wen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2306.12656 2024-06-28 cs.CL cs.AI 88%

Identifying and Extracting Rare Disease Phenotypes with Large Language Models

Cathy Shyr, Yan Hu, Paul A. Harris, Hua Xu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Journal ref J Healthc Inform Res 8, 438-461 (2024)

2406.15996 2024-06-25 cs.CL cs.AI 88%

Memorizing Documents with Guidance in Large Language Models

Bumjin Park, Jaesik Choi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments IJCAI 2024

2406.06455 2024-06-17 cs.AI cs.CL 88%

A Large Language Model Pipeline for Breast Cancer Oncology

Tristen Pool, Dennis Trujillo

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

2406.06962 2024-06-12 cs.CL cs.AI 88%

Evolving Subnetwork Training for Large Language Models

Hanqi Li, Lu Chen, Da Ma, Zijian Wu, Su Zhu, Kai Yu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to ICML 2024

2403.11103 2024-06-11 cs.CL cs.LG 88%

ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models

Yuzhao Heng, Chunyuan Deng, Yitong Li, Yue Yu, Yinghao Li, Rongzhi Zhang, Chao Zhang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2024 Findings

2406.01457 2024-06-05 cs.LG cs.CL cs.CR 88%

Differentially Private Tabular Data Synthesis using Large Language Models

Toan V. Tran, Li Xiong

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

2405.21068 2024-06-03 cs.CL cs.AI 88%

Code Pretraining Improves Entity Tracking Abilities of Language Models

Najoung Kim, Sebastian Schuster, Shubham Toshniwal

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL、cs.AI

2405.14057 2024-05-24 cs.CL cs.AI 88%

Your Large Language Models Are Leaving Fingerprints

Hope McGovern, Rickard Stureborg, Yoshi Suhara, Dimitris Alikaniotis

专题命中预训练与数据：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL、cs.AI

2405.06239 2024-05-13 cs.CL cs.AI 88%

SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corpora

Faisal Qarah

专题命中预训练与数据：language model(title,abstract)；large language model(title)；pretraining(abstract)；分类 cs.CL、cs.AI

2404.18534 2024-05-13 cs.CL cs.AI cs.CR cs.SE 88%

Evaluating and Mitigating Linguistic Discrimination in Large Language Models

Guoliang Dong, Haoyu Wang, Jun Sun, Xinyu Wang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

1. 预训练与数据 12486 篇

Exploring Large Language Models on Cross-Cultural Values in Connection with Training Methodology

BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining

Evaluating Tokenizer Performance of Large Language Models Across Official Indian Languages

Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus

Fineweb-Edu-Ar: Machine-translated Corpus to Support Arabic Small Language Models

Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking

Unlocking the Archives: Using Large Language Models to Transcribe Handwritten Historical Documents

Maintaining Informative Coherence: Migrating Hallucinations in Large Language Models via Absorbing Markov Chains

Advancing Large Language Model Attribution through Self-Improving

Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models

Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)

Topics as Entity Clusters: Entity-based Topics from Large Language Models and Graph Neural Networks

Proving membership in LLM pretraining data via data watermarks

ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook

Evaluating the Translation Performance of Large Language Models Based on Euas-20

Data Generation Using Large Language Models for Text Classification: An Empirical Case Study

Predicting Emotion Intensity in Polish Political Texts: Comparing Supervised Models and Large Language Models in a Resource-Poor Language

Arabic Automatic Story Generation with Large Language Models

Distilling Event Sequence Knowledge From Large Language Models

YuLan: An Open-source Large Language Model

Identifying and Extracting Rare Disease Phenotypes with Large Language Models

Memorizing Documents with Guidance in Large Language Models

A Large Language Model Pipeline for Breast Cancer Oncology

Evolving Subnetwork Training for Large Language Models

ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models

Differentially Private Tabular Data Synthesis using Large Language Models

Code Pretraining Improves Entity Tracking Abilities of Language Models

Your Large Language Models Are Leaving Fingerprints

SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corpora

Evaluating and Mitigating Linguistic Discrimination in Large Language Models