语言大模型 / LLM - arXivDaily 专题

2402.11725 2024-06-19 cs.CL cs.CR cs.CY 88%

How Susceptible are Large Language Models to Ideological Manipulation?

Kai Chen, Zihao He, Jun Yan, Taiwei Shi, Kristina Lerman

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2406.08718 2024-06-14 cs.CL 88%

Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations

Jun-Woo Kim, Ji-Eun Han, Jun-Seok Koh, Hyeon-Tae Seo, Du-Seong Chang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments IJCAI 2024 AI4Research workshop

2402.00159 2024-06-10 cs.CL 88%

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

Comments Accepted at ACL 2024; Dataset: https://hf.co/datasets/allenai/dolma; Code: https://github.com/allenai/dolma

2406.02100 2024-06-05 cs.CL 88%

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

Haolong Li, Yu Ma, Yinqi Zhang, Chen Ye, Jie Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accept by Findings of ACL 2024

2406.01375 2024-06-04 cs.CL 88%

D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

Haoran Que, Jiaheng Liu, Ge Zhang, Chenchen Zhang, Xingwei Qu, Yinghao Ma, Feiyu Duan, Zhiqi Bai, Jiakai Wang, Yuanxing Zhang, Xu Tan, Jie Fu, Wenbo Su, Jiamang Wang, Lin Qu, Bo Zheng

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.15370 2024-05-27 cs.CL 88%

Large Language Models can Deliver Accurate and Interpretable Time Series Anomaly Detection

Jun Liu, Chaoyun Zhang, Jiaxu Qian, Minghua Ma, Si Qin, Chetan Bansal, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.06640 2024-05-13 cs.CL 88%

Linearizing Large Language Models

Jean Mercat, Igor Vasiljevic, Sedrick Keh, Kushal Arora, Achal Dave, Adrien Gaidon, Thomas Kollar

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2405.06510 2024-05-13 cs.AI 88%

UniDM: A Unified Framework for Data Manipulation with Large Language Models

Yichen Qian, Yongyi He, Rong Zhu, Jintao Huang, Zhijian Ma, Haibin Wang, Yaohua Wang, Xiuyu Sun, Defu Lian, Bolin Ding, Jingren Zhou

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments MLSys24

2404.16461 2024-04-29 cs.CL 88%

Large Language Models Perform on Par with Experts Identifying Mental Health Factors in Adolescent Online Forums

Isabelle Lorge, Dan W. Joyce, Andrey Kormilitzin

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.14772 2024-04-24 cs.CL 88%

Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Models

Chris Samarinas, Pracha Promthaw, Atharva Nijasure, Hansi Zeng, Julian Killingback, Hamed Zamani

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2404.07647 2024-04-12 cs.CL 88%

Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck

Nathan Godey, Éric de la Clergerie, Benoît Sagot

专题命中预训练与数据：language model(title,abstract)；small language model(title)；pretraining(abstract)；分类 cs.CL

2404.05428 2024-04-09 cs.CL 88%

Language Models on a Diet: Cost-Efficient Development of Encoders for Closely-Related Languages via Additional Pretraining

Nikola Ljubešić, Vít Suchomel, Peter Rupnik, Taja Kuzman, Rik van Noord

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

2403.16248 2024-03-27 cs.CL 88%

Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling

Yida Mu, Chun Dong, Kalina Bontcheva, Xingyi Song

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at LREC-COLING 2024

2403.15230 2024-03-25 cs.SE cs.LG 88%

An Exploratory Investigation into Code License Infringements in Large Language Model Training Datasets

Jonathan Katzy, Răzvan-Mihai Popescu, Arie van Deursen, Maliheh Izadi

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Comments Accepted to FORGE 2024

2305.07766 2024-03-25 cs.CL 88%

NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Models

Yongchao Chen, Rujul Gandhi, Yang Zhang, Chuchu Fan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 25 pages, 18 figures

Journal ref Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

2403.12881 2024-03-20 cs.CL 88%

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Zehui Chen, Kuikun Liu, Qiuchen Wang, Wenwei Zhang, Jiangning Liu, Dahua Lin, Kai Chen, Feng Zhao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Technical Report

2403.05065 2024-03-11 cs.CL 88%

Can we obtain significant success in RST discourse parsing by using Large Language Models?

Aru Maekawa, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted in the main conference of EACL 2024

2310.06474 2024-03-05 cs.CL 88%

Multilingual Jailbreak Challenges in Large Language Models

Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, Lidong Bing

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ICLR 2024

2403.00417 2024-03-04 cs.CL 88%

Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models

Jinbiao Yang

专题命中预训练与数据：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL

2402.15202 2024-02-27 cs.CL 88%

Fine-Grained Detoxification via Instance-Level Prefixes for Large Language Models

Xin Yi, Linlin Wang, Xiaoling Wang, Liang He

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2402.10675 2024-02-19 cs.CL 88%

German Text Simplification: Finetuning Large Language Models with Semi-Synthetic Data

Lars Klöser, Mika Beele, Jan-Niklas Schagen, Bodo Kraft

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at Fourth Workshop on Language Technology for Equality, Diversity, Inclusion - EACL 2024

2308.03958 2024-02-16 cs.CL 88%

Simple synthetic data reduces sycophancy in large language models

Jerry Wei, Da Huang, Yifeng Lu, Denny Zhou, Quoc V. Le

专题命中预训练与数据：language model(title,abstract)；large language model(title)；instruction tuning(abstract)；分类 cs.CL

2307.07262 2024-02-06 cs.CL 88%

MorphPiece : A Linguistic Tokenizer for Large Language Models

Haris Jabbar

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Manuscript under review. Patent pending

2401.14680 2024-01-30 cs.CL 88%

MaLLaM -- Malaysia Large Language Model

Husein Zolkepli, Aisyah Razak, Kamarul Adha, Ariff Nazhan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2308.07610 2024-01-29 cs.SE cs.CL 88%

Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies

Yilun Liu, Shimin Tao, Weibin Meng, Jingyu Wang, Wenbing Ma, Yanqing Zhao, Yuhang Chen, Hao Yang, Yanfei Jiang, Xun Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by ICPC 2024

2308.16692 2024-01-24 cs.CL cs.SD eess.AS 88%

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models

Xin Zhang, Dong Zhang, Shimin Li, Yaqian Zhou, Xipeng Qiu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by ICLR 2024. Project page is at https://0nutation.github.io/SpeechTokenizer.github.io/

2308.01497 2024-01-18 cs.CL 88%

Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors

Nicholas Ichien, Dušan Stamenković, Keith J. Holyoak

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2401.07760 2024-01-17 cs.CL 88%

On the importance of Data Scale in Pretraining Arabic Language Models

Abbas Ghaddar, Philippe Langlais, Mehdi Rezagholizadeh, Boxing Chen

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

2312.11658 2024-01-17 cs.CR cs.AI cs.SE 88%

Traces of Memorisation in Large Language Models for Code

Ali Al-Kaswan, Maliheh Izadi, Arie van Deursen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments ICSE 2024 Research Track

2301.13779 2023-12-21 cs.PL cs.AI cs.SE 88%

FLAME: A small language model for spreadsheet formulas

Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radiček, Gust Verbruggen

专题命中预训练与数据：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.AI

Comments Accepted to AAAI 2024

1. 预训练与数据 12486 篇

How Susceptible are Large Language Models to Ideological Manipulation?

Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

Large Language Models can Deliver Accurate and Interpretable Time Series Anomaly Detection

Linearizing Large Language Models

UniDM: A Unified Framework for Data Manipulation with Large Language Models

Large Language Models Perform on Par with Experts Identifying Mental Health Factors in Adolescent Online Forums

Simulating Task-Oriented Dialogues with State Transition Graphs and Large Language Models

Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck

Language Models on a Diet: Cost-Efficient Development of Encoders for Closely-Related Languages via Additional Pretraining

Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling

An Exploratory Investigation into Code License Infringements in Large Language Model Training Datasets

NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Models

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Can we obtain significant success in RST discourse parsing by using Large Language Models?

Multilingual Jailbreak Challenges in Large Language Models

Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models

Fine-Grained Detoxification via Instance-Level Prefixes for Large Language Models

German Text Simplification: Finetuning Large Language Models with Semi-Synthetic Data

Simple synthetic data reduces sycophancy in large language models

MorphPiece : A Linguistic Tokenizer for Large Language Models

MaLLaM -- Malaysia Large Language Model

Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models

Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors

On the importance of Data Scale in Pretraining Arabic Language Models

Traces of Memorisation in Large Language Models for Code

FLAME: A small language model for spreadsheet formulas