语言大模型 / LLM - arXivDaily 专题

2305.07766 2024-03-25 cs.CL 88%

NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Models

Yongchao Chen, Rujul Gandhi, Yang Zhang, Chuchu Fan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 25 pages, 18 figures

Journal ref Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

2403.12881 2024-03-20 cs.CL 88%

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Zehui Chen, Kuikun Liu, Qiuchen Wang, Wenwei Zhang, Jiangning Liu, Dahua Lin, Kai Chen, Feng Zhao

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Technical Report

2403.05065 2024-03-11 cs.CL 88%

Can we obtain significant success in RST discourse parsing by using Large Language Models?

Aru Maekawa, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted in the main conference of EACL 2024

2310.06474 2024-03-05 cs.CL 88%

Multilingual Jailbreak Challenges in Large Language Models

Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, Lidong Bing

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ICLR 2024

2403.00417 2024-03-04 cs.CL 88%

Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models

Jinbiao Yang

专题命中预训练与数据：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL

2402.15202 2024-02-27 cs.CL 88%

Fine-Grained Detoxification via Instance-Level Prefixes for Large Language Models

Xin Yi, Linlin Wang, Xiaoling Wang, Liang He

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2402.10675 2024-02-19 cs.CL 88%

German Text Simplification: Finetuning Large Language Models with Semi-Synthetic Data

Lars Klöser, Mika Beele, Jan-Niklas Schagen, Bodo Kraft

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted at Fourth Workshop on Language Technology for Equality, Diversity, Inclusion - EACL 2024

2308.03958 2024-02-16 cs.CL 88%

Simple synthetic data reduces sycophancy in large language models

Jerry Wei, Da Huang, Yifeng Lu, Denny Zhou, Quoc V. Le

专题命中预训练与数据：language model(title,abstract)；large language model(title)；instruction tuning(abstract)；分类 cs.CL

2307.07262 2024-02-06 cs.CL 88%

MorphPiece : A Linguistic Tokenizer for Large Language Models

Haris Jabbar

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Manuscript under review. Patent pending

2401.14680 2024-01-30 cs.CL 88%

MaLLaM -- Malaysia Large Language Model

Husein Zolkepli, Aisyah Razak, Kamarul Adha, Ariff Nazhan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2308.07610 2024-01-29 cs.SE cs.CL 88%

Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies

Yilun Liu, Shimin Tao, Weibin Meng, Jingyu Wang, Wenbing Ma, Yanqing Zhao, Yuhang Chen, Hao Yang, Yanfei Jiang, Xun Chen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by ICPC 2024

2308.16692 2024-01-24 cs.CL cs.SD eess.AS 88%

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models

Xin Zhang, Dong Zhang, Shimin Li, Yaqian Zhou, Xipeng Qiu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by ICLR 2024. Project page is at https://0nutation.github.io/SpeechTokenizer.github.io/

2308.01497 2024-01-18 cs.CL 88%

Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors

Nicholas Ichien, Dušan Stamenković, Keith J. Holyoak

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2401.07760 2024-01-17 cs.CL 88%

On the importance of Data Scale in Pretraining Arabic Language Models

Abbas Ghaddar, Philippe Langlais, Mehdi Rezagholizadeh, Boxing Chen

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

2312.11658 2024-01-17 cs.CR cs.AI cs.SE 88%

Traces of Memorisation in Large Language Models for Code

Ali Al-Kaswan, Maliheh Izadi, Arie van Deursen

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Comments ICSE 2024 Research Track

2301.13779 2023-12-21 cs.PL cs.AI cs.SE 88%

FLAME: A small language model for spreadsheet formulas

Harshit Joshi, Abishai Ebenezer, José Cambronero, Sumit Gulwani, Aditya Kanade, Vu Le, Ivan Radiček, Gust Verbruggen

专题命中预训练与数据：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.AI

Comments Accepted to AAAI 2024

2311.06377 2023-11-14 cs.CL 88%

Heaps' Law in GPT-Neo Large Language Model Emulated Corpora

Uyen Lai, Gurjit S. Randhawa, Paul Sheridan

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 4 pages, 1 figure, 1 table, EVIA 2023

2308.15727 2023-11-07 cs.CL 88%

Quantifying and Analyzing Entity-level Memorization in Large Language Models

Zhenhong Zhou, Jiuyang Xiang, Chaomeng Chen, Sen Su

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 9 pages, 7 figures

2310.04027 2023-11-07 cs.CL q-fin.ST q-fin.TR 88%

Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models

Boyu Zhang, Hongyang Yang, Tianyu Zhou, Ali Babar, Xiao-Yang Liu

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments ACM International Conference on AI in Finance (ICAIF) 2023

2310.13673 2023-11-01 cs.CL 88%

StereoMap: Quantifying the Awareness of Human-like Stereotypes in Large Language Models

Sullam Jeoung, Yubin Ge, Jana Diesner

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023

2310.19998 2023-11-01 cs.CL cond-mat.dis-nn cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph 88%

Generative retrieval-augmented ontologic graph and multi-agent strategies for interpretive large language model-based materials design

Markus J. Buehler

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2310.16261 2023-10-26 cs.CL 88%

The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining

Ting-Rui Chiang, Dani Yogatama

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.CL

Comments EMNLP 2023

2310.12874 2023-10-24 cs.CL 88%

StoryAnalogy: Deriving Story-level Analogies from Large Language Models to Unlock Analogical Understanding

Cheng Jiayang, Lin Qiu, Tsz Ho Chan, Tianqing Fang, Weiqi Wang, Chunkit Chan, Dongyu Ru, Qipeng Guo, Hongming Zhang, Yangqiu Song, Yue Zhang, Zheng Zhang

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023 main conference

2310.13705 2023-10-24 cs.HC cs.AI 88%

Large language models in textual analysis for gesture selection

Laura B. Hensel, Nutchanon Yongsatianchot, Parisa Torshizi, Elena Minucci, Stacy Marsella

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI

Journal ref 25th ACM International Conference on Multimodal Interaction. ICMI. 2023. 1-10

2310.10808 2023-10-18 cs.IR cs.AI 88%

If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in History

Giselle Gonzalez Garcia, Christian Weilbach

专题命中预训练与数据：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.AI

Comments Will be published at CHR2023

2308.04948 2023-10-10 cs.CL 88%

Extrapolating Large Language Models to Non-English by Aligning Languages

Wenhao Zhu, Yunzhe Lv, Qingxiu Dong, Fei Yuan, Jingjing Xu, Shujian Huang, Lingpeng Kong, Jiajun Chen, Lei Li

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

2305.10321 2023-09-20 cs.CL cs.SD eess.AS 88%

Controllable Speaking Styles Using a Large Language Model

Atli Thor Sigurgeirsson, Simon King

专题命中预训练与数据：language model(title,abstract)；large language model(title)；LLM(abstract)；分类 cs.CL

Comments Submitted to ICASSP 2024

2309.09390 2023-09-19 cs.CL cs.SD eess.AS 88%

Augmenting text for spoken language understanding with Large Language Models

Roshan Sharma, Suyoun Kim, Daniel Lazar, Trang Le, Akshat Shrivastava, Kwanghoon Ahn, Piyush Kansal, Leda Sari, Ozlem Kalinli, Michael Seltzer

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Submitted to ICASSP 2024

2309.04516 2023-09-12 eess.AS cs.LG cs.SD 88%

End-to-End Speech Recognition and Disfluency Removal with Acoustic Language Model Pretraining

Saksham Bassi, Giulio Duregon, Siddhartha Jalagam, David Roth

专题命中预训练与数据：language model(title,abstract)；pretraining(title,abstract)；分类 cs.LG

2309.00642 2023-09-06 cs.CL 88%

Extracting Mathematical Concepts with Large Language Models

Valeria de Paiva, Qiyue Gao, Pavel Kovalev, Lawrence S. Moss

专题命中预训练与数据：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments 13 pages, 4 figures, presented to the 14th MathUI Workshop 2023

1. 预训练与数据 12429 篇

NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Models

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Can we obtain significant success in RST discourse parsing by using Large Language Models?

Multilingual Jailbreak Challenges in Large Language Models

Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models

Fine-Grained Detoxification via Instance-Level Prefixes for Large Language Models

German Text Simplification: Finetuning Large Language Models with Semi-Synthetic Data

Simple synthetic data reduces sycophancy in large language models

MorphPiece : A Linguistic Tokenizer for Large Language Models

MaLLaM -- Malaysia Large Language Model

Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies

SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models

Large Language Model Displays Emergent Ability to Interpret Novel Literary Metaphors

On the importance of Data Scale in Pretraining Arabic Language Models

Traces of Memorisation in Large Language Models for Code

FLAME: A small language model for spreadsheet formulas

Heaps' Law in GPT-Neo Large Language Model Emulated Corpora

Quantifying and Analyzing Entity-level Memorization in Large Language Models

Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models

StereoMap: Quantifying the Awareness of Human-like Stereotypes in Large Language Models

Generative retrieval-augmented ontologic graph and multi-agent strategies for interpretive large language model-based materials design

The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining

StoryAnalogy: Deriving Story-level Analogies from Large Language Models to Unlock Analogical Understanding

Large language models in textual analysis for gesture selection

If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in History

Extrapolating Large Language Models to Non-English by Aligning Languages

Controllable Speaking Styles Using a Large Language Model

Augmenting text for spoken language understanding with Large Language Models

End-to-End Speech Recognition and Disfluency Removal with Acoustic Language Model Pretraining

Extracting Mathematical Concepts with Large Language Models