语言大模型 / LLM - arXivDaily 专题

2306.02254 2023-06-07 cs.CL 79%

A Technical Report for Polyglot-Ko: Open-Source Large-Scale Korean Language Models

Hyunwoong Ko, Kichang Yang, Minho Ryu, Taekyoon Choi, Seungmu Yang, Jiwung Hyun, Sungho Park, Kyubyong Park

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2306.02579 2023-06-06 cs.CL cs.SD eess.AS 79%

Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model

Hoyeon Lee, Hyun-Wook Yoon, Jong-Hwan Kim, Jae-Min Kim

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted by INTERSPEECH 2023

2211.07733 2023-06-02 cs.CL 79%

Speaking Multiple Languages Affects the Moral Bias of Language Models

Katharina Hämmerl, Björn Deiseroth, Patrick Schramowski, Jindřich Libovický, Constantin A. Rothkopf, Alexander Fraser, Kristian Kersting

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments To appear in ACL Findings 2023

2305.12676 2023-05-30 cs.CL 79%

Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition

Hong Liu, Zhaobiao Lv, Zhijian Ou, Wenbo Zhao, Qing Xiao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted into INTERSPEECH 2023

2305.17440 2023-05-30 cs.CL 79%

Modeling Adversarial Attack on Pre-trained Language Models as Sequential Decision Making

Xuanjie Fang, Sijie Cheng, Yang Liu, Wei Wang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2305.17304 2023-05-30 cs.CL 79%

External Language Model Integration for Factorized Neural Transducers

Michael Levit, Sarangarajan Parthasarathy, Cem Aksoylar, Mohammad Sadegh Rasooli, Shuangyu Chang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2301.09152 2023-05-30 cs.LG 79%

Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data

Shengchao Chen, Guodong Long, Tao Shen, Jing Jiang

专题命中其他LLM ：foundation model(title,abstract)；分类 cs.LG

Comments Accepted by IJCAI'23 (32nd International Joint Conference on Artificial Intelligence)

2305.15743 2023-05-26 cs.AI 79%

TransWorldNG: Traffic Simulation via Foundation Model

Ding Wang, Xuhong Wang, Liang Chen, Shengyue Yao, Ming Jing, Honghai Li, Li Li, Shiqiang Bao, Fei-Yue Wang, Yilun Lin

专题命中其他LLM ：foundation model(title,abstract)；分类 cs.AI

2305.15501 2023-05-26 cs.CL 79%

Deriving Language Models from Masked Language Models

Lucas Torroba Hennigen, Yoon Kim

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2023

2004.05067 2023-05-26 cs.CL 79%

Overestimation of Syntactic Representationin Neural Language Models

Jordan Kodner, Nitish Gupta

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted for publication at ACL 2020

Journal ref https://aclanthology.org/2020.acl-main.160

2305.14936 2023-05-25 cs.CL 79%

Trade-Offs Between Fairness and Privacy in Language Modeling

Cleo Matzken, Steffen Eger, Ivan Habernal

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Findings of ACL 2023

2301.12652 2023-05-25 cs.CL 79%

REPLUG: Retrieval-Augmented Black-Box Language Models

Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Rich James, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2212.10559 2023-05-16 cs.CL 79%

Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers

Damai Dai, Yutao Sun, Li Dong, Yaru Hao, Shuming Ma, Zhifang Sui, Furu Wei

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL 2023 findings

2305.07839 2023-05-16 cs.CL 79%

The Geometry of Multilingual Language Models: An Equality Lens

Cheril Shah, Yashashree Chandak, Manan Suri

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 8 pages, 6 figues, 1st ICLR TinyPapers

2305.06615 2023-05-12 cs.CL 79%

Autocorrelations Decay in Texts and Applicability Limits of Language Models

Nikolay Mikhaylovskiy, Ilya Churilov

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to Dialog-2023

2305.03530 2023-05-12 cs.SD cs.LG eess.AS 79%

Exploring Softly Masked Language Modelling for Controllable Symbolic Music Generation

Nicolas Jonason, Bob L. T. Sturm

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments Version 1.1

2303.01911 2023-05-10 cs.CL 79%

Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM

Rachel Bawden, François Yvon

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at EAMT 2023

2303.05313 2023-05-09 cs.CV cs.CL 79%

Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training

Lisai Zhang, Qingcai Chen, Zhijian Chen, Yunpeng Han, Zhonghua Li, Zhao Cao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Work in progress, v0.2

2305.01624 2023-05-08 cs.CL 79%

UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models

Deming Ye, Yankai Lin, Zhengyan Zhang, Maosong Sun

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 8 pages

2304.13597 2023-04-27 cs.CL 79%

Shades of meaning: Uncovering the geometry of ambiguous word representations through contextualised language models

Benedetta Cevoli, Chris Watkins, Yang Gao, Kathleen Rastle

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2304.05336 2023-04-12 cs.CL 79%

Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages

Gabriela Pałka, Artur Nowakowski

专题命中其他LLM ：foundation model(title,abstract)；分类 cs.CL

Comments Slavic NLP 2023 @ EACL 2023

2303.10893 2023-03-23 cs.CL 79%

Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models

Xinnian Liang, Zefan Zhou, Hui Huang, Shuangzhi Wu, Tong Xiao, Muyun Yang, Zhoujun Li, Chao Bian

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments preprint

2302.12299 2023-02-27 cs.CL 79%

In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages

Asım Ersoy, Gerson Vizcarra, Tasmiah Tahsin Mayeesha, Benjamin Muller

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 17 pages

2302.04761 2023-02-10 cs.CL 79%

Toolformer: Language Models Can Teach Themselves to Use Tools

Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, Thomas Scialom

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2302.02453 2023-02-07 cs.CL cs.CY 79%

FineDeb: A Debiasing Framework for Language Models

Akash Saravanan, Dhruv Mullick, Habibur Rahman, Nidhi Hegde

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Poster presentation at AAAI 2023: The Workshop on Artificial Intelligence for Social Good 2023 (https://amulyayadav.github.io/AI4SG2023/)

2212.12131 2022-12-26 cs.CL 79%

Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?

Byung-Doh Oh, William Schuler

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Transactions of the Association for Computational Linguistics (pre-MIT Press publication version)

2212.10536 2022-12-21 cs.CL 79%

Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion

Yuling Gu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2212.03979 2022-12-09 cs.LG q-bio.GN 79%

Unsupervised language models for disease variant prediction

Allan Zhou, Nicholas C. Landolfi, Daniel C. O'Neill

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments Machine Learning for Structural Biology Workshop, NeurIPS 2022

2212.02216 2022-12-06 cs.CL 79%

Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Feng Nie, Meixi Chen, Zhirui Zhang, Xu Cheng

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Work in progress

2211.14639 2022-11-29 cs.CL 79%

Gender Biases Unexpectedly Fluctuate in the Pre-training Stage of Masked Language Models

Kenan Tang, Hanchun Jiang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

1. 其他LLM 12193 篇

A Technical Report for Polyglot-Ko: Open-Source Large-Scale Korean Language Models

Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model

Speaking Multiple Languages Affects the Moral Bias of Language Models

Exploring Energy-based Language Models with Different Architectures and Training Methods for Speech Recognition

Modeling Adversarial Attack on Pre-trained Language Models as Sequential Decision Making

External Language Model Integration for Factorized Neural Transducers

Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data

TransWorldNG: Traffic Simulation via Foundation Model

Deriving Language Models from Masked Language Models

Overestimation of Syntactic Representationin Neural Language Models

Trade-Offs Between Fairness and Privacy in Language Modeling

REPLUG: Retrieval-Augmented Black-Box Language Models

Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers

The Geometry of Multilingual Language Models: An Equality Lens

Autocorrelations Decay in Texts and Applicability Limits of Language Models

Exploring Softly Masked Language Modelling for Controllable Symbolic Music Generation

Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM

Refined Vision-Language Modeling for Fine-grained Multi-modal Pre-training

UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models

Shades of meaning: Uncovering the geometry of ambiguous word representations through contextualised language models

Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages

Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models

In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages

Toolformer: Language Models Can Teach Themselves to Use Tools

FineDeb: A Debiasing Framework for Language Models

Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?

Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion

Unsupervised language models for disease variant prediction

Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Gender Biases Unexpectedly Fluctuate in the Pre-training Stage of Masked Language Models