语言大模型 / LLM - arXivDaily 专题

2210.14698 2022-11-18 cs.CL 79%

Autoregressive Structured Prediction with Language Models

Tianyu Liu, Yuchen Jiang, Nicholas Monath, Ryan Cotterell, Mrinmaya Sachan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022 (findings)

2205.12558 2022-11-09 cs.CL 79%

Gradient-Based Constrained Sampling from Language Models

Sachin Kumar, Biswajit Paria, Yulia Tsvetkov

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2201.11627 2022-11-03 eess.AS cs.AI cs.SD 79%

Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASR

Yufei Liu, Rao Ma, Haihua Xu, Yi He, Zejun Ma, Weibin Zhang

专题命中其他LLM ：language model(title,abstract)；分类 cs.AI

Comments Proceedings of INTERSPEECH

2205.11463 2022-11-02 cs.CL 79%

Context Limitations Make Neural Language Models More Human-Like

Tatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro Inui

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP2022 (main long)

2210.15191 2022-10-28 cs.CL 79%

Truncation Sampling as Language Model Desmoothing

John Hewitt, Christopher D. Manning, Percy Liang

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Findings of EMNLP, + small fixes

2210.13985 2022-10-26 cs.CL cs.CY 79%

This joke is [MASK]: Recognizing Humor and Offense with Prompting

Junze Li, Mengjie Zhao, Yubo Xie, Antonis Maronikolakis, Pearl Pu, Hinrich Schütze

专题命中其他LLM ：prompting(title,abstract)；分类 cs.CL

Comments Transfer Learning for Natural Language Processing Workshop at NeurIPS 2022

2203.15465 2022-10-25 q-bio.BM cs.LG q-bio.QM 79%

Protein language models trained on multiple sequence alignments learn phylogenetic relationships

Umberto Lupo, Damiano Sgarbossa, Anne-Florence Bitbol

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments 29 pages, 10 figures, 7 tables

Journal ref Nat Commun 13, 6298 (2022)

2210.12265 2022-10-25 cs.CL 79%

On the Calibration of Massively Multilingual Language Models

Kabir Ahuja, Sunayana Sitaram, Sandipan Dandapat, Monojit Choudhury

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2022

2202.08827 2022-10-20 cs.LG cs.DC 79%

LAMP: Extracting Text from Gradients with Language Model Priors

Mislav Balunović, Dimitar I. Dimitrov, Nikola Jovanović, Martin Vechev

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

2210.09179 2022-10-18 cs.CL cs.IR 79%

Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time

Kiymet Akdemir, Ali Hürriyetoğlu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at CASE 2022

2205.12035 2022-10-18 cs.CL 79%

RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder

Shitao Xiao, Zheng Liu, Yingxia Shao, Zhao Cao

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2022

2210.07093 2022-10-14 cs.CL 79%

Query Expansion Using Contextual Clue Sampling with Language Models

Linqing Liu, Minghan Li, Jimmy Lin, Sebastian Riedel, Pontus Stenetorp

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2210.05143 2022-10-12 cs.CL cs.SI 79%

Time-aware topic identification in social media with pre-trained language models: A case study of electric vehicles

Byeongki Jeong, Janghyeok Yoon, Jaewoong Choi

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2210.02526 2022-10-07 cs.CL 79%

"No, they did not": Dialogue response dynamics in pre-trained language models

Sanghee J. Kim, Lang Yu, Allyson Ettinger

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments 12 pages, 8 figures, COLING 2022, see https://github.com/sangheek16/dialogue-response-dynamics for codes and material

2209.10875 2022-09-23 cs.CL 79%

Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model

Qiao Cheng, Jin Huang, Yitao Duan

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2022 Main Conference (Long paper). https://coling2022.org/

2202.13558 2022-09-22 cs.CL 79%

CINO: A Chinese Minority Pre-trained Language Model

Ziqing Yang, Zihang Xu, Yiming Cui, Baoxin Wang, Min Lin, Dayong Wu, Zhigang Chen

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2022

2209.00154 2022-09-02 cs.CL 79%

Contextualized language models for semantic change detection: lessons learned

Andrey Kutuzov, Erik Velldal, Lilja Øvrelid

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Journal ref Northern European Journal of Language Technology (NEJLT). ISSN 2000-1533. 8(1)

2208.06946 2022-08-24 cs.AI cs.CR 79%

Targeted Honeyword Generation with Language Models

Fangyi Yu, Miguel Vargas Martin

专题命中其他LLM ：language model(title,abstract)；分类 cs.AI

Comments 8 pages, 7 tables, 2 figures

2206.10112 2022-08-04 cs.CR cs.CL 79%

General Framework for Reversible Data Hiding in Texts Based on Masked Language Modeling

Xiaoyan Zheng, Yurun Fang, Hanzhou Wu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments https://scholar.google.com/citations?user=IdiF7M0AAAAJ&hl=en

Journal ref IEEE International Workshop on Multimedia Signal Processing (2022)

2110.04878 2022-07-27 cs.CL 79%

Automatic Text Extractive Summarization Based on Graph and Pre-trained Language Model Attention

Yuan-Ching Lin, Jinwen Ma

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2108.12944 2022-07-19 cs.CL cs.CR 79%

Selective Differential Privacy for Language Modeling

Weiyan Shi, Aiqi Cui, Evan Li, Ruoxi Jia, Zhou Yu

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments NAACL 2022

2207.07646 2022-07-18 cs.CV cs.LG 79%

Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Models

Rui Qian, Yeqing Li, Zheng Xu, Ming-Hsuan Yang, Serge Belongie, Yin Cui

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

2206.14623 2022-06-30 eess.AS cs.AI 79%

Contextual Density Ratio for Language Model Biasing of Sequence to Sequence ASR Systems

Jesús Andrés-Ferrer, Dario Albesano, Puming Zhan, Paul Vozila

专题命中其他LLM ：language model(title,abstract)；分类 cs.AI

Comments Interspeech 2021 (draft)

Journal ref Interspeech 2021

2206.13517 2022-06-29 cs.LG q-bio.QM 79%

ProGen2: Exploring the Boundaries of Protein Language Models

Erik Nijkamp, Jeffrey Ruffolo, Eli N. Weinstein, Nikhil Naik, Ali Madani

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

2206.11684 2022-06-24 cs.CL 79%

Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models

Yang Trista Cao, Anna Sotnikova, Hal Daumé, Rachel Rudinger, Linda Zou

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

2111.06310 2022-06-20 cs.CL cs.SD eess.AS 79%

Self-Normalized Importance Sampling for Neural Language Modeling

Zijian Yang, Yingbo Gao, Alexander Gerstenberger, Jintao Jiang, Ralf Schlüter, Hermann Ney

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted at INTERSPEECH 2022

2206.04980 2022-06-13 cs.CL 79%

Unsupervised and Few-shot Parsing from Pretrained Language Models

Zhiyuan Zeng, Deyi Xiong

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Published in Artificial Intelligence

Journal ref Artificial Intelligence, Volume 305, April 2022, 103665

1902.10630 2022-06-06 cs.LG cs.NE 79%

Alternating Synthetic and Real Gradients for Neural Language Modeling

Fangxin Shang, Hao Zhang

专题命中其他LLM ：language model(title,abstract)；分类 cs.LG

Comments renew the ideas

2104.08666 2022-05-23 cs.CL 79%

Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models

Tejas Srinivasan, Yonatan Bisk

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

Comments Accepted to 4th Workshop on Gender Bias in Natural Language Processing, NAACL 2022

2205.07634 2022-05-17 cs.CL 79%

A Precis of Language Models are not Models of Language

Csaba Veres

专题命中其他LLM ：language model(title,abstract)；分类 cs.CL

1. 其他LLM 12193 篇

Autoregressive Structured Prediction with Language Models

Gradient-Based Constrained Sampling from Language Models

Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASR

Context Limitations Make Neural Language Models More Human-Like

Truncation Sampling as Language Model Desmoothing

This joke is [MASK]: Recognizing Humor and Offense with Prompting

Protein language models trained on multiple sequence alignments learn phylogenetic relationships

On the Calibration of Massively Multilingual Language Models

LAMP: Extracting Text from Gradients with Language Model Priors

Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time

RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder

Query Expansion Using Contextual Clue Sampling with Language Models

Time-aware topic identification in social media with pre-trained language models: A case study of electric vehicles

"No, they did not": Dialogue response dynamics in pre-trained language models

Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model

CINO: A Chinese Minority Pre-trained Language Model

Contextualized language models for semantic change detection: lessons learned

Targeted Honeyword Generation with Language Models

General Framework for Reversible Data Hiding in Texts Based on Masked Language Modeling

Automatic Text Extractive Summarization Based on Graph and Pre-trained Language Model Attention

Selective Differential Privacy for Language Modeling

Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Models

Contextual Density Ratio for Language Model Biasing of Sequence to Sequence ASR Systems

ProGen2: Exploring the Boundaries of Protein Language Models

Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models

Self-Normalized Importance Sampling for Neural Language Modeling

Unsupervised and Few-shot Parsing from Pretrained Language Models

Alternating Synthetic and Real Gradients for Neural Language Modeling

Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models

A Precis of Language Models are not Models of Language