语言大模型 / LLM - arXivDaily 专题

2107.03176 2021-07-08 cs.CL cs.LG 62%

On Training Instance Selection for Few-Shot Neural Text Generation

Ernie Chang, Xiaoyu Shen, Hui-Syuan Yeh, Vera Demberg

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at ACL 2021

2106.08126 2021-07-02 eess.AS cs.CL cs.LG cs.SD 62%

Dialectal Speech Recognition and Translation of Swiss German Speech to Standard German Text: Microsoft's Submission to SwissText 2021

Yuriy Arabskyy, Aashish Agarwal, Subhadeep Dey, Oscar Koller

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments to be published in SwissText 2021

2106.14127 2021-06-29 cs.CL cs.AI cs.CV 62%

Visual Conceptual Blending with Large-scale Language and Vision Models

Songwei Ge, Devi Parikh

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

2106.01345 2021-06-25 cs.LG cs.AI 62%

Decision Transformer: Reinforcement Learning via Sequence Modeling

Lili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee, Aditya Grover, Michael Laskin, Pieter Abbeel, Aravind Srinivas, Igor Mordatch

专题命中其他LLM ：language model(abstract)；分类 cs.AI、cs.LG

Comments First two authors contributed equally. Last two authors advised equally

2106.08571 2021-06-17 cs.LG cs.CL 62%

Discrete Auto-regressive Variational Attention Models for Text Modeling

Xianghong Fang, Haoli Bai, Jian Li, Zenglin Xu, Michael Lyu, Irwin King

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments IJCNN 2021

2106.07719 2021-06-16 cs.CL cs.LG 62%

Unbiased Sentence Encoder For Large-Scale Multi-lingual Search Engines

Mahdi Hajiaghayi, Monir Hajiaghayi, Mark Bolin

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2010.12919 2021-06-15 cs.CL cs.AI 62%

Causal Effects of Linguistic Properties

Reid Pryzant, Dallas Card, Dan Jurafsky, Victor Veitch, Dhanya Sridhar

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments To appear at NAACL 2021 (Annual Conference of the North American Chapter of the Association for Computational Linguistics)

2106.04985 2021-06-10 cs.LG cs.CL cs.NE cs.SE 62%

Energy-Based Models for Code Generation under Compilability Constraints

Tomasz Korbak, Hady Elsahar, Marc Dymetman, Germán Kruszewski

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted for the First Workshop on Natural Language Processing for Programming, ACL 2021

2106.03530 2021-06-09 cs.CL cs.AI 62%

CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue System

Etsuko Ishii, Yan Xu, Genta Indra Winata, Zhaojiang Lin, Andrea Madotto, Zihan Liu, Peng Xu, Pascale Fung

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted in DialDoc21 Workshop in ACL 2021. Etsuko Ishii and Yan Xu contributed equally to this work

2106.00958 2021-06-09 cs.LG cs.AI cs.NE stat.ML 62%

A Generalizable Approach to Learning Optimizers

Diogo Almeida, Clemens Winter, Jie Tang, Wojciech Zaremba

专题命中其他LLM ：language model(abstract)；分类 cs.AI、cs.LG

2106.00104 2021-06-02 cs.CL cs.LG 62%

Text Summarization with Latent Queries

Yumo Xu, Mirella Lapata

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 12 pages

2105.13418 2021-05-31 cs.CR cs.CL cs.LG 62%

On Privacy and Confidentiality of Communications in Organizational Graphs

Masoumeh Shafieinejad, Huseyin Inan, Marcello Hasegawa, Robert Sim

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 10 pages

2105.10956 2021-05-25 cs.CL cs.AI 62%

Structural Pre-training for Dialogue Comprehension

Zhuosheng Zhang, Hai Zhao

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL-IJCNLP 2021 main conference

2005.00743 2021-05-25 cs.CL cs.IR cs.LG 62%

Synthesizer: Rethinking Self-Attention in Transformer Models

Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments ICML 2021

2006.03955 2021-05-20 cs.CY cs.AI cs.CL 62%

Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biases

Wei Guo, Aylin Caliskan

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments 19 pages, 2 figures, 4 tables

Journal ref AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society 2021

2012.07580 2021-05-18 cs.CL cs.AI 62%

Modelling General Properties of Nouns by Selectively Averaging Contextualised Embeddings

Na Li, Zied Bouraoui, Jose Camacho Collados, Luis Espinosa-Anke, Qing Gu, Steven Schockaert

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

1909.05023 2021-05-03 quant-ph cs.CL cs.DS cs.LG 62%

A Quantum Search Decoder for Natural Language Processing

Johannes Bausch, Sathyawageeswar Subramanian, Stephen Piddock

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 39 pages, 16 figures, 2 algorithms

Journal ref Quantum Mach. Intell. 3, 16 (2021)

2104.10441 2021-04-22 cs.CL cs.LG 62%

Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?

Tim Isbister, Fredrik Carlsson, Magnus Sahlgren

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2104.06045 2021-04-14 cs.CL cs.LG 62%

Structural analysis of an all-purpose question answering model

Vincent Micheli, Quentin Heinrich, François Fleuret, Wacim Belblidia

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2012.05983 2021-04-14 cs.CL cs.AI 62%

Towards Neural Programming Interfaces

Zachary C. Brown, Nathaniel Robinson, David Wingate, Nancy Fulda

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments 24 pages total (13 for main paper and references, 11 for Appendix 1), accepted for publication in Advances in Neural Information Processing Systems 33 (NeurIPS 2020)

Journal ref Neural Information Processing Systems 33 (2020) 17416-17428

2103.15963 2021-04-01 cs.CL cs.AI 62%

Contextual Text Embeddings for Twi

Paul Azunre, Salomey Osei, Salomey Addo, Lawrence Asamoah Adu-Gyamfi, Stephen Moore, Bernard Adabankah, Bernard Opoku, Clara Asare-Nyarko, Samuel Nyarko, Cynthia Amoaba, Esther Dansoa Appiah, Felix Akwerh, Richard Nii Lante Lawson, Joel Budu, Emmanuel Debrah, Nana Boateng, Wisdom Ofori, Edwin Buabeng-Munkoh, Franklin Adjei, Isaac Kojo Essel Ampomah, Joseph Otoo, Reindorf Borkor, Standylove Birago Mensah, Lucien Mensah, Mark Amoako Marcel, Anokye Acheampong Amponsah, James Ben Hayfron-Acquah

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments 10 pages paper; Accepted at African NLP Workshop @ EACL 2021

2103.16102 2021-03-31 cs.CL cs.LG 62%

XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning

Yuxin Jiang, Ziyi Shou, Qijun Wang, Hao Wu, Fangzhen Lin

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 6 pages, 5 figures, SemEval-2021 Workshop, ACL-IJCNLP 2021

2103.13606 2021-03-26 cs.CL cs.AI 62%

Predicting Directionality in Causal Relations in Text

Pedram Hosseini, David A. Broniatowski, Mona Diab

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

2005.07456 2021-03-25 cs.CL cs.LG 62%

Cross-lingual Transfer of Sentiment Classifiers

Marko Robnik-Sikonja, Kristjan Reba, Igor Mozetic

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 18 pages, 8 tables

2103.09857 2021-03-19 cs.LG cs.CL 62%

Value-aware Approximate Attention

Ankit Gupta, Jonathan Berant

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

1907.10885 2021-03-18 cs.CL cs.LG 62%

Adaptive Noise Injection: A Structure-Expanding Regularization for RNN

Rui Li, Kai Shuang, Mengyu Gu, Sen Su

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Recently, we find the theory "extending model can play the role of regularization"doesn't hold on other NLP tasks' datasets. Now, we are looking for a new theory to explain the effectiveness of ANI.We don't have an alternative version yet, so we choose to withdraw it

2103.05327 2021-03-12 cs.CL cs.LG 62%

BERTese: Learning to Speak to BERT

Adi Haviv, Jonathan Berant, Amir Globerson

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted to EACL 2021

2103.05683 2021-03-11 cs.CL cs.LG cs.NE 62%

Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification

Amey Hengle, Atharva Kshirsagar, Shaily Desai, Manisha Marathe

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

Comments 7 pages, 1 figure, The Sixth Arabic Natural Language Processing Workshop. (WANLP 2021), held in conjunction with EACL 2021

2010.11731 2021-03-02 cs.CL cs.LG 62%

Improving BERT Performance for Aspect-Based Sentiment Analysis

Akbar Karimi, Leonardo Rossi, Andrea Prati

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.LG

2102.12671 2021-02-26 cs.CL cs.AI 62%

LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching

Boer Lyu, Lu Chen, Su Zhu, Kai Yu

专题命中其他LLM ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by AAAI 2021; 9 pages, 5 figures

1. 其他LLM 12321 篇

On Training Instance Selection for Few-Shot Neural Text Generation

Dialectal Speech Recognition and Translation of Swiss German Speech to Standard German Text: Microsoft's Submission to SwissText 2021

Visual Conceptual Blending with Large-scale Language and Vision Models

Decision Transformer: Reinforcement Learning via Sequence Modeling

Discrete Auto-regressive Variational Attention Models for Text Modeling

Unbiased Sentence Encoder For Large-Scale Multi-lingual Search Engines

Causal Effects of Linguistic Properties

Energy-Based Models for Code Generation under Compilability Constraints

CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue System

A Generalizable Approach to Learning Optimizers

Text Summarization with Latent Queries

On Privacy and Confidentiality of Communications in Organizational Graphs

Structural Pre-training for Dialogue Comprehension

Synthesizer: Rethinking Self-Attention in Transformer Models

Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biases

Modelling General Properties of Nouns by Selectively Averaging Contextualised Embeddings

A Quantum Search Decoder for Natural Language Processing

Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?

Structural analysis of an all-purpose question answering model

Towards Neural Programming Interfaces

Contextual Text Embeddings for Twi

XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning

Predicting Directionality in Causal Relations in Text

Cross-lingual Transfer of Sentiment Classifiers

Value-aware Approximate Attention

Adaptive Noise Injection: A Structure-Expanding Regularization for RNN

BERTese: Learning to Speak to BERT

Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification

Improving BERT Performance for Aspect-Based Sentiment Analysis

LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching