语言大模型 / LLM - arXivDaily 专题

2210.13002 2022-10-25 cs.CL 70%

An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks

Changlong Yu, Tianyi Xiao, Lingpeng Kong, Yangqiu Song, Wilfred Ng

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments EMNLP 2022 Main Conference

2210.10358 2022-10-25 cs.CL 70%

Leveraging a New Spanish Corpus for Multilingual and Crosslingual Metaphor Detection

Elisa Sanchez-Bayona, Rodrigo Agerri

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments To be published in CoNLL 2022

2210.12079 2022-10-24 cs.CL cs.CV 70%

Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?

Mitja Nikolaus, Emmanuelle Salin, Stephane Ayache, Abdellah Fourtassi, Benoit Favre

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments To appear at EMNLP 2022

2210.11885 2022-10-24 cs.CL cs.SD eess.AS 70%

Deep LSTM Spoken Term Detection using Wav2Vec 2.0 Recognizer

Jan Švec, Jan Lehečka, Luboš Šmídl

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Journal ref Švec, J., Lehečka, J., Šmídl, L. (2022) Deep LSTM Spoken Term Detection using Wav2Vec 2.0 Recognizer. Proc. Interspeech 2022, 1886-1890

2209.00133 2022-09-02 cs.CL 70%

The Fellowship of the Authors: Disambiguating Names from Social Network Context

Ryan Muther, David Smith

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

2206.10883 2022-07-25 cs.CL cs.CY 70%

Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities

Zejiang Shen, Kyle Lo, Lauren Yu, Nathan Dahlberg, Margo Schlanger, Doug Downey

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 37 pages, 2 figures, 9 tables

2207.01940 2022-07-19 cs.CL 70%

MIA 2022 Shared Task Submission: Leveraging Entity Representations, Dense-Sparse Hybrids, and Fusion-in-Decoder for Cross-Lingual Question Answering

Zhucheng Tu, Sarguna Janani Padmanabhan

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments System description for the Multilingual Information Access 2022 Shared Task

2206.10789 2022-06-23 cs.CV cs.LG 70%

Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments Preprint

2206.09253 2022-06-22 cs.CL 70%

Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods

Valeriya Goloviznina, Evgeny Kotelnikov

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted by Dialogue-2022 conference

2206.06888 2022-06-15 cs.SE cs.CL cs.PL 70%

CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generation

Daoguang Zan, Bei Chen, Dejian Yang, Zeqi Lin, Minsu Kim, Bei Guan, Yongji Wang, Weizhu Chen, Jian-Guang Lou

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Accepted for publication at IJCAI-ECAI 2022

2206.05229 2022-06-13 cs.LG 70%

Measuring the Carbon Intensity of AI in Cloud Instances

Jesse Dodge, Taylor Prewitt, Remi Tachet Des Combes, Erika Odmark, Roy Schwartz, Emma Strubell, Alexandra Sasha Luccioni, Noah A. Smith, Nicole DeCario, Will Buchanan

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.LG

Comments In ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT) 2022

2110.04627 2022-06-07 cs.CV cs.LG 70%

Vector-quantized Image Modeling with Improved VQGAN

Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, Yonghui Wu

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.LG

Comments Accepted in ICLR 2022

2202.03052 2022-06-02 cs.CV cs.CL 70%

OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

Peng Wang, An Yang, Rui Men, Junyang Lin, Shuai Bai, Zhikang Li, Jianxin Ma, Chang Zhou, Jingren Zhou, Hongxia Yang

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted at ICML2022

2205.15661 2022-06-01 cs.CL 70%

NEWTS: A Corpus for News Topic-Focused Summarization

Seyed Ali Bahrainian, Sheridan Feucht, Carsten Eickhoff

专题命中预训练与数据：language model(abstract)；prompting(abstract)；分类 cs.CL

2205.14981 2022-05-31 cs.CL 70%

ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System

Chia-Chien Hung, Tommaso Green, Robert Litschko, Tornike Tsereteli, Sotaro Takeshita, Marco Bombieri, Goran Glavaš, Simone Paolo Ponzetto

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

2205.09295 2022-05-23 cs.CL 70%

Are Prompt-based Models Clueless?

Pride Kavumba, Ryo Takahashi, Yusuke Oda

专题命中预训练与数据：language model(abstract)；prompting(abstract)；分类 cs.CL

2205.03026 2022-05-20 cs.CL 70%

Hearing voices at the National Library -- a speech corpus and acoustic model for the Swedish language

Martin Malmsten, Chris Haffenden, Love Börjeson

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

2204.07955 2022-04-22 cs.CV cs.CL cs.MM 70%

Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis

Yan Ling, Jianfei Yu, Rui Xia

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted by ACL 2022 (long paper)

2204.04748 2022-04-12 cs.CL 70%

Breaking Character: Are Subwords Good Enough for MRLs After All?

Omri Keren, Tal Avinari, Reut Tsarfaty, Omer Levy

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

2203.09101 2022-03-18 cs.CL 70%

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

Yew Ken Chia, Lidong Bing, Soujanya Poria, Luo Si

专题命中预训练与数据：language model(abstract)；prompting(abstract)；分类 cs.CL

Comments 13 pages, 9 figures, to appear in ACL Findings 2022

2203.00902 2022-03-03 cs.CL 70%

Do Prompts Solve NLP Tasks Using Natural Language?

Sen Yang, Yunchen Zhang, Leyang Cui, Yue Zhang

专题命中预训练与数据：language model(abstract)；prompting(abstract)；分类 cs.CL

2110.15836 2022-02-14 cs.CL cs.SD eess.AS 70%

Combining Unsupervised and Text Augmented Semi-Supervised Learning for Low Resourced Autoregressive Speech Recognition

Chak-Fai Li, Francis Keith, William Hartmann, Matthew Snover

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments 5 pages, minor changes for camera ready version, to be published in IEEE ICASSP 2022

2201.06642 2022-01-19 cs.CL 70%

Towards a Cleaner Document-Oriented Multilingual Crawled Corpus

Julien Abadji, Pedro Ortiz Suarez, Laurent Romary, Benoît Sagot

专题命中预训练与数据：large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 12 pages, 6 figures, 2 tables

2012.05395 2021-12-17 cs.CL 70%

Infusing Finetuning with Semantic Dependencies

Zhaofeng Wu, Hao Peng, Noah A. Smith

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments TACL 2021

2112.01742 2021-12-06 cs.CL 70%

Multitask Finetuning for Improving Neural Machine Translation in Indian Languages

Shaily Desai, Atharva Kshirsagar, Manisha Marathe

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

2112.00599 2021-12-02 cs.CV cs.LG 70%

An implementation of the "Guess who?" game using CLIP

Arnau Martí Sarri, Victor Rodriguez-Fernandez

专题命中预训练与数据：pretraining(abstract)；prompting(abstract)；分类 cs.LG

Comments Code available at https://github.com/ArnauDIMAI/CLIP-GuessWho

Journal ref Intelligent Data Engineering and Automated Learning (IDEAL 2021). Lecture Notes in Computer Science, vol 13113

2111.15622 2021-12-01 cs.CL 70%

Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches

Virginia Adams, Hoo-Chang Shin, Carol Anderson, Bo Liu, Anas Abidin

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Submission to the BioCreative VII challenge - Track-2

2003.09166 2021-12-01 cs.CL 70%

TNT-KID: Transformer-based Neural Tagger for Keyword Identification

Matej Martinc, Blaž Škrlj, Senja Pollak

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to Natural Language Engineering journal

Journal ref Martinc, M., Škrlj, B., & Pollak, S. (2021). TNT-KID: Transformer-based neural tagger for keyword identification. Natural Language Engineering, 1-40. doi:10.1017/S1351324921000127

2012.15421 2021-10-19 cs.CL 70%

Verb Knowledge Injection for Multilingual Event Processing

Olga Majewska, Ivan Vulić, Goran Glavaš, Edoardo M. Ponti, Anna Korhonen

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments 19 pages, 1 figure, 8 tables

Journal ref Proceedings of ACL-IJCNLP 2021 Volume 1 Long Papers 6952-6969

2105.05991 2021-10-14 cs.SE cs.LG 70%

Improving Code Autocompletion with Transfer Learning

Wen Zhou, Seohyun Kim, Vijayaraghavan Murali, Gareth Ari Aye

专题命中预训练与数据：language model(abstract)；pretraining(abstract)；分类 cs.LG

1. 预训练与数据 12486 篇

An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks

Leveraging a New Spanish Corpus for Multilingual and Crosslingual Metaphor Detection

Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?

Deep LSTM Spoken Term Detection using Wav2Vec 2.0 Recognizer

The Fellowship of the Authors: Disambiguating Names from Social Network Context

Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities

MIA 2022 Shared Task Submission: Leveraging Entity Representations, Dense-Sparse Hybrids, and Fusion-in-Decoder for Cross-Lingual Question Answering

Scaling Autoregressive Models for Content-Rich Text-to-Image Generation

Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods

CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generation

Measuring the Carbon Intensity of AI in Cloud Instances

Vector-quantized Image Modeling with Improved VQGAN

OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

NEWTS: A Corpus for News Topic-Focused Summarization

ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System

Are Prompt-based Models Clueless?

Hearing voices at the National Library -- a speech corpus and acoustic model for the Swedish language

Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis

Breaking Character: Are Subwords Good Enough for MRLs After All?

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

Do Prompts Solve NLP Tasks Using Natural Language?

Combining Unsupervised and Text Augmented Semi-Supervised Learning for Low Resourced Autoregressive Speech Recognition

Towards a Cleaner Document-Oriented Multilingual Crawled Corpus

Infusing Finetuning with Semantic Dependencies

Multitask Finetuning for Improving Neural Machine Translation in Indian Languages

An implementation of the "Guess who?" game using CLIP

Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches

TNT-KID: Transformer-based Neural Tagger for Keyword Identification

Verb Knowledge Injection for Multilingual Event Processing

Improving Code Autocompletion with Transfer Learning