语言大模型 / LLM

On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence

Gengchen Mai, Weiming Huang, Jin Sun, Suhang Song, Deepak Mishra, Ninghao Liu, Song Gao, Tianming Liu, Gao Cong, Yingjie Hu, Chris Cundy, Ziyuan Li, Rui Zhu, Ni Lao

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Masakhane-Afrisenti at SemEval-2023 Task 12: Sentiment Analysis using Afro-centric Language Models and Adapters for Low-resource African Languages

Israel Abebe Azime, Sana Sabah Al-Azzawi, Atnafu Lambebo Tonja, Iyanuoluwa Shode, Jesujoba Alabi, Ayodele Awokoya, Mardiyyah Oduwole, Tosin Adewumi, Samuel Fanijo, Oyinkansola Awosan, Oreen Yousuf

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments SemEval 2023

Policy Adaptation from Foundation Model Feedback

Yuying Ge, Annabella Macaluso, Li Erran Li, Ping Luo, Xiaolong Wang

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by CVPR 2023; Project page: https://geyuying.github.io/PAFF/

Can a Frozen Pretrained Language Model be used for Zero-shot Neural Retrieval on Entity-centric Questions?

Yasuto Hoshi, Daisuke Miyashita, Yasuhiro Morioka, Youyang Ng, Osamu Torii, Jun Deguchi

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to Workshop on Knowledge Augmented Methods for Natural Language Processing, in conjunction with AAAI 2023

Watermarking Pre-trained Language Models with Backdooring

Chenxi Gu, Chengsong Huang, Xiaoqing Zheng, Kai-Wei Chang, Cho-Jui Hsieh

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Should You Mask 15% in Masked Language Modeling?

Alexander Wettig, Tianyu Gao, Zexuan Zhong, Danqi Chen

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to EACL 2023. The code and pre-trained models are available at https://github.com/princeton-nlp/DinkyTrain

Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection

Ben Chen, Bin Chen, Dehong Gao, Qijin Chen, Chengfu Huo, Xiaonan Meng, Weijun Ren, Yang Zhou

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments AAAI 2021 Workshop Best Paper. 9 pages, 1 figures

Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging

Peng Lu, Ivan Kobyzev, Mehdi Rezagholizadeh, Ahmad Rashid, Ali Ghodsi, Philippe Langlais

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published at EMNLP 2022 (Findings)

Localized Latent Updates for Fine-Tuning Vision-Language Models

Moritz Ibing, Isaak Lim, Leif Kobbelt

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language Models

Lifu Tu, Caiming Xiong, Yingbo Zhou

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2022. Code link is added

Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis

Kai Zhang, Kun Zhang, Mengdi Zhang, Hongke Zhao, Qi Liu, Wei Wu, Enhong Chen

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 12 pages, 5 figures

PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models

Yuan Yao, Qianyu Chen, Ao Zhang, Wei Ji, Zhiyuan Liu, Tat-Seng Chua, Maosong Sun

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2022

GRAM: Fast Fine-tuning of Pre-trained Language Models for Content-based Collaborative Filtering

Yoonseok Yang, Kyu Seok Kim, Minsam Kim, Juneyoung Park

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL 2022 Main Conference (Long Paper)

Journal ref https://aclanthology.org/2022.naacl-main.61

Finding Skill Neurons in Pre-trained Transformer-based Language Models

Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, Lei Hou, Zhiyuan Liu, Juanzi Li

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at EMNLP 2022. Camera-ready version

On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting

Tomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc Dymetman

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively

Haojie Zhang, Ge Li, Jia Li, Zhongjin Zhang, Yuqi Zhu, Zhi Jin

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2022

Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition

Zihan Wang, Kewen Zhao, Zilong Wang, Jingbo Shang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Pre-Trained Language Models for Interactive Decision-Making

Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, Jacob Andreas, Igor Mordatch, Antonio Torralba, Yuke Zhu

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models

Zhiyuan Zhang, Lingjuan Lyu, Xingjun Ma, Chenguang Wang, Xu Sun

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by Findings of EMNLP 2022

MALM: Mixing Augmented Language Modeling for Zero-Shot Machine Translation

Kshitij Gupta

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Published in 2nd Workshop on Natural Language Processing for Digital Humanities (NLP4DH 2022) which was organized with AACL 2022

PromptAttack: Prompt-based Attack for Language Models via Gradient Search

Yundi Shi, Piji Li, Changchun Yin, Zhaoyang Han, Lu Zhou, Zhe Liu

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 12 pages

Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondence

Myeongjun Jang, Frank Mtumbuka, Thomas Lukasiewicz

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted in the Findings of NAACL 2022

Training Large-Vocabulary Neural Language Models by Private Federated Learning for Resource-Constrained Devices

Mingbin Xu, Congzheng Song, Ye Tian, Neha Agrawal, Filip Granqvist, Rogier van Dalen, Xiao Zhang, Arturo Argueta, Shiyi Han, Yaqiao Deng, Leo Liu, Anmol Walia, Alex Jin

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Differentially Private Fine-tuning of Language Models

Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICLR 2022. Code available at https://github.com/huseyinatahaninan/Differentially-Private-Fine-tuning-of-Language-Models

Distilling a Pretrained Language Model to a Multilingual ASR Model

Kwanghee Choi, Hyung-Min Park

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to Interspeech 2022. Official implementation provided in https://github.com/juice500ml/xlm_to_xlsr

Prompt Tuning for Discriminative Pre-trained Language Models

Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by Findings of ACL 2022

KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering

Jianing Wang, Chengyu Wang, Minghui Qiu, Qiuhui Shi, Hongbin Wang, Jun Huang, Ming Gao

专题命中 指令微调 ：prompting(title)；language model(abstract)；分类 cs.CL、cs.AI

Multi-task Pre-training Language Model for Semantic Network Completion

Da Li, Sen Yang, Kele Xu, Ming Yi, Yukai He, Huaimin Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Standing on the Shoulders of Giant Frozen Language Models

Yoav Levine, Itay Dalmedigos, Ori Ram, Yoel Zeldes, Daniel Jannai, Dor Muhlgay, Yoni Osin, Opher Lieber, Barak Lenz, Shai Shalev-Shwartz, Amnon Shashua, Kevin Leyton-Brown, Yoav Shoham

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Models

Heting Gao, Junrui Ni, Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments submitted to INTERSPEECH 2022