语言大模型 / LLM

Aligning Language Models with Offline Learning from Human Feedback

Jian Hu, Li Tao, June Yang, Chandler Zhou

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

SymNoise: Advancing Language Model Fine-tuning with Symmetric Noise

Abhay Kumar Yadav, Arjun Singh

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

RoAST: Robustifying Language Models via Adversarial Perturbation with Selective Training

Jaehyung Kim, Yuning Mao, Rui Hou, Hanchao Yu, Davis Liang, Pascale Fung, Qifan Wang, Fuli Feng, Lifu Huang, Madian Khabsa

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 33 pages, accepted at EMNLP 2023 Findings

Continual Instruction Tuning for Large Multimodal Models

Jinghan He, Haiyun Guo, Ming Tang, Jinqiao Wang

专题命中 指令微调 ：instruction tuning(title,abstract)；分类 cs.AI、cs.LG

Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models

Shuo Chen, Jindong Gu, Zhen Han, Yunpu Ma, Philip Torr, Volker Tresp

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at NeurIPS 2023 Datasets and Benchmarks Track; 9 pages, 5 figures

Source Prompt: Coordinated Pre-training of Language Models on Diverse Corpora from Multiple Sources

Yipei Xu, Dakuan Lu, Jiaqing Liang, Xintao Wang, Yipeng Geng, Yingsi Xin, Hengkui Wu, Ken Chen, ruiji zhang, Yanghua Xiao

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Context-dependent Instruction Tuning for Dialogue Response Generation

Jin Myung Kwak, Minseon Kim, Sung Ju Hwang

专题命中 指令微调 ：instruction tuning(title)；language model(abstract)；分类 cs.CL、cs.AI

Comments Work in Progress

Human Language Modeling

Nikita Soni, Matthew Matero, Niranjan Balasubramanian, H. Andrew Schwartz

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

LLMSTEP: LLM proofstep suggestions in Lean

Sean Welleck, Rahul Saha

专题命中 指令微调 ：LLM(title)；language model(abstract)；分类 cs.AI、cs.LG

PAC-tuning:Fine-tuning Pretrained Language Models with PAC-driven Perturbed Gradient Descent

Guangliang Liu, Zhiyu Xue, Xitong Zhang, Kristen Marie Johnson, Rongrong Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to EMNLP23 main

Rethinking the Construction of Effective Metrics for Understanding the Mechanisms of Pretrained Language Models

You Li, Jinhui Yin, Yuming Lin

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by Findings of EMNLP2023

Toward a Foundation Model for Time Series Data

Chin-Chia Michael Yeh, Xin Dai, Huiyuan Chen, Yan Zheng, Yujie Fan, Audrey Der, Vivian Lai, Zhongfang Zhuang, Junpeng Wang, Liang Wang, Wei Zhang

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Benchmarking and Improving Generator-Validator Consistency of Language Models

Xiang Lisa Li, Vaishnavi Shrivastava, Siyan Li, Tatsunori Hashimoto, Percy Liang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments preprint

ProbVLM: Probabilistic Adapter for Frozen Vision-Language Models

Uddeshya Upadhyay, Shyamgopal Karthik, Massimiliano Mancini, Zeynep Akata

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments ICCV 2023

FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning

Haokun Chen, Yao Zhang, Denis Krompass, Jindong Gu, Volker Tresp

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Why Is Prompt Tuning for Vision-Language Models Robust to Noisy Labels?

Cheng-En Wu, Yu Tian, Haichao Yu, Heng Wang, Pedro Morgado, Yu Hen Hu, Linjie Yang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by ICCV2023

BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning

Changdae Oh, Hyeji Hwang, Hee-young Lee, YongTaek Lim, Geunyoung Jung, Jiyoung Jung, Hosik Choi, Kyungwoo Song

专题命中 指令微调 ：prompting(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted to CVPR 2023 (v2: citation error was fixed)

Task-Specific Skill Localization in Fine-tuned Language Models

Abhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev Arora

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted at 40th International Conference on Machine Learning (ICML 2023)

Exploring Vision-Language Models for Imbalanced Learning

Yidong Wang, Zhuohao Yu, Jindong Wang, Qiang Heng, Hao Chen, Wei Ye, Rui Xie, Xing Xie, Shikun Zhang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments IJCV minor revision; 16 pages; code: https://github.com/Imbalance-VLM/Imbalance-VLM

Snowman: A Million-scale Chinese Commonsense Knowledge Graph Distilled from Foundation Model

Jiaan Wang, Jianfeng Qu, Yunlong Liang, Zhixu Li, An Liu, Guanfeng Liu, Xin Zheng

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.CL、cs.AI

Comments tech report

Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models

Guande He, Jianfei Chen, Jun Zhu

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments ICLR 2023

Weighted Sampling for Masked Language Modeling

Linhan Zhang, Qian Chen, Wen Wang, Chong Deng, Xin Cao, Kongzhang Hao, Yuxin Jiang, Wei Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 2 figures

Journal ref 2023 IEEE International Conference on Acoustics, Speech and Signal Processing

Enhancing Chat Language Models by Scaling High-quality Instructional Conversations

Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Zhi Zheng, Shengding Hu, Zhiyuan Liu, Maosong Sun, Bowen Zhou

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection

Rheeya Uppaal, Junjie Hu, Yixuan Li

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2023

KGLM: Integrating Knowledge Graph Structure in Language Models for Link Prediction

Jason Youn, Ilias Tagkopoulos

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Fine-Tuning Language Models via Epistemic Neural Networks

Ian Osband, Seyed Mohammad Asghari, Benjamin Van Roy, Nat McAleese, John Aslanides, Geoffrey Irving

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Language modeling via stochastic processes

Rose E Wang, Esin Durmus, Noah Goodman, Tatsunori Hashimoto

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Correct claims on goal-directed decoding, adds non-goal-directed baselines. ICLR 2022 Oral. Code: https://github.com/rosewang2008/language_modeling_via_stochastic_processes

Using Language Models on Low-end Hardware

Fabian Ziegner, Janos Borst, Andreas Niekler, Martin Potthast

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 5+4 pages, 6 tables; fixed affiliation

FreeLM: Fine-Tuning-Free Language Model

Xiang Li, Xin Jiang, Xuying Meng, Aixin Sun, Yequan Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

AMR Parsing with Instruction Fine-tuned Pre-trained Language Models

Young-Suk Lee, Ramón Fernandez Astudillo, Radu Florian, Tahira Naseem, Salim Roukos

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI