语言大模型 / LLM

PreConfig: A Pretrained Model for Automating Network Configuration

Fuliang Li, Haozhi Lang, Jiajie Zhang, Jiaxing Shen, Xingwei Wang

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)

Mechanics of Next Token Prediction with Self-Attention

Yingcong Li, Yixiao Huang, M. Emrullah Ildiz, Ankit Singh Rawat, Samet Oymak

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to AISTATS 2024

BLO-SAM: Bi-level Optimization Based Overfitting-Preventing Finetuning of SAM

Li Zhang, Youwei Liang, Ruiyi Zhang, Amirhosein Javadi, Pengtao Xie

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)

JVNV: A Corpus of Japanese Emotional Speech with Verbal Content and Nonverbal Expressions

Detai Xin, Junfeng Jiang, Shinnosuke Takamichi, Yuki Saito, Akiko Aizawa, Hiroshi Saruwatari

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Measuring Impacts of Poisoning on Model Parameters and Neuron Activations: A Case Study of Poisoning CodeBERT

Aftab Hussain, Md Rafiqul Islam Rabin, Navid Ayoobi, Mohammad Amin Alipour

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Scaling Laws for Associative Memories

Vivien Cabannes, Elvis Dohmatob, Alberto Bietti

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Scaling Laws Behind Code Understanding Model

Jiayi Lin, Hande Dong, Yutao Xie, Lei Zhang

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Parallel Structures in Pre-training Data Yield In-Context Learning

Yanda Chen, Chen Zhao, Zhou Yu, Kathleen McKeown, He He

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Transformers Can Achieve Length Generalization But Not Robustly

Yongchao Zhou, Uri Alon, Xinyun Chen, Xuezhi Wang, Rishabh Agarwal, Denny Zhou

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Multi-Label Zero-Shot Product Attribute-Value Extraction

Jiaying Gong, Hoda Eldardiry

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Comments 12 pages, 4 figures, WWW2024

PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs

Michael Dorkenwald, Nimrod Barazani, Cees G. M. Snoek, Yuki M. Asano

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Computer says 'no': Exploring systemic bias in ChatGPT using an audit approach

Louis Lippens

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Comments 39 pages, 2 tables, 4 figures; for data and supplementary tables, see https://osf.io/vezt7

Natural Language Supervision for General-Purpose Audio Representations

Benjamin Elizalde, Soham Deshmukh, Huaming Wang

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Quan Sun, Jinsheng Wang, Qiying Yu, Yufeng Cui, Fan Zhang, Xiaosong Zhang, Xinlong Wang

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)

Improving Automated Code Reviews: Learning from Experience

Hong Yi Lin, Patanamon Thongtanunam, Christoph Treude, Wachiraphan Charoenwet

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Comments Accepted by the 21st International Conference on Mining Software Repositories (MSR 24)

DINOv2: Learning Robust Visual Features without Supervision

Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mahmoud Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jegou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)

BERT in Plutarch's Shadows

Ivan P. Yamshchikov, Alexey Tikhonov, Yorgos Pantis, Charlotte Schubert, Jürgen Jost

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

What Makes Good In-context Demonstrations for Code Intelligence Tasks with LLMs?

Shuzheng Gao, Xin-Cheng Wen, Cuiyun Gao, Wenxuan Wang, Hongyu Zhang, Michael R. Lyu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Comments This paper is accepted by ASE 2023

COMMA: Co-Articulated Multi-Modal Learning

Lianyu Hu, Liqing Gao, Zekang Liu, Chi-Man Pun, Wei Feng

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)

Comments Accepted to AAAI2024. Code is available at https://github.com/hulianyuyy/COMMA

Image Captioning with Multi-Context Synthetic Data

Feipeng Ma, Yizhou Zhou, Fengyun Rao, Yueyi Zhang, Xiaoyan Sun

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

Comments Accepted by AAAI 2024

Improving Biomedical Entity Linking with Retrieval-enhanced Learning

Zhenxi Lin, Ziheng Zhang, Xian Wu, Yefeng Zheng

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ICASSP 2024

VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation

Jinguo Zhu, Xiaohan Ding, Yixiao Ge, Yuying Ge, Sijie Zhao, Hengshuang Zhao, Xiaohua Wang, Ying Shan

专题命中 预训练与数据 ：language model(abstract)；instruction tuning(abstract)

Exploring Transferability for Randomized Smoothing

Kai Qiu, Huishuai Zhang, Zhirong Wu, Stephen Lin

专题命中 预训练与数据 ：foundation model(abstract)；pretraining(abstract)

Cross-modal Contrastive Learning with Asymmetric Co-attention Network for Video Moment Retrieval

Love Panta, Prashant Shrestha, Brabeem Sapkota, Amrita Bhattarai, Suresh Manandhar, Anand Kumar Sah

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

GELDA: A generative language annotation framework to reveal visual biases in datasets

Krish Kabra, Kathleen M. Lewis, Guha Balakrishnan

专题命中 预训练与数据 ：LLM(abstract)；language model(abstract)

Comments 21 pages, 15 figures, 9 tables

Unlocking Spatial Comprehension in Text-to-Image Diffusion Models

Mohammad Mahdi Derakhshani, Menglin Xia, Harkirat Behl, Cees G. M. Snoek, Victor Rühle

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)

ANPL: Towards Natural Programming with Interactive Decomposition

Di Huang, Ziyuan Nan, Xing Hu, Pengwei Jin, Shaohui Peng, Yuanbo Wen, Rui Zhang, Zidong Du, Qi Guo, Yewen Pu, Yunji Chen

专题命中 预训练与数据 ：LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Mug-STAN: Adapting Image-Language Pretrained Models for General Video Understanding

Ruyang Liu, Jingjia Huang, Wei Gao, Thomas H. Li, Ge Li

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)

Learning Deductive Reasoning from Synthetic Corpus based on Formal Logic

Terufumi Morishita, Gaku Morio, Atsuki Yamaguchi, Yasuhiro Sogawa

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Journal ref Proceedings of the 40th International Conference on Machine Learning, PMLR 202:25254-25274, 2023

Watermarking Vision-Language Pre-trained Models for Multi-modal Embedding as a Service

Yuanmin Tang, Jing Yu, Keke Gai, Xiangyan Qu, Yue Hu, Gang Xiong, Qi Wu

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)