语言大模型 / LLM

Masked Audio Text Encoders are Effective Multi-Modal Rescorers

Jinglun Cai, Monica Sunkara, Xilai Li, Anshu Bhatia, Xiao Pan, Sravan Bodapati

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering

Avi Caciularu, Matthew E. Peters, Jacob Goldberger, Ido Dagan, Arman Cohan

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at ACL 2023; camera-ready version

Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling

Linhan Zhang, Qian Chen, Wen Wang, Yuxin Jiang, Bing Li, Wei Wang, Xin Cao

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.AI

Adversarial Nibbler: A Data-Centric Challenge for Improving the Safety of Text-to-Image Models

Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Max Bartolo, Oana Inel, Juan Ciro, Rafael Mosquera, Addison Howard, Will Cukierski, D. Sculley, Vijay Janapa Reddi, Lora Aroyo

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Leaving Reality to Imagination: Robust Classification via Generated Datasets

Hritik Bansal, Aditya Grover

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments 22 pages, 12 Figures, 9 Tables. Results for ImageNet-C, and finetuned generative model are included now

Accessing Higher Dimensions for Unsupervised Word Translation

Sida I. Wang

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.LG

Emotion Recognition based on Psychological Components in Guided Narratives for Emotion Regulation

Gustave Cortal, Alain Finkel, Patrick Paroubek, Lina Ye

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Journal ref Association for Computational Linguistics, May 2023, Dubrovnik, Croatia. pp.72-81

Towards Unifying Multi-Lingual and Cross-Lingual Summarization

Jiaan Wang, Fandong Meng, Duo Zheng, Yunlong Liang, Zhixu Li, Jianfeng Qu, Jie Zhou

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at ACL 2023 as a long paper of the main conference

Extracting Cultural Commonsense Knowledge at Scale

Tuan-Phong Nguyen, Simon Razniewski, Aparna Varde, Gerhard Weikum

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 6 figures, 10 tables

Journal ref ACM Web Conference 2023

Knowledge-Guided Data-Centric AI in Healthcare: Progress, Shortcomings, and Future Directions

Edward Y. Chang

专题命中 预训练与数据 ：language model(abstract)；分类 cs.AI、cs.LG

Comments 21 pages, 13 figures, 4 tables. arXiv admin note: text overlap with arXiv:1707.09873

GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters

Md Mahfuz Ibn Alam, Ruoyu Xie, Fahim Faisal, Antonios Anastasopoulos

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

Comments Accepted at SemEval Workshop at ACL 2023

Video Pre-trained Transformer: A Multimodal Mixture of Pre-trained Experts

Kastan Day, Daniel Christl, Rohan Salvi, Pranav Sriram

专题命中 预训练与数据 ：language model(abstract)；分类 cs.AI、cs.LG

EC^2: Emergent Communication for Embodied Control

Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo, Chuang Gan

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

Comments Published in CVPR2023

A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning

Aishwarya Kamath, Peter Anderson, Su Wang, Jing Yu Koh, Alexander Ku, Austin Waters, Yinfei Yang, Jason Baldridge, Zarana Parekh

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.LG

Comments CVPR 2023

With Shared Microexponents, A Little Shifting Goes a Long Way

Bita Rouhani, Ritchie Zhao, Venmugil Elango, Rasoul Shafipour, Mathew Hall, Maral Mesmakhosroshahi, Ankit More, Levi Melnick, Maximilian Golub, Girish Varatkar, Lei Shao, Gaurav Kolhe, Dimitry Melts, Jasmine Klar, Renee L'Heureux, Matt Perry, Doug Burger, Eric Chung, Zhaoxia Deng, Sam Naghshineh, Jongsoo Park, Maxim Naumov

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Incorporating Structured Sentences with Time-enhanced BERT for Fully-inductive Temporal Relation Prediction

Zhongwu Chen, Chengjin Xu, Fenglong Su, Zhen Huang, Yong Dou

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

A Closer Look at Rehearsal-Free Continual Learning

James Seale Smith, Junjiao Tian, Shaunak Halbe, Yen-Chang Hsu, Zsolt Kira

专题命中 预训练与数据 ：prompting(abstract)；分类 cs.AI、cs.LG

Comments Accepted by the 2023 IEEE/CVF Conference on Computer Vision and Pattern (CVPR) Workshop on Continual Learning in Computer Vision (CLVision 2023)

Carolina: a General Corpus of Contemporary Brazilian Portuguese with Provenance, Typology and Versioning Information

Maria Clara Ramos Morales Crespo, Maria Lina de Souza Jeannine Rocha, Mariana Lourenço Sturzeneker, Felipe Ribas Serras, Guilherme Lamartine de Mello, Aline Silva Costa, Mayara Feliciano Palma, Renata Morais Mesquita, Raquel de Paula Guets, Mariana Marques da Silva, Marcelo Finger, Maria Clara Paixão de Sousa, Cristiane Namiuti, Vanessa Martins do Monte

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 3 figures, 1 appendix

Pre-training Transformers for Knowledge Graph Completion

Sanxing Chen, Hao Cheng, Xiaodong Liu, Jian Jiao, Yangfeng Ji, Jianfeng Gao

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

SPEC: Summary Preference Decomposition for Low-Resource Abstractive Summarization

Yi-Syuan Chen, Yun-Zhu Song, Hong-Han Shuai

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP) 2022; Published Version

Bangla Grammatical Error Detection Using T5 Transformer Model

H. A. Z. Sameen Shahgir, Khondker Salman Sayeed

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

Knowledge Transfer for Pseudo-code Generation from Low Resource Programming Language

Ankita Sontakke, Kanika Kalra, Manasi Patwardhan, Lovekesh Vig, Raveendra Kumar Medicherla, Ravindra Naik, Shrishti Pradhan

专题命中 预训练与数据 ：language model(abstract)；分类 cs.AI、cs.LG

Comments 11 pages, 1 figure, 5 tables

Label prompt for multi-label text classification

Rui Song, Xingbing Chen, Zelong Liu, Haining An, Zhiqi Zhang, Xiaoguang Wang, Hao Xu

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

A Multi-Grained Self-Interpretable Symbolic-Neural Model For Single/Multi-Labeled Text Classification

Xiang Hu, Xinyu Kong, Kewei Tu

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

Comments ICLR 2023

Hierarchical discriminative learning improves visual representations of biomedical microscopy

Cheng Jiang, Xinhai Hou, Akhil Kondepudi, Asadur Chowdury, Christian W. Freudiger, Daniel A. Orringer, Honglak Lee, Todd C. Hollon

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments CVPR 2023. Project page: https://hidisc.mlins.org

The ROOTS Search Tool: Data Transparency for LLMs

Aleksandra Piktus, Christopher Akiki, Paulo Villegas, Hugo Laurençon, Gérard Dupont, Alexandra Sasha Luccioni, Yacine Jernite, Anna Rogers

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling

Rui Wang, Pengyu Cheng, Ricardo Henao

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.AI

GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks

Zemin Liu, Xingtong Yu, Yuan Fang, Xinming Zhang

专题命中 预训练与数据 ：prompting(abstract)；分类 cs.CL、cs.LG

Comments WWW23 research track

A Reinforcement Learning Framework for Online Speaker Diarization

Baihan Lin, Xinxin Zhang

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Learning Language Representations with Logical Inductive Bias

Jianshu Chen

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.LG

Comments Published as a conference paper at ICLR 2023