语言大模型 / LLM

Constructing Concept-based Models to Mitigate Spurious Correlations with Minimal Human Effort

Jeeyung Kim, Ze Wang, Qiang Qiu

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.LG

Uni-ELF: A Multi-Level Representation Learning Framework for Electrolyte Formulation Design

Boshen Zeng, Sian Chen, Xinxin Liu, Changhong Chen, Bin Deng, Xiaoxu Wang, Zhifeng Gao, Yuzhi Zhang, Weinan E, Linfeng Zhang

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI

Concept Bottleneck Models Without Predefined Concepts

Simon Schrodi, Julian Schur, Max Argus, Thomas Brox

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Universal Knowledge Graph Embeddings

N'Dah Jean Kouagou, Caglar Demir, Hamada M. Zahera, Adrian Wilke, Stefan Heindorf, Jiayi Li, Axel-Cyrille Ngonga Ngomo

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.AI

Comments 5 pages, 3 tables

Journal ref Companion Proceedings of the ACM Web Conference 2024 (WWW '24 Companion), May 13--17, 2024, Singapore, Singapore

Boosting Biomedical Concept Extraction by Rule-Based Data Augmentation

Qiwei Shao, Fengran Mo, Jian-Yun Nie

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Language Anisotropic Cross-Lingual Model Editing

Yang Xu, Yutai Hou, Wanxiang Che, Min Zhang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

FoRAG: Factuality-optimized Retrieval Augmented Generation for Web-enhanced Long-form Question Answering

Tianchi Cai, Zhiwen Tan, Xierui Song, Tao Sun, Jiyan Jiang, Yunqi Xu, Yinger Zhang, Jinjie Gu

专题命中 知识编辑与模型理解 ：RLHF(abstract)；分类 cs.CL

Journal ref KDD 2024

VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation

Yixiao Song, Yekyung Kim, Mohit Iyyer

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Coarse-to-Fine Concept Bottleneck Models

Konstantinos P. Panousis, Dino Ienco, Diego Marcos

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning

Dongyang Li, Taolin Zhang, Longtao Huang, Chengyu Wang, Xiaofeng He, Hui Xue

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

XNLP: An Interactive Demonstration System for Universal Structured NLP

Hao Fei, Meishan Zhang, Min Zhang, Tat-Seng Chua

专题命中 知识编辑与模型理解 ：LLM(abstract)；分类 cs.CL

Comments ACL 2024 Demonstration Paper

Evaluating representation learning on the protein structure universe

Arian R. Jamasb, Alex Morehead, Chaitanya K. Joshi, Zuobai Zhang, Kieran Didi, Simon V. Mathis, Charles Harris, Jian Tang, Jianlin Cheng, Pietro Lio, Tom L. Blundell

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Comments ICLR 2024

Measuring and Mitigating Biases in Motor Insurance Pricing

Mulah Moriah, Franck Vermet, Arthur Charpentier

专题命中 知识编辑与模型理解 ：prompting(abstract)；分类 cs.LG

Conceptual Learning via Embedding Approximations for Reinforcing Interpretability and Transparency

Maor Dikter, Tsachi Blau, Chaim Baskin

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Do Llamas Work in English? On the Latent Language of Multilingual Transformers

Chris Wendler, Veniamin Veselovsky, Giovanni Monea, Robert West

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments 12 pages. 28 with appendix

Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?

Yu-Lin Tsai, Chia-Yi Hsu, Chulin Xie, Chih-Hsun Lin, Jia-You Chen, Bo Li, Pin-Yu Chen, Chia-Mu Yu, Chun-Ying Huang

专题命中 知识编辑与模型理解 ：prompting(abstract)；分类 cs.LG

Comments This paper has already been accepted by ICLR 2024. This version is the camera-ready version

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks

Liam Collins, Hamed Hassani, Mahdi Soltanolkotabi, Aryan Mokhtari, Sanjay Shakkottai

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval

Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, Yongping Xiong

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted to ACL 2024 main conference

MACT: Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsing

Jiangming Liu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted by LREC-COLING 2024

LetsMap: Unsupervised Representation Learning for Semantic BEV Mapping

Nikhil Gosala, Kürsat Petek, B Ravi Kiran, Senthil Yogamani, Paulo Drews-Jr, Wolfram Burgard, Abhinav Valada

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI

Comments 23 pages, 5 figures

Experts Don't Cheat: Learning What You Don't Know By Predicting Pairs

Daniel D. Johnson, Daniel Tarlow, David Duvenaud, Chris J. Maddison

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Comments Accepted at ICML 2024. 9 pages, 6 figures

Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection

Shaoxiong Ji, Ya Gao, Pekka Marttinen

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments LREC-COLING 2024

How does GPT-2 Predict Acronyms? Extracting and Understanding a Circuit via Mechanistic Interpretability

Jorge García-Carrasco, Alejandro Maté, Juan Trujillo

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Journal ref Jorge García-Carrasco, Alejandro Maté, Juan Carlos Trujillo Proceedings of The 27th International Conference on Artificial Intelligence and Statistics, PMLR 238:3322-3330, 2024

Language-Enhanced Latent Representations for Out-of-Distribution Detection in Autonomous Driving

Zhenjiang Mao, Dong-You Jhong, Ao Wang, Ivan Ruchkin

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.LG

Comments Presented at the Robot Trust for Symbiotic Societies (RTSS) Workshop, co-located with ICRA 2024

PromptCL: Improving Event Representation via Prompt Template and Contrastive Learning

Yubo Feng, Lishuang Li, Yi Xiang, Xueyang Qin

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments NLPCC 2023 Best Student Paper

Journal ref Natural Language Processing and Chinese Computing (NLPCC 2023)

Lost in Recursion: Mining Rich Event Semantics in Knowledge Graphs

Florian Plötzky, Niklas Kiehne, Wolf-Tilo Balke

专题命中 知识编辑与模型理解 ：prompting(abstract)；分类 cs.CL

Comments Accepted at WebSci'24, 11 pages, 4 figures

Neural Language of Thought Models

Yi-Fu Wu, Minseung Lee, Sungjin Ahn

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Comments Accepted in ICLR 2024

ExpPoint-MAE: Better interpretability and performance for self-supervised point cloud transformers

Ioannis Romanelis, Vlassis Fotis, Konstantinos Moustakas, Adrian Munteanu

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

VI-OOD: A Unified Representation Learning Framework for Textual Out-of-distribution Detection

Li-Ming Zhan, Bo Liu, Xiao-Ming Wu

专题命中 知识编辑与模型理解 ：LLM(abstract)；分类 cs.CL

Comments COLING 2024

Encoding of lexical tone in self-supervised models of spoken language

Gaofei Shen, Michaela Watkins, Afra Alishahi, Arianna Bisazza, Grzegorz Chrupała

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted to NAACL 2024