语言大模型 / LLM

Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient

George Wang, Jesse Hoogland, Stan van Wingerden, Zach Furman, Daniel Murfet

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI、cs.LG

Mind the Uncertainty in Human Disagreement: Evaluating Discrepancies between Model Predictions and Human Responses in VQA

Jian Lan, Diego Frassinelli, Barbara Plank

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English

Fiifi Dawson, Zainab Mosunmola, Sahil Pocker, Raj Abhijit Dandekar, Rajat Dandekar, Sreedath Panat

专题命中 知识编辑与模型理解 ：LLM(abstract)；分类 cs.CL、cs.AI

Comments 19 pages, 10 figures, 6 tables

Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsing

Deokhyung Kang, Seonjeong Hwang, Yunsu Kim, Gary Geunbae Lee

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2024

Multi-modal Masked Siamese Network Improves Chest X-Ray Representation Learning

Saeed Shurrab, Alejandro Guerra-Manzanares, Farah E. Shamout

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments Under review

Journal ref Scientific Reports 14 (2024) 22516

Lego: Learning to Disentangle and Invert Personalized Concepts Beyond Object Appearance in Text-to-Image Diffusion Models

Saman Motamed, Danda Pani Paudel, Luc Van Gool

专题命中 知识编辑与模型理解 ：LLM(abstract)；分类 cs.CL、cs.LG

Evaluating Theory of (an uncertain) Mind: Predicting the Uncertain Beliefs of Others in Conversation Forecasting

Anthony Sicilia, Malihe Alikhani

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Incremental and Data-Efficient Concept Formation to Support Masked Word Prediction

Xin Lian, Nishant Baglodi, Christopher J. MacLellan

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by the Eleventh Annual Conference on Advances in Cognitive Systems

Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Loss

Wei He, Marco Idiart, Carolina Scarton, Aline Villavicencio

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Journal ref Findings of the Association for Computational Linguistics. ACL 2024. 12473-12485 (2024)

Probing self-attention in self-supervised speech models for cross-linguistic differences

Sai Gopinath, Joselyn Rodriguez

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.CL、cs.LG

Comments 10 pages, 18 figures

Enhancing Source Code Classification Effectiveness via Prompt Learning Incorporating Knowledge Features

Yong Ma, Senlin Luo, Yu-Ming Shang, Yifei Zhang, Zhengjun Li

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by Scientific Reports

Does CLIP Bind Concepts? Probing Compositionality in Large Image Models

Martha Lewis, Nihal V. Nayak, Peilin Yu, Qinan Yu, Jack Merullo, Stephen H. Bach, Ellie Pavlick

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Comments Lewis and Nayak contributed equally

Journal ref In Findings of the Association for Computational Linguistics, EACL 2024, pages 1487 - 1500, Malta. Association for Computational Linguistics

Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models

Zhiqiu Lin, Samuel Yu, Zhiyi Kuang, Deepak Pathak, Deva Ramanan

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.AI、cs.LG

Comments Published at CVPR 2023. Project site: https://linzhiqiu.github.io/papers/cross_modal/

Evidence-Enhanced Triplet Generation Framework for Hallucination Alleviation in Generative Question Answering

Haowei Du, Huishuai Zhang, Dongyan Zhao

专题命中 知识编辑与模型理解 ：LLM(abstract)；分类 cs.CL、cs.AI

Beneath the Surface of Consistency: Exploring Cross-lingual Knowledge Representation Sharing in LLMs

Maxim Ifergan, Leshem Choshen, Roee Aharoni, Idan Szpektor, Omri Abend

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Rhyme-aware Chinese lyric generator based on GPT

Yixiao Yuan, Yangchen Huang, Yu Ma, Xinjin Li, Zhenglin Li, Yiming Shi, Huapeng Zhou

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Data

Atul Kumar, Siddharth Garg, Soumya Dutta

专题命中 知识编辑与模型理解 ：prompting(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication at IEEE Visualization 2024

Representation Learning with Conditional Information Flow Maximization

Dou Hu, Lingwei Wei, Wei Zhou, Songlin Hu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.LG

Comments 16 pages, accepted to ACL 2024 (main conference), the code is available at https://github.com/zerohd4869/CIFM

Deep Representation Learning for Open Vocabulary Electroencephalography-to-Text Decoding

Hamza Amrani, Daniela Micucci, Paolo Napoletano

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.LG

Comments 12 pages, 5 figures, preprint

Ontology of Belief Diversity: A Community-Based Epistemological Approach

Tyler Fischella, Erin van Liemt, Qiuyi, Zhang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI、cs.LG

Comments AIES 2024

MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learning

Vishal Nedungadi, Ankit Kariryaa, Stefan Oehmcke, Serge Belongie, Christian Igel, Nico Lang

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments Accepted for ECCV 2024. Data and code: https://vishalned.github.io/mmearth Update arXiv v2 (ECCV): 1. Dataset fix: Removed duplicates and corrected ERA5 yearly statistics. 2. Data augmentation fix: Random crops are now aligned. 3. Test metrics fix: Metrics are now overall instead of mini-batch averages, matching GEO-Bench metrics. 4. Pretrained on MMEarth v001 & evaluated on GEO-Bench v1.0

CORN: Contact-based Object Representation for Nonprehensile Manipulation of General Unseen Objects

Yoonyoung Cho, Junhyek Han, Yoontae Cho, Beomjoon Kim

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2024

The Platonic Representation Hypothesis

Minyoung Huh, Brian Cheung, Tongzhou Wang, Phillip Isola

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI、cs.LG

Comments Equal contributions. Project: https://phillipi.github.io/prh/ Code: https://github.com/minyoungg/platonic-rep

HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts

Hao Zhao, Zihan Qiu, Huijia Wu, Zili Wang, Zhaofeng He, Jie Fu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI、cs.LG

Early screening of potential breakthrough technologies with enhanced interpretability: A patent-specific hierarchical attention network model

Jaewoong Choi, Janghyeok Yoon, Changyong Lee

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.AI

Model editing for distribution shifts in uranium oxide morphological analysis

Davis Brown, Cody Nizinski, Madelyn Shapiro, Corey Fallon, Tianzhixi Yin, Henry Kvinge, Jonathan H. Tu

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments Presented at CV4MS @ CVPR 2024

DEAL: Disentangle and Localize Concept-level Explanations for VLMs

Tang Li, Mengmeng Ma, Xi Peng

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI、cs.LG

Comments In Proceedings of the European Conference on Computer Vision (ECCV), 2024

NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields

Muhammad Zubair Irshad, Sergey Zakharov, Vitor Guizilini, Adrien Gaidon, Zsolt Kira, Rares Ambrus

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments Accepted to ECCV 2024. Project Page: https://nerf-mae.github.io/

AVCap: Leveraging Audio-Visual Features as Text Tokens for Captioning

Jongsuk Kim, Jiwon Shin, Junmo Kim

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL、cs.LG

Comments Interspeech 2024

Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP

Zixiang Chen, Yihe Deng, Yuanzhi Li, Quanquan Gu

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments 31 pages, 7 tables, 6 figures. In ICLR 2024