语言大模型 / LLM

ConceptFusion: Open-set Multimodal 3D Mapping

Krishna Murthy Jatavallabhula, Alihusein Kuwajerwala, Qiao Gu, Mohd Omama, Tao Chen, Alaa Maalouf, Shuang Li, Ganesh Iyer, Soroush Saryazdi, Nikhil Keetha, Ayush Tewari, Joshua B. Tenenbaum, Celso Miguel de Melo, Madhava Krishna, Liam Paull, Florian Shkurti, Antonio Torralba

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.AI

Comments RSS 2023. Project page: https://concept-fusion.github.io Explainer video: https://www.youtube.com/watch?v=rkXgws8fiDs Code: https://github.com/concept-fusion/concept-fusion

The Less the Merrier? Investigating Language Representation in Multilingual Models

Hellina Hailu Nigatu, Atnafu Lambebo Tonja, Jugal Kalita

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023(Findings)

CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learning

Xiaoming Liu, Zhaohan Zhang, Yichen Wang, Hang Pu, Yu Lan, Chao Shen

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2023 main cofference

The Locality and Symmetry of Positional Encodings

Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Long Paper in Findings of EMNLP23

Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing

Dmitry Nikolaev, Sebastian Padó

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted to BlackboxNLP 2023

A Systematic Study of Joint Representation Learning on Protein Sequences and Structures

Zuobai Zhang, Chuanrui Wang, Minghao Xu, Vijil Chenthamarakshan, Aurélie Lozano, Payel Das, Jian Tang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors

Thomas Hartvigsen, Swami Sankaranarayanan, Hamid Palangi, Yoon Kim, Marzyeh Ghassemi

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Comments Accepted to NeurIPS 2023

Group SELFIES: A Robust Fragment-Based Molecular String Representation

Austin Cheng, Andy Cai, Santiago Miret, Gustavo Malkomes, Mariano Phielipp, Alán Aspuru-Guzik

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Comments 11 pages + references and appendix

Journal ref Digital Discovery (2023)

Disentangling the Linguistic Competence of Privacy-Preserving BERT

Stefan Arnold, Nils Kemmerzell, Annika Schreiner

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Self-Supervised 3D Action Representation Learning with Skeleton Cloud Colorization

Siyuan Yang, Jun Liu, Shijian Lu, Er Meng Hwa, Yongjian Hu, Alex C. Kot

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.AI

Comments Accepted by TPAMI. This work is an extension of our ICCV 2021 paper [arXiv:2108.01959] https://openaccess.thecvf.com/content/ICCV2021/html/Yang_Skeleton_Cloud_Colorization_for_Unsupervised_3D_Action_Representation_Learning_ICCV_2021_paper.html

Legend at ArAIEval Shared Task: Persuasion Technique Detection using a Language-Agnostic Text Representation Model

Olumide E. Ojo, Olaronke O. Adebanji, Hiram Calvo, Damian O. Dieke, Olumuyiwa E. Ojo, Seye E. Akinsanya, Tolulope O. Abiola, Anna Feldman

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation

Yanjie Ze, Yuyao Liu, Ruizhe Shi, Jiaxin Qin, Zhecheng Yuan, Jiashun Wang, Huazhe Xu

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.LG

Comments NeurIPS 2023. Code and videos: https://yanjieze.com/H-InDex

A Comparative Study of Transformer-based Neural Text Representation Techniques on Bug Triaging

Atish Kumar Dipongkor, Kevin Moran

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments 12 pages, to appear in the Proceedings of 38th IEEE/ACM International Conference on Automated Software Engineering (ASE'23)

Uni3D: Exploring Unified 3D Representation at Scale

Junsheng Zhou, Jinsheng Wang, Baorui Ma, Yu-Shen Liu, Tiejun Huang, Xinlong Wang

专题命中 知识编辑与模型理解 ：foundation model(abstract)；分类 cs.CL

Comments Code and Demo: https://github.com/baaivision/Uni3D

Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations

Ekaterina Taktasheva, Vladislav Mikhailov, Ekaterina Artemova

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments accepted to MRL @ EMNLP 2021

Scaling Experiments in Self-Supervised Cross-Table Representation Learning

Maximilian Schambach, Dominique Paul, Johannes S. Otterbach

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Motif-Centric Representation Learning for Symbolic Music

Yuxuan Wu, Roger B. Dannenberg, Gus Xia

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

PICK: Polished & Informed Candidate Scoring for Knowledge-Grounded Dialogue Systems

Bryan Wilie, Yan Xu, Willy Chung, Samuel Cahyawijaya, Holy Lovenia, Pascale Fung

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation

Anna Deichler, Shivam Mehta, Simon Alexanderson, Jonas Beskow

专题命中 知识编辑与模型理解 ：pretraining(abstract)；分类 cs.LG

Identifying Interpretable Subspaces in Image Representations

Neha Kalibhat, Shweta Bhardwaj, Bayan Bruss, Hamed Firooz, Maziar Sanjabi, Soheil Feizi

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG

Comments Published at ICML 2023 Code: https://github.com/NehaKalibhat/falcon-explain

Expectation consistency for calibration of neural networks

Lucas Clarté, Bruno Loureiro, Florent Krzakala, Lenka Zdeborová

专题命中 知识编辑与模型理解 ：post-training(abstract)；分类 cs.LG

Journal ref Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence, PMLR 216:443-453, 2023

Multilingual Text Representation

Fahim Faisal

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments PhD Comprehensive exam report

A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER

Guanting Dong, Zechen Wang, Jinxu Zhao, Gang Zhao, Daichi Guo, Dayuan Fu, Tingfeng Hui, Chen Zeng, Keqing He, Xuefeng Li, Liwen Wang, Xinyue Cui, Weiran Xu

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Accepted by CIKM 2023 (Oral Presentation)

DexBERT: Effective, Task-Agnostic and Fine-grained Representation Learning of Android Bytecode

Tiezhu Sun, Kevin Allix, Kisub Kim, Xin Zhou, Dongsun Kim, David Lo, Tegawendé F. Bissyandé, Jacques Klein

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI

Comments Accepted by IEEE TSE, 2023

Concept Evolution in Deep Learning Training: A Unified Interpretation Framework and Discoveries

Haekyu Park, Seongmin Lee, Benjamin Hoover, Austin P. Wright, Omar Shaikh, Rahul Duggal, Nilaksh Das, Kevin Li, Judy Hoffman, Duen Horng Chau

专题命中 知识编辑与模型理解 ：post-training(abstract)；分类 cs.LG

Comments Accepted at CIKM'23

ViLLA: Fine-Grained Vision-Language Representation Learning from Real-World Data

Maya Varma, Jean-Benoit Delbrouck, Sarah Hooper, Akshay Chaudhari, Curtis Langlotz

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.AI

Comments ICCV 2023

Human-in-the-Loop Schema Induction

Tianyi Zhang, Isaac Tham, Zhaoyi Hou, Jiaxuan Ren, Liyang Zhou, Hainiu Xu, Li Zhang, Lara J. Martin, Rotem Dror, Sha Li, Heng Ji, Martha Palmer, Susan Brown, Reece Suchocki, Chris Callison-Burch

专题命中 知识编辑与模型理解 ：prompting(abstract)；分类 cs.CL

Comments 10 pages, ACL2023 demo track

Enhancing Language Representation with Constructional Information for Natural Language Understanding

Lvxiaowei Xu, Jianwang Wu, Jiawei Peng, Zhilin Gong, Ming Cai, Tianxiang Wang

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments Long paper, accepted at the ACL 2023

Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis

Mario Giulianelli, Iris Luden, Raquel Fernandez, Andrey Kutuzov

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.CL

Comments ACL 2023

Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla

Tom Lieberum, Matthew Rahtz, János Kramár, Neel Nanda, Geoffrey Irving, Rohin Shah, Vladimir Mikulik

专题命中 知识编辑与模型理解 ：language model(abstract)；分类 cs.LG