多模态大模型

Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patches

Qing Yu, Mikihiro Tanaka, Kent Fujiwara

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024, Project website: https://yu1ut.com/MotionPatches-HP/

ChatPose: Chatting about 3D Human Pose

Yao Feng, Jing Lin, Sai Kumar Dwivedi, Yu Sun, Priyanka Patel, Michael J. Black

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Home page: https://yfeng95.github.io/ChatPose/

Intelligent Message Behavioral Identification System

Yuvaraju Chinnam, Bosubabu Sambana

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Connecting NeRFs, Images, and Text

Francesco Ballerini, Pierluigi Zama Ramirez, Roberto Mirabella, Samuele Salti, Luigi Di Stefano

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Accepted at CVPRW-INRV 2024

Understanding normalization in contrastive representation learning and out-of-distribution detection

Tai Le-Gia, Jaehyun Ahn

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Autonomous Artificial Intelligence Agents for Clinical Decision Making in Oncology

Dyke Ferber, Omar S. M. El Nahhas, Georg Wölflein, Isabella C. Wiest, Jan Clusmann, Marie-Elisabeth Leßman, Sebastian Foersch, Jacqueline Lammert, Maximilian Tschochohei, Dirk Jäger, Manuel Salto-Tellez, Nikolaus Schultz, Daniel Truhn, Jakob Nikolas Kather

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments 91 pages, 2 Figures

Image-to-Image Matching via Foundation Models: A New Perspective for Open-Vocabulary Semantic Segmentation

Yuan Wang, Rui Sun, Naisong Luo, Yuwen Pan, Tianzhu Zhang

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR2024

Online Embedding Multi-Scale CLIP Features into 3D Maps

Shun Taguchi, Hideki Deguchi

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments 8 pages, 7 figures

CLAMP: Contrastive LAnguage Model Prompt-tuning

Piotr Teterwak, Ximeng Sun, Bryan A. Plummer, Kate Saenko, Ser-Nam Lim

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification

Kaijie Ren, Lei Zhang

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2024

Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrieval

Yucheng Suo, Fan Ma, Linchao Zhu, Yi Yang

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments CVPR 2024

Training-free Zero-shot Composed Image Retrieval with Local Concept Reranking

Shitong Sun, Fanghua Ye, Shaogang Gong

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments Under Review

PiGW: A Plug-in Generative Watermarking Framework

Rui Ma, Mengxi Guo, Li Yuming, Hengyuan Zhang, Cong Ma, Yuan Li, Xiaodong Xie, Shanghang Zhang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.MM

Comments Improve experimental content

N-Modal Contrastive Losses with Applications to Social Media Data in Trimodal Space

William Theisen, Walter Scheirer

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Interactive Continual Learning: Fast and Slow Thinking

Biqing Qi, Xingquan Chen, Junqi Gao, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024

YYDS: Visible-Infrared Person Re-Identification with Coarse Descriptions

Yunhao Du, Zhicheng Zhao, Fei Su

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments 14 pages, 6 figures

From Artificially Real to Real: Leveraging Pseudo Data from Large Language Models for Low-Resource Molecule Discovery

Yuhan Chen, Nuwa Xi, Yanrui Du, Haochun Wang, Jianyu Chen, Sendong Zhao, Bing Qin

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CL

Comments AAAI2024

CorruptEncoder: Data Poisoning based Backdoor Attacks to Contrastive Learning

Jinghuai Zhang, Hongbin Liu, Jinyuan Jia, Neil Zhenqiang Gong

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments CVPR 2024

Enhancing Visual Document Understanding with Contrastive Learning in Large Visual-Language Models

Xin Li, Yunfei Wu, Xinghua Jiang, Zhihao Guo, Mingming Gong, Haoyu Cao, Yinsong Liu, Deqiang Jiang, Xing Sun

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Vision-by-Language for Training-Free Compositional Image Retrieval

Shyamgopal Karthik, Karsten Roth, Massimiliano Mancini, Zeynep Akata

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments ICLR 2024

Impression-CLIP: Contrastive Shape-Impression Embedding for Fonts

Yugo Kubota, Daichi Haraguchi, Seiichi Uchida

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Error-Robust Retrieval for Chinese Spelling Check

Xunjian Yin, Xinyu Hu, Jin Jiang, Xiaojun Wan

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments 11 pages, 3 figures

Fusion of Diffusion Weighted MRI and Clinical Data for Predicting Functional Outcome after Acute Ischemic Stroke with Deep Contrastive Learning

Chia-Ling Tsai, Hui-Yun Su, Shen-Feng Sung, Wei-Yang Lin, Ying-Ying Su, Tzu-Hsien Yang, Man-Lin Mai

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments 12 pages, 5 figures, 5 tables

SemTra: A Semantic Skill Translator for Cross-Domain Zero-Shot Policy Adaptation

Sangwoo Shin, Minjong Yoo, Jeongwoo Lee, Honguk Woo

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

Comments AAAI 2024 Camera-ready version

Expressivity-aware Music Performance Retrieval using Mid-level Perceptual Features and Emotion Word Embeddings

Shreyan Chowdhury, Gerhard Widmer

专题命中 跨模态检索 ：cross-modal(abstract)；分类 eess.AS

Comments Presented at FIRE 2023 (Forum for Information Retrieval Evaluation) conference, Goa, India

LanDA: Language-Guided Multi-Source Domain Adaptation

Zhenbin Wang, Lei Zhang, Lituan Wang, Minjuan Zhu

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments 20 pages, 8 figures

Unsupervised Domain Adaptation Using Compact Internal Representations

Mohammad Rostami

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Models

Marco Bronzini, Carlo Nicolini, Bruno Lepri, Andrea Passerini, Jacopo Staiano

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Modality-Aware Representation Learning for Zero-shot Sketch-based Image Retrieval

Eunyi Lyou, Doyeon Lee, Jooeun Kim, Joonseok Lee

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at WACV 2024

Query-Based Knowledge Sharing for Open-Vocabulary Multi-Label Classification

Xuelin Zhu, Jian Liu, Dongqi Tang, Jiawei Ge, Weijia Liu, Bo Liu, Jiuxin Cao

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV