多模态大模型

Camera-LiDAR Fusion with Latent Contact for Place Recognition in Challenging Cross-Scenes

Yan Pan, Jiapeng Xie, Jiajie Wu, Bo Zhou

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Towards Unified AI Drug Discovery with Multiple Knowledge Modalities

Yizhen Luo, Xing Yi Liu, Kai Yang, Kui Huang, Massimo Hong, Jiahuan Zhang, Yushuai Wu, Zaiqing Nie

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments 10 pages, 6 figures

Three-Dimensional Medical Image Fusion with Deformable Cross-Attention

Lin Liu, Xinxin Fan, Chulong Zhang, Jingjing Dai, Yaoqin Xie, Xiaokun Liang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusion

Donghao Qiao, Farhana Zulkernine

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

FusionFormer: A Multi-sensory Fusion in Bird's-Eye-View and Temporal Consistent Transformer for 3D Object Detection

Chunyong Hu, Hang Zheng, Kun Li, Jianyun Xu, Weibo Mao, Maochun Luo, Lingxuan Wang, Mingxia Chen, Qihao Peng, Kaixuan Liu, Yiru Zhao, Peihan Hao, Minzhe Liu, Kaicheng Yu

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Generating 3D Brain Tumor Regions in MRI using Vector-Quantization Generative Adversarial Networks

Meng Zhou, Matthias W Wagner, Uri Tabori, Cynthia Hawkins, Birgit B Ertl-Wagner, Farzad Khalvati

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Preprint, In Submission

Making LLaMA SEE and Draw with SEED Tokenizer

Yuying Ge, Sijie Zhao, Ziyun Zeng, Yixiao Ge, Chen Li, Xintao Wang, Ying Shan

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Project released at: https://github.com/AILab-CVC/SEED. arXiv admin note: substantial text overlap with arXiv:2307.08041

GeoVLN: Learning Geometry-Enhanced Visual Representation with Slot Attention for Vision-and-Language Navigation

Jingyang Huo, Qiang Sun, Boyan Jiang, Haitao Lin, Yanwei Fu

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023

SGAligner : 3D Scene Alignment with Scene Graphs

Sayan Deb Sarkar, Ondrej Miksik, Marc Pollefeys, Daniel Barath, Iro Armeni

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted at ICCV 2023

Offline Detection of Misspelled Handwritten Words by Convolving Recognition Model Features with Text Labels

Andrey Totev, Tomas Ward

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action Recognition

Ming-Zhe Li, Zhen Jia, Zhang Zhang, Zhanyu Ma, Liang Wang

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by ICIG 2023 (The code has been released at https://github.com/EHZ9NIWI7/MSF-GZSSAR.)

Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Driving

Zijian Zhu, Yichi Zhang, Hai Chen, Yinpeng Dong, Shu Zhao, Wenbo Ding, Jiachen Zhong, Shibao Zheng

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments 8 pages, CVPR2023

Cross Modal Transformer: Towards Fast and Robust 3D Object Detection

Junjie Yan, Yingfei Liu, Jianjian Sun, Fan Jia, Shuailin Li, Tiancai Wang, Xiangyu Zhang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

A Survivor in the Era of Large-Scale Pretraining: An Empirical Study of One-Stage Referring Expression Comprehension

Gen Luo, Yiyi Zhou, Jiamu Sun, Xiaoshuai Sun, Rongrong Ji

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Medical Image Segmentation with Belief Function Theory and Deep Learning

Ling Huang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Ph.D. Thesis

A skeletonization algorithm for gradient-based optimization

Martin J. Menten, Johannes C. Paetzold, Veronika A. Zimmer, Suprosanna Shit, Ivan Ezhov, Robbie Holland, Monika Probst, Julia A. Schnabel, Daniel Rueckert

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Accepted at ICCV 2023

InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning

Sharath Nittur Sridhar, Souvik Kundu, Sairam Sundaresan, Maciej Szankin, Anthony Sarah

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

Domain-Specificity Inducing Transformers for Source-Free Domain Adaptation

Sunandini Sanyal, Ashish Ramayee Asokan, Suvaansh Bhambri, Akshay Kulkarni, Jogendra Nath Kundu, R. Venkatesh Babu

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments ICCV 2023. Project page: http://val.cds.iisc.ac.in/DSiT-SFDA

SF2Former: Amyotrophic Lateral Sclerosis Identification From Multi-center MRI Data Using Spatial and Frequency Fusion Transformer

Rafsanjany Kushol, Collin C. Luk, Avyarthana Dey, Michael Benatar, Hannah Briemberg, Annie Dionne, Nicolas Dupré, Richard Frayne, Angela Genge, Summer Gibson, Simon J. Graham, Lawrence Korngut, Peter Seres, Robert C. Welsh, Alan Wilman, Lorne Zinman, Sanjay Kalra, Yee-Hong Yang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments 17 pages, 8 figures

Journal ref Computerized Medical Imaging and Graphics Volume 108, September 2023, 102279

Pre-train, Adapt and Detect: Multi-Task Adapter Tuning for Camouflaged Object Detection

Yinghui Xing, Dexuan Kong, Shizhou Zhang, Geng Chen, Lingyan Ran, Peng Wang, Yanning Zhang

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Fusing Structural and Functional Connectivities using Disentangled VAE for Detecting MCI

Qiankun Zuo, Yanfei Zhu, Libin Lu, Zhi Yang, Yuhui Li, Ning Zhang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 4 figures

VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language Navigation

Yanyuan Qiao, Zheng Yu, Qi Wu

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by ICCV 2023

Cross-view Semantic Alignment for Livestreaming Product Recognition

Wenjie Yang, Yiyi Chen, Yan Li, Yanhua Cheng, Xudong Liu, Quan Chen, Han Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Accepted to ICCV2023

ALADIN-NST: Self-supervised disentangled representation learning of artistic style through Neural Style Transfer

Dan Ruta, Gemma Canet Tarres, Alexander Black, Andrew Gilbert, John Collomosse

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detection

Jifeng Shen, Yifei Chen, Yue Liu, Xin Zuo, Heng Fan, Wankou Yang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments submitted to Pattern Recognition Journal, minor revision

SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generator

Zhe Zhu, Honghua Chen, Xing He, Weiming Wang, Jing Qin, Mingqiang Wei

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by ICCV 2023

Spatial-information Guided Adaptive Context-aware Network for Efficient RGB-D Semantic Segmentation

Yang Zhang, Chenyun Xiong, Junjie Liu, Xuhui Ye, Guodong Sun

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by IEEE Sensors Journal

HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection

Tim Broedermann, Christos Sakaridis, Dengxin Dai, Luc Van Gool

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments IEEE International Conference on Intelligent Transportation Systems (ITSC) 2023

Cross-Domain Product Representation Learning for Rich-Content E-Commerce

Xuehan Bai, Yan Li, Yanhua Cheng, Wenjie Yang, Quan Chen, Han Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments ICCV23

Fine-grained building roof instance segmentation based on domain adapted pretraining and composite dual-backbone

Guozhang Liu, Baochai Peng, Ting Liu, Pan Zhang, Mengke Yuan, Chaoran Lu, Ningning Cao, Sen Zhang, Simin Huang, Tao Wang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV