多模态大模型

What's in a Name? Evaluating Assembly-Part Semantic Knowledge in Language Models through User-Provided Names in CAD Files

Peter Meltzer, Joseph G. Lambourne, Daniele Grandi

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CL

Adaptive-Mask Fusion Network for Segmentation of Drivable Road and Negative Obstacle With Untrustworthy Features

Zhen Feng, Yuchao Feng, Yanning Guo, Yuxiang Sun

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments This paper has been accepted by 2023 IEEE Intelligent Vehicles Symposium (IV) (IEEE IV 2023)

Center Feature Fusion: Selective Multi-Sensor Fusion of Center-based Objects

Philip Jacobson, Yiyang Zhou, Wei Zhan, Masayoshi Tomizuka, Ming C. Wu

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ICRA 2023

Enriching Source Code with Contextual Data for Code Completion Models: An Empirical Study

Tim van Dam, Maliheh Izadi, Arie van Deursen

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CL

Comments 13 pages. To appear in the Proceedings of the 20th International Conference on Mining Software Repositories (MSR 2023)

RGBT Tracking via Progressive Fusion Transformer with Dynamically Guided Learning

Yabin Zhu, Chenglong Li, Xiao Wang, Jin Tang, Zhixiang Huang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Incorrect experimental setup on the LasHeR dataset

Information Extraction from Documents: Question Answering vs Token Classification in real-world setups

Laurent Lam, Pirashanth Ratnamogan, Joël Tang, William Vanhuffel, Fabien Caspani

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CL

FUTR3D: A Unified Sensor Fusion Framework for 3D Detection

Xuanyao Chen, Tianyuan Zhang, Yue Wang, Yilun Wang, Hang Zhao

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Journal ref CVPR 2023 workshop on autonomous driving

DetCLIPv2: Scalable Open-Vocabulary Object Detection Pre-training via Word-Region Alignment

Lewei Yao, Jianhua Han, Xiaodan Liang, Dan Xu, Wei Zhang, Zhenguo Li, Hang Xu

专题命中 多模态训练与对齐 ：image-text(abstract)；分类 cs.CV

Comments Accepted to CVPR2023

Sparse Dense Fusion for 3D Object Detection

Yulu Gao, Chonghao Sima, Shaoshuai Shi, Shangzhe Di, Si Liu, Hongyang Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Better "CMOS" Produces Clearer Images: Learning Space-Variant Blur Estimation for Blind Image Super-Resolution

Xuhai Chen, Jiangning Zhang, Chao Xu, Yabiao Wang, Chengjie Wang, Yong Liu

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023

MemeFier: Dual-stage Modality Fusion for Image Meme Classification

Christos Koutlis, Manos Schinas, Symeon Papadopoulos

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, 2 figures, ICMR 2023

UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View

Shengchao Zhou, Weizhou Liu, Chen Hu, Shuchang Zhou, Chao Ma

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

CLIP$^2$: Contrastive Language-Image-Point Pretraining from Real-World Point Cloud Data

Yihan Zeng, Chenhan Jiang, Jiageng Mao, Jianhua Han, Chaoqiang Ye, Qingqiu Huang, Dit-Yan Yeung, Zhen Yang, Xiaodan Liang, Hang Xu

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments To appear at CVPR 2023

SCADE: NeRFs from Space Carving with Ambiguity-Aware Depth Estimates

Mikaela Angelina Uy, Ricardo Martin-Brualla, Leonidas Guibas, Ke Li

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2023

TwistSLAM++: Fusing multiple modalities for accurate dynamic semantic SLAM

Mathieu Gonzalez, Eric Marchand, Amine Kacete, Jérôme Royan

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

A Dual Branch Network for Emotional Reaction Intensity Estimation

Jun Yu, Jichao Zhu, Wangyuan Zhu, Zhongpeng Cai, Guochen Xie, Renda Li, Gongpeng Zhao

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

RIFT2: Speeding-up RIFT with A New Rotation-Invariance Technique

Jiayuan Li, Pengcheng Shi, Qingwu Hu, Yongjun Zhang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

BB-GCN: A Bi-modal Bridged Graph Convolutional Network for Multi-label Chest X-Ray Recognition

Guoli Wang, Pingping Wang, Jinyu Cong, Kunmeng Liu, Benzheng Wei

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments under Computers in Biology and Medicine submission

Fine-tuning of sign language recognition models: a technical report

Maxim Novopoltsev, Leonid Verkhovtsev, Ruslan Murtazin, Dmitriy Milevich, Iuliia Zemtsova

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Vision Transformer Adapter for Dense Predictions

Zhe Chen, Yuchen Duan, Wenhai Wang, Junjun He, Tong Lu, Jifeng Dai, Yu Qiao

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to ICLR 2023

CADG: A Model Based on Cross Attention for Domain Generalization

Cheng Dai, Yingqiao Lin, Fan Li, Xiyao Li, Donglin Xie

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Language-aware Domain Generalization Network for Cross-Scene Hyperspectral Image Classification

Yuxiang Zhang, Mengmeng Zhang, Wei Li, Shuai Wang, Ran Tao

专题命中 多模态训练与对齐 ：image-text(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2209.01634

PTA-Det: Point Transformer Associating Point cloud and Image for 3D Object Detection

Rui Wan, Tianyun Zhao, Wei Zhao

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Intelligent Feature Extraction, Data Fusion and Detection of Concrete Bridge Cracks: Current Development and Challenges

Di Wang, Simon X. Yang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments Published at Intelligence & Robotics; Its copyright belongs to authors

Asymmetric Cross-Scale Alignment for Text-Based Person Search

Zhong Ji, Junhua Hu, Deyin Liu, Lin Yuanbo Wu, Ye zhao

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Multimedia

Clover: Towards A Unified Video-Language Alignment and Fusion Model

Jingjia Huang, Yinan Li, Jiashi Feng, Xinglong Wu, Xiaoshuai Sun, Rongrong Ji

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Update Tri-modal Alignment task

Multi-task Joint Strategies of Self-supervised Representation Learning on Biomedical Networks for Drug Discovery

Xiaoqi Wang, Yingjie Cheng, Yaning Yang, Yue Yu, Fei Li, Shaoliang Peng

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments 44 pages, 11 figures

DouFu: A Double Fusion Joint Learning Method For Driving Trajectory Representation

Han Wang, Zhou Huang, Xiao Zhou, Ganmin Yin, Yi Bao, Yi Zhang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments 11 pages, 7 figures

Compound Tokens: Channel Fusion for Vision-Language Representation Learning

Maxwell Mbabilla Aladago, AJ Piergiovanni

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics

Chunyuan Li, Xinliang Zhu, Jiawen Yao, Junzhou Huang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments accepted by ICPR 2022