多模态大模型

Hierarchical Feature Alignment Network for Unsupervised Video Object Segmentation

Gensheng Pei, Fumin Shen, Yazhou Yao, Guo-Sen Xie, Zhenmin Tang, Jinhui Tang

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by ECCV-2022

Fusion of Physiological and Behavioural Signals on SPD Manifolds with Application to Stress and Pain Detection

Yujin WU, Mohamed Daoudi, Ali Amad, Laurent Sparrow, Fabien D'Hondt

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Comments International Conference on Systems, Man, and Cybernetics, IEEE SMC 2022, October 9-12, 2022

GroupViT: Semantic Segmentation Emerges from Text Supervision

Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang

专题命中 多模态训练与对齐 ：image-text(abstract)；分类 cs.CV

Comments CVPR 2022. Project page and code: https://jerryxu.net/GroupViT

Transformaly -- Two (Feature Spaces) Are Better Than One

Matan Jacob Cohen, Shai Avidan

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments CVPR Workshop, 2022

Multiple Kernel Clustering with Dual Noise Minimization

Junpu Zhang, Liang Li, Siwei Wang, Jiyuan Liu, Yue Liu, Xinwang Liu, En Zhu

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

Modern Views of Machine Learning for Precision Psychiatry

Zhe Sage Chen, Prathamesh, Kulkarni, Isaac R. Galatzer-Levy, Benedetta Bigio, Carla Nasca, Yu Zhang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Amplitude Spectrum Transformation for Open Compound Domain Adaptive Semantic Segmentation

Jogendra Nath Kundu, Akshay Kulkarni, Suvaansh Bhambri, Varun Jampani, R. Venkatesh Babu

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments AAAI 2022. Project page: http://sites.google.com/view/ast-ocdaseg

TANet: Transformer-based Asymmetric Network for RGB-D Salient Object Detection

Chang Liu, Gang Yang, Shuo Wang, Hangxu Wang, Yunhua Zhang, Yutao Wang

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Explicit and implicit models in infrared and visible image fusion

Zixuan Wang, Bin Sun

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments 8 pages, 5 figures, 2 tables

Self-supervised Vision Transformers for Joint SAR-optical Representation Learning

Yi Wang, Conrad M Albrecht, Xiao Xiang Zhu

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 4 pages, 1 figure; IGARSS 2022

Learning Selective Sensor Fusion for States Estimation

Changhao Chen, Stefano Rosa, Chris Xiaoxuan Lu, Bing Wang, Niki Trigoni, Andrew Markham

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Neural Networks and Learning Systems (TNNLS). arXiv admin note: text overlap with arXiv:1903.01534

MATrIX -- Modality-Aware Transformer for Information eXtraction

Thomas Delteil, Edouard Belval, Lei Chen, Luis Goncalves, Vijay Mahadevan

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

OTFPF: Optimal Transport-Based Feature Pyramid Fusion Network for Brain Age Estimation with 3D Overlapped ConvNeXt

Yu Fu, Yanyan Huang, Yalin Wang, Shunjie Dong, Le Xue, Xunzhao Yin, Qianqian Yang, Yiyu Shi, Cheng Zhuo

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Fake News Detection with Heterogeneous Transformer

Tianle Li, Yushi Sun, Shang-ling Hsu, Yanjia Li, Raymond Chi-Wing Wong

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

Relational Representation Learning in Visually-Rich Documents

Xin Li, Yan Zheng, Yiqing Hu, Haoyu Cao, Yunfei Wu, Deqiang Jiang, Yinsong Liu, Bo Ren

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CL

Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes

Yunjie Peng, Kang Ma, Yang Zhang, Zhiqiang He

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments The paper is under consideration at Multimedia Tools and Applications

C3-STISR: Scene Text Image Super-resolution with Triple Clues

Minyi Zhao, Miao Wang, Fan Bai, Bingjia Li, Jie Wang, Shuigeng Zhou

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by IJCAI 2022

Expansion-Squeeze-Excitation Fusion Network for Elderly Activity Recognition

Xiangbo Shu, Jiawen Yang, Rui Yan, Yan Song

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Pay "Attention" to Adverse Weather: Weather-aware Attention-based Object Detection

Saket S. Chaturvedi, Lan Zhang, Xiaoyong Yuan

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments This paper is accepted at IEEE International Conference on Pattern Recognition (ICPR), 2022

Simulation of machine learning-based 6G systems in virtual worlds

Ailton Oliveira, Felipe Bastos, Isabela Trindade, Walter Frazao, Arthur Nascimento, Diego Gomes, Francisco Muller, Aldebaro Klautau

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.AI

Journal ref ITU Journal on Future and Evolving Technologies, Volume 2 (2021), Issue 4 - AI and machine learning solutions in 5G and future networks, Pages 113-123

MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review

Zhiqing Wei, Fengkai Zhang, Shuo Chang, Yangyang Liu, Huici Wu, Zhiyong Feng

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

A Rich Recipe Representation as Plan to Support Expressive Multi Modal Queries on Recipe Content and Preparation Process

Vishal Pallagani, Priyadharsini Ramamurthy, Vedant Khandelwal, Revathy Venkataramanan, Kausik Lakkaraju, Sathyanarayanan N. Aakur, Biplav Srivastava

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.AI

Exploring Body Texture from mmW Images for Person Recognition

E. Gonzalez-Sosa, J. Fierrez, R. Vera-Rodriguez, F. Alonso-Fernandez, V. M. Patel

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

Comments Published at IEEE Transactions on Biometrics, Behavior, and Identity Science

Mixed Differential Privacy in Computer Vision

Aditya Golatkar, Alessandro Achille, Yu-Xiang Wang, Aaron Roth, Michael Kearns, Stefano Soatto

专题命中 多模态训练与对齐 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at CVPR 2022

S2-Net: Self-supervision Guided Feature Representation Learning for Cross-Modality Images

Shasha Mei

专题命中 多模态训练与对齐 ：multi-modal(abstract)；分类 cs.CV

A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advances

Yan Wang, Wei Song, Wei Tao, Antonio Liotta, Dawei Yang, Xinlei Li, Shuyong Gao, Yixuan Sun, Weifeng Ge, Wei Zhang, Wenqiang Zhang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.MM

Comments Accepted for Information Fusion

Convolutional Simultaneous Sparse Approximation with Applications to RGB-NIR Image Fusion

Farshad G. Veshki, Sergiy A. Vorobyov

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Mobile Behavioral Biometrics for Passive Authentication

Giuseppe Stragapede, Ruben Vera-Rodriguez, Ruben Tolosana, Aythami Morales, Alejandro Acien, Gael Le Lan

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Supervising Remote Sensing Change Detection Models with 3D Surface Semantics

Isaac Corley, Peyman Najafirad

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Convolutional Neural Network with Convolutional Block Attention Module for Finger Vein Recognition

Zhongxia Zhang, Mingwen Wang

专题命中 多模态训练与对齐 ：multimodal(abstract)；分类 cs.CV

Comments 11 pages, 6 figures, 5 tables