多模态大模型

Cross-domain Food Image-to-Recipe Retrieval by Weighted Adversarial Learning

Bin Zhu, Chong-Wah Ngo, Jingjing Chen, Wing-Kwong Chan

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.MM

Alloprof: a new French question-answer education dataset and its use in an information retrieval case study

Antoine Lefebvre-Brossard, Stephane Gazaille, Michel C. Desmarais

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

DATE: Domain Adaptive Product Seeker for E-commerce

Haoyuan Li, Hao Jiang, Tao Jin, Mengyan Li, Yan Chen, Zhijie Lin, Yang Zhao, Zhou Zhao

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments This paper was accepted by CVPR 2023

A Unified Model for Video Understanding and Knowledge Embedding with Heterogeneous Knowledge Graph Dataset

Jiaxin Deng, Dong Shen, Haojie Pan, Xiangyu Wu, Ximan Liu, Gaofeng Meng, Fan Yang, Size Li, Ruiji Fu, Zhongyuan Wang

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ICMR 2023

Parts2Words: Learning Joint Embedding of Point Clouds and Texts by Bidirectional Matching between Parts and Words

Chuan Tang, Xi Yang, Bojian Wu, Zhizhong Han, Yi Chang

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

ViPFormer: Efficient Vision-and-Pointcloud Transformer for Unsupervised Pointcloud Understanding

Hongyu Sun, Yongcai Wang, Xudong Cai, Xuewei Bai, Deying Li

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments 9 pages, 4 figures, 7 tables; accepted by ICRA 2023

Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style

Fengyin Lin, Mingkang Li, Da Li, Timothy Hospedales, Yi-Zhe Song, Yonggang Qi

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2023 (Highlight)

LargeKernel3D: Scaling up Kernels in 3D Sparse CNNs

Yukang Chen, Jianhui Liu, Xiangyu Zhang, Xiaojuan Qi, Jiaya Jia

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments In CVPR 2023. Code is at https://github.com/dvlab-research/LargeKernel3D

Motion Transformer with Global Intention Localization and Local Movement Refinement

Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2022 as Oral Presentation

MODIFY: Model-driven Face Stylization without Style Images

Yuhe Ding, Jian Liang, Jie Cao, Aihua Zheng, Ran He

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Data-Free Sketch-Based Image Retrieval

Abhra Chaudhuri, Ayan Kumar Bhunia, Yi-Zhe Song, Anjan Dutta

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Computer Vision and Pattern Recognition (CVPR) 2023

Joint Representations of Text and Knowledge Graphs for Retrieval and Evaluation

Teven Le Scao, Claire Gardent

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CL

MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models

Hongyin Zhu

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Visually-Augmented Language Modeling

Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments ICLR 2023

Deep Learning for Video-Text Retrieval: a Review

Cunjuan Zhu, Qi Jia, Wei Chen, Yanming Guo, Yu Liu

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments International Journal of Multimedia Information Retrieval (IJMIR)

ACE: Zero-Shot Image to Image Translation via Pretrained Auto-Contrastive-Encoder

Sihan Xu, Zelong Jiang, Ruisi Liu, Kaikai Yang, Zhijie Huang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Que2Engage: Embedding-based Retrieval for Relevant and Engaging Products at Facebook Marketplace

Yunzhong He, Yuxin Tian, Mengjiao Wang, Feier Chen, Licheng Yu, Maolong Tang, Congcong Chen, Ning Zhang, Bin Kuang, Arul Prakash

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments Accepted by WWW'2023

CoCoSoDa: Effective Contrastive Learning for Code Search

Ensheng Shi, Yanlin Wang, Wenchao Gu, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Hongbin Sun

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments Accepted by ICSE 2023 (The 45th International Conference on Software Engineering)

TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Network

Zhengyi Liu, Yuan Wang, Zhengzheng Tu, Yun Xiao, Bin Tang

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

CommitBART: A Large Pre-trained Model for GitHub Commits

Shangqing Liu, Yanzhou Li, Xiaofei Xie, Yang Liu

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.AI

Distribution Aligned Feature Clustering for Zero-Shot Sketch-Based Image Retrieval

Yuchen Wu, Kun Song, Fangzheng Zhao, Jiansheng Chen, Huimin Ma

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Position-Aware Contrastive Alignment for Referring Image Segmentation

Bo Chen, Zhiwei Hu, Zhilong Ji, Jinfeng Bai, Wangmeng Zuo

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments 12 pages, 6 figures

FreeSeg: Free Mask from Interpretable Contrastive Language-Image Pretraining for Semantic Segmentation

Yi Li, Huifeng Yao, Hualiang Wang, Xiaomeng Li

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments This paper contains some immature results

Group Generalized Mean Pooling for Vision Transformer

Byungsoo Ko, Han-Gyu Kim, Byeongho Heo, Sangdoo Yun, Sanghyuk Chun, Geonmo Gu, Wonjae Kim

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

MouseGAN++: Unsupervised Disentanglement and Contrastive Representation for Multiple MRI Modalities Synthesis and Structural Segmentation of Mouse Brain

Ziqi Yu, Xiaoyang Han, Shengjie Zhang, Jianfeng Feng, Tingying Peng, Xiao-Yong Zhang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments IEEE Transactions on Medical Imaging (IEEE-TMI) 2022

Testing GLOM's ability to infer wholes from ambiguous parts

Laura Culp, Sara Sabour, Geoffrey E. Hinton

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Exploring Visual Interpretability for Contrastive Language-Image Pre-training

Yi Li, Hualiang Wang, Yiqun Duan, Hang Xu, Xiaomeng Li

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments 15 pages, 9 figures

TimbreCLIP: Connecting Timbre to Text and Images

Nicolas Jonason, Bob L. T. Sturm

专题命中 跨模态检索 ：cross-modal(abstract)；分类 eess.AS

Comments Submitted to AAAI workshop on creative AI across modalities

Unsupervised Feature Clustering Improves Contrastive Representation Learning for Medical Image Segmentation

Yejia Zhang, Xinrong Hu, Nishchal Sapkota, Yiyu Shi, Danny Z. Chen

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM'22) proceedings

Tell Your Story: Task-Oriented Dialogs for Interactive Content Creation

Satwik Kottur, Seungwhan Moon, Aram H. Markosyan, Hardik Shah, Babak Damavandi, Alborz Geramifard

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments 8 pages, 6 figures, 2 tables