多模态大模型 - arXivDaily 专题

2210.07443 2022-10-17 cs.IR 78%

MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

Kang Liu, Feng Xue, Dan Guo, Le Wu, Shujie Li, Richang Hong

专题命中跨模态检索：multimodal(title,abstract)

2209.12491 2022-09-27 cs.LG cs.IR 78%

Information-Theoretic Hashing for Zero-Shot Cross-Modal Retrieval

Yufeng Shi, Shujian Yu, Duanquan Xu, Xinge You

专题命中跨模态检索：cross-modal(title,abstract)

2208.00767 2022-09-07 cs.CV cs.AI cs.CL cs.IR 78%

Multimodal Neural Machine Translation with Search Engine Based Image Retrieval

ZhenHao Tang, XiaoBing Zhang, Zi Long, XiangHua Fu

专题命中跨模态检索：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments 9 pages, 5 figures

2207.10154 2022-07-22 eess.SP 78%

Multimodal Estimation of End Point Force During Quasi-dynamic and Dynamic Muscle Contractions Using Deep Learning

Gelareh Hajian, Evelyn Morin, Ali Etemad

专题命中跨模态检索：multimodal(title,abstract)

Comments Accepted to IEEE Transactions on Instrumentation and Measurement

2201.05946 2022-07-13 cs.SI 78%

Understanding Political Polarization via Jointly Modeling Users, Connections and Multimodal Contents on Heterogeneous Graphs

Hanjia Lyu, Jiebo Luo

专题命中跨模态检索：multimodal(title,abstract)

Comments Accepted for publication in Proceedings of the 30th ACM International Conference on Multimedia, 2022

2205.14289 2022-05-31 cs.SE 78%

Contrastive Learning for Multi-Modal Automatic Code Review

Bingting Wu, Xiaofang Zhang

专题命中跨模态检索：multi-modal(title,abstract)

Comments 6 pages

2203.15788 2022-03-30 cs.RO 78%

COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems

Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor

专题命中跨模态检索：multimodal(title,abstract)

2004.00197 2022-03-22 cs.IR cs.LG 78%

Task-adaptive Asymmetric Deep Cross-modal Hashing

Fengling Li, Tong Wang, Lei Zhu, Zheng Zhang, Xinhua Wang

专题命中跨模态检索：cross-modal(title,abstract)

2104.10067 2022-01-13 cs.RO 78%

Spherical Multi-Modal Place Recognition for Heterogeneous Sensor Systems

Lukas Bernreiter, Lionel Ott, Juan Nieto, Roland Siegwart, Cesar Cadena

专题命中跨模态检索：multi-modal(title,abstract)

Comments Accepted for IEEE International Conference on Robotics and Automation, 2021

Journal ref 2021 IEEE International Conference on Robotics and Automation (ICRA)

1911.06814 2021-11-16 eess.IV physics.app-ph physics.optics 78%

X-ray Multimodal Intrinsic-Speckle-Tracking

Konstantin M. Pavlov, David M. Paganin, Heyang Li, Sebastien Berujon, Hélène Rougé-Labriet, Emmanuel Brun

专题命中跨模态检索：multimodal(title)；multi-modal(abstract)

Journal ref Journal of Optics 22 125604 (2020)

2106.03919 2021-09-16 cs.RO 78%

Learning to Detect Multi-Modal Grasps for Dexterous Grasping in Dense Clutter

Matt Corsaro, Stefanie Tellex, George Konidaris

专题命中跨模态检索：multi-modal(title,abstract)

Comments IROS 2021 Accepted Version

2108.06338 2021-08-16 q-bio.QM cs.LG 78%

Graph2MDA: a multi-modal variational graph embedding model for predicting microbe-drug associations

Lei Deng, Yibiao Huang, Xuejun Liu, Hui Liu

专题命中跨模态检索：multi-modal(title,abstract)

2106.11360 2021-06-23 cs.LG 78%

Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records

Yikuan Li, Mohammad Mamouei, Gholamreza Salimi-Khorshidi, Shishir Rao, Abdelaali Hassaine, Dexter Canoy, Thomas Lukasiewicz, Kazem Rahimi

专题命中跨模态检索：multimodal(title,abstract)

2007.01179 2021-04-22 cs.LG stat.ML 78%

Relating by Contrasting: A Data-efficient Framework for Multimodal Generative Models

Yuge Shi, Brooks Paige, Philip H. S. Torr, N. Siddharth

专题命中跨模态检索：multimodal(title,abstract)

2101.03525 2021-03-02 cs.RO cs.LG 78%

Cross-Modal Contrastive Learning of Representations for Navigation using Lightweight, Low-Cost Millimeter Wave Radar for Adverse Environmental Conditions

Jui-Te Huang, Chen-Lung Lu, Po-Kai Chang, Ching-I Huang, Chao-Chun Hsu, Zu Lin Ewe, Po-Jui Huang, Hsueh-Cheng Wang

专题命中跨模态检索：cross-modal(title,abstract)

Comments For further details, please visit https://arg-nctu.github.io/projects/deeprl-mmWave.html

Journal ref IEEE Robotics and Automation Letters, 2021

2010.01666 2020-10-06 cs.IR cs.LG 78%

Multi-Modal Retrieval using Graph Neural Networks

Aashish Kumar Misraa, Ajinkya Kale, Pranav Aggarwal, Ali Aminian

专题命中跨模态检索：multi-modal(title,abstract)

2007.03634 2020-07-08 cs.LG cs.IR cs.SI stat.ML 78%

PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterest

Aditya Pal, Chantat Eksombatchai, Yitong Zhou, Bo Zhao, Charles Rosenberg, Jure Leskovec

专题命中跨模态检索：multi-modal(title,abstract)

Comments 10 pages, 7 figures

Journal ref KDD 2020

2003.12164 2020-04-09 cs.RO 78%

Representing Multi-Robot Structure through Multimodal Graph Embedding for the Selection of Robot Teams

Brian Reily, Christopher Reardon, Hao Zhang

专题命中跨模态检索：multimodal(title,abstract)

Comments Accepted to International Conference on Robotics and Automation (ICRA) 2020, IEEE copyright

1909.13516 2019-10-01 cs.SE cs.PL 78%

Multi-Modal Attention Network Learning for Semantic Source Code Retrieval

Yao Wan, Jingdong Shu, Yulei Sui, Guandong Xu, Zhou Zhao, Jian Wu, Philip S. Yu

专题命中跨模态检索：multi-modal(title,abstract)

1904.02449 2019-04-05 cs.IR 78%

Triplet-Based Deep Hashing Network for Cross-Modal Retrieval

Cheng Deng, Zhaojia Chen, Xianglong Liu, Xinbo Gao, Dacheng Tao

专题命中跨模态检索：cross-modal(title,abstract)

1903.12019 2019-03-29 cs.LG stat.ML 78%

Multimodal Deep Network Embedding with Integrated Structure and Attribute Information

Conghui Zheng, Li Pan, Peng Wu

专题命中跨模态检索：multimodal(title,abstract)

Comments 15 pages, 10 figures

1903.02149 2019-03-07 cs.IR 78%

Coupled CycleGAN: Unsupervised Hashing Network for Cross-Modal Retrieval

Chao Li, Cheng Deng, Lei Wang, De Xie, Xianglong Liu

专题命中跨模态检索：cross-modal(title,abstract)

1811.11422 2018-11-29 cs.IR 78%

Exploiting "Quantum-like Interference" in Decision Fusion for Ranking Multimodal Documents

Dimitris Gkoumas, Dawei Sogn

专题命中跨模态检索：multimodal(title,abstract)

1802.09729 2018-07-27 cs.IR cs.LG cs.SE 78%

Network-Clustered Multi-Modal Bug Localization

Thong Hoang, Richard J. Oentaryo, Tien-Duy B. Le, David Lo

专题命中跨模态检索：multi-modal(title,abstract)

Comments IEEE Transactions on Software Engineering

1805.12312 2018-06-01 cs.IR 78%

Collaborative Multi-modal deep learning for the personalized product retrieval in Facebook Marketplace

Lu Zheng, Zhao Tan, Kun Han, Ren Mao

专题命中跨模态检索：multi-modal(title,abstract)

Comments 6 pages, 4 figures

1802.00985 2018-02-14 cs.IR 78%

Modeling Text with Graph Convolutional Network for Cross-Modal Information Retrieval

Jing Yu, Yuhang Lu, Zengchang Qin, Yanbing Liu, Jianlong Tan, Li Guo, Weifeng Zhang

专题命中跨模态检索：cross-modal(title,abstract)

Comments 7 pages, 11 figures

1801.02693 2018-01-10 cs.MA cs.DS 78%

Stable Marriage with Multi-Modal Preferences

Jiehua Chen, Rolf Niedermeier, Piotr Skowron

专题命中跨模态检索：multi-modal(title,abstract)

1707.08322 2017-07-27 cs.IR 78%

Discrete Latent Factor Model for Cross-Modal Hashing

Qing-Yuan Jiang, Wu-Jun Li

专题命中跨模态检索：cross-modal(title,abstract)

1608.00134 2017-02-23 cs.IR cs.DB 78%

A Graph Framework for Multimodal Medical Information Processing

Georgios Drakopoulos, Vasileios Megalooikonomou

专题命中跨模态检索：multimodal(title,abstract)

Comments We need to correct certain errors both in the software description as well as in the algorithms

1602.02255 2016-02-16 cs.IR 78%

Deep Cross-Modal Hashing

Qing-Yuan Jiang, Wu-Jun Li

专题命中跨模态检索：cross-modal(title,abstract)

Comments 12 pages

1. 跨模态检索 3475 篇

MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

Information-Theoretic Hashing for Zero-Shot Cross-Modal Retrieval

Multimodal Neural Machine Translation with Search Engine Based Image Retrieval

Multimodal Estimation of End Point Force During Quasi-dynamic and Dynamic Muscle Contractions Using Deep Learning

Understanding Political Polarization via Jointly Modeling Users, Connections and Multimodal Contents on Heterogeneous Graphs

Contrastive Learning for Multi-Modal Automatic Code Review

COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems

Task-adaptive Asymmetric Deep Cross-modal Hashing

Spherical Multi-Modal Place Recognition for Heterogeneous Sensor Systems

X-ray Multimodal Intrinsic-Speckle-Tracking

Learning to Detect Multi-Modal Grasps for Dexterous Grasping in Dense Clutter

Graph2MDA: a multi-modal variational graph embedding model for predicting microbe-drug associations

Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records

Relating by Contrasting: A Data-efficient Framework for Multimodal Generative Models

Cross-Modal Contrastive Learning of Representations for Navigation using Lightweight, Low-Cost Millimeter Wave Radar for Adverse Environmental Conditions

Multi-Modal Retrieval using Graph Neural Networks

PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterest

Representing Multi-Robot Structure through Multimodal Graph Embedding for the Selection of Robot Teams

Multi-Modal Attention Network Learning for Semantic Source Code Retrieval

Triplet-Based Deep Hashing Network for Cross-Modal Retrieval

Multimodal Deep Network Embedding with Integrated Structure and Attribute Information

Coupled CycleGAN: Unsupervised Hashing Network for Cross-Modal Retrieval

Exploiting "Quantum-like Interference" in Decision Fusion for Ranking Multimodal Documents

Network-Clustered Multi-Modal Bug Localization

Collaborative Multi-modal deep learning for the personalized product retrieval in Facebook Marketplace

Modeling Text with Graph Convolutional Network for Cross-Modal Information Retrieval

Stable Marriage with Multi-Modal Preferences

Discrete Latent Factor Model for Cross-Modal Hashing

A Graph Framework for Multimodal Medical Information Processing

Deep Cross-Modal Hashing