多模态大模型 - arXivDaily 专题

2403.16645 2024-03-26 cs.HC 78%

Virtual Co-Pilot: Multimodal Large Language Model-enabled Quick-access Procedures for Single Pilot Operations

Fan Li, Shanshan Feng, Yuqi Yan, Ching-Hung Lee, Yew Soon Ong

专题命中跨模态检索：multimodal(title,abstract)

Comments 10 pages,7 figures

2310.04971 2024-03-19 cs.LG 78%

Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift

Yihao Xue, Siddharth Joshi, Dang Nguyen, Baharan Mirzasoleiman

专题命中跨模态检索：multi-modal(title)；multimodal(abstract)

2402.03635 2024-02-07 cs.IR 78%

Retrieval Augmented Cross-Modal Tag Recommendation in Software Q&A Sites

Sijin Lu, Pengyu Xu, Bing Liu, Hongjian Sun, Liping Jing, Jian Yu

专题命中跨模态检索：cross-modal(title,abstract)

2402.02357 2024-02-07 cs.LG stat.ME 78%

Multi-modal Causal Structure Learning and Root Cause Analysis

Lecheng Zheng, Zhengzhang Chen, Jingrui He, Haifeng Chen

专题命中跨模态检索：multi-modal(title,abstract)

Comments Accepted by the Web Conference 2024

2401.10464 2024-01-22 cs.HC 78%

PhotoScout: Synthesis-Powered Multi-Modal Image Search

Celeste Barnaby, Qiaochu Chen, Chenglong Wang, Isil Dillig

专题命中跨模态检索：multi-modal(title,abstract)

2312.16194 2023-12-29 physics.geo-ph 78%

Multimodal machine learning for 3-dimensional characterization of hidden groundwater and geothermal resources

Michael J. Friedel, Nicole Lautze, Erin Wallin, Roland Gritto, Alain Bonneville, Massimo Buscema, Steve Martel

专题命中跨模态检索：multimodal(title,abstract)

Comments 29 figures, 7 tables

2312.06397 2023-12-12 cs.DB cs.IR 78%

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

Mengzhao Wang, Xiangyu Ke, Xiaoliang Xu, Lu Chen, Yunjun Gao, Pinpin Huang, Runkai Zhu

专题命中跨模态检索：multimodal(title,abstract)

Comments This paper has been accepted by ICDE 2024

2310.18951 2023-10-31 cs.IR 78%

A Multimodal Ecological Civilization Pattern Recommendation Method Based on Large Language Models and Knowledge Graph

Zhihang Yu, Shu Wang, Yunqiang Zhu, Zhiqiang Zou

专题命中跨模态检索：multimodal(title,abstract)

2310.11612 2023-10-19 cs.LG 78%

Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks

Yimu Wang, Xiangru Jian, Bo Xue

专题命中跨模态检索：cross-modal(title,abstract)

Comments Accepted by EMNLP 2023

2310.08270 2023-10-13 cs.RO 78%

Hilbert Space Embedding-based Trajectory Optimization for Multi-Modal Uncertain Obstacle Trajectory Prediction

Basant Sharma, Aditya Sharma, K. Madhava Krishna, Arun Kumar Singh

专题命中跨模态检索：multi-modal(title,abstract)

2310.01762 2023-10-04 cs.LG cs.DS math.ST stat.TH 78%

Sampling Multimodal Distributions with the Vanilla Score: Benefits of Data-Based Initialization

Frederic Koehler, Thuy-Duong Vuong

专题命中跨模态检索：multimodal(title,abstract)

2309.17037 2023-10-02 cs.IR 78%

Beyond Co-occurrence: Multi-modal Session-based Recommendation

Xiaokun Zhang, Bo Xu, Fenglong Ma, Chenliang Li, Liang Yang, Hongfei Lin

专题命中跨模态检索：multi-modal(title,abstract)

Comments This paper has been accepted by TKDE 2023

2308.14786 2023-08-30 cs.IR cs.HC 78%

Extending Cross-Modal Retrieval with Interactive Learning to Improve Image Retrieval Performance in Forensics

Nils Böhne, Mark Berger, Ronald van Velzen

专题命中跨模态检索：cross-modal(title,abstract)

Comments Submitted to the AAAI22 conference

2308.13820 2023-08-29 cs.IR 78%

Video and Audio are Images: A Cross-Modal Mixer for Original Data on Video-Audio Retrieval

Zichen Yuan, Qi Shen, Bingyi Zheng, Yuting Liu, Linying Jiang, Guibing Guo

专题命中跨模态检索：cross-modal(title,abstract)

2308.04579 2023-08-10 cs.IR cs.LG 78%

RECipe: Does a Multi-Modal Recipe Knowledge Graph Fit a Multi-Purpose Recommendation System?

Ali Pesaranghader, Touqir Sajed

专题命中跨模态检索：multi-modal(title,abstract)

Comments 19 pages, 8 figures, 8 tables

2307.09018 2023-07-21 q-bio.QM cs.LG 78%

Multimodal LLMs for health grounded in individual-specific data

Anastasiya Belyaeva, Justin Cosentino, Farhad Hormozdiari, Krish Eswaran, Shravya Shetty, Greg Corrado, Andrew Carroll, Cory Y. McLean, Nicholas A. Furlotte

专题命中跨模态检索：multimodal(title,abstract)

2212.06573 2023-07-10 cs.SI cs.CR cs.CY cs.LG 78%

On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning

Yiting Qu, Xinlei He, Shannon Pierson, Michael Backes, Yang Zhang, Savvas Zannettou

专题命中跨模态检索：multimodal(title,abstract)

Comments To Appear in the 44th IEEE Symposium on Security and Privacy, May 22-25, 2023

2302.10512 2023-06-01 cs.SE 78%

Robust Failure Diagnosis of Microservice System through Multimodal Data

Shenglin Zhang, Pengxiang Jin, Zihan Lin, Yongqian Sun, Bicheng Zhang, Sibo Xia, Zhengdan Li, Zhenyu Zhong, Minghua Ma, Wa Jin, Dai Zhang, Zhenyu Zhu, Dan Pei

专题命中跨模态检索：multimodal(title,abstract)

2212.11261 2023-05-17 cs.CY cs.AI cs.CL cs.CV cs.LG 78%

Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias

Robert Wolfe, Yiwei Yang, Bill Howe, Aylin Caliskan

专题命中跨模态检索：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments 12 pages, 4 figures, 2 tables

Journal ref ACM FAccT 2023

2305.02504 2023-05-05 cs.LG 78%

Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention

Kwanhyung Lee, Soojeong Lee, Sangchul Hahn, Heejung Hyun, Edward Choi, Byungeun Ahn, Joohyung Lee

专题命中跨模态检索：multi-modal(title,abstract)

Comments MLHC 2023, Under Review

2305.01245 2023-05-03 cs.CR cs.LG 78%

MDENet: Multi-modal Dual-embedding Networks for Malware Open-set Recognition

Jingcai Guo, Yuanyuan Xu, Wenchao Xu, Yufeng Zhan, Yuxia Sun, Song Guo

专题命中跨模态检索：multi-modal(title,abstract)

Comments 14 pages, 7 figures

2207.05969 2023-05-02 cs.IR 78%

Bootstrap Latent Representations for Multi-modal Recommendation

Xin Zhou, Hongyu Zhou, Yong Liu, Zhiwei Zeng, Chunyan Miao, Pengwei Wang, Yuan You, Feijun Jiang

专题命中跨模态检索：multi-modal(title,abstract)

Comments Accepted by Proceedings of the ACM Web Conference 2023 (WWW'23)

2304.13277 2023-04-27 cs.IR 78%

Self-Supervised Multi-Modal Sequential Recommendation

Kunzhe Song, Qingfeng Sun, Can Xu, Kai Zheng, Yaming Yang

专题命中跨模态检索：multi-modal(title,abstract)

2304.12608 2023-04-27 cs.IR 78%

OFAR: A Multimodal Evidence Retrieval Framework for Illegal Live-streaming Identification

Lin Dengtian, Ma Yang, Li Yuhong, Song Xuemeng, Wu Jianlong, Nie Liqiang

专题命中跨模态检索：multimodal(title,abstract)

2303.14267 2023-03-28 cs.LG 78%

A Self-supervised Framework for Improved Data-Driven Monitoring of Stress via Multi-modal Passive Sensing

Shayan Fazeli, Lionel Levine, Mehrab Beikzadeh, Baharan Mirzasoleiman, Bita Zadeh, Tara Peris, Majid Sarrafzadeh

专题命中跨模态检索：multi-modal(title,abstract)

2303.09166 2023-03-17 cs.LG stat.ML 78%

Identifiability Results for Multimodal Contrastive Learning

Imant Daunhawer, Alice Bizeul, Emanuele Palumbo, Alexander Marx, Julia E. Vogt

专题命中跨模态检索：multimodal(title,abstract)

Comments ICLR 2023 camera-ready version

2302.06232 2023-03-16 cs.LG stat.ML 78%

Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data

Ryumei Nakada, Halil Ibrahim Gulluk, Zhun Deng, Wenlong Ji, James Zou, Linjun Zhang

专题命中跨模态检索：multimodal(title,abstract)

Comments 42 pages, 3 figures, accepted by AISTATS 2023; a link to GitHub repository added, style corrected, acknowledgements section added

2209.00179 2023-02-07 cs.IR 78%

Universal Vision-Language Dense Retrieval: Learning A Unified Representation Space for Multi-Modal Retrieval

Zhenghao Liu, Chenyan Xiong, Yuanhuiyi Lv, Zhiyuan Liu, Ge Yu

专题命中跨模态检索：multi-modal(title,abstract)

Comments Accepted by ICLR 2023

2210.15377 2023-01-10 cs.IR cs.AI cs.CL cs.CV cs.LG 78%

Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis

Miriam Anschütz, Tobias Eder, Georg Groh

专题命中跨模态检索：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments 8 pages, 5 figures, published at 2023 IEEE 17th International Conference on Semantic Computing (ICSC)

2211.06378 2022-11-14 q-fin.ST 78%

A Multimodal Embedding-Based Approach to Industry Classification in Financial Markets

Rian Dolphin, Barry Smyth, Ruihai Dong

专题命中跨模态检索：multimodal(title,abstract)

Comments 8 pages. Accepted at AICS 2022 under title "A Machine Learning Approach to Industry Classification in Financial Markets". Preliminary version under this title was discussed at ICAIF '22 Workshop on NLP and Network Analysis in Financial Applications. arXiv admin note: text overlap with arXiv:2202.08968

1. 跨模态检索 3475 篇

Virtual Co-Pilot: Multimodal Large Language Model-enabled Quick-access Procedures for Single Pilot Operations

Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift

Retrieval Augmented Cross-Modal Tag Recommendation in Software Q&A Sites

Multi-modal Causal Structure Learning and Root Cause Analysis

PhotoScout: Synthesis-Powered Multi-Modal Image Search

Multimodal machine learning for 3-dimensional characterization of hidden groundwater and geothermal resources

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

A Multimodal Ecological Civilization Pattern Recommendation Method Based on Large Language Models and Knowledge Graph

Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks

Hilbert Space Embedding-based Trajectory Optimization for Multi-Modal Uncertain Obstacle Trajectory Prediction

Sampling Multimodal Distributions with the Vanilla Score: Benefits of Data-Based Initialization

Beyond Co-occurrence: Multi-modal Session-based Recommendation

Extending Cross-Modal Retrieval with Interactive Learning to Improve Image Retrieval Performance in Forensics

Video and Audio are Images: A Cross-Modal Mixer for Original Data on Video-Audio Retrieval

RECipe: Does a Multi-Modal Recipe Knowledge Graph Fit a Multi-Purpose Recommendation System?

Multimodal LLMs for health grounded in individual-specific data

On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning

Robust Failure Diagnosis of Microservice System through Multimodal Data

Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias

Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention

MDENet: Multi-modal Dual-embedding Networks for Malware Open-set Recognition

Bootstrap Latent Representations for Multi-modal Recommendation

Self-Supervised Multi-Modal Sequential Recommendation

OFAR: A Multimodal Evidence Retrieval Framework for Illegal Live-streaming Identification

A Self-supervised Framework for Improved Data-Driven Monitoring of Stress via Multi-modal Passive Sensing

Identifiability Results for Multimodal Contrastive Learning

Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data

Universal Vision-Language Dense Retrieval: Learning A Unified Representation Space for Multi-Modal Retrieval

Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis

A Multimodal Embedding-Based Approach to Industry Classification in Financial Markets