arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 9204 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态评测 9204 篇

2306.14125 2023-06-27 eess.SP 78%

M$^3$SC: A Generic Dataset for Mixed Multi-Modal (MMM) Sensing and Communication Integration

Xiang Cheng, Ziwei Huang, Lu Bai, Haotian Zhang, Mingran Sun, Boxun Liu, Sijiang Li, Jianan Zhang, Minson Lee

专题命中 多模态评测 :multi-modal(title,abstract)

Comments 12 pages, 12 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.13076 2023-06-23 cs.LG 78%

A Comparison of Time-based Models for Multimodal Emotion Recognition

Ege Kesim, Selahattin Serdar Helli, Sena Nur Cavsak

专题命中 多模态评测 :multimodal(title);multi-modal(abstract)

Comments in Turkish language

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.12705 2023-06-23 cs.RO 78%

Multimodal Zero-Shot Learning for Tactile Texture Recognition

Guanqun Cao, Jiaqi Jiang, Danushka Bollegala, Min Li, Shan Luo

专题命中 多模态评测 :multimodal(title,abstract)

Comments Under review at Robotics and Autonomous Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.09486 2023-06-22 cs.DC cs.LG 78%

FedMultimodal: A Benchmark For Multimodal Federated Learning

Tiantian Feng, Digbalay Bose, Tuo Zhang, Rajat Hebbar, Anil Ramakrishna, Rahul Gupta, Mi Zhang, Salman Avestimehr, Shrikanth Narayanan

专题命中 多模态评测 :multimodal(title,abstract)

Comments This paper was accepted to KDD 2023 Applied Data Science (ADS) track

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.08871 2023-06-16 cs.SI cs.CY 78%

Med-MMHL: A Multi-Modal Dataset for Detecting Human- and LLM-Generated Misinformation in the Medical Domain

Yanshen Sun, Jianfeng He, Shuo Lei, Limeng Cui, Chang-Tien Lu

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.08522 2023-06-16 cs.RO 78%

Challenges of Indoor SLAM: A multi-modal multi-floor dataset for SLAM evaluation

Pushyami Kaveti, Aniket Gupta, Dennis Giaya, Madeline Karp, Colin Keil, Jagatpreet Nir, Zhiyong Zhang, Hanumant Singh

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.15266 2023-06-06 cs.CR cs.LG 78%

Data Poisoning Attacks Against Multimodal Encoders

Ziqing Yang, Xinlei He, Zheng Li, Michael Backes, Mathias Humbert, Pascal Berrang, Yang Zhang

专题命中 多模态评测 :multimodal(title,abstract)

Comments To Appear in the 40th International Conference on Machine Learning, July 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.01492 2023-06-05 cs.SE 78%

Multi-Modal Emotion Recognition for Enhanced Requirements Engineering: A Novel Approach

Ben Cheng, Chetan Arora, Xiao Liu, Thuong Hoang, Yi Wang, John Grundy

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.00517 2023-05-02 cs.HC 78%

Multimodal Earable Sensing for Human Energy Expenditure Estimation

Yasith Amarasinghe, Darshana Sandaruwan, Thilina Madusanka, Indika Perera, Lakmal Meegahapola

专题命中 多模态评测 :multimodal(title,abstract)

Comments IEEE EMBC 2023 (45th Annual International Conference of the IEEE Engineering in Medicine and Biology Society)

详情

展开后加载摘要…

URL PDF HTML 收藏
2304.11764 2023-04-25 cs.RO cs.SY eess.SY 78%

Learning-enabled multi-modal motion prediction in urban environments

Vinicius Trentin, Chenxu Ma, Jorge Villagra, Zaid Al-Ars

专题命中 多模态评测 :multi-modal(title,abstract)

Comments Accepted for publication at the IEEE Intelligent Vehicle Symposium 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.05935 2023-04-05 cs.CV cs.AI cs.CL 78%

Hierarchical multimodal transformers for Multi-Page DocVQA

Rubèn Tito, Dimosthenis Karatzas, Ernest Valveny

专题命中 多模态评测 :multimodal(title);分类 cs.CV、cs.CL、cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2304.00584 2023-04-04 cs.RO 78%

An End-to-End Human Simulator for Task-Oriented Multimodal Human-Robot Collaboration

Afagh Mehri Shervedani, Siyu Li, Natawut Monaikul, Bahareh Abbasi, Barbara Di Eugenio, Milos Zefran

专题命中 多模态评测 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.07742 2023-03-15 cs.LG cs.HC eess.SP 78%

ForDigitStress: A multi-modal stress dataset employing a digital job interview scenario

Alexander Heimerl, Pooja Prajod, Silvan Mertes, Tobias Baur, Matthias Kraus, Ailin Liu, Helen Risack, Nicolas Rohleder, Elisabeth André, Linda Becker

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.07682 2023-03-07 cs.LG cs.RO 78%

Masked Imitation Learning: Discovering Environment-Invariant Modalities in Multimodal Demonstrations

Yilun Hao, Ruinan Wang, Zhangjie Cao, Zihan Wang, Yuchen Cui, Dorsa Sadigh

专题命中 多模态评测 :multimodal(title,abstract)

Comments 13 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.00423 2023-03-02 cs.HC cs.RO 78%

Multiperspective Teaching of Unknown Objects via Shared-gaze-based Multimodal Human-Robot Interaction

Daniel Weber, Wolfgang Fuhl, Enkelejda Kasneci, Andreas Zell

专题命中 多模态评测 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2002.09283 2023-02-24 cs.DL cs.LG q-bio.NC 78%

MODMA dataset: a Multi-modal Open Dataset for Mental-disorder Analysis

Hanshu Cai, Yiwen Gao, Shuting Sun, Na Li, Fuze Tian, Han Xiao, Jianxiu Li, Zhengwu Yang, Xiaowei Li, Qinglin Zhao, Zhenyu Liu, Zhijun Yao, Minqiang Yang, Hong Peng, Jing Zhu, Xiaowei Zhang, Guoping Gao, Fang Zheng, Rui Li, Zhihua Guo, Rong Ma, Jing Yang, Lan Zhang, Xiping Hu, Yumin Li, Bin Hu

专题命中 多模态评测 :multi-modal(title,abstract)

Journal ref Sci Data 9, 178 (2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.16875 2023-02-14 cs.RO 78%

A Multi-modal Deformable Land-air Robot for Complex Environments

Xinyu Zhang, Yuanhao Huang, Kangyao Huang, Xiaoyu Wang, Dafeng Jin, Huaping Liu, Jun Li

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.05250 2023-02-13 eess.SY cs.SY 78%

Optimized utilization of decentral flexibility for the operational management of cellular multi-modal distribution grids

Béla Wiegel, Lando Helmrich von Elgott, Davood Babazadeh, Christian Becker

专题命中 多模态评测 :multi-modal(title,abstract)

Comments Submitted to VDE ETG Congress 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.02965 2023-02-01 physics.geo-ph physics.flu-dyn 78%

Evaluation of a general model for multimodal unsaturated soil hydraulic properties

Katsutoshi Seki, Nobuo Toride, Martinus Th. van Genuchten

专题命中 多模态评测 :multimodal(title,abstract)

Journal ref Journal of Hydrology and Hydromechanics, 71, 2023, 1, 22-34

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.14574 2023-01-02 cs.RO 78%

X-MAS: Extremely Large-Scale Multi-Modal Sensor Dataset for Outdoor Surveillance in Real Environments

DongKi Noh, Changki Sung, Teayoung Uhm, WooJu Lee, Hyungtae Lim, Jaeseok Choi, Kyuewang Lee, Dasol Hong, Daeho Um, Inseop Chung, Hochul Shin, MinJung Kim, Hyoung-Rock Kim, SeungMin Baek, Hyun Myung

专题命中 多模态评测 :multi-modal(title,abstract)

Comments 8 pages, 13 figures, IEEE Robotics and Automation Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.10425 2022-12-21 cs.RO 78%

Evaluating Multimodal Interaction of Robots Assisting Older Adults

Afagh Mehri Shervedani, Ki-Hwan Oh, Bahareh Abbasi, Natawut Monaikul, Zhanibek Rysbek, Barbara Di Eugenio, Milos Zefran

专题命中 多模态评测 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.08102 2022-12-19 physics.ao-ph cs.LG math.OC 78%

A Multi-Modal Machine Learning Approach to Detect Extreme Rainfall Events in Sicily

Eleonora Vitanza, Giovanna Maria Dimitri, Chiara Mocenni

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.05489 2022-12-13 cs.HC 78%

AliCHI: A Large-scale Multi-modal Dataset and Automated Evaluation Tool for Human-like Dialogue Systems

Zhiling Luo, Qiankun Shi, Sha Zhao, Wei Zhou, Haiqing Chen, Yuankai Ma, Haitao Leng

专题命中 多模态评测 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.02689 2022-12-07 cs.HC 78%

Visual Area of Interests based Multimodal Trajectory Prediction for Probabilistic Risk Assessment

Qiang Zhang, Lingfang Yang, Xiaoliang Zhang, Xiaolin Song, Zhi Huang

专题命中 多模态评测 :multimodal(title,abstract)

Comments 11 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.02334 2022-12-06 eess.SP 78%

Estimating Multi-Modal Dense Multipath Components using Auto-Encoders

Steffen Schieler, Michael Döbereiner, Sebastian Semper, Markus Landmann

专题命中 多模态评测 :multi-modal(title,abstract)

Comments https://ieeexplore.ieee.org/document/9909796

Journal ref 2022 30th European Signal Processing Conference (EUSIPCO), INSPEC Accession Number: 22235512

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.08042 2022-11-16 cs.IR 78%

MM-Locate-News: Multimodal Focus Location Estimation in News

Golsa Tahmasebzadeh, Eric Müller-Budack, Sherzod Hakimov, Ralph Ewerth

专题命中 多模态评测 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.07089 2022-11-15 cs.LG 78%

PMR: Prototypical Modal Rebalance for Multimodal Learning

Yunfeng Fan, Wenchao Xu, Haozhao Wang, Junxiao Wang, Song Guo

专题命中 多模态评测 :multimodal(title,abstract)

Comments 10 pages,4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.05230 2022-11-11 physics.med-ph 78%

Multimodal Optical Techniques in Pre-Clinical Evaluation of Oral Cancer: Fluorescence Imaging and Spectroscopic Devices

Pramila Thapa, Veena Singh, Virendra Kumar, Sunil Bhatt, Kiran Maurya, Vivek Nayyar, Kiran Jot, Deepika Mishra, Anurag Shrivastava, Dalip Singh Mehta

专题命中 多模态评测 :multimodal(title);multi-modal(abstract)

Comments 12 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.01871 2022-11-10 physics.geo-ph cs.LG 78%

Direct multi-modal inversion of geophysical logs using deep learning

Sergey Alyaev, Ahmed H. Elsheikh

专题命中 多模态评测 :multi-modal(title,abstract)

Comments Submitted to Earth and Space Science

Journal ref Earth and Space Science, 9, e2021EA002186 (2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.09761 2022-10-19 cs.HC 78%

Personality-adapted multimodal dialogue system

Tamotsu Miyama, Shogo Okada

专题命中 多模态评测 :multimodal(title,abstract)

Comments This paper is part of the proceedings of the Dialogue Robot Competition 2022

详情

展开后加载摘要…

URL PDF HTML 收藏