多模态大模型 - arXivDaily 专题

2411.05212 2024-11-11 cs.RO 78%

RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model

Jinxuan Xu, Shiyu Jin, Yutian Lei, Yuqian Zhang, Liangjun Zhang

专题命中多模态评测：multi-modal(title,abstract)

Comments Accepted to IROS 2024

2411.04508 2024-11-08 cs.HC cs.CY 78%

A Comprehensive Review of Multimodal XR Applications, Risks, and Ethical Challenges in the Metaverse

Panagiotis Kourtesis

专题命中多模态评测：multimodal(title,abstract)

Comments 43 Pages, 1 Figure, 3 Tables

Journal ref Interact. 2024, 8, 98

2411.04016 2024-11-07 cs.LG 78%

Multi-Scale and Multimodal Species Distribution Modeling

Nina van Tiel, Robin Zbinden, Emanuele Dalsasso, Benjamin Kellenberger, Loïc Pellissier, Devis Tuia

专题命中多模态评测：multimodal(title,abstract)

Comments Published at the CV4Ecology workshop at ECCV 2024 (https://cv4e.netlify.app/papers/06.pdf)

2411.02938 2024-11-06 cs.RO 78%

Multi-Modal 3D Scene Graph Updater for Shared and Dynamic Environments

Emilio Olivastri, Jonathan Francis, Alberto Pretto, Niko Sünderhauf, Krishan Rana

专题命中多模态评测：multi-modal(title)；multimodal(abstract)

Comments This paper has been accepted at the Workshop on Lifelong Learning for Home Robots at the 8th Conference on Robot Learning (CoRL 2024), Munich, Germany

2309.04177 2024-11-05 physics.app-ph 78%

Generative inverse design of multimodal resonant structures for locally resonant metamaterials

Sander Dedoncker, Christian Donner, Raphael Bischof, Linus Taenzer, Bart Van Damme

专题命中多模态评测：multimodal(title,abstract)

2411.00780 2024-11-05 cs.IR 78%

Proactive Detection and Calibration of Seasonal Advertisements with Multimodal Large Language Models

Hamid Eghbalzadeh, Shuai Shao, Saurabh Verma, Venugopal Mani, Hongnan Wang, Jigar Madia, Vitali Karpinchyk, Andrey Malevich

专题命中多模态评测：multimodal(title,abstract)

2410.20680 2024-10-29 eess.SP cs.LG 78%

Multi-modal Data based Semi-Supervised Learning for Vehicle Positioning

Ouwen Huan, Yang Yang, Tao Luo, Mingzhe Chen

专题命中多模态评测：multi-modal(title,abstract)

2403.06705 2024-10-27 cs.RO 78%

Multimodal Transformers for Real-Time Surgical Activity Prediction

Keshara Weerasinghe, Seyed Hamid Reza Roodabeh, Kay Hutchinson, Homa Alemzadeh

专题命中多模态评测：multimodal(title,abstract)

Comments This work has been submitted to the IEEE for possible publication

2407.05131 2024-10-18 cs.LG cs.AI cs.CL cs.CV cs.CY 78%

RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

Peng Xia, Kangyu Zhu, Haoran Li, Hongtu Zhu, Yun Li, Gang Li, Linjun Zhang, Huaxiu Yao

专题命中多模态评测：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments EMNLP 2024 main

2402.16872 2024-10-18 cs.IR 78%

NFT1000: A Cross-Modal Dataset for Non-Fungible Token Retrieval

Shuxun Wang, Yunfei Lei, Ziqi Zhang, Wei Liu, Haowei Liu, Li Yang, Wenjuan Li, Bing Li, Weiming Hu

专题命中多模态评测：cross-modal(title)；image-text(abstract)

Comments 11 pages,12figures to be published in ACM Multimedia 2024, see https://openreview.net/forum?id=xUtNrKH8iB&noteId=xUtNrKH8iB

2402.06798 2024-10-16 cs.RO 78%

Reasoning Grasping via Multimodal Large Language Model

Shiyu Jin, Jinxuan Xu, Yutian Lei, Liangjun Zhang

专题命中多模态评测：multimodal(title,abstract)

Comments CoRL 2024

2410.08479 2024-10-14 cs.CE 78%

Cyber-physical and business perspectives using Federated Digital Twins in multinational and multimodal transportation systems

Ricardo M. Czekster, Alexeis Garcia Perez, Manolya Kavakli-Thorne, Seif Allah El Mesloul Nasri, Siraj Shaikh

专题命中多模态评测：multimodal(title,abstract)

2406.19072 2024-10-10 eess.SP 78%

Scatterer Recognition for Multi-Modal Intelligent Vehicular Channel Modeling via Synesthesia of Machines

Ziwei Huang, Lu Bai, Zengrui Han, Xiang Cheng

专题命中多模态评测：multi-modal(title,abstract)

2410.03265 2024-10-08 cs.IR cs.SI 78%

Multimodal Point-of-Interest Recommendation

Yuta Kanzawa, Toyotaro Suzumura, Hiroki Kanezashi, Jiawei Yong, Shintaro Fukushima

专题命中多模态评测：multimodal(title,abstract)

2409.13863 2024-09-24 eess.IV 78%

Unsupervised Learning of Multi-modal Affine Registration for PET/CT

Junyu Chen, Yihao Liu, Shuwen Wei, Aaron Carass, Yong Du

专题命中多模态评测：multi-modal(title,abstract)

Comments Accepted by IEEE NSS/MIC/RTSD'24 ((c) IEEE). Code available at https://github.com/junyuchen245/Correlation_Ratio

2209.03048 2024-09-18 cs.LG 78%

Benchmarking Multimodal Variational Autoencoders: CdSprites+ Dataset and Toolkit

Gabriela Sejnova, Michal Vavrecka, Karla Stepanova, Tadahiro Taniguchi

专题命中多模态评测：multimodal(title,abstract)

2409.10244 2024-09-17 cs.SI 78%

ES-KT-24: A Multimodal Knowledge Tracing Benchmark Dataset with Educational Game Playing Video and Synthetic Text Generation

Dohee Kim, Unggi Lee, Sookbun Lee, Jiyeong Bae, Taekyung Ahn, Jaekwon Park, Gunho Lee, Hyeoncheol Kim

专题命中多模态评测：multimodal(title,abstract)

Comments 11 pages, 5 figures

2409.09811 2024-09-17 cs.LG cs.NA math.NA physics.flu-dyn 78%

PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamics

Yuxuan Liu, Jingmin Sun, Xinjie He, Griffin Pinney, Zecheng Zhang, Hayden Schaeffer

专题命中多模态评测：multimodal(title,abstract)

2409.07322 2024-09-12 cs.LG eess.IV 78%

Three-Dimensional, Multimodal Synchrotron Data for Machine Learning Applications

Calum Green, Sharif Ahmed, Shashidhara Marathe, Liam Perera, Alberto Leonardi, Killian Gmyrek, Daniele Dini, James Le Houx

专题命中多模态评测：multimodal(title,abstract)

Comments 9 pages, 4 figures. Image Processing and Artificial Intelligence Conference, 2024

2409.06341 2024-09-11 eess.SP 78%

A Wearable Multi-Modal Edge-Computing System for Real-Time Kitchen Activity Recognition

Mengxi Liu, Sungho Suh, Juan Felipe Vargas, Bo Zhou, Agnes Grünerbl, Paul Lukowicz

专题命中多模态评测：multi-modal(title,abstract)

Comments the paper was accepted by the IJCAI24 workshp (4th International Workshop on Deep Learning for Human Activity Recognition)

2409.04123 2024-09-09 eess.IV 78%

Feature Compression for Cloud-Edge Multimodal 3D Object Detection

Chongzhen Tian, Zhengxin Li, Hui Yuan, Raouf Hamzaoui, Liquan Shen, Sam Kwong

专题命中多模态评测：multimodal(title,abstract)

2408.13402 2024-09-04 cs.LG 78%

LLaVaOLMoBitnet1B: Ternary LLM goes Multimodal!

Jainaveen Sundaram, Ravi Iyer

专题命中多模态评测：multimodal(title,abstract)

2408.06002 2024-08-13 cs.RO 78%

Generative Design of Multimodal Soft Pneumatic Actuators

Saswath Ghosh, Sitikantha Roy

专题命中多模态评测：multimodal(title,abstract)

2408.04276 2024-08-09 cs.LG 78%

Early Risk Assessment Model for ICA Timing Strategy in Unstable Angina Patients Using Multi-Modal Machine Learning

Candi Zheng, Kun Liu, Yang Wang, Shiyi Chen, Hongli Li

专题命中多模态评测：multi-modal(title,abstract)

2407.09064 2024-08-07 cs.IR cs.LG 78%

Multi-Modal Dataset Creation for Federated Learning with DICOM Structured Reports

Malte Tölle, Lukas Burger, Halvar Kelm, Florian André, Peter Bannas, Gerhard Diller, Norbert Frey, Philipp Garthe, Stefan Groß, Anja Hennemuth, Lars Kaderali, Nina Krüger, Andreas Leha, Simon Martin, Alexander Meyer, Eike Nagel, Stefan Orwat, Clemens Scherer, Moritz Seiffert, Jan Moritz Seliger, Stefan Simm, Tim Friede, Tim Seidler, Sandy Engelhardt

专题命中多模态评测：multi-modal(title,abstract)

2403.10221 2024-08-06 cs.MA 78%

V2AIX: A Multi-Modal Real-World Dataset of ETSI ITS V2X Messages in Public Road Traffic

Guido Kueppers, Jean-Pierre Busch, Lennart Reiher, Lutz Eckstein

专题命中多模态评测：multi-modal(title,abstract)

Comments 7 pages; Accepted to be published as part of the 27th International Conference on Intelligent Transportation Systems (ITSC), Edmonton, Canada, September 24-27, 2024

2408.00129 2024-08-02 cs.CR cs.LG 78%

Vera Verto: Multimodal Hijacking Attack

Minxing Zhang, Ahmed Salem, Michael Backes, Yang Zhang

专题命中多模态评测：multimodal(title,abstract)

2310.19967 2024-08-01 cs.LG 78%

Early detection of inflammatory arthritis to improve referrals using multimodal machine learning from blood testing, semi-structured and unstructured patient records

Bing Wang, Weizi Li, Anthony Bradlow, Antoni T. Y. Chan, Eghosa Bazuaye

专题命中多模态评测：multimodal(title,abstract)

Comments We found some issues in data preprocessing, which will impact the final result. Therefore we would like to withdraw the paper

2407.19728 2024-07-30 cs.HC cs.CY 78%

PersonalityScanner: Exploring the Validity of Personality Assessment Based on Multimodal Signals in Virtual Reality

Xintong Zhang, Di Lu, Huiqi Hu, Nan Jiang, Xianhao Yu, Jinan Xu, Yujia Peng, Qing Li, Wenjuan Han

专题命中多模态评测：multimodal(title)；multi-modal(abstract)

Comments Accepted to COGSCI 2024

2312.00935 2024-07-30 cs.LG 78%

Understanding Unimodal Bias in Multimodal Deep Linear Networks

Yedi Zhang, Peter E. Latham, Andrew Saxe

专题命中多模态评测：multimodal(title,abstract)

Comments ICML 2024 camera ready

1. 多模态评测 9204 篇

RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model

A Comprehensive Review of Multimodal XR Applications, Risks, and Ethical Challenges in the Metaverse

Multi-Scale and Multimodal Species Distribution Modeling

Multi-Modal 3D Scene Graph Updater for Shared and Dynamic Environments

Generative inverse design of multimodal resonant structures for locally resonant metamaterials

Proactive Detection and Calibration of Seasonal Advertisements with Multimodal Large Language Models

Multi-modal Data based Semi-Supervised Learning for Vehicle Positioning

Multimodal Transformers for Real-Time Surgical Activity Prediction

RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

NFT1000: A Cross-Modal Dataset for Non-Fungible Token Retrieval

Reasoning Grasping via Multimodal Large Language Model

Cyber-physical and business perspectives using Federated Digital Twins in multinational and multimodal transportation systems

Scatterer Recognition for Multi-Modal Intelligent Vehicular Channel Modeling via Synesthesia of Machines

Multimodal Point-of-Interest Recommendation

Unsupervised Learning of Multi-modal Affine Registration for PET/CT

Benchmarking Multimodal Variational Autoencoders: CdSprites+ Dataset and Toolkit

ES-KT-24: A Multimodal Knowledge Tracing Benchmark Dataset with Educational Game Playing Video and Synthetic Text Generation

PROSE-FD: A Multimodal PDE Foundation Model for Learning Multiple Operators for Forecasting Fluid Dynamics

Three-Dimensional, Multimodal Synchrotron Data for Machine Learning Applications

A Wearable Multi-Modal Edge-Computing System for Real-Time Kitchen Activity Recognition

Feature Compression for Cloud-Edge Multimodal 3D Object Detection

LLaVaOLMoBitnet1B: Ternary LLM goes Multimodal!

Generative Design of Multimodal Soft Pneumatic Actuators

Early Risk Assessment Model for ICA Timing Strategy in Unstable Angina Patients Using Multi-Modal Machine Learning

Multi-Modal Dataset Creation for Federated Learning with DICOM Structured Reports

V2AIX: A Multi-Modal Real-World Dataset of ETSI ITS V2X Messages in Public Road Traffic

Vera Verto: Multimodal Hijacking Attack

Early detection of inflammatory arthritis to improve referrals using multimodal machine learning from blood testing, semi-structured and unstructured patient records

PersonalityScanner: Exploring the Validity of Personality Assessment Based on Multimodal Signals in Virtual Reality

Understanding Unimodal Bias in Multimodal Deep Linear Networks