多模态大模型

Loneliness Forecasting Using Multi-modal Wearable and Mobile Sensing in Everyday Settings

Zhongqi Yang, Iman Azimi, Salar Jafarlou, Sina Labbaf, Brenda Nguyen, Hana Qureshi, Christopher Marcotullio, Jessica L. Borelli, Nikil Dutt, Amir M. Rahmani

专题命中 多模态评测 ：multi-modal(title)

Journal ref 2023 IEEE 19th International Conference on Body Sensor Networks (BSN), 1-4

Examining the physical and psychological effects of combining multimodal feedback with continuous control in prosthetic hands

Digby Chappell, Zeyu Yang, Angus B. Clark, Alexandre Berkovic, Colin Laganier, Weston Baxter, Fernando Bello, Petar Kormushev, Nicolas Rojas

专题命中 多模态评测 ：multimodal(title)

Comments 17 pages, 5 figures, 1 table. Submitted to Scientific Reports

ProtSolM: Protein Solubility Prediction with Multi-modal Features

Yang Tan, Jia Zheng, Liang Hong, Bingxin Zhou

专题命中 多模态评测 ：multi-modal(title)

Comments 10 pages, 7 figures, 9 tables

The OxMat dataset: a multimodal resource for the development of AI-driven technologies in maternal and newborn child health

M. Jaleed Khan, Ioana Duta, Beth Albert, William Cooke, Manu Vatish, Gabriel Davis Jones

专题命中 多模态评测 ：multimodal(title)

CognitiveOS: Large Multimodal Model based System to Endow Any Type of Robot with Generative AI

Artem Lykov, Mikhail Konenkov, Koffivi Fidèle Gbagbe, Mikhail Litvinov, Denis Davletshin, Aleksey Fedoseev, Miguel Altamirano Cabrera, Robinroy Peter, Dzmitry Tsetserukou

专题命中 多模态评测 ：multimodal(title)

Comments The paper is submitted to the IEEE conference

The GREENBOT dataset: Multimodal mobile robotic dataset for a typical Mediterranean greenhouse

Fernando Cañadas-Aránega, Jose Luis Blanco-Claraco, Jose Carlos Moreno, Francisco Rodriguez

专题命中 多模态评测 ：multimodal(title)

Comments 29 pages, 15 figures

Journal ref Sensors 2024, 24, 1874

Thematic agreement assessment of gridded, multi-modal geospatial datasets of different semantics and spatial granularities

Johannes H. Uhl, Stefan Leyk

专题命中 多模态评测 ：multi-modal(title)

A Multimodal Graph Neural Network Framework of Cancer Molecular Subtype Classification

Bingjun Li, Sheida Nabavi

专题命中 多模态评测 ：multimodal(title)

Comments 18 pages, 4 figure

Multimodal Brain-Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselines

Prithila Angkan, Behnam Behinaein, Zunayed Mahmud, Anubhav Bhatti, Dirk Rodenburg, Paul Hungler, Ali Etemad

专题命中 多模态评测 ：multimodal(title)

Comments 16 pages, 9 figures, 11 tables. This work has been accepted to the IEEE Transactions on Intelligent Transportation Systems. \c{opyright} 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses

Longitudinal Assessment of Seasonal Impacts and Depression Associations on Circadian Rhythm Using Multimodal Wearable Sensing

Yuezhou Zhang, Amos A Folarin, Shaoxiong Sun, Nicholas Cummins, Yatharth Ranjan, Zulqarnain Rashid, Callum Stewart, Pauline Conde, Heet Sankesara, Petroula Laiou, Faith Matcham, Katie M White, Carolin Oetzmann, Femke Lamers, Sara Siddi, Sara Simblett, Srinivasan Vairavan, Inez Myin-Germeys, David C. Mohr, Til Wykes, Josep Maria Haro, Peter Annas, Brenda WJH Penninx, Vaibhav A Narayan, Matthew Hotopf, Richard JB Dobson, RADAR-CNS consortium

专题命中 多模态评测 ：multimodal(title)

A Multimodal Dataset of 21,412 Recorded Nights for Sleep and Respiratory Research

Alon Diament, Maria Gorodetski, Adam Jankelow, Ayya Keshet, Tal Shor, Daphna Weissglas-Volkov, Hagai Rossman, Eran Segal

专题命中 多模态评测 ：multimodal(title)

Comments Extended Abstract presented at Machine Learning for Health (ML4H) symposium 2023, December 10th, 2023, New Orleans, United States, 14 pages

Into the LAIONs Den: Investigating Hate in Multimodal Datasets

Abeba Birhane, Vinay Prabhu, Sang Han, Vishnu Naresh Boddeti, Alexandra Sasha Luccioni

专题命中 多模态评测 ：multimodal(title)

Comments To appear at 37th Conference on Neural Information Processing Systems (NeurIPS 2023) Datasets and Benchmarks Track. arXiv admin note: substantial text overlap with arXiv:2306.13141

RoboVQA: Multimodal Long-Horizon Reasoning for Robotics

Pierre Sermanet, Tianli Ding, Jeffrey Zhao, Fei Xia, Debidatta Dwibedi, Keerthana Gopalakrishnan, Christine Chan, Gabriel Dulac-Arnold, Sharath Maddineni, Nikhil J Joshi, Pete Florence, Wei Han, Robert Baruch, Yao Lu, Suvir Mirchandani, Peng Xu, Pannag Sanketi, Karol Hausman, Izhak Shafran, Brian Ichter, Yuan Cao

专题命中 多模态评测 ：multimodal(title)

Hessian-based Similarity Metric for Multimodal Medical Image Registration

Mohammadreza Eskandari, Houssem-Eddine Gueziri, D. Louis Collins

专题命中 多模态评测 ：multimodal(title)

Modeling and indexing the drought severity by augmenting SPI metric system to incorporate multi-modal ground temperature data

Sachini Karunarathne, Kushani De Silva, Sanjeewa Perera

专题命中 多模态评测 ：multi-modal(title)

Comments 16 pages, 6 pages

Multimodal Group Activity Dataset for Classroom Engagement Level Prediction

Alpay Sabuncuoglu, T. Metin Sezgin

专题命中 多模态评测 ：multimodal(title)

A Multimodal Data Set of Human Handovers with Design Implications for Human-Robot Handovers

Parag Khanna, Mårten Björkman, Christian Smith

专题命中 多模态评测 ：multimodal(title)

Comments The data set of human-human handovers can be found at: https://github.com/paragkhanna1/dataset

Wearable Sensor-based Multimodal Physiological Responses of Socially Anxious Individuals across Social Contexts

Emma R. Toner, Mark Rucker, Zhiyuan Wang, Maria A. Larrazabal, Lihua Cai, Debajyoti Datta, Elizabeth Thompson, Haroon Lone, Mehdi Boukhechba, Bethany A. Teachman, Laura E. Barnes

专题命中 多模态评测 ：multimodal(title)

Extracting Digital Biomarkers for Unobtrusive Stress State Screening from Multimodal Wearable Data

Berrenur Saylam, Özlem Durmaz İncel

专题命中 多模态评测 ：multimodal(title)

Design of a Multimodal Fingertip Sensor for Dynamic Manipulation

Andrew SaLoutos, Elijah Stanger-Jones, Menglong Guo, Hongmin Kim, Sangbae Kim

专题命中 多模态评测 ：multimodal(title)

Comments 6 pages, 2 pages of references, supplementary video at https://youtu.be/6Ph-cNJyJYQ. Appearing at ICRA 2023

maplab 2.0 -- A Modular and Multi-Modal Mapping Framework

Andrei Cramariuc, Lukas Bernreiter, Florian Tschopp, Marius Fehr, Victor Reijgwart, Juan Nieto, Roland Siegwart, Cesar Cadena

专题命中 多模态评测 ：multi-modal(title)

Decoding Multi-class Motor-related Intentions with User-optimized and Robust BCI System Based on Multimodal Dataset

Jeong-Hyun Cho, Byoung-Hee Kwon, Byeong-Hoo Lee

专题命中 多模态评测 ：multimodal(title)

Comments Submitted to 2023 11th IEEE International Winter Conference on Brain-Computer Interface

Coordinating Cross-modal Distillation for Molecular Property Prediction

Hao Zhang, Nan Zhang, Ruixin Zhang, Lei Shen, Yingyi Zhang, Meng Liu

专题命中 多模态评测 ：cross-modal(title)

Assessing Fatigue with Multimodal Wearable Sensors and Machine Learning

Ashish Jaiswal, Mohammad Zaki Zadeh, Aref Hebri, Fillia Makedon

专题命中 多模态评测 ：multimodal(title)

Comments 7 pages, 8 figures, 5 tables

Edge-centric Optimization of Multi-modal ML-driven eHealth Applications

Anil Kanduri, Sina Shahhosseini, Emad Kasaeyan Naeini, Hamidreza Alikhani, Pasi Liljeberg, Nikil Dutt, Amir M. Rahmani

专题命中 多模态评测 ：multi-modal(title)

Characterization of Real-time Haptic Feedback from Multimodal Neural Network-based Force Estimates during Teleoperation

Zonghe Chua, Allison M. Okamura

专题命中 多模态评测 ：multimodal(title)

Comments 8 pages, 7 figures

A multimodal sensor dataset for continuous stress detection of nurses in a hospital

Seyedmajid Hosseini, Satya Katragadda, Ravi Teja Bhupatiraju, Ziad Ashkar, Christoph W. Borst, Kenneth Cochran, Raju Gottumukkala

专题命中 多模态评测 ：multimodal(title)

Comments 14 pages, 9 images

OutFin, a multi-device and multi-modal dataset for outdoor localization based on the fingerprinting approach

Fahad Alhomayani, Mohammad H. Mahoor

专题命中 多模态评测 ：multi-modal(title)

Journal ref Sci Data 8, 66 (2021)

Enabling Radio Sensing for Multimodal Intelligent Transportation Systems: From Virtual Testing to Immersive Testbeds

Paul Schwarzbach, Jonas Ninnemann, Oliver Michler

专题命中 多模态评测 ：multimodal(title)

Update on the multimodal pathophysiological dataset of gradual cerebral ischemia in a cohort of juvenile pigs: auditory, sensory and high-frequency sensory evoked potentials

Martin G. Frasch, Bernd Walter, Christoph Anders, Reinhard Bauer

专题命中 多模态评测 ：multimodal(title)

Comments Accompanying data repository: https://doi.org/10.6084/m9.figshare.14122049.v3. arXiv admin note: text overlap with arXiv:2002.09154