arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 9205 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态评测 9205 篇

2110.04239 2021-10-11 eess.SP eess.IV 71%

OPERAnet: A Multimodal Activity Recognition Dataset Acquired from Radio Frequency and Vision-based Sensors

Mohammud J. Bocus, Wenda Li, Shelly Vishwakarma, Roget Kou, Chong Tang, Karl Woodbridge, Ian Craddock, Ryan McConville, Raul Santos-Rodriguez, Kevin Chetty, Robert Piechocki

专题命中 多模态评测 :multimodal(title)

Comments 17 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.01097 2021-09-27 stat.ME stat.AP 71%

Tangent functional canonical correlation analysis for densities and shapes, with applications to multimodal imaging data

Min Ho Cho, Sebastian Kurtek, Karthik Bharath

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.09523 2021-09-01 cond-mat.mtrl-sci cond-mat.mes-hall physics.app-ph 71%

py4DSTEM: a software package for multimodal analysis of four-dimensional scanning transmission electron microscopy datasets

Benjamin H Savitzky, Lauren A Hughes, Steven E Zeltmann, Hamish G Brown, Shiteng Zhao, Philipp M Pelz, Edward S Barnard, Jennifer Donohue, Luis Rangel DaCosta, Thomas C. Pekin, Ellis Kennedy, Matthew T Janish, Matthew M Schneider, Patrick Herring, Chirranjeevi Gopal, Abraham Anapolsky, Peter Ercius, Mary Scott, Jim Ciston, Andrew M Minor, Colin Ophus

专题命中 多模态评测 :multimodal(title)

Comments 32 pages, 18 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.06031 2021-08-16 eess.IV eess.SP 71%

Multimodal Unrolled Robust PCA for Background Foreground Separation

Spencer Markowitz, Corey Snyder, Yonina C. Eldar, Minh N. Do

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.01128 2021-05-05 cs.LG eess.SP 71%

Fusing multimodal neuroimaging data with a variational autoencoder

Eloy Geenjaar, Noah Lewis, Zening Fu, Rohan Venkatdas, Sergey Plis, Vince Calhoun

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.11751 2021-03-31 cs.RO 71%

Multimodal dynamics modeling for off-road autonomous vehicles

Jean-François Tremblay, Travis Manderson, Aurélio Noca, Gregory Dudek, David Meger

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.00680 2021-03-02 econ.GN q-fin.EC 71%

Consequential LCA for territorial and multimodal transportation policies: method and application to the free-floating e-scooter disruption in Paris

Anne de Bortoli, Zoi Christoforou

专题命中 多模态评测 :multimodal(title)

Journal ref Journal of Cleaner Production, Volume 273, 2020, 122898

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.11935 2021-01-29 cs.LG eess.IV 71%

A Machine Learning Challenge for Prognostic Modelling in Head and Neck Cancer Using Multi-modal Data

Michal Kazmierski, Mattea Welch, Sejin Kim, Chris McIntosh, Princess Margaret Head, Neck Cancer Group, Katrina Rey-McIntyre, Shao Hui Huang, Tirth Patel, Tony Tadic, Michael Milosevic, Fei-Fei Liu, Andrew Hope, Scott Bratman, Benjamin Haibe-Kains

专题命中 多模态评测 :multi-modal(title)

Comments 27 pages, 7 figures, under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.11656 2021-01-29 q-bio.QM cs.LG eess.IV 71%

G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification

Sayan Ghosal, Qiang Chen, Giulio Pergola, Aaron L. Goldman, William Ulrich, Karen F. Berman, Giuseppe Blasi, Leonardo Fazio, Antonio Rampino, Alessandro Bertolino, Daniel R. Weinberger, Venkata S. Mattay, Archana Venkataraman

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.15441 2021-01-18 cs.LG cs.HC 71%

DeepTake: Prediction of Driver Takeover Behavior using Multimodal Data

Erfan Pakdamanian, Shili Sheng, Sonia Baee, Seongkook Heo, Sarit Kraus, Lu Feng

专题命中 多模态评测 :multimodal(title)

Comments Accepted to CHI 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.12267 2021-01-05 cond-mat.mtrl-sci 71%

Nanoindentation in multi-modal map combinations: A Correlative Approach to Local Mechanical Property Assessment

C. M. Magazzeni, H. M. Gardner, I. Howe, P. Gopon, J. C. Waite, D. Rugg, D. E. J. Armstrong, A. J. Wilkinson

专题命中 多模态评测 :multi-modal(title)

Comments 33 pages, 15 figures (9 main body) + graphical abstract, code on Github @XPCorrelate

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.08895 2020-12-17 cs.LG cs.CY cs.SI 71%

ReINTEL: A Multimodal Data Challenge for Responsible Information Identification on Social Network Sites

Duc-Trong Le, Xuan-Son Vu, Nhu-Dung To, Huu-Quang Nguyen, Thuy-Trinh Nguyen, Linh Le, Anh-Tuan Nguyen, Minh-Duc Hoang, Nghia Le, Huyen Nguyen, Hoang D. Nguyen

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.04088 2020-11-24 cs.SI cs.CY 71%

MM-COVID: A Multilingual and Multimodal Data Repository for Combating COVID-19 Disinformation

Yichuan Li, Bohan Jiang, Kai Shu, Huan Liu

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.06301 2020-11-13 cs.LG q-bio.QM 71%

Learning Inter-Modal Correspondence and Phenotypes from Multi-Modal Electronic Health Records

Kejing Yin, William K. Cheung, Benjamin C. M. Fung, Jonathan Poon

专题命中 多模态评测 :multi-modal(title)

Comments Accepted by IEEE Transactions on Knowledge and Data Engineering (TKDE)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.14998 2020-10-29 cs.NE math.OC 71%

Real-valued Evolutionary Multi-modal Multi-objective Optimization by Hill-Valley Clustering

S. C. Maree, T. Alderliesten, P. A. N. Bosman

专题命中 多模态评测 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.08819 2020-10-20 cs.LG cs.SY eess.SY 71%

Assessment of Reward Functions in Reinforcement Learning for Multi-Modal Urban Traffic Control under Real-World limitations

Alvaro Cabrejas-Egea, Colm Connaughton

专题命中 多模态评测 :multi-modal(title)

Comments 8 pages, conference paper, 3 figures, 1 table

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.01378 2020-09-16 physics.med-ph 71%

Multimodal assessment of nigrosomal degeneration in Parkinson's disease

Jason Langley, Daniel E. Huddleston, Bruce Crosson, David Song, Stewart A. Factor, Xiaoping Hu

专题命中 多模态评测 :multimodal(title)

Comments 11 pages, 3 figures, 1 table. Submitted to Parkinsonism and Related Disorders

详情

展开后加载摘要…

URL PDF HTML 收藏
1909.07471 2019-09-18 cs.RO cs.HC cs.LG 71%

Multimodal Dataset of Human-Robot Hugging Interaction

Kunal Bagewadi, Joseph Campbell, Heni Ben Amor

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.12175 2019-07-30 cs.LG eess.SP stat.ML 71%

Multi-modal Predictive Models of Diabetes Progression

Ramin Ramazi, Christine Perndorfer, Emily Soriano, Jean-Philippe Laurenceau, Rahmatollah Beheshti

专题命中 多模态评测 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1809.08410 2018-09-25 q-bio.QM cs.LG eess.SP 71%

Entropy-Assisted Multi-Modal Emotion Recognition Framework Based on Physiological Signals

Kuan Tung, Po-Kang Liu, Yu-Chuan Chuang, Sheng-Hui Wang, An-Yeu Wu

专题命中 多模态评测 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1809.05839 2018-09-18 cs.HC cs.LG stat.ML 71%

A Generic Multi-modal Dynamic Gesture Recognition System using Machine Learning

Gautham Krishna G, Karthik Subramanian Nathan, Yogesh Kumar B, Ankith A Prabhu, Ajay Kannan, Vineeth Vijayaraghavan

专题命中 多模态评测 :multi-modal(title)

Comments Accepted at IEEE Future of Information and Communications Conference (FICC 2018)

详情

展开后加载摘要…

URL PDF HTML 收藏
1804.09241 2018-09-18 physics.app-ph cs.AR cs.ET cs.RO physics.ins-det 71%

A Hardware Platform for Efficient Multi-Modal Sensing with Adaptive Approximation

Phillip Stanley-Marbell, Martin Rinard

专题命中 多模态评测 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1807.02022 2018-07-06 cs.CY 71%

The TESTMED Project Experience. Process-aware Enactment of Clinical Guidelines through Multimodal Interfaces

Andrea Marrella, Massimo Mecella, Mahmoud Sharf, Tiziana Catarci

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1801.06048 2018-01-19 cs.CY cs.HC cs.LG 71%

Deep Learning for Fatigue Estimation on the Basis of Multimodal Human-Machine Interactions

Yuri Gordienko, Sergii Stirenko, Yuriy Kochura, Oleg Alienin, Michail Novotarskiy, Nikita Gordienko

专题命中 多模态评测 :multimodal(title)

Comments 12 pages, 10 figures, 1 table; presented at XXIX IUPAP Conference in Computational Physics (CCP2017) July 9-13, 2017, Paris, University Pierre et Marie Curie - Sorbonne (https://ccp2017.sciencesconf.org/program)

详情

展开后加载摘要…

URL PDF HTML 收藏
1711.00617 2017-11-03 cs.SI 71%

How Polarized Have We Become? A Multimodal Classification of Trump Followers and Clinton Followers

Yu Wang, Yang Feng, Zhe Hong, Ryan Berger, Jiebo Luo

专题命中 多模态评测 :multimodal(title)

Comments 16 pages, SocInfo 2017, 9th International Conference on Social Informatics

详情

展开后加载摘要…

URL PDF HTML 收藏
1709.01796 2017-09-07 cs.HC 71%

Interakt---A Multimodal Multisensory Interactive Cognitive Assessment Tool

Daniel Sonntag

专题命中 多模态评测 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1612.05710 2016-12-20 cs.NI cs.SI 71%

Multi-modal Mining and Modeling of Big Mobile Networks Based on Users Behavior and Interest

Saeed Moghaddam, Ahmed Helmy

专题命中 多模态评测 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1608.00462 2016-08-02 cs.CY cs.SI physics.soc-ph 71%

Are Safer Looking Neighborhoods More Lively? A Multimodal Investigation into Urban Life

Marco De Nadai, Radu L. Vieriu, Gloria Zen, Stefan Dragicevic, Nikhil Naik, Michele Caraviello, Cesar A. Hidalgo, Nicu Sebe, Bruno Lepri

专题命中 多模态评测 :multimodal(title)

Comments To appear in the Proceedings of ACM Multimedia Conference (MM), 2016. October 15 - 19, 2016, Amsterdam, Netherlands

详情

展开后加载摘要…

URL PDF HTML 收藏
1502.01233 2015-06-12 cs.CR cs.CY 71%

Exploiting Multimodal Biometrics in E-Privacy Scheme for Electronic Health Records

Adebayo Omotosho, Omotanwa Adegbola, Barakat Adelakin, Adeyemi Adelakun, Justice Emuoyibofarhe

专题命中 多模态评测 :multimodal(title)

Comments Published

Journal ref JBAH 2014, Vol , No 18, pp 22 - 33

详情

展开后加载摘要…

URL PDF HTML 收藏
1503.04967 2015-03-18 cs.RO cs.HC 71%

Implementation and Evaluation of multimodal input/output channels for task-based industrial robot programming

Stefan Profanter

专题命中 多模态评测 :multimodal(title)

Comments Master Thesis in Robotics, Cognition, Intelligence

详情

展开后加载摘要…

URL PDF HTML 收藏