多模态大模型

"Pass the butter": A study on desktop-classic multitasking robotic arm based on advanced YOLOv7 and BERT

Haohua Que, Wenbin Pan, Jie Xu, Hao Luo, Pei Wang, Li Zhang

专题命中 音频语音多模态 ：multimodal(abstract)

Exploiting Out-of-band Motion Sensor Data to De-anonymize Virtual Reality Users

Mohd Sabra, Nisha Vinayaga Sureshkanth, Ari Sharma, Anindya Maiti, Murtuza Jadliwala

专题命中 音频语音多模态 ：audio-visual(abstract)

Mixing Modes: Active and Passive Integration of Speech, Text, and Visualization for Communicating Data Uncertainty

Chase Stokes, Chelsea Sanker, Bridget Cogley, Vidya Setlur

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 5 pages, 2 figures, accepted at Eurographics Conference on Visualization (EuroVis) 2024

From Delays to Densities: Exploring Data Uncertainty through Speech, Text, and Visualization

Chase Stokes, Chelsea Sanker, Bridget Cogley, Vidya Setlur

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 14 pages, 3 figures, accepted at Eurographics Conference on Visualization (EuroVis) 2024

Pulse-echo ultrasound attenuation tomography

Naiara Korta Martiartu, Parisa Salemi Yolgunlu, Martin Frenz, Michael Jaeger

专题命中 音频语音多模态 ：multi-modal(abstract)

NatSGD: A Dataset with Speech, Gestures, and Demonstrations for Robot Learning in Natural Human-Robot Interaction

Snehesh Shrestha, Yantian Zha, Saketh Banagiri, Ge Gao, Yiannis Aloimonos, Cornelia Fermuller

专题命中 音频语音多模态 ：multimodal(abstract)

Partial Federated Learning

Tiantian Feng, Anil Ramakrishna, Jimit Majmudar, Charith Peris, Jixuan Wang, Clement Chung, Richard Zemel, Morteza Ziyadi, Rahul Gupta

专题命中 音频语音多模态 ：multi-modal(abstract)

Is Silent eHMI Enough? A Passenger-Centric Study on Effective eHMI for Autonomous Personal Mobility Vehicles in the Field

Hailong Liu, Yang Li, Zhe Zeng, Hao Cheng, Chen Peng, Takahiro Wada

专题命中 音频语音多模态 ：multimodal(abstract)

Automatically Detecting Confusion and Conflict During Collaborative Learning Using Linguistic, Prosodic, and Facial Cues

Yingbo Ma, Yukyeong Song, Mehmet Celepkolu, Kristy Elizabeth Boyer, Eric Wiebe, Collin F. Lynch, Maya Israel

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 27 pages, 7 figures, 7 tables

Multimodality in Group Communication Research

Robin Lange, Brooke Foucault Welles, Gyanendra Sharma, Richard J. Radke, Javier O. Garcia, Christoph Riedl

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 27 pages, 3 figures

"Hey Model!" - Natural User Interactions and Agency in Accessible Interactive 3D Models

Samuel Reinders, Matthew Butler, Kim Marriott

专题命中 音频语音多模态 ：multi-modal(abstract)

Comments Paper presented at ACM CHI 2020: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, ACM, New York, April 2020; Replacement: typos corrected, character encoding

Co-speech gestures for human-robot collaboration

A. Ekrekli, A. Angleraud, G. Sharma, R. Pieters

专题命中 音频语音多模态 ：multi-modal(abstract)

Comments 5 pages, accepted to IEEE International Conference on Robotics Computing

Modular Customizable ROS-Based Framework for Rapid Development of Social Robots

Mahta Akhyani, Hadi Moradi

专题命中 音频语音多模态 ：multimodal(abstract)

Insights into Age-Related Functional Brain Changes during Audiovisual Integration Tasks: A Comprehensive EEG Source-Based Analysis

Prerna Singh, Ayush Tripathi, Lalan Kumar, Tapan Kumar Gandhi

专题命中 音频语音多模态 ：audio-visual(abstract)

Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysis

Victor Letzelter, Mathieu Fontaine, Mickaël Chen, Patrick Pérez, Slim Essid, Gaël Richard

专题命中 音频语音多模态 ：multimodal(abstract)

Journal ref Advances in neural information processing systems, Dec 2023, New Orleans, United States

An Exploration of Multimodality and Data Augmentation for Dementia Classification

Kaiying Lin, Peter Washington

专题命中 音频语音多模态 ：multimodal(abstract)

From Plate to Production: Artificial Intelligence in Modern Consumer-Driven Food Systems

Weiqing Min, Pengfei Zhou, Leyi Xu, Tao Liu, Tianhao Li, Mingyu Huang, Ying Jin, Yifan Yi, Min Wen, Shuqiang Jiang, Ramesh Jain

专题命中 音频语音多模态 ：multimodal(abstract)

Datastore Design for Analysis of Police Broadcast Audio at Scale

Ayah Ahmad, Christopher Graziul, Margaret Beale Spencer

专题命中 音频语音多模态 ：multimodal(abstract)

Machine Learning Approaches for Fine-Grained Symptom Estimation in Schizophrenia: A Comprehensive Review

Niki Maria Foteinopoulou, Ioannis Patras

专题命中 音频语音多模态 ：audio-visual(abstract)

Comments 19 pages, 5 figures

Sound-skwatter (Did You Mean: Sound-squatter?) AI-powered Generator for Phishing Prevention

Rodolfo Valentim, Idilio Drago, Marco Mellia, Federico Cerutti

专题命中 音频语音多模态 ：multi-modal(abstract)

Talking to Data Visualizations: Opportunities and Challenges

Gabriela Molina León, Petra Isenberg, Andreas Breiter

专题命中 音频语音多模态 ：multimodal(abstract)

Comments Accepted at the MERCADO workshop at IEEE VIS 2023

Concurrent Haptic, Audio, and Visual Data Set During Bare Finger Interaction with Textured Surfaces

Alexis W. M. Devillard, Aruna Ramasamy, Damien Faux, Vincent Hayward, Etienne Burdet

专题命中 音频语音多模态 ：multi-modal(abstract)

Journal ref 2023 IEEE World Haptics Conference (WHC)

Tensorized LSSVMs for Multitask Regression

Jiani Liu, Qinghua Tao, Ce Zhu, Yipeng Liu, Johan A. K. Suykens

专题命中 音频语音多模态 ：multimodal(abstract)

Journal ref ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 2023, pp. 1-5

ARGUS: Visualization of AI-Assisted Task Guidance in AR

Sonia Castelo, Joao Rulff, Erin McGowan, Bea Steers, Guande Wu, Shaoyu Chen, Iran Roman, Roque Lopez, Ethan Brewer, Chen Zhao, Jing Qian, Kyunghyun Cho, He He, Qi Sun, Huy Vo, Juan Bello, Michael Krone, Claudio Silva

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 11 pages, 8 figures. This is the author's version of the article of the article that has been accepted for publication in IEEE Transactions on Visualization and Computer Graphics

Towards a New Interface for Music Listening: A User Experience Study on YouTube

Ahyeon Choi, Eunsik Shin, Haesun Joung, Joongseek Lee, Kyogu Lee

专题命中 音频语音多模态 ：audio-visual(abstract)

Comments 6 pages without reference, 1 figure, 3 tables

Screen or No Screen? Lessons Learnt from a Real-World Deployment Study of Using Voice Assistants With and Without Touchscreen for Older Adults

Chen Chen, Ella T. Lifset, Yichen Han, Arkajyoti Roy, Michael Hogarth, Alison A. Moore, Emilia Farcas, Nadir Weibel

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 25 pages

Detection Threshold of Audio Haptic Asynchrony in a Driving Context

Gyanendra Sharma, Hiroshi Yasuda, Manuel Kuehner

专题命中 音频语音多模态 ：multimodal(abstract)

Comments 8 pages, 9 figures

Axiomatizing Hybrid XPath with Data

Carlos Areces, Raul Fervari

专题命中 音频语音多模态 ：multi-modal(abstract)

Journal ref Logical Methods in Computer Science, Volume 17, Issue 3 (July 20, 2021) lmcs:6259

Creative beyond TikToks: Investigating Adolescents' Social Privacy Management on TikTok

Nico Ebert, Tim Geppert, Joanna Strycharz, Melanie Knieps, Michael Hönig, Elke Brucker-Kley

专题命中 音频语音多模态 ：audio-visual(abstract)

Exploring Human Response Times to Combinations of Audio, Haptic, and Visual Stimuli from a Mobile Device

Kyle T. Yoshida, Joel X. Kiernan, Allison M. Okamura, Cara M. Nunez

专题命中 音频语音多模态 ：multi-modal(abstract)

Comments Accepted to World Haptics Conference 2023