OmniAI：一种面向人机交互的表面自适应空中投影界面
OmniAI: A Surface-Adaptive Aerial Projection Interface for Human--Drone Interaction
- Skolkovo Institute of Science and Technology（斯科尔科沃科学技术研究院）
- School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）理工学院）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
OmniAI是一种具现化空中智能体，通过自适应投影实现人机交互，采用RGB-D与RANSAC检测投影表面，支持语音、手势控制，为情境感知人机交互提供移动空间AR界面。
AI中文摘要：
在人类环境中，无人机往往缺乏用于情境化通信的空间接地界面。本文提出OmniAI，一种具现化空中智能体，可通过在机载屏幕与附近环境表面之间切换投影来支持表面自适应交互。伺服驱动的MEMS激光投影仪渲染来自网络增强型LLM流水线的文本与图像响应。无需预映射几何结构，通过RGB-D感知与RANSAC平面拟合在线检测投影表面。OmniAI提供功能等效的语音与手势控制，用于无人机运动及投影内容。结合语音、空中手势、自适应投影与空中移动性，OmniAI展现了一种用于情境感知人机交互的移动空间AR界面。
英文摘要：
Drones in human environments often lack spatially grounded in- terfaces for situated communication. We present OmniAI, an em- bodied aerial agent that supports surface-adaptive interaction by switching projection between an onboard screen and nearby en- vironmental surfaces. A servo-actuated MEMS laser projector renders text-and-image responses from a web-augmented LLM pipeline. Projection surfaces are detected online using RGB-D sensing and RANSAC plane fitting, without pre-mapped geometry. OmniAI provides functionally equivalent voice and gesture con- trol for both drone motion and projected content. By combining speech, mid-air gestures, adaptive projection, and aerial mobility, OmniAI demonstrates a mobile spatial AR interface for context- aware human-drone interaction.
