通过多模式界面与交通控制摄像头进行自然交互
Natural interaction with traffic control cameras through multimodal interfaces
摘要：
人机界面在现代软件系统的可用性和命令的可解释性方面一直扮演着基础性的角色。随着人工智能概念的爆炸，这样的界面已经开始填补用户和系统本身之间的空白，进一步发展为自适应用户界面（AUI）。Meta界面是对用户的进一步发展，他们的目的是支持人类活动在周围的交互空间，在这样一种方式，用户可以控制周围的空间，并与之进行交互。这项工作的目的是提出一个元用户界面，利用把那有范式，使用户能够快速交互，采用自然语言和手势。应用场景是视频监控控制室，其中行动和反应的速度是城市安全以及驾驶员和行人安全的基础。交互面向三个环境：第一个是控制室本身，操作员可以通过语音命令和手势组织与现场摄像机相关的监视器视图，以及在耳机或房间扬声器中传送音频。第二个与视频的控制有关，以便来回切换到显示特定事件的特定场景，或放大/缩小特定摄像机;第三个允许操作员在需要时在特定街道上发送救援车辆。手势数据通过Microsoft Kinect 2获取，该Kinect 2捕获指向和手势，允许用户进行多模式交互，从而增加交互的自然性;相关模块将运动信息映射到特定指令，也由语音命令支持，从而使其能够执行。（...）
英文摘要：
Human-Computer Interfaces have always played a fundamental role in usability and commands' interpretability of the modern software systems. With the explosion of the Artificial Intelligence concept, such interfaces have begun to fill the gap between the user and the system itself, further evolving in Adaptive User Interfaces (AUI). Meta Interfaces are a further step towards the user, and they aim at supporting the human activities in an ambient interactive space; in such a way, the user can control the surrounding space and interact with it. This work aims at proposing a meta user interface that exploits the Put That There paradigm to enable the user to fast interaction by employing natural language and gestures. The application scenario is a video surveillance control room, in which the speed of actions and reactions is fundamental for urban safety and driver and pedestrian security. The interaction is oriented towards three environments: the first is the control room itself, in which the operator can organize the views of the monitors related to the cameras on site by vocal commands and gestures, as well as conveying the audio on the headset or in the speakers of the room. The second one is related to the control of the video, in order to go back and forth to a particular scene showing specific events, or zoom in/out a particular camera; the third allows the operator to send rescue vehicle in a particular street, in case of need. The gestures data are acquired through a Microsoft Kinect 2 which captures pointing and gestures allowing the user to interact multimodally thus increasing the naturalness of the interaction; the related module maps the movement information to a particular instruction, also supported by vocal commands which enable its execution. (cont...)
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
