通过Kinect进行自动化培训和维护
Automated Training and Maintenance through Kinect
摘要:
在本文中,我们致力于减轻机械师的负担,涉及在集中车间进行的复杂汽车维修活动。我们已经提出了一个系统原型,结合增强现实与Kinect。通过使用Kinect,可以以相当低的成本获得非常高质量的传感器,从而降低了系统设计的总体支出。系统可以在语音模式或手势模式下操作。如果用户选择语音模式,系统可以通过各种音频命令进行控制。同样的控制也可以通过在手势模式下使用一组手势来完成。手势识别是由Kinect系统执行的任务。该系统与RGB和深度相机捆绑在一起,通过跟踪20个不同的身体关节来处理骨骼数据。识别手势是通过验证用户的动作和检查他们对预定义的条件。增强现实模块从高分辨率摄像机捕获实时图像数据流。然后,该模块生成叠加在实时的数据上的3D模型。
英文摘要:
In this paper, we have worked on reducing burden on mechanic involving complex automobile maintenance activities that are performed in centralised workshops. We have presented a system prototype that combines Augmented Reality with Kinect. With the use of Kinect, very high quality sensors are available at considerably low costs, thus reducing overall expenditure for system design. The system can be operated either in Speech mode or in Gesture mode. The system can be controlled by various audio commands if user opts for Speech mode. The same controlling can also be done by using a set of Gestures in Gesture mode. Gesture recognition is the task performed by Kinect system. This system, bundled with RGB and Depth camera, processes the skeletal data by keeping track of 20 different body joints. Recognizing Gestures is done by verifying user movements and checking them against predefined condition. Augmented Reality module captures real-time image data streams from high resolution camera. This module then generates 3D model that is superimposed on real time data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。