arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1906.01810cs.NIeess.SP
收藏

一种可持续的多模式多层边缘感知服务

A Sustainable Multi-modal Multi-layer Emotion-aware Service at the Edge

Long Hu, Wei Li, Jun Yang, Giancarlo Fortino, Min Chen

摘要:

受终端设备计算能力、电池电量和网络带宽的限制,情感识别任务无法为用户带来良好的交互体验。用户无法忍受的延迟也严重限制了边缘环境中情感识别应用的普及,例如自动驾驶中的疲劳检测。边缘计算的发展为这一问题提供了更可持续的解决方案。提出了一种基于边缘计算的多模态多层情感感知服务(MULTI-EASE)架构,以用户的面部表情和语音作为情感识别的多模态数据源,以智能终端、边缘服务器和云端为多层执行环境。通过分析每个任务的平均时延和移动终端的平均能耗,提出了一个时延约束的能量最小化问题,并在多个层之间执行一个任务调度策略,利用基于边缘的方法来降低端到端的时延和能耗,进而改善用户的情感交互体验,实现边缘计算的节能。最后,通过一个原型系统对MULTI-EASE的架构进行了验证,实验结果表明MULTI-EASE是一个可持续的、高效的情感分析应用平台,同时也为MULTI-EASE架构下的动态任务调度提供了有价值的参考。

英文摘要:

Limited by the computational capabilities and battery energy of terminal devices and network bandwidth, emotion recognition tasks fail to achieve good interactive experience for users. The intolerable latency for users also seriously restricts the popularization of emotion recognition applications in the edge environments such as fatigue detection in auto-driving. The development of edge computing provides a more sustainable solution for this problem. Based on edge computing, this article proposes a multi-modal multi-layer emotion-aware service (MULTI-EASE) architecture that considers user's facial expression and voice as a multi-modal data source of emotion recognition, and employs the intelligent terminal, edge server and cloud as multi-layer execution environment. By analyzing the average delay of each task and the average energy consumption at the mobile device, we formulate a delay-constrained energy minimization problem and perform a task scheduling policy between multiple layers to reduce the end-to-end delay and energy consumption by using an edge-based approach, further to improve the users' emotion interactive experience and achieve energy saving in edge computing. Finally, a prototype system is also implemented to validate the architecture of MULTI-EASE, the experimental results show that MULTI-EASE is a sustainable and efficient platform for emotion analysis applications, and also provide a valuable reference for dynamic task scheduling under MULTI-EASE architecture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑