利用transprecision计算实现边缘机器视觉应用
Leveraging Transprecision Computing for Machine Vision Applications at the Edge
摘要:
机器视觉任务对资源受限的边缘设备提出了挑战,特别是当它们执行具有可变工作负载的多个任务时。一个强大的方法,可以动态地适应在运行时,同时保持最大的服务质量(QoS)的资源限制,是必要的。本文提出了一种轻量级的方法,监控运行时的工作负载约束,并利用准确性和吞吐量的权衡。优化技术包括为每个任务找到最佳精度,能量和内存的配置,并管理配置之间的透明切换。对于1%的准确度下降,我们显示了1.6倍的更高的帧处理速率,在较低的准确度下可能会有进一步的改进。
英文摘要:
Machine vision tasks present challenges for resource constrained edge devices, particularly as they execute multiple tasks with variable workloads. A robust approach that can dynamically adapt in runtime while maintaining the maximum quality of service (QoS) within resource constraints, is needed. The paper presents a lightweight approach that monitors the runtime workload constraint and leverages accuracy-throughput trade-off. Optimisation techniques are included which find the configurations for each task for optimal accuracy, energy and memory and manages transparent switching between configurations. For an accuracy drop of 1%, we show a 1.6x higher achieved frame processing rate with further improvements possible at lower accuracy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。