arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.05643cs.DCcs.SE
收藏

CLAID:闭合人工智能与数据收集的环路——面向智能边缘云与数字生物标志物应用的跨平台透明计算中间件框架

CLAID: Closing the Loop on AI & Data Collection -- A Cross-Platform Transparent Computing Middleware Framework for Smart Edge-Cloud and Digital Biomarker Applications

Patrick Langer, Elgar Fleisch, Filipe Barata

AI总结:

本文提出开源跨平台中间件框架CLAID,通过透明计算实现多操作系统边缘设备与云端的逻辑集成、通信与计算卸载,并提出“ML-Model in the Loop”方法验证模型迁移问题,在数据采集覆盖率和咳嗽检测模型跨平台性能上取得了一致结果。

摘要:

具备增强感知能力的边缘设备数量日益增多,例如配备传感器的智能手机、可穿戴设备和物联网设备,这为医疗健康领域的创新智能边缘应用带来了潜力。这些设备生成海量多模态数据,使得数字生物标志物的实现成为可能,机器学习解决方案可以利用这些数字生物标志物来推导见解、预测健康风险并实现个性化干预。训练这些模型需要从边缘设备收集数据并在云端进行聚合。为了验证和核实这些模型,必须在真实场景中使用它们,并利用来自不同人群的数据对其进行测试。由于某些模型计算开销过大,无法直接在边缘设备上运行,因此边缘与云端之间的协作框架变得必要。在本文中,我们提出了CLAID,这是一个基于透明计算的开源跨平台中间件框架,兼容Android、iOS、WearOS、Linux、macOS和Windows。CLAID能够将运行不同操作系统的设备在逻辑上集成到一个边缘云系统中,促进它们之间的通信与计算卸载,并提供多种编程语言的绑定。我们提供了用于从各种传感器收集数据以及部署机器学习模型的模块。此外,我们提出了一种新颖的方法——“环路中的机器学习模型”(ML-Model in the Loop),用于验证已部署的机器学习模型,这有助于分析模型从云端迁移到边缘设备过程中可能出现的问题。我们在三个不同的实验中验证了我们的框架,在不同传感器上实现了100%的数据收集采样覆盖率,并且在Android和iOS设备上部署的咳嗽检测模型取得了相同的性能。我们评估了该框架的内存和电池消耗。

英文摘要:

The increasing number of edge devices with enhanced sensing capabilities, such as smartphones, wearables, and IoT devices equipped with sensors, holds the potential for innovative smart-edge applications in healthcare. These devices generate vast amounts of multimodal data, enabling the implementation of digital biomarkers which can be leveraged by machine learning solutions to derive insights, predict health risks, and allow personalized interventions. Training these models requires collecting data from edge devices and aggregating it in the cloud. To validate and verify those models, it is essential to utilize them in real-world scenarios and subject them to testing using data from diverse cohorts. Since some models are too computationally expensive to be run on edge devices directly, a collaborative framework between the edge and cloud becomes necessary. In this paper, we present CLAID, an open-source cross-platform middleware framework based on transparent computing compatible with Android, iOS, WearOS, Linux, macOS, and Windows. CLAID enables logical integration of devices running different operating systems into an edge-cloud system, facilitating communication and offloading between them, with bindings available in different programming languages. We provide Modules for data collection from various sensors as well as for the deployment of machine-learning models. Furthermore, we propose a novel methodology, "ML-Model in the Loop" for verifying deployed machine learning models, which helps to analyze problems that may occur during the migration of models from cloud to edge devices. We verify our framework in three different experiments and achieve 100% sampling coverage for data collection across different sensors as well as an equal performance of a cough detection model deployed on both Android and iOS devices. We evaluate the memory and battery consumption of our framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑