Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence
Hamad Bin Khalifa University(哈马德·本·哈利法大学);Qatar University(卡塔尔大学);Delft University of Technology(代尔夫特理工大学);Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学(MBZUAI))
Artificial intelligence (AI) has witnessed a substantial breakthrough in a variety of Internet of Things (IoT) applications and services, spanning from recommendation systems to robotics control and military surveillance. This is driven by the easier access to sensory data and the enormous scale of pervasive/ubiquitous devices that generate zettabytes (ZB) of real-time data streams. Designing accurate models using such data streams, to predict future insights and revolutionize the decision-taking process, inaugurates pervasive systems as a worthy paradigm for a better quality-of-life. The confluence of pervasive computing and artificial intelligence, Pervasive AI, expanded the role of ubiquitous IoT systems from mainly data collection to executing distributed computations with a promising alternative to centralized learning, presenting various challenges. In this context, a wise cooperation and resource scheduling should be envisaged among IoT devices (e.g., smartphones, smart vehicles) and infrastructure (e.g. edge nodes, and base stations) to avoid communication and computation overheads and ensure maximum performance. In this paper, we conduct a comprehensive survey of the recent techniques developed to overcome these resource challenges in pervasive AI systems. Specifically, we first present an overview of the pervasive computing, its architecture, and its intersection with artificial intelligence. We then review the background, applications and performance metrics of AI, particularly Deep Learning (DL) and online learning, running in a ubiquitous system. Next, we provide a deep literature review of communication-efficient techniques, from both algorithmic and system perspectives, of distributed inference, training and online learning tasks across the combination of IoT devices, edge devices and cloud servers. Finally, we discuss our future vision and research challenges.
Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions
Pennsylvania State University(宾夕法尼亚州立大学);Fudan University(复旦大学)
联合学习(Federated Learning,FL)和分裂学习(Split Learning,SL)是两种新兴的协作学习方法,可以极大地促进物联网(Internet of Things,IoT)中的泛在智能。联邦学习使使用私有数据本地训练的机器学习(ML)模型能够聚合成全局模型。拆分学习允许ML模型的不同部分在学习框架中的不同工作者上进行协作训练。联邦学习和分裂学习各有其独特的优势和各自的局限性,可以相互补充,共同实现物联网中的泛在智能。因此,联邦学习和分裂学习的结合成为近年来一个活跃的研究领域,引起了广泛的兴趣。在本文中,我们回顾了联邦学习和分离学习的最新发展,并对在基于边缘计算的物联网环境中结合这两种学习方法的最新技术进行了调查。我们还确定了一些开放的问题,并讨论了在这一领域的未来研究的可能方向,希望进一步引起研究界对这一新兴领域的兴趣。
SCEI: A Smart-Contract Driven Edge Intelligence Framework for IoT Systems
Deakin University(迪肯大学);Jilin University(吉林大学);Changchun University of Technology(长春工业大学);Macquarie University(麦考瑞大学);Qilu University of Technology(齐鲁工业大学);Shandong Computer Science Center(山东计算机科学中心);Facebook(脸书)
Orchestrating the Development Lifecycle of Machine Learning-Based IoT Applications: A Taxonomy and Survey
Newcastle University(纽卡斯尔大学);University of Leeds(利兹大学);The University of Sydney(悉尼大学);Cardiff University(卡迪夫大学);China University of Geoscience (Wuhan)(中国地质大学(武汉))