The emerging field of artificial intelligence of things (AIoT, AI+IoT) is driven by the widespread use of intelligent infrastructures and the impressive success of deep learning (DL). With the deployment of DL on various intelligent infrastructures featuring rich sensors and weak DL computing capabilities, a diverse range of AIoT applications has become possible. However, DL models are notoriously resource-intensive. Existing research strives to realize near-/realtime inference of AIoT live data and low-cost training using AIoT datasets on resource-scare infrastructures. Accordingly, the accuracy and responsiveness of DL models are bounded by resource availability. To this end, the algorithm-system co-design that jointly optimizes the resource-friendly DL models and model-adaptive system scheduling improves the runtime resource availability and thus pushes the performance boundary set by the standalone level. Unlike previous surveys on resource-friendly DL models or hand-crafted DL compilers/frameworks with partially fine-tuned components, this survey aims to provide a broader optimization space for more free resource-performance tradeoffs. The cross-level optimization landscape involves various granularity, including the DL model, computation graph, operator, memory schedule, and hardware instructor in both on-device and distributed paradigms. Furthermore, due to the dynamic nature of AIoT context, which includes heterogeneous hardware, agnostic sensing data, varying user-specified performance demands, and resource constraints, this survey explores the context-aware inter-/intra-device controllers for automatic cross-level adaptation. Additionally, we identify some potential directions for resource-efficient AIoT systems. By consolidating problems and techniques scattered over diverse levels, we aim to help readers understand their connections and stimulate further discussions.
Multi-Agent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-enabled Vehicular Metaverses with Trajectory Prediction
Guangdong University of Technology(广东工业大学);Nanyang Technological University(南洋理工大学);Singapore University of Technology and Design(新加坡科技设计大学);Sun Yat-sen University(中山大学);University of Sydney(悉尼大学)
Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search
Brandeis University(布兰迪斯大学);Northeastern University(东北大学);Beihang University(北京航空航天大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);Zhejiang University(浙江大学);University of Windsor(温莎大学)
The Ohio State University(俄亥俄州立大学);Indiana University(印第安纳大学);Fudan University(复旦大学);Hangzhou City University(杭州城市大学);The University of Hong Kong(香港大学);Tongji University(同济大学);The Chinese University of Hong Kong(香港中文大学);Peking University(北京大学)
Resource-efficient medical image classification for edge devices
ECE University of Tehran(电子工程系,伊朗德黑兰大学);ECE Tehran University(电子工程系,伊朗德黑兰大学);Engineering University of St. Thomas, Minnesota(工程系,圣托马斯大学(明尼苏达));Technology Management University of Tehran(技术管理,伊朗德黑兰大学)