Building reliable AI decision support systems requires a robust set of data on which to train models; both with respect to quantity and diversity. Obtaining such datasets can be difficult in resource limited settings, or for applications in early stages of deployment. Sample rejection is one way to work around this challenge, however much of the existing work in this area is ill-suited for such scenarios. This paper substantiates that position and proposes a simple solution as a proof of concept baseline.
Resource-Efficient Generative AI Model Deployment in Mobile Edge Networks
School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院);School of Cyber Science and Engineering, Huazhong University of Science and Technology(华中科技大学网络空间安全学院);School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院)
针对边缘资源受限下生成式 AI 模型部署难题,提出边云协同框架与模型级决策选择算法,联合优化资源消耗、模型切换时延及总体成本。
BitRL: Reinforcement Learning with 1-bit Quantized Language Models for Resource-Constrained Edge Deployment
Department of Computer Science BRAC University Dhaka 1212, Bangladesh;Department of Computer Science Missouri State University Springfield, MO, USA;Department of Computer Science \& Engineering Prime University Dhaka, Bangladesh;Department of Computer Science \& Engineering German University Bangladesh Dhaka, Bangladesh;Department of Information Technology Jahangirnagar University Dhaka, Bangladesh
Learning Optimal and Fair Policies for Online Allocation of Scarce Societal Resources from Data Collected in Deployment
USC CAIS Center for Artificial Intelligence in Society(USC 人工智能与社会中心);Luxembourg Centre for Logistics and Supply Chain Management, University of Luxembourg(卢森堡物流与供应链管理中心,卢森堡大学)
Efficient Deployment of Large Language Models on Resource-constrained Devices
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);Suzhou Institute for Advanced Research, University of Science and Technology of China(中国科学技术大学苏州高等研究院)
Knowledge Grafting: A Mechanism for Optimizing AI Model Deployment in Resource-Constrained Environments
Prince Sattam Bin Abdulaziz University, Kingdom of Saudi Arabia(普林斯·萨塔姆·宾·阿卜杜勒阿齐兹大学);Indian Institute of Technology Ropar, India(印度理工学院罗帕尔分校);Azzaytuna University, Libya(阿扎伊图纳大学);Cardiff University, United Kingdom(卡迪夫大学)
MetaCLBench: Meta Continual Learning Benchmark on Resource-Constrained Edge Devices
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Samsung AI Center-Cambridge(三星AI中心-剑桥);The Hong Kong Polytechnic University(香港理工大学)
Microservice Deployment in Space Computing Power Networks via Robust Reinforcement Learning
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);EPFL(洛桑联邦理工学院);Beijing National Research Center for Information Science and Technology, Tsinghua University(清华大学北京信息科学与技术国家研究中心)
Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Services
School of Future Science and Engineering, Soochow University(苏州大学未来科学与工程学院);School of Computing Technologies, RMIT University(皇家墨尔本理工大学计算技术学院);Department of Control Science and Engineering, The National Key Laboratory of Autonomous Intelligent Unmanned Systems, Tongji University(同济大学控制科学与工程系);Department of automation, China University of Petroleum (East China)(中国石油大学(华东)自动化系);College of Computer and Information Sciences, Fujian Agriculture and Forestry University(福建农林大学计算机与信息科学学院);Department of Electrical and Computer Engineering, Western University(西方大学电气与计算机工程系)