Active-Learning-as-a-Service: An Automatic and Efficient MLOps System for Data-Centric AI
Institute for Infocomm Research(信息通信研究院);A*STAR(新加坡科技研究局);Nanyang Technological University(南洋理工大学);Institute of High Performance Computing(高性能计算研究院);National University of Singapore(新加坡国立大学)
Yizheng Huang, Huaizheng Zhang, Yuanming Li, Chiew Tong Lau, Yang You
The success of today's AI applications requires not only model training (Model-centric) but also data engineering (Data-centric). In data-centric AI, active learning (AL) plays a vital role, but current AL tools 1) require users to manually select AL strategies, and 2) can not perform AL tasks efficiently. To this end, this paper presents an automatic and efficient MLOps system for AL, named ALaaS (Active-Learning-as-a-Service). Specifically, 1) ALaaS implements an AL agent, including a performance predictor and a workflow controller, to decide the most suitable AL strategies given users' datasets and budgets. We call this a predictive-based successive halving early-stop (PSHEA) procedure. 2) ALaaS adopts a server-client architecture to support an AL pipeline and implements stage-level parallelism for high efficiency. Meanwhile, caching and batching techniques are employed to further accelerate the AL process. In addition to efficiency, ALaaS ensures accessibility with the help of the design philosophy of configuration-as-a-service. Extensive experiments show that ALaaS outperforms all other baselines in terms of latency and throughput. Also, guided by the AL agent, ALaaS can automatically select and run AL strategies for non-expert users under different datasets and budgets. Our code is available at \url{https://github.com/MLSysOps/Active-Learning-as-a-Service}.
Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models
Technical University of Munich, Munich Center for Machine Learning (MCML), MDSI(慕尼黑工业大学,慕尼黑机器学习中心(MCML),MDSI);LTCI, Télécom Paris, Institut Polytechnique de Paris, France(法国巴黎理工学院,巴黎电信学院,LTCI);Helmholtz Munich(亥姆霍兹慕尼黑中心);University of California, Berkeley(加州大学伯克利分校)
Data-centric AI approach to improve optic nerve head segmentation and localization in OCT en face images
Medical University of Vienna(维也纳医科大学);Carl Zeiss Meditec, Inc.(卡尔蔡司医疗技术公司)
视网膜成像数据中解剖特征的自动检测和定位与许多方面相关。在这项工作中,我们遵循以数据为中心的方法来优化分类器训练,用于在视网膜的光学相干断层扫描正面图像中进行视神经乳头检测和定位。我们研究领域知识驱动的空间复杂性降低对所产生的视神经乳头分割和定位性能的影响。我们提出了一种机器学习方法,用于在3D宽场扫频源光学相干断层扫描的2D正面投影中分割视神经乳头,该方法能够自动评估大量数据。对视网膜的手动注释的2D en face图像的评估表明,当底层像素级二进制分类任务通过领域知识在空间上放松时,标准U-Net的训练可以产生改进的视神经乳头分割和定位性能。
Handoff Design in User-Centric Cell-Free Massive MIMO Networks Using DRL
Department of Electrical and Computer Engineering (ECE), Royal Military College of Canada(电气与计算机工程系,加拿大皇家军事学院);Department of ECE, University of Toronto(电气工程系,多伦多大学);Department of Electrical, Computer, and Software Engineering, University of Ontario Institute of Technology(电气、计算机与软件工程系, Ontario Institute of Technology 大学);Ericsson Canada(爱立信加拿大)