Backward compatibility of model predictions is a desired property when updating a machine learning driven application. It allows to seamlessly improve the underlying model without introducing regression bugs. In classification tasks these bugs occur in the form of negative flips. This means an instance that was correctly classified by the old model is now classified incorrectly by the updated model. This has direct negative impact on the user experience of such systems e.g. a frequently used voice assistant query is suddenly misclassified. A common reason to update the model is when new training data becomes available and needs to be incorporated. Simply retraining the model with the updated data introduces the unwanted negative flips. We study the problem of regression during data updates and propose Backward Compatible Weight Interpolation (BCWI). This method interpolates between the weights of the old and new model and we show in extensive experiments that it reduces negative flips without sacrificing the improved accuracy of the new model. BCWI is straight forward to implement and does not increase inference cost. We also explore the use of importance weighting during interpolation and averaging the weights of multiple new models in order to further reduce negative flips.
Improving Forward Compatibility in Class Incremental Learning by Increasing Representation Rank and Feature Richness
LINE Investment Technologies(LINE投资技术公司);Seoul National University(首尔大学);LG AI Research(LG人工智能研究院);Research Institute for Convergence Science, Seoul National University(首尔大学融合科学研究院)
Interpretable Diagnostics and Adaptive Data Assimilation for Neural ODEs via Discrete Empirical Interpolation
School of Mechanical Engineering, Purdue University(普渡大学机械工程学院);Mathematics and Computer Science Division, Argonne National Laboratory(阿贡国家实验室数学与计算机科学部)
Enforcing Latent Euclidean Geometry in Single-Cell VAEs for Manifold Interpolation
Institute of Computational Biology, Helmholtz Munich, Munich, Germany(海德堡医学院计算生物学研究所);Lamin Labs(Lamin实验室);Munich Data Science Institute, Technical University of Munich, Germany(慕尼黑数据科学研究所);TUM School of Life Sciences Weihenstephan, Technical University of Munich, Germany(技术大学生命科学学院)