arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.25699cs.LGcs.AI
收藏

机器学习流水线的神经网络转换

Neural Network Conversion of Machine Learning Pipelines

Raytheon BBN Technologies(雷神BBN科技公司)

Man-Ling Sung, Jan Silovsky, Man-Hung Siu, Herbert Gish, Chinnu Pittapally

AI总结:

本文探讨了将非神经网络的机器学习流水线作为教师模型,转换为神经网络学生模型的方法,通过联合优化流水线组件实现多任务统一推理引擎。

摘要:

本文探讨了将非神经网络的机器学习流水线作为教师模型,转换为神经网络学生模型的方法,通过联合优化流水线组件实现多任务统一推理引擎。

英文摘要:

Transfer learning and knowledge distillation has recently gained a lot of attention in the deep learning community. One transfer approach, the student-teacher learning, has been shown to successfully create ``small'' student neural networks that mimic the performance of a much bigger and more complex ``teacher'' networks. In this paper, we investigate an extension to this approach and transfer from a non-neural-based machine learning pipeline as teacher to a neural network (NN) student, which would allow for joint optimization of the various pipeline components and a single unified inference engine for multiple ML tasks. In particular, we explore replacing the random forest classifier by transfer learning to a student NN. We experimented with various NN topologies on 100 OpenML tasks in which random forest has been one of the best solutions. Our results show that for the majority of the tasks, the student NN can indeed mimic the teacher if one can select the right NN hyper-parameters. We also investigated the use of random forest for selecting the right NN hyper-parameters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑