arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.08698cs.NEcs.LG
收藏

利用演化计算生成高效的DNN集成

Generating Efficient DNN-Ensembles with Evolutionary Computation

Barcelona Supercomputing Center(巴塞罗那超级计算中心);IBM Research - Zurich(IBM苏黎世研究院)

Marc Ortiz, Florian Scheidegger, Marc Casas, Cristiano Malossi, Eduard Ayguadé

摘要:

在这项工作中,我们利用集成学习作为创建更快,更小,更准确的深度学习模型的工具。我们证明,我们可以通过组合DNN分类器来联合优化准确性,推理时间和参数数量。为了实现这一目标,我们结合了多种集成策略:装袋,提升和分类器的有序链。为了减少搜索过程中DNN集成评估的数量,我们提出了EARN,一种进化方法,根据用户指定的约束条件的三个目标来优化集成。我们在10个图像分类数据集上运行EARN,初始池为32个最先进的DCNN,在CPU和GPU平台上,我们生成的模型加速高达$7.60\times$,参数减少了$10\times$,或者准确度增加了$6.01\%$。此外,我们的方法生成的模型是$5.6\times$比最先进的自动模型生成方法更快。

英文摘要:

In this work, we leverage ensemble learning as a tool for the creation of faster, smaller, and more accurate deep learning models. We demonstrate that we can jointly optimize for accuracy, inference time, and the number of parameters by combining DNN classifiers. To achieve this, we combine multiple ensemble strategies: bagging, boosting, and an ordered chain of classifiers. To reduce the number of DNN ensemble evaluations during the search, we propose EARN, an evolutionary approach that optimizes the ensemble according to three objectives regarding the constraints specified by the user. We run EARN on 10 image classification datasets with an initial pool of 32 state-of-the-art DCNN on both CPU and GPU platforms, and we generate models with speedups up to $7.60\times$, reductions of parameters by $10\times$, or increases in accuracy up to $6.01\%$ regarding the best DNN in the pool. In addition, our method generates models that are $5.6\times$ faster than the state-of-the-art methods for automatic model generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑