arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.08951cs.LGcs.CVeess.IV
收藏

NAS的元学习在医学图像应用中的少样本学习

Meta-Learning of NAS for Few-shot Learning in Medical Image Applications

University of Arkansas(阿肯色大学);VNUHCM-University of Science(越南胡志明市国家大学科学大学)

Viet-Khoa Vo-Ho, Kashu Yamazaki, Hieu Hoang, Minh-Triet Tran, Ngan Le

摘要:

深度学习方法已经成功地解决了机器学习中的任务,并在许多领域取得了突破,因为它们能够从非结构化数据中自动提取特征。然而,它们的性能依赖于手动试错过程来选择适当的网络架构、用于训练的超参数以及前/后程序。尽管已经表明,网络结构在从数据中学习特征表示特征和最终性能方面起着关键作用,但搜索最佳网络结构是计算密集型的,并且严重依赖于研究人员的经验。自动化机器学习(AutoML)及其高级技术,即神经架构搜索(NAS)已经被推广以解决这些限制。NAS不仅适用于一般的计算机视觉任务,而且还推动了包括医学成像在内的多个领域的各种应用。在医学成像中,NAS在提高图像分类、分割、重建等的准确性方面取得了重大进展。然而,NAS需要大量带注释的数据、大量计算资源和预定义任务的可用性。为了解决这些限制,元学习已经被采用在少样本学习和多任务的场景中。在本书的这一章中,我们首先通过讨论搜索空间、搜索策略和评估策略中的著名方法来简要回顾NAS。然后,我们介绍了各种NAS方法在医学成像与不同的应用,如分类,分割,检测,重建等元学习在NAS的少样本学习和多个任务,然后解释。最后,我们描述了几个开放的问题,在NAS。

英文摘要:

Deep learning methods have been successful in solving tasks in machine learning and have made breakthroughs in many sectors owing to their ability to automatically extract features from unstructured data. However, their performance relies on manual trial-and-error processes for selecting an appropriate network architecture, hyperparameters for training, and pre-/post-procedures. Even though it has been shown that network architecture plays a critical role in learning feature representation feature from data and the final performance, searching for the best network architecture is computationally intensive and heavily relies on researchers' experience. Automated machine learning (AutoML) and its advanced techniques i.e. Neural Architecture Search (NAS) have been promoted to address those limitations. Not only in general computer vision tasks, but NAS has also motivated various applications in multiple areas including medical imaging. In medical imaging, NAS has significant progress in improving the accuracy of image classification, segmentation, reconstruction, and more. However, NAS requires the availability of large annotated data, considerable computation resources, and pre-defined tasks. To address such limitations, meta-learning has been adopted in the scenarios of few-shot learning and multiple tasks. In this book chapter, we first present a brief review of NAS by discussing well-known approaches in search space, search strategy, and evaluation strategy. We then introduce various NAS approaches in medical imaging with different applications such as classification, segmentation, detection, reconstruction, etc. Meta-learning in NAS for few-shot learning and multiple tasks is then explained. Finally, we describe several open problems in NAS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑