In this paper, we propose a new measure to gauge the complexity of image classification problems. Given an annotated image dataset, our method computes a complexity measure called the cumulative spectral gradient (CSG) which strongly correlates with the test accuracy of convolutional neural networks (CNN). The CSG measure is derived from the probabilistic divergence between classes in a spectral clustering framework. We show that this metric correlates with the overall separability of the dataset and thus its inherent complexity. As will be shown, our metric can be used for dataset reduction, to assess which classes are more difficult to disentangle, and approximate the accuracy one could expect to get with a CNN. Results obtained on 11 datasets and three CNN models reveal that our method is more accurate and faster than previous complexity measures.
Assessing Pre-Trained Models for Transfer Learning Through Distribution of Spectral Components
School of Data Science and Engineering, East China Normal University(华东师范大学数据科学与工程学院);School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院)
The effects of Hessian eigenvalue spectral density type on the applicability of Hessian analysis to generalization capability assessment of neural networks
Joint Stock “Research and production company “Kryptonite”(“Kryptonite”股份公司“科研生产公司”)
Parallel Implementations Assessment of a Spatial-Spectral Classifier for Hyperspectral Clinical Applications
Centre of Software Technologies and Multimedia Systems (CITSEM), Universidad Politécnica de Madrid (UPM)(马德里理工大学软件技术与多媒体系统中心);University of Pavia(帕维亚大学);Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC)(拉斯帕尔马斯大加那利大学应用微电子研究所)