We consider supervised learning problems where the features are embedded in a graph, such as gene expressions in a gene network. In this context, it is of much interest to automatically select a subgraph with few connected components; by exploiting prior knowledge, one can indeed improve the prediction performance or obtain results that are easier to interpret. Regularization or penalty functions for selecting features in graphs have recently been proposed, but they raise new algorithmic challenges. For example, they typically require solving a combinatorially hard selection problem among all connected subgraphs. In this paper, we propose computationally feasible strategies to select a sparse and well-connected subset of features sitting on a directed acyclic graph (DAG). We introduce structured sparsity penalties over paths on a DAG called "path coding" penalties. Unlike existing regularization functions that model long-range interactions between features in a graph, path coding penalties are tractable. The penalties and their proximal operators involve path selection problems, which we efficiently solve by leveraging network flow optimization. We experimentally show on synthetic, image, and genomic data that our approach is scalable and leads to more connected subgraphs than other regularization functions for graphs.
A Supervised Learning Algorithm for Multilayer Spiking Neural Networks Based on Temporal Coding Toward Energy-Efficient VLSI Processor Design
Institute of Industrial Science, The University of Tokyo(东京大学生产技术研究所);NEC Corporation(日本电气股份有限公司);Interdisciplinary Graduate School of Engineering Sciences, Kyushu University(九州大学工学研究院跨学科工学研究科);Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology(九州工业大学生命科学与系统工程研究生院);International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, The University of Tokyo(东京大学高等研究院神经智能国际研究中心(WPI-IRCN))
Reykjavik University(雷克雅未克大学);Primary Health Care Service of the Capital Area(首都地区初级卫生保健服务中心);University of Iceland(冰岛大学);Development Centre for Primary Health Care in Iceland(冰岛初级卫生保健发展中心)