arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.05279cs.LGcs.CV
收藏

流形:通过流形发现的直接空间划分

Manifoldron: Direct Space Partition via Manifold Discovery

Weill Cornell Medicine, Cornell University(康奈尔大学威尔康奈尔医学院);University of Florida(佛罗里达大学);Rensselaer Polytechnic Institute(伦斯勒理工学院)

Dayang Wang, Feng-Lei Fan, Bo-Jian Hou, Hao Zhang, Zhen Jia, Boce Zhou, Rongjie Lai, Hengyong Yu, Fei Wang

摘要:

具有广泛使用的ReLU激活的神经网络已被证明可以将样本空间划分为许多凸多面体进行预测。然而,神经网络和其他机器学习模型用于划分空间的参数化方式有缺陷,\textit{e}。\textit{g} .,复杂模型的可解释性受到损害,由于模型的通用特性而导致决策边界构建的不确定性,以及陷入捷径解决方案的风险。相比之下,尽管非参数化模型可以巧妙地避免或淡化这些问题,但由于过度简化或未能适应数据的多种结构,它们通常不够强大。在这种情况下,我们首先提出了一种新型的机器学习模型,称为流形,直接从数据中导出决策边界,并通过流形结构发现来划分空间。然后,我们系统地分析了流形的关键特性,如流形表征能力及其与神经网络的联系。在4个合成示例、20个公共基准数据集和1个真实应用上的实验结果表明,与主流机器学习模型相比,该Manifoldron具有很强的竞争力.我们已经在\url{https://github.com/wdayang/Manifoldron}中共享了我们的代码,供免费下载和评估。

英文摘要:

A neural network with the widely-used ReLU activation has been shown to partition the sample space into many convex polytopes for prediction. However, the parameterized way a neural network and other machine learning models use to partition the space has imperfections, \textit{e}.\textit{g}., the compromised interpretability for complex models, the inflexibility in decision boundary construction due to the generic character of the model, and the risk of being trapped into shortcut solutions. In contrast, although the non-parameterized models can adorably avoid or downplay these issues, they are usually insufficiently powerful either due to over-simplification or the failure to accommodate the manifold structures of data. In this context, we first propose a new type of machine learning models referred to as Manifoldron that directly derives decision boundaries from data and partitions the space via manifold structure discovery. Then, we systematically analyze the key characteristics of the Manifoldron such as manifold characterization capability and its link to neural networks. The experimental results on 4 synthetic examples, 20 public benchmark datasets, and 1 real-world application demonstrate that the proposed Manifoldron performs competitively compared to the mainstream machine learning models. We have shared our code in \url{https://github.com/wdayang/Manifoldron} for free download and evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑