arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.08800cs.LGmath.OC
收藏

非光滑目标的深度学习

Deep Learning with Nonsmooth Objectives

Vinesha Peiris, Nadezda Sukhorukova, Vera Roshchina

摘要:

我们探讨了在人工神经网络的训练中使用基于最大范数的非光滑损失函数的可能性。我们假设,这可能会导致优越的分类结果在某些特殊情况下,训练数据是非常小的或不平衡的。我们的数值实验上进行了一个简单的人工神经网络没有隐藏层(设置立即服从标准的非光滑优化技术)似乎证实了我们的假设,基于均匀近似的方法可能更适合于数据集的可靠的训练数据,无论是有限的大小或偏见的相对集群大小。

英文摘要:

We explore the potential for using a nonsmooth loss function based on the max-norm in the training of an artificial neural network. We hypothesise that this may lead to superior classification results in some special cases where the training data is either very small or unbalanced. Our numerical experiments performed on a simple artificial neural network with no hidden layers (a setting immediately amenable to standard nonsmooth optimisation techniques) appear to confirm our hypothesis that uniform approximation based approaches may be more suitable for the datasets with reliable training data that either is limited size or biased in terms of relative cluster sizes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑