arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.00880cs.CVcs.LGstat.ML
收藏

为深度学习引入模糊层

Introducing Fuzzy Layers for Deep Learning

U.S. Army Engineer Research and Development Center(美国陆军工程研究与发展中心);Mississippi College(密西西比学院);University of Missouri(密苏里大学)

Stanton R. Price, Steven R. Price, Derek T. Anderson

摘要:

近年来发展的许多最先进的技术都在一定程度上受到了机器学习的影响。在撰写本文时,最流行的是属于深度学习范畴的人工智能方法。深度学习已经在许多应用程序中被证明是非常强大的,能够处理非常复杂和困难的问题。在这项工作中,我们为深度学习引入了一个新的层:模糊层。传统上,神经网络的网络架构由输入层、隐藏层的某种组合和输出层组成。我们建议在深度学习架构中引入模糊层,以利用通过模糊方法表达的强大聚合属性,例如Choquet和Sugueno模糊积分。迄今为止,用于深度学习的模糊方法已经通过在决策级应用各种融合策略来聚合来自最先进的预训练模型的输出,例如,AlexNet、VGG 16、GoogLeNet、Inception-v3、ResNet-18等。虽然这些策略已被证明可以提高图像分类任务的准确性,但没有一个探索过模糊化中间层或隐藏层的使用。在此,我们提出了一种新的深度学习策略,该策略将模糊策略结合到深度学习架构中,专注于使用每像素分类的语义分割的应用。实验进行了基准数据集,以及通过无人驾驶航空系统收集的数据集在美国陆军试验场的任务,自动道路分割,初步结果是有希望的。

英文摘要:

Many state-of-the-art technologies developed in recent years have been influenced by machine learning to some extent. Most popular at the time of this writing are artificial intelligence methodologies that fall under the umbrella of deep learning. Deep learning has been shown across many applications to be extremely powerful and capable of handling problems that possess great complexity and difficulty. In this work, we introduce a new layer to deep learning: the fuzzy layer. Traditionally, the network architecture of neural networks is composed of an input layer, some combination of hidden layers, and an output layer. We propose the introduction of fuzzy layers into the deep learning architecture to exploit the powerful aggregation properties expressed through fuzzy methodologies, such as the Choquet and Sugueno fuzzy integrals. To date, fuzzy approaches taken to deep learning have been through the application of various fusion strategies at the decision level to aggregate outputs from state-of-the-art pre-trained models, e.g., AlexNet, VGG16, GoogLeNet, Inception-v3, ResNet-18, etc. While these strategies have been shown to improve accuracy performance for image classification tasks, none have explored the use of fuzzified intermediate, or hidden, layers. Herein, we present a new deep learning strategy that incorporates fuzzy strategies into the deep learning architecture focused on the application of semantic segmentation using per-pixel classification. Experiments are conducted on a benchmark data set as well as a data set collected via an unmanned aerial system at a U.S. Army test site for the task of automatic road segmentation, and preliminary results are promising.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑