arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.03187cs.LGcs.AI
收藏

集成特征选择和规则提取的自适应神经模糊系统在高维分类问题中的应用

An Adaptive Neuro-Fuzzy System with Integrated Feature Selection and Rule Extraction for High-Dimensional Classification Problems

China University of Petroleum (East China)(中国石油大学(华东));Indian Statistical Institute(印度统计研究所)

Guangdong Xue, Qin Chang, Jian Wang, Kai Zhang, Nikhil R. Pal

摘要:

模糊或神经模糊系统的一个主要限制是它们无法处理高维数据集。这主要是由于使用了T范数,特别是乘积或最小值(或它的较软版本)。因此,几乎没有任何工作处理维度超过一百左右的数据集。在这里,我们提出了一个神经模糊的框架,可以处理数据集的维度甚至超过7000!在这种情况下,我们提出了一个自适应softmin(Ada-softmin),有效地克服了现有的模糊系统在处理高维问题时出现的"数值下溢”和"假最小值”的缺点。我们称之为自适应Takagi-Sugeno-Kang(AdaTSK)模糊系统。然后,我们装备的AdaTSK系统进行特征选择和规则提取在一个集成的方式。在这种情况下,一个新的门函数被引入,并嵌入在随后的部分,它可以确定有用的功能和规则,在两个连续的学习阶段。与传统的模糊规则库,我们设计了一个增强的模糊规则库(En-FRB),它保持足够的规则,但不增长的规则数量与维度,通常发生的模糊神经网络。集成的特征选择和规则提取AdaTSK(FSRE-AdaTSK)系统包括三个连续的阶段:(i)特征选择,(ii)规则提取,和(iii)微调。FSRE-AdaTSK的有效性证明了19个数据集,其中5个是在超过2000的维度,包括两个维度大于7000。这可能是第一次模糊系统实现的分类涉及超过7000个输入功能。

英文摘要:

A major limitation of fuzzy or neuro-fuzzy systems is their failure to deal with high-dimensional datasets. This happens primarily due to the use of T-norm, particularly, product or minimum (or a softer version of it). Thus, there are hardly any work dealing with datasets with dimensions more than hundred or so. Here, we propose a neuro-fuzzy framework that can handle datasets with dimensions even more than 7000! In this context, we propose an adaptive softmin (Ada-softmin) which effectively overcomes the drawbacks of ``numeric underflow" and ``fake minimum" that arise for existing fuzzy systems while dealing with high-dimensional problems. We call it an Adaptive Takagi-Sugeno-Kang (AdaTSK) fuzzy system. We then equip the AdaTSK system to perform feature selection and rule extraction in an integrated manner. In this context, a novel gate function is introduced and embedded only in the consequent parts, which can determine the useful features and rules, in two successive phases of learning. Unlike conventional fuzzy rule bases, we design an enhanced fuzzy rule base (En-FRB), which maintains adequate rules but does not grow the number of rules exponentially with dimension that typically happens for fuzzy neural networks. The integrated Feature Selection and Rule Extraction AdaTSK (FSRE-AdaTSK) system consists of three sequential phases: (i) feature selection, (ii) rule extraction, and (iii) fine tuning. The effectiveness of the FSRE-AdaTSK is demonstrated on 19 datasets of which five are in more than 2000 dimension including two with dimension greater than 7000. This may be the first time fuzzy systems are realized for classification involving more than 7000 input features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑