人工神经网络中符号规则的提取
Extraction of Symbolic Rules from Artificial Neural Networks
摘要:
虽然反向传播ANN通常比决策树更好地预测模式分类问题,但它们通常被视为黑盒,即,它们的预测不能解释为决策树的预测。在许多应用中,希望从训练的ANN中提取知识,以便用户更好地理解网络如何解决问题。提出并实现了一种新的规则提取算法--人工神经网络规则提取算法(REANN)。一个标准的三层前馈人工神经网络是该算法的基础。提出了一种四阶段的反向传播学习算法。通过将所提取的规则与由其他方法生成的符号规则进行比较来支持所提取的规则的显式性。提取的规则与其他方法相比,在规则的数量,规则的平均条件数,和预测精度。对乳腺癌、虹膜、糖尿病、季节分类等典型分类问题的实验结果表明,该方法具有较好的泛化能力.
英文摘要:
Although backpropagation ANNs generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions cannot be explained as those of decision trees. In many applications, it is desirable to extract knowledge from trained ANNs for the users to gain a better understanding of how the networks solve the problems. A new rule extraction algorithm, called rule extraction from artificial neural networks (REANN) is proposed and implemented to extract symbolic rules from ANNs. A standard three-layer feedforward ANN is the basis of the algorithm. A four-phase training algorithm is proposed for backpropagation learning. Explicitness of the extracted rules is supported by comparing them to the symbolic rules generated by other methods. Extracted rules are comparable with other methods in terms of number of rules, average number of conditions for a rule, and predictive accuracy. Extensive experimental studies on several benchmarks classification problems, such as breast cancer, iris, diabetes, and season classification problems, demonstrate the effectiveness of the proposed approach with good generalization ability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。