arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv cs/0105022cs.AI
收藏

规则发现的多通道并行自适应理论

Multi-Channel Parallel Adaptation Theory for Rule Discovery

Li Min Fu

摘要:

在本文中,我们介绍了一种新的机器学习理论的基础上,多通道并行适应的规则发现。该理论与神经网络的并行分布式自适应理论的区别在于基于通道的收敛到目标规则。我们展示了如何实现这一理论在一个名为CFRule的学习系统。CFRule是一个基于权重的并行模型,但它不同于传统的神经计算,因为它的内部知识是可理解的。此外,当模型在训练时收敛时,每个通道收敛到目标规则。模型自适应规则采用基于梯度下降的多级并行权值优化方法。然而,由于梯度下降只能保证局部最优,因此开发了基于多通道回归的优化策略来有效地处理这个问题。形式上,我们证明了CFRule模型可以显式和精确地编码任何给定的规则集。此外,我们证明了异步并行收敛,这是多通道并行适应理论的规则学习的一个关键因素有关的属性。由于CFRule模型的可量化性,可以通过基于阈值的机制完整、可靠地提取规则。最后,该理论在DNA启动子识别和肝炎预后预测中的实际应用。

英文摘要:

In this paper, we introduce a new machine learning theory based on multi-channel parallel adaptation for rule discovery. This theory is distinguished from the familiar parallel-distributed adaptation theory of neural networks in terms of channel-based convergence to the target rules. We show how to realize this theory in a learning system named CFRule. CFRule is a parallel weight-based model, but it departs from traditional neural computing in that its internal knowledge is comprehensible. Furthermore, when the model converges upon training, each channel converges to a target rule. The model adaptation rule is derived by multi-level parallel weight optimization based on gradient descent. Since, however, gradient descent only guarantees local optimization, a multi-channel regression-based optimization strategy is developed to effectively deal with this problem. Formally, we prove that the CFRule model can explicitly and precisely encode any given rule set. Also, we prove a property related to asynchronous parallel convergence, which is a critical element of the multi-channel parallel adaptation theory for rule learning. Thanks to the quantizability nature of the CFRule model, rules can be extracted completely and soundly via a threshold-based mechanism. Finally, the practical application of the theory is demonstrated in DNA promoter recognition and hepatitis prognosis prediction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑