arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1005.5556cs.LGcs.AIcs.NE
收藏

以特征重要性形式的弱领域知识辅助的经验学习

Empirical learning aided by weak domain knowledge in the form of feature importance

American International University Bangladesh(孟加拉美国国际大学)

Ridwan Al Iqbal

摘要:

使用领域知识的标准混合学习者需要更强的知识,这是很难和昂贵的获得。然而,较弱的领域知识可以受益于先验知识,同时具有成本效益。弱知识的形式特征相对重要性(FRI)的介绍和解释。特征相对重要性是由专家提供的特征重要性的实值近似。IANN是一种改进的多层神经网络算法,证明了利用这些知识的优势。IANN是标准神经网络算法的一个非常简单的修改,但获得显着的性能增益。在分子生物学领域的实验结果表明,更高的性能比其他经验学习算法,包括标准的反向传播和支持向量机。IANN的性能甚至可以与使用更强领域知识的理论精化系统KBANN相媲美。这表明特征相对重要性可以以最小的努力显着提高现有经验学习算法的性能。

英文摘要:

Standard hybrid learners that use domain knowledge require stronger knowledge that is hard and expensive to acquire. However, weaker domain knowledge can benefit from prior knowledge while being cost effective. Weak knowledge in the form of feature relative importance (FRI) is presented and explained. Feature relative importance is a real valued approximation of a feature's importance provided by experts. Advantage of using this knowledge is demonstrated by IANN, a modified multilayer neural network algorithm. IANN is a very simple modification of standard neural network algorithm but attains significant performance gains. Experimental results in the field of molecular biology show higher performance over other empirical learning algorithms including standard backpropagation and support vector machines. IANN performance is even comparable to a theory refinement system KBANN that uses stronger domain knowledge. This shows Feature relative importance can improve performance of existing empirical learning algorithms significantly with minimal effort.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑