arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1703.02570cs.LGstat.ML
收藏

利用特征边信息正则化非线性模型

Regularising Non-linear Models Using Feature Side-information

HES-SO(瑞士西部应用科学与艺术大学);University of Geneva(日内瓦大学)

Amina Mollaysa, Pablo Strasser, Alexandros Kalousis

摘要:

通常,功能都有自己的矢量描述,这些描述提供了有关其属性的详细信息。我们将这些矢量描述称为特征边信息。在标准学习场景中,输入被表示为特征向量,并且特征边信息最常被忽略或仅用于模型拟合之前的特征选择。我们相信,如果在学习过程中以适当的方式使用,携带关于特征内在属性的信息的特征边信息将有助于提高模型预测。在本文中,我们提出了一个框架,允许在非常一般的模型族的学习过程中纳入特征边信息,以提高预测性能。我们控制学习模型的结构,使它们反映特征相似性,因为这些特征是基于边信息定义的。我们在一些基准数据集上进行实验,这些数据集在一些基线上显示出显着的预测性能增益,这是由于利用了边信息。

英文摘要:

Very often features come with their own vectorial descriptions which provide detailed information about their properties. We refer to these vectorial descriptions as feature side-information. In the standard learning scenario, input is represented as a vector of features and the feature side-information is most often ignored or used only for feature selection prior to model fitting. We believe that feature side-information which carries information about features intrinsic property will help improve model prediction if used in a proper way during learning process. In this paper, we propose a framework that allows for the incorporation of the feature side-information during the learning of very general model families to improve the prediction performance. We control the structures of the learned models so that they reflect features similarities as these are defined on the basis of the side-information. We perform experiments on a number of benchmark datasets which show significant predictive performance gains, over a number of baselines, as a result of the exploitation of the side-information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑