arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08044cs.LGcs.AI
收藏

自优化特征转换

Self-Optimizing Feature Transformation

Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);University of Central Florida(中佛罗里达大学);Portland State University(波特兰州立大学);Institute for Infocomm Research(资讯通信研究院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))

Meng Xiao, Dongjie Wang, Min Wu, Kunpeng Liu, Hui Xiong, Yuanchun Zhou, Yanjie Fu

摘要:

特征变换旨在通过对现有特征进行数学变换来提取良好的表示(特征)空间。解决维数灾难、增强模型泛化能力、克服数据稀疏性和扩展经典模型的可用性是至关重要的。目前的研究主要集中在基于领域知识的特征工程或学习潜在的表示,然而,这些方法并不完全自动化,不能产生一个可追溯的和最佳的表示空间。当为机器学习任务重建特征空间时,这些限制是否可以同时解决?在这项扩展研究中,我们提出了一个自优化的框架功能转换。为了实现更好的性能,我们通过以下方式改进了初步工作:(1)获得高级状态表示,使增强型代理能够更好地理解当前特征集;(2)解决增强型代理中的Q值高估,以学习无偏和有效的策略。最后,为了使实验比前期工作更有说服力,我们通过添加五个数据集的离群值检测任务,评估各种状态表示方法,并比较不同的训练策略来得出结论。大量的实验和案例研究表明,我们的工作是更有效的和优越的。

英文摘要:

Feature transformation aims to extract a good representation (feature) space by mathematically transforming existing features. It is crucial to address the curse of dimensionality, enhance model generalization, overcome data sparsity, and expand the availability of classic models. Current research focuses on domain knowledge-based feature engineering or learning latent representations; nevertheless, these methods are not entirely automated and cannot produce a traceable and optimal representation space. When rebuilding a feature space for a machine learning task, can these limitations be addressed concurrently? In this extension study, we present a self-optimizing framework for feature transformation. To achieve a better performance, we improved the preliminary work by (1) obtaining an advanced state representation for enabling reinforced agents to comprehend the current feature set better; and (2) resolving Q-value overestimation in reinforced agents for learning unbiased and effective policies. Finally, to make experiments more convincing than the preliminary work, we conclude by adding the outlier detection task with five datasets, evaluating various state representation approaches, and comparing different training strategies. Extensive experiments and case studies show that our work is more effective and superior.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑