DIWIFT:发现表格数据的实例影响特征
DIWIFT: Discovering Instance-wise Influential Features for Tabular Data
摘要:
表格数据是许多现实世界的Web应用程序(如零售、银行和电子商务)背后最常见的数据存储格式之一。这些Web应用程序的成功在很大程度上取决于所采用的机器学习模型准确区分表格数据中的所有预定特征和有影响力的特征的能力。直观地说,在实际业务场景中,不同的实例应该对应不同的影响特征集合,同一实例的影响特征集合在不同的场景中可能会有所不同。然而,大多数现有的方法集中于全局特征选择,假设所有实例具有相同的一组有影响力的特征,并且很少考虑实例式特征选择的方法忽略不同场景中有影响力的特征的可变性。本文首先介绍了一种基于影响函数的实例特征选择的新观点,并给出了相应的理论见解,其核心是利用影响函数作为衡量实例特征重要性的指标。然后,我们提出了一个新的解决方案,发现表数据中的实例有影响力的功能(DIWIFT),自注意力网络被用作特征选择模型和相应的影响函数的值被用作优化目标,以指导模型。受益于影响函数的优点,即,它的计算不依赖于特定的架构,并且还可以考虑不同场景下的数据分布,因此我们的DIWIFT具有更好的灵活性和鲁棒性。最后,我们在合成和真实世界的数据集上进行了广泛的实验,以验证我们的DIWIFT的有效性。
英文摘要:
Tabular data is one of the most common data storage formats behind many real-world web applications such as retail, banking, and e-commerce. The success of these web applications largely depends on the ability of the employed machine learning model to accurately distinguish influential features from all the predetermined features in tabular data. Intuitively, in practical business scenarios, different instances should correspond to different sets of influential features, and the set of influential features of the same instance may vary in different scenarios. However, most existing methods focus on global feature selection assuming that all instances have the same set of influential features, and few methods considering instance-wise feature selection ignore the variability of influential features in different scenarios. In this paper, we first introduce a new perspective based on the influence function for instance-wise feature selection, and give some corresponding theoretical insights, the core of which is to use the influence function as an indicator to measure the importance of an instance-wise feature. We then propose a new solution for discovering instance-wise influential features in tabular data (DIWIFT), where a self-attention network is used as a feature selection model and the value of the corresponding influence function is used as an optimization objective to guide the model. Benefiting from the advantage of the influence function, i.e., its computation does not depend on a specific architecture and can also take into account the data distribution in different scenarios, our DIWIFT has better flexibility and robustness. Finally, we conduct extensive experiments on both synthetic and real-world datasets to validate the effectiveness of our DIWIFT.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。