arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.10114cs.LGstat.ML
收藏

网络在网络中的表格数据分类在现实世界中的应用

Network On Network for Tabular Data Classification in Real-world Applications

Paradigm Inc.(第四范式公司);Hong Kong University of Science and Technology(香港科技大学)

Yuanfei Luo, Hao Zhou, Weiwei Tu, Yuqiang Chen, Wenyuan Dai, Qiang Yang

摘要:

表格数据是我们的客户从零售、金融到电子商务最常用的数据格式,而表格数据分类对其业务起着至关重要的作用。在本文中,我们提出了Network On Network(NON),这是一种基于深度神经网络的实用表格数据分类模型,可提供准确的预测。人们提出了各种各样的深部探测方法,并取得了可喜的进展。然而,它们大多使用神经网络和因式分解机等操作来直接融合不同特征的嵌入,并将这些操作的输出线性组合以获得最终的预测。结果,场内信息和那些操作(例如,神经网络和因子分解机器)之间的非线性交互被忽略。场内信息是每个场内的特征属于同一场的信息。NON被提出来充分利用场内信息和非线性相互作用。它由三个部分组成:底层的逐场网络,用于捕获场内信息;中间的跨场网络,用于选择合适的操作数据驱动器;顶层的操作融合网络,用于对所选操作的输出进行深度融合。在六个真实世界数据集上的广泛实验表明,NON可以显着优于最先进的模型。此外,定性和定量的研究嵌入空间的特征表明,NON可以有效地捕捉场内信息。

英文摘要:

Tabular data is the most common data format adopted by our customers ranging from retail, finance to E-commerce, and tabular data classification plays an essential role to their businesses. In this paper, we present Network On Network (NON), a practical tabular data classification model based on deep neural network to provide accurate predictions. Various deep methods have been proposed and promising progress has been made. However, most of them use operations like neural network and factorization machines to fuse the embeddings of different features directly, and linearly combine the outputs of those operations to get the final prediction. As a result, the intra-field information and the non-linear interactions between those operations (e.g. neural network and factorization machines) are ignored. Intra-field information is the information that features inside each field belong to the same field. NON is proposed to take full advantage of intra-field information and non-linear interactions. It consists of three components: field-wise network at the bottom to capture the intra-field information, across field network in the middle to choose suitable operations data-drivenly, and operation fusion network on the top to fuse outputs of the chosen operations deeply. Extensive experiments on six real-world datasets demonstrate NON can outperform the state-of-the-art models significantly. Furthermore, both qualitative and quantitative study of the features in the embedding space show NON can capture intra-field information effectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑