arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.12002cs.LGcs.SIstat.ML
收藏

Grale:设计用于图学习的网络

Grale: Designing Networks for Graph Learning

Google Research(谷歌研究院);YouTube

Jonathan Halcrow, Alexandru Moşoi, Sam Ruth, Bryan Perozzi

摘要:

我们如何为半监督学习找到正确的图?在现实世界的应用中,选择哪些边用于计算是任何图学习过程的第一步。有趣的是,通常有许多类型的相似性可供选择作为节点之间的边,边的选择可以极大地影响下游半监督学习系统的性能。然而,尽管图设计的重要性,大多数文献假设图是静态的。在这项工作中,我们提出了Grale,一个可扩展的方法,我们已经开发出解决问题的图设计的图与数十亿个节点。Grale通过将不同的相似性度量(潜在的弱相似性)融合在一起来创建一个图,该图在其节点之间表现出高度的任务特定的同质性。Grale是为在大型数据集上运行而设计的。我们已经在Google的20多个不同的工业环境中部署了Grale,包括拥有数百亿个节点的数据集,以及数百万亿条潜在的边缘。通过采用局部敏感哈希技术,我们大大减少了需要评分的对的数量,使我们能够在几小时内学习特定于任务的模型并为这些数据集构建相关的最近邻图,而不是可能需要几天甚至几周。我们通过一个案例研究来说明这一点,在这个案例中,我们研究了Grale在YouTube上的滥用分类问题中的应用,该问题有数亿个项目。在这个应用程序中,我们发现Grale在硬编码规则和内容分类器的基础上检测到大量恶意行为者,仅这些方法的总召回率就提高了89%。

英文摘要:

How can we find the right graph for semi-supervised learning? In real world applications, the choice of which edges to use for computation is the first step in any graph learning process. Interestingly, there are often many types of similarity available to choose as the edges between nodes, and the choice of edges can drastically affect the performance of downstream semi-supervised learning systems. However, despite the importance of graph design, most of the literature assumes that the graph is static. In this work, we present Grale, a scalable method we have developed to address the problem of graph design for graphs with billions of nodes. Grale operates by fusing together different measures of(potentially weak) similarity to create a graph which exhibits high task-specific homophily between its nodes. Grale is designed for running on large datasets. We have deployed Grale in more than 20 different industrial settings at Google, including datasets which have tens of billions of nodes, and hundreds of trillions of potential edges to score. By employing locality sensitive hashing techniques,we greatly reduce the number of pairs that need to be scored, allowing us to learn a task specific model and build the associated nearest neighbor graph for such datasets in hours, rather than the days or even weeks that might be required otherwise. We illustrate this through a case study where we examine the application of Grale to an abuse classification problem on YouTube with hundreds of million of items. In this application, we find that Grale detects a large number of malicious actors on top of hard-coded rules and content classifiers, increasing the total recall by 89% over those approaches alone.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑