arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.08680cs.AI
收藏

基于GPT-4的异构图神经网络架构搜索

Heterogeneous Graph Neural Architecture Search with GPT-4

Cyberspace Institute of Advanced Technology, Guangzhou University(广州大学网络空间先进技术研究院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)

Haoyuan Dong, Yang Gao, Haishuai Wang, Hong Yang, Peng Zhang

AI总结:

针对现有异构图神经网络架构搜索效率低、结果不稳定的问题,提出GPT-4增强的GHGNAS方法,通过迭代提示与反馈优化生成架构,实现更高效稳定的搜索效果。

摘要:

异构图神经网络架构搜索(HGNAS)是自动设计高效异构图神经网络的有力工具,但现有HGNAS算法存在搜索效率低、结果不稳定的问题。本文提出一种新型基于GPT-4的HGNAS模型,以提升HGNAS的搜索效率与搜索精度。具体而言,我们提出了GPT-4增强的异构图神经网络架构搜索(简称GHGNAS),其核心思路是设计一组提示词,引导GPT-4完成生成新型异构图神经网络架构的任务。通过使用提示词迭代询问GPT-4,GHGNAS会持续验证生成的HGNN的精度,并利用反馈进一步优化提示词。实验结果表明,GHGNAS可借助GPT-4强大的泛化能力设计新型HGNN,且相比此前基于强化学习和可微搜索算法的HGNAS模型,运行更高效、结果更稳定。

英文摘要:

Heterogeneous graph neural architecture search (HGNAS) represents a powerful tool for automatically designing effective heterogeneous graph neural networks. However, existing HGNAS algorithms suffer from inefficient searches and unstable results. In this paper, we present a new GPT-4 based HGNAS model to improve the search efficiency and search accuracy of HGNAS. Specifically, we present a new GPT-4 enhanced Heterogeneous Graph Neural Architecture Search (GHGNAS for short). The basic idea of GHGNAS is to design a set of prompts that can guide GPT-4 toward the task of generating new heterogeneous graph neural architectures. By iteratively asking GPT-4 with the prompts, GHGNAS continually validates the accuracy of the generated HGNNs and uses the feedback to further optimize the prompts. Experimental results show that GHGNAS can design new HGNNs by leveraging the powerful generalization capability of GPT-4. Moreover, GHGNAS runs more effectively and stably than previous HGNAS models based on reinforcement learning and differentiable search algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑