Existing benchmarks like NLGraph and GraphQA evaluate LLMs on graphs by focusing mainly on pairwise relationships, overlooking the high-order correlations found in real-world data. Hypergraphs, which can model complex beyond-pairwise relationships, offer a more robust framework but are still underexplored in the context of LLMs. To address this gap, we introduce LLM4Hypergraph, the first comprehensive benchmark comprising 21,500 problems across eight low-order, five high-order, and two isomorphism tasks, utilizing both synthetic and real-world hypergraphs from citation networks and protein structures. We evaluate six prominent LLMs, including GPT-4o, demonstrating our benchmark's effectiveness in identifying model strengths and weaknesses. Our specialized prompting framework incorporates seven hypergraph languages and introduces two novel techniques, Hyper-BAG and Hyper-COT, which enhance high-order reasoning and achieve an average 4% (up to 9%) performance improvement on structure classification tasks. This work establishes a foundational testbed for integrating hypergraph computational capabilities into LLMs, advancing their comprehension. The source codes are at https://github.com/iMoonLab/LLM4Hypergraph.
HGMEM: Hypergraph-based Working Memory to Improve Multi-step RAG for Long-Context Complex Relational Modeling
The Chinese University of Hong Kong.(香港中文大学);Pengcheng Laboratory.(鹏城实验室);WeChat AI, Tencent(微信AI,腾讯);University of Chinese Academy of Sciences.(中国科学院大学)
Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation
School of Software, Tsinghua University(清华大学软件学院);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);School of Science, Shanghai University(上海大学理学院);School of Information and Electronics, Beijing Institute of Technology(北京理工大学信息与电子学院)
Beyond Single-Audio: Advancing Multi-Audio Processing in Audio Large Language Models
National University of Singapore(新加坡国立大学);ASUS Intelligent Cloud Services(华硕智能云服务);I2R, Agency for Science, Technology, and Research (A*STAR)(新加坡科技研究局信息研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Universidad Politécnica de Madrid(马德里理工大学)
Hypergraph Neural Stochastic Diffusion: An SDE Framework for Uncertainty Estimation
School of Mathematics and Statistics, Shandong University, Weihai(山东大学(威海)数学与统计学院);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);University of Chinese Academy of Sciences(中国科学院大学)
HyperDet: Source Detection in Hypergraphs via Interactive Relationship Construction and Feature-rich Attention Fusion
School of Artificial Intelligence, Optics and Electronics, Northwestern Polytechnical University(人工智能、光学与电子学院,西北工业大学);School of Computer Science, Northwestern Polytechnical University(计算机科学学院,西北工业大学);School of Cybersecurity, Northwestern Polytechnical University(网络安全学院,西北工业大学);Cyberspace Institute of Advanced Technology, Guangzhou University(先进技术网络空间研究院,广州大学)
School of Statistics and Data Science, Nankai University(南开大学统计与数据科学学院);Department of Computer Science, University of California, Los Angeles(加利福尼亚大学洛杉矶分校计算机系)
DAIL: Beyond Task Ambiguity for Language-Conditioned Reinforcement Learning
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation Chinese Academy of Sciences(认知与决策智能复杂系统重点实验室,自动化研究所,中国科学院);Department of Automation Tsinghua University(清华大学自动化系);Moonshot AI;Department of Computer Science and Engineering Washington University(华盛顿大学计算机科学与工程系);Tecent AI Lab(腾讯AI实验室)
Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots
Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125, USA(计算与数学科学系,加州理工学院,帕萨迪纳,CA 91125,美国);Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA 91109, USA(喷气推进实验室,加州理工学院,帕萨迪纳,CA 91109,美国)