The ability to discriminate between generative graph models is critical to understanding complex structural patterns in both synthetic graphs and the real-world structures that they emulate. While Graph Neural Networks (GNNs) have seen increasing use to great effect in graph classification tasks, few studies explore their integration with interpretable graph theoretic features. This paper investigates the classification of synthetic graph families using a hybrid approach that combines GNNs with engineered graph-theoretic features. We generate a large and structurally diverse synthetic dataset comprising graphs from five representative generative families, Erdos-Renyi, Watts-Strogatz, Barab'asi-Albert, Holme-Kim, and Stochastic Block Model. These graphs range in size up to 1x10^4 nodes, containing up to 1.1x10^5 edges. A comprehensive range of node and graph level features is extracted for each graph and pruned using a Random Forest based feature selection pipeline. The features are integrated into six GNN architectures: GCN, GAT, GATv2, GIN, GraphSAGE and GTN. Each architecture is optimised for hyperparameter selection using Optuna. Finally, models were compared against a baseline Support Vector Machine (SVM) trained solely on the handcrafted features. Our evaluation demonstrates that GraphSAGE and GTN achieve the highest classification performance, with 98.5% accuracy, and strong class separation evidenced by t-SNE and UMAP visualisations. GCN and GIN also performed well, while GAT-based models lagged due to limitations in their ability to capture global structures. The SVM baseline confirmed the importance of the message passing functionality for performance gains and meaningful class separation.
DispBench: Benchmarking Disparity Estimation to Synthetic Corruptions
Data and Web Science Group, University of Mannheim(曼海姆大学数据与网络科学小组);Max-Planck-Institute for Informatics, Saarland Informatics Campus(马克斯·普朗克研究所信息学研究所萨尔兰信息学校区)
本文提出DispBench基准测试工具,系统评估视差估计方法在对抗攻击和2D Common Corruptions等合成损坏下的鲁棒性,并通过迄今最广泛的分析揭示准确率、可靠性与泛化能力之间的关键相关性。
Protein-SE(3): Benchmarking SE(3)-based Generative Models for Protein Structure Design
School of Computer Science and Technology, East China Normal University(东华师范大学计算机科学与技术学院);Shanghai Institute of AI for Education, East China Normal University(东华师范大学上海人工智能教育研究所);AI Lab, Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心人工智能实验室)
ConvGeN: Convex space learning improves deep-generative oversampling for tabular imbalanced classification on smaller datasets
University of Rostock(罗斯托克大学);Leibniz-Institute for Food Systems Biology(莱布尼茨食品系统生物学研究所);Technical University of Munich(慕尼黑工业大学);Technische Universität Dresden(德累斯顿工业大学)
Benchmarking Time Series Generation Methods for Privacy-Preserving Forecasting
University of Minho(米尼奥大学);Universidade do Porto(波尔图大学);Laboratory for Artificial Intelligence and Computer Science (LIACC)(人工智能与计算机科学实验室(LIACC));Fraunhofer Portugal AICOS(弗劳恩霍夫葡萄牙AICOS机构);INESCTEC;University of Coimbra(科英布拉大学)
Parameterized Argumentation-based Reasoning Tasks for Benchmarking Generative Language Models
Bernoulli Institute of Mathematics, Computer Science and Artificial Intelligence, University of Groningen(伯努利数学、计算机科学和人工智能研究所,格罗宁根大学);Department of Information and Computing Sciences, Utrecht University(信息与计算科学系,乌得勒支大学)
AtomBench: A Benchmarking Framework for Generative Crystal Reconstruction Models in Conventional Superconductors
Department of Physics and Astronomy, West Virginia University(物理与天文学系,西弗吉尼亚大学);Department of Materials Science and Engineering, Whiting School of Engineering, The Johns Hopkins University(材料科学与工程系,韦廷工程学院,约翰霍普金斯大学)
Multimodal Large Language Models for End-to-End Affective Computing: Benchmarking and Boosting with Generative Knowledge Prompting
School of Computer Science, South China Normal University(华南师范大学计算机科学学院);School of Information Technology in Education, South China Normal University(华南师范大学教育信息技术学院)
Benchmarking Deep Learning-Based Reconstruction Methods for Photoacoustic Computed Tomography with Clinically Relevant Synthetic Datasets
Department of Bioengineering, University of Illinois Urbana-Champaign(生物工程系,伊利诺伊大学厄巴纳-香槟分校);Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign(电气与计算机工程系,伊利诺伊大学厄巴纳-香槟分校);Department of Biomedical Engineering, The University of Texas at Austin(生物医学工程系,德克萨斯大学奥斯汀分校);Oden Institute for Computational Engineering and Sciences, The University of Texas at Austin(奥登计算工程与科学研究所,德克萨斯大学奥斯汀分校)
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
Insilico Medicine Hong Kong Ltd;Chemistry and Chemical Biology Department, Harvard University(哈佛大学化学与化学生物学系);Neuromation OU;Hit discovery, Discovery Sciences, Biopharmaceutics R&D, AstraZeneca Gothenburg(阿斯利康哥德堡公司发现科学部药物研发中心);National Research University Higher School of Economics(俄罗斯国家研究型高等经济大学);Department of Chemistry and Department of Computer Science, University of Toronto(多伦多大学化学系与计算机科学系);National Research University Higher School of Economics, St. Petersburg(俄罗斯国家研究型高等经济大学圣彼得堡分校)
LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Data
Oxford-Man Institute of Quantitative Finance, University of Oxford(牛津大学量化金融研究所);Department of Computer Science, University of Oxford(牛津大学计算机科学系);Department of Statistics, University of Oxford(牛津大学统计学系);Foerster Lab for AI Research, University of Oxford(福尔斯特人工智能研究实验室);J.P. Morgan AI Research(摩根大通人工智能研究)
Generating Spatial Synthetic Populations Using Wasserstein Generative Adversarial Network: A Case Study with EU-SILC Data for Helsinki and Thessaloniki
NORCE Norwegian Research Center AS(挪威NORCE研究中心);Centre for Modelling Social Systems(社会系统建模中心)