Robustness is a critical aspect of machine learning models. Existing robustness evaluation approaches often lack theoretical generality or rely heavily on empirical assessments, limiting insights into the structural factors contributing to robustness. Moreover, theoretical robustness analysis is not applicable for direct comparisons between models. To address these challenges, we propose $\textit{TopoLip}$, a metric based on layer-wise analysis that bridges topological data analysis and Lipschitz continuity for robustness evaluation. TopoLip provides a unified framework for both theoretical and empirical robustness comparisons across different architectures or configurations, and it reveals how model parameters influence the robustness of models. Using TopoLip, we demonstrate that attention-based models typically exhibit smoother transformations and greater robustness compared to convolution-based models, as validated through theoretical analysis and adversarial tasks. Our findings establish a connection between architectural design, robustness, and topological properties.
Energy Guided smoothness to improve Robustness in Graph Classification
Sapienza University of Rome, Rome, Italy(罗马萨皮恩扎大学);CNRS, i3S, Inria(国家科学研究中心、i3S、法国国家信息与自动化技术研究所);Institute of Information Science and Technologies "Alessandro Faedo" - ISTI-CNR, Pisa, Italy(信息科学与技术研究所"Alessandro Faedo" - ISTI-CNR,比萨,意大利)
TRS: Transferability Reduced Ensemble via Encouraging Gradient Diversity and Model Smoothness
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Tencent Inc.(腾讯公司);University of Melbourne(墨尔本大学);Huazhong University of Science and Technology(华中科技大学);ETH Zurich(苏黎世联邦理工学院)
Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks
South China Agricultural University(华南农业大学);City University of Hong Kong(香港城市大学);Zhejiang Normal University(浙江师范大学);Zhejiang Institute of Optoelectronics(浙江光电研究所);The University of Sydney(悉尼大学)