In-painting networks use existing pixels to generate appropriate pixels to fill "holes" placed on parts of an image. A 2-D in-painting network's input usually consists of (1) a three-channel 2-D image, and (2) an additional channel for the "holes" to be in-painted in that image. In this paper, we study the robustness of a given in-painting neural network against variations in hole geometry distributions. We observe that the robustness of an in-painting network is dependent on the probability distribution function (PDF) of the hole geometry presented to it during its training even if the underlying image dataset used (in training and testing) does not alter. We develop an experimental methodology for testing and evaluating relative robustness of in-painting networks against four different kinds of hole geometry PDFs. We examine a number of hypothesis regarding (1) the natural bias of in-painting networks to the hole distribution used for their training, (2) the underlying dataset's ability to differentiate relative robustness as hole distributions vary in a train-test (cross-comparison) grid, and (3) the impact of the directional distribution of edges in the holes and in the image dataset. We present results for L1, PSNR and SSIM quality metrics and develop a specific measure of relative in-painting robustness to be used in cross-comparison grids based on these quality metrics. (One can incorporate other quality metrics in this relative measure.) The empirical work reported here is an initial step in a broader and deeper investigation of "filling the blank" neural networks' sensitivity, robustness and regularization with respect to hole "geometry" PDFs, and it suggests further research in this domain.
FoolSDEdit: Deceptively Steering Your Edits Towards Targeted Attribute-aware Distribution
Zhejiang University(浙江大学);Nanyang Technological University(南洋理工大学);Institute of High Performance Computing (IHPC)(高性能计算研究所);Centre for Frontier AI Research (CFAR)(前沿人工智能研究中心)
Certified vs. Empirical Adversarial Robust-ness via Hybrid Convolutions with Attention Stochasticity
Indian Institute of Technology Ropar(印度理工学院罗帕尔分校);Nanyang Technological University(南洋理工大学);RoentGen Health(RoentGen健康);Queensland University of Technology(昆士兰理工大学);RMIT University(皇家墨尔本理工大学);Murdoch University(莫纳什大学);Deakin University(迪金大学)
SAM Meets Robotic Surgery: An Empirical Study in Robustness Perspective
The Chinese University of Hong Kong(香港中文大学);University College London(伦敦大学学院);National University of Singapore(新加坡国立大学);Hubei University of Technology(湖北工业大学)
Modularity Trumps Invariance for Compositional Robustness
Massachusetts Institute of Technology(麻省理工学院);Artificial Intelligence Laboratory(人工智能实验室);Fujitsu Limited(富士通有限公司);Fujitsu Research of America, Inc.(美国富士通研究公司)
Adversarial Robustness in Zero-Shot Learning:An Empirical Study on Class and Concept-Level Vulnerabilities
iFLYTEK Co., Ltd.(iFLYTEK公司);UCAS-Terminus AI Lab, University of Chinese Academy of Sciences(中国科学院大学Terminus AI实验室);School of Computer Science, the University of Nottingham(诺丁汉大学计算机学院);TGAI lab, the Westlake University(西湖大学TGAI实验室);RippleInfo Co., Ltd(RippleInfo公司)