The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and ironically, previous models of image complexity have been quite complex. There have been many attempts to find handcrafted features that explain complexity, but these features are usually dataset specific, and hence fail to generalise. On the other hand, more recent work has employed deep neural networks to predict complexity, but these models remain difficult to interpret, and do not guide a theoretical understanding of the problem. Here we propose to model complexity using segment-based representations of images. We use state-of-the-art segmentation models, SAM and FC-CLIP, to quantify the number of segments at multiple granularities, and the number of classes in an image respectively. We find that complexity is well-explained by a simple linear model with these two features across six diverse image-sets of naturalistic scene and art images. This suggests that the complexity of images can be surprisingly simple.
Leveraging Causal Reasoning Method for Explaining Medical Image Segmentation Models
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Shenzhen University of Advanced Technology(深圳先进技术大学);Shenzhen Polytechnic University(深圳职业技术大学);University of Macau(澳门大学);Southern University of Science and Technology(南方科技大学)
Striving for Simplicity: Simple Yet Effective Prior-Aware Pseudo-Labeling for Semi-Supervised Ultrasound Image Segmentation
Wuhan University of Technology(武汉理工大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);MedAI Technology (Wuxi) Co. Ltd.(MedAI科技(无锡)有限公司);Technical University of Munich(慕尼黑工业大学)
Entropy-Centric Explainable AI for Remote Sensing Image Segmentation
Faculty of Engineering, Lebanese University(黎巴嫩大学工程学院);University of Paris-Est Créteil (UPEC)(巴黎东部克雷泰伊大学);EFREI(EFREI学院);National Center for Remote Sensing - CNRS(国家遥感中心 - 法国国家科学研究中心)
Faculty of Biology and Medicine, University of Lausanne (UNIL)(日内瓦大学生物医学学院);Radiology Department, Lausanne University Hospital (CHUV)(拉索恩大学医院放射科);MedGIFT, Institute of Informatics, School of Management, HES--SO Valais--Wallis University of Applied Sciences and Arts Western Switzerland(应用科学与艺术西瓦利斯-瓦利斯大学信息学院);CIBM Center for Biomedical Imaging(生物医学成像中心);Department of Radiology and Medical Informatics, University of Geneva(日内瓦大学放射科与医学信息学系);Translational Imaging in Neurology (ThINK) Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel(神经学转化成像(ThINK)巴塞尔,医学与生物医学工程系,巴塞尔大学医院和巴塞尔大学);Multiple Sclerosis Center, Department of Neurology, University Hospital Basel(多发性硬化中心,神经科,巴塞尔大学医院);Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel(临床神经免疫学和神经科学巴塞尔研究中心(RC2NB),巴塞尔大学医院和巴塞尔大学);Department of Neurology, Icahn School of Medicine at Mount Sinai(伊坎医学院 Mount Sinai 神经科);Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health(神经学转化放射学部门,国家神经疾病与中风研究所,国家卫生研究院);Neuroinflammation Imaging Lab (NIL), Université catholique de Louvain(神经炎症成像实验室(NIL),卢瓦纳大学);EPFL+ECAL Lab, École polytechnique fédérale de Lausanne (EPFL)(EPFL+ECAL 实验室,日内瓦联邦理工学院(EPFL))
Benchmarking and Explaining Deep Learning Cortical Lesion MRI Segmentation in Multiple Sclerosis
Faculty of Biology and Medicine, University of Lausanne (UNIL)(日内瓦大学生物与医学学院);Radiology Department, Lausanne University Hospital (CHUV)(洛桑大学医院放射科);MedGIFT, Institute of Informatics, School of Management, HES--SO Valais--Wallis University of Applied Sciences(应用科学与艺术西瓦利斯-瓦利斯大学信息学院);CIBM Center for Biomedical Imaging(生物医学成像中心);Department of Radiology and Medical Informatics, University of Geneva(日内瓦大学放射科与医学信息学系);Translational Imaging in Neurology (ThINK) Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel(神经学转化成像(ThINK)巴塞尔,巴塞尔大学医院和巴塞尔大学医学与生物医学工程系);Multiple Sclerosis Center, Department of Neurology, University Hospital Basel(多发性硬化中心,巴塞尔大学医院神经科);Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel(临床神经免疫学与神经科学巴塞尔研究中心(RC2NB),巴塞尔大学医院和巴塞尔大学);Division of Radiological Physics, Department of Radiology, University Hospital Basel(放射物理学系,放射科,巴塞尔大学医院);Department of Neurology, Icahn School of Medicine at Mount Sinai(伊坎医学院神经科);Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health(神经疾病国家研究所转化神经放射学组,国家卫生研究院);Neuroinflammation Imaging Lab (NIL), Université catholique de Louvain(神经炎症成像实验室(NIL),卢旺达大学)
Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
Shape-intensity knowledge distillation for robust medical image segmentation
National Engineering Research Center for Multimedia Software(国家多媒体软件工程技术研究中心);School of Computer Science, Wuhan University(武汉大学计算机学院);Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University(武汉大学多媒体与网络通信工程湖北省重点实验室);Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University(武汉大学人民医院医学人工智能研究院)
A Generic Approach to Lung Field Segmentation from Chest Radiographs using Deep Space and Shape Learning
Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Health System(儿童国家卫生系统谢赫扎耶德儿科外科创新研究所);Children’s National Health System(儿童国家卫生系统);San Francisco State University(旧金山州立大学);School of Medicine and Health Sciences, George Washington University(乔治华盛顿大学医学与健康科学学院)
已提出将计算机辅助诊断(CAD)技术用于成人队列的胸片(CXR)肺野分割,但很少用于儿科受试者。统计形状模型(SSM),最先进的基于CXR的肺野分割方法的主力,不能有效地适应在儿科发育阶段的肺野的形状变化。我们工作的主要贡献是:(1)来自CXR的通用肺野分割框架,适应成人和儿科队列的大形状变化;(2)深度表示学习检测机制\emph{ensemble space learning},用于鲁棒的对象定位;以及(3)\emph{marginal shape deep learning},用于形状变形参数估计。与传统SSM的迭代方法不同,所提出的形状学习机制将参数空间转换为边缘子空间,这些边缘子空间使用递归表示学习机制有效地求解。此外,我们的方法是第一个在基于CXR的肺分割中包括具有挑战性的心脏后区域,以进行准确的肺活量估计。该框架在3个月至89岁的患者的668个CXR上进行评估。我们得到平均Dice相似系数为$0.96\pm0.03$(包括心脏后区域)。对于一个给定的精度,所提出的方法也被发现比传统的基于SSM的迭代分割方法更快。所提出的通用框架的计算简单性可以类似地应用于其他可变形对象的快速分割。
SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation
Inception Institute of Artificial Intelligence(起源人工智能研究院);Tianjin University(天津大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach
Xi’an Jiaotong-liverpool University(西交利物浦大学);University of Technology Sydney(悉尼科技大学);Alibaba-Zhejiang University Joint Institute of Frontier Technologies(阿里巴巴-浙江大学前沿技术联合研究院)
Simple is what you need for efficient and accurate medical image segmentation
Department of Ultrasound, Shenzhen Maternity and Child Healthcare Hospital, Women and Children's Medical Center, Southern Medical University, Shenzhen, Guangdong Province, China(超声科,深圳母婴保健医院,妇女儿童医疗中心,南方医科大学,深圳,广东省,中国)
A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial
Warren Alpert Medical School of Brown University(布朗大学沃伦·阿尔珀特医学院);Emory University School of Medicine(埃默里大学医学院);University of Florida School of Medicine(佛罗里达大学医学院);Brown University(布朗大学)