We present a novel graph-based approach for labeling the anatomical branches of a given airway tree segmentation. The proposed method formulates airway labeling as a branch classification problem in the airway tree graph, where branch features are extracted using convolutional neural networks (CNN) and enriched using graph neural networks. Our graph neural network is structure-aware by having each node aggregate information from its local neighbors and position-aware by encoding node positions in the graph.
We evaluated the proposed method on 220 airway trees from subjects with various severity stages of Chronic Obstructive Pulmonary Disease (COPD). The results demonstrate that our approach is computationally efficient and significantly improves branch classification performance than the baseline method. The overall average accuracy of our method reaches 91.18\% for labeling all 18 segmental airway branches, compared to 83.83\% obtained by the standard CNN method. We published our source code at https://github.com/DIAGNijmegen/spgnn. The proposed algorithm is also publicly available at https://grand-challenge.org/algorithms/airway-anatomical-labeling/.
Shanghai Jiao Tong University（上海交通大学）；Imperial College London（帝国理工学院）
Airway segmentation on CT scans is critical for pulmonary disease diagnosis and endobronchial navigation. Manual extraction of airway requires strenuous efforts due to the complicated structure and various appearance of airway. For automatic airway extraction, convolutional neural networks (CNNs) based methods have recently become the state-of-the-art approach. However, there still remains a challenge for CNNs to perceive the tree-like pattern and comprehend the connectivity of airway. To address this, we propose a voxel-connectivity aware approach named AirwayNet for accurate airway segmentat…
Baillie Gifford Pandemic Science Hub（巴利尔·吉福德疫情科学中心）；Institute of Regeneration and Repair（再生与修复研究所）；Heriot-Watt University（赫罗特-瓦特大学）；Institute of Photonics and Quantum Science（光子与量子科学研究所）
AirMorph: Topology-Preserving Deep Learning for Pulmonary Airway Analysis
Institute of Medical Robotics, Shanghai Jiao Tong University（上海交通大学医疗机器人研究院）；Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University（上海交通大学图像处理与模式识别研究所）；Shanghai Chest Hospital（上海市胸科医院）
Sichuan University - Pittsburgh Institute（四川大学-匹兹堡学院）
Airway segmentation from chest computed tomography scans has played an essential role in the pulmonary disease diagnosis. The computer-assisted airway segmentation based on the U-net architecture is more efficient and accurate compared to the manual segmentation. In this paper we employ the U$^2$-net trained by the Dice loss function to model the airway tree from the multi-site CT scans based on 299 training CT scans provided by the ATM'22. The derived saliency probability map from the training is applied to the validation data to extract the corresponding airway trees. The observation shows t…
Topology-Aware Wavelet Mamba for Airway Structure Segmentation in Postoperative Recurrent Nasopharyngeal Carcinoma CT Scans
School of Software Engineering, Sun Yat-sen University（中山大学软件工程学院）；School of Microelectronics, Shanghai University（上海大学微电子学院）；Electronic and Computer Engineering, The Hong Kong University of Science and Technology（香港科技大学电子与计算机工程系）；Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）；Eye & ENT Hospital, Fudan University（复旦大学附属眼耳鼻喉科医院）
Airway Segmentation Network for Enhanced Tubular Feature Extraction
School of Optical-electrical and Computer Engineering（光学电子与计算机工程学院）；University of Shanghai for Science and Technology（上海理工大学）；School of Information Technology（信息技术学院）；Jiangsu Open University（江苏开放大学）
Northwestern Polytechnical University（西北工业大学）；Australian Centre for Robotic Vision（澳大利亚机器人视觉中心）
This paper is concerned with the problem of how to better exploit 3D geometric information for dense semantic image labeling. Existing methods often treat the available 3D geometry information (e.g., 3D depth-map) simply as an additional image channel besides the R-G-B color channels, and apply the same technique for RGB image labeling. In this paper, we demonstrate that directly performing 3D convolution in the framework of a residual connected 3D voxel top-down modulation network can lead to superior results. Specifically, we propose a 3D semantic labeling method to label outdoor street scen…
Semantically Consistent Discrete Diffusion for 3D Biological Graph Modeling
Department of Quantitative Biomedicine, University of Zurich, Switzerland（苏黎世大学定量生物医学系）；ETH AI Center, ETH Zurich, Switzerland（苏黎世联邦理工学院AI中心）；Department of Computer Science, Technical University of Munich, Germany（慕尼黑技术大学计算机科学系）；Athinoula A. Martinos Center, Harvard Medical School, USA（哈佛医学院阿提尼娅·马丁斯中心）
Weakly supervised object detection (WSOD), where a detector is trained with only image-level annotations, is attracting more and more attention. As a method to obtain a well-performing detector, the detector and the instance labels are updated iteratively. In this study, for more efficient iterative updating, we focus on the instance labeling problem, a problem of which label should be annotated to each region based on the last localization result. Instead of simply labeling the top-scoring region and its highly overlapping regions as positive and others as negative, we propose more effective …
Institute of Industrial Science, The University of Tokyo（东京大学生产技术研究所）；OMRON SINIC X Corporation（欧姆龙SINIC X公司）
Hand segmentation is a crucial task in first-person vision. Since first-person images exhibit strong bias in appearance among different environments, adapting a pre-trained segmentation model to a new domain is required in hand segmentation. Here, we focus on appearance gaps for hand regions and backgrounds separately. We propose (i) foreground-aware image stylization and (ii) consensus pseudo-labeling for domain adaptation of hand segmentation. We stylize source images independently for the foreground and background using target images as style. To resolve the domain shift that the stylizatio…
National Chiao Tung University（国立交通大学）；Phiar Technologies（Phiar科技公司）
For monocular depth estimation, acquiring ground truths for real data is not easy, and thus domain adaptation methods are commonly adopted using the supervised synthetic data. However, this may still incur a large domain gap due to the lack of supervision from the real data. In this paper, we develop a domain adaptation framework via generating reliable pseudo ground truths of depth from real data to provide direct supervisions. Specifically, we propose two mechanisms for pseudo-labeling: 1) 2D-based pseudo-labels via measuring the consistency of depth predictions when images are with the same…
Barcelona Supercomputing Center（巴塞罗那超级计算中心）；Universitat Politècnica de Catalunya（加泰罗尼亚理工大学）
Methods that move towards less supervised scenarios are key for image segmentation, as dense labels demand significant human intervention. Generally, the annotation burden is mitigated by labeling datasets with weaker forms of supervision, e.g. image-level labels or bounding boxes. Another option are semi-supervised settings, that commonly leverage a few strong annotations and a huge number of unlabeled/weakly-labeled data. In this paper, we revisit semi-supervised segmentation schemes and narrow down significantly the annotation budget (in terms of total labeling time of the training set) com…
VERIDAH: Solving Enumeration Anomaly Aware Vertebra Labeling across Imaging Sequences
TUM University Hospital（慕尼黑技术大学医院）；Technical University of Munich (TUM)（慕尼黑技术大学）；Institute of Biomedical Engineering（生物医学工程学院）；Polytechnique Montreal（蒙特利尔理工学院）；Mila -- Quebec AI Institute（魁北克人工智能研究所）；University of Zurich（苏黎世大学）；Rostock University Medical Center（罗斯托克大学医学中心）；University Hospital Heidelberg（海德堡大学医院）；Medical Center -- University of Freiburg（弗赖堡大学医学中心）；Max-Delbrueck-Center for Molecular Medicine in the Helmholtz Association (MDC)（马克斯-德尔布吕克分子医学中心（马克斯·普朗克协会））；University Hospital Augsburg（奥格斯堡大学医院）
Dual Cross-image Semantic Consistency with Self-aware Pseudo Labeling for Semi-supervised Medical Image Segmentation
School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University（生物医学工程学院及先进医疗材料与器件国家重点实验室，上海科技大学）；Lingang Laboratory（临港实验室）；Department of Radiology, Stanford University（放射科，斯坦福大学）
Sun Yat-sen University（中山大学）；ByteDance Inc.（字节跳动公司）；Shenzhen Research Institute of Big Data（深圳大数据研究院）
Recent advances in deep learning significantly boost the performance of salient object detection (SOD) at the expense of labeling larger-scale per-pixel annotations. To relieve the burden of labor-intensive labeling, deep unsupervised SOD methods have been proposed to exploit noisy labels generated by handcrafted saliency methods. However, it is still difficult to learn accurate saliency details from rough noisy labels. In this paper, we propose to learn saliency from synthetic but clean labels, which naturally has higher pixel-labeling quality without the effort of manual annotations. Specifi…
University of Freiburg（弗莱堡大学）；TU Darmstadt（达姆施塔特工业大学）
Recent approaches for instance-aware semantic labeling have augmented convolutional neural networks (CNNs) with complex multi-task architectures or computationally expensive graphical models. We present a method that leverages a fully convolutional network (FCN) to predict semantic labels, depth and an instance-based encoding using each pixel's direction towards its corresponding instance center. Subsequently, we apply low-level computer vision techniques to generate state-of-the-art instance segmentation on the street scene datasets KITTI and Cityscapes. Our approach outperforms existing work…
Center for Research in Computer Vision（计算机视觉研究中心）；University of Central Florida（中佛罗里达大学）
The recent research in semi-supervised learning (SSL) is mostly dominated by consistency regularization based methods which achieve strong performance. However, they heavily rely on domain-specific data augmentations, which are not easy to generate for all data modalities. Pseudo-labeling (PL) is a general SSL approach that does not have this constraint but performs relatively poorly in its original formulation. We argue that PL underperforms due to the erroneous high confidence predictions from poorly calibrated models; these predictions generate many incorrect pseudo-labels, leading to noisy…
Semi-Supervised Hyperspectral Image Classification with Edge-Aware Superpixel Label Propagation and Adaptive Pseudo-Labeling
Liaoning Technical University（辽宁技术大学）；State Key Laboratory of Regional and Urban Ecology, Institute of Urban Environment, Chinese Academy of Sciences（区域与城市生态国家重点实验室，城市环境研究所，中国科学院）
Striving for Simplicity: Simple Yet Effective Prior-Aware Pseudo-Labeling for Semi-Supervised Ultrasound Image Segmentation
Wuhan University of Technology（武汉理工大学）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；MedAI Technology (Wuxi) Co. Ltd.（MedAI科技（无锡）有限公司）；Technical University of Munich（慕尼黑工业大学）
MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Images
Boston University（波士顿大学）；Stanford University（斯坦福大学）；Carnegie Mellon University（卡内基梅隆大学）；University of Pittsburgh Medical Center（匹兹堡大学医学中心）；University of Pittsburgh（匹兹堡大学）
Debate-Enhanced Pseudo Labeling and Frequency-Aware Progressive Debiasing for Weakly-Supervised Camouflaged Object Detection with Scribble Annotations
School of Cyber Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；Jiangsu Provincial Key Laboratory of Computer Networking Technology（江苏省计算机网络技术重点实验室）；Jiangsu Provincial Key Laboratory of Network and Information Security（江苏省网络与信息安全重点实验室）；Key Laboratory of Computer Network and Information Integration of Ministry of Education of China（教育部计算机网络与信息集成重点实验室）；Nanjing Purple Mountain Laboratories（南京紫金山实验室）；Fintech and Big Data Laboratory of Southeast University（东南大学金融科技与大数据实验室）；Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University（香港理工大学航空与航空工程系）；School of Computer Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；School of Electronics, Electrical Engineering and Computer Science, Queen’s University Belfast（贝尔法斯特女王大学电子、电气与计算机科学学院）
Seoul National University（首尔国立大学）；Soong-sil University（崇实大学）
Individual tooth segmentation from cone beam computed tomography (CBCT) images is an essential prerequisite for an anatomical understanding of orthodontic structures in several applications, such as tooth reformation planning and implant guide simulations. However, the presence of severe metal artifacts in CBCT images hinders the accurate segmentation of each individual tooth. In this study, we propose a neural network for pixel-wise labeling to exploit an instance segmentation framework that is robust to metal artifacts. Our method comprises of three steps: 1) image cropping and realignment b…
Learning Topology-Aware Implicit Field for Unified Pulmonary Tree Modeling with Incomplete Topological Supervision
School of Computer Science, The University of Sydney（悉尼大学计算机科学学院）；ELLIS Institute Finland（芬兰ELLIS研究所）；Aalto University（阿尔托大学）；Department of Computer Science and Engineering, University of Buffalo（布法罗大学计算机科学与工程系）；Department of Radiology, Northwestern University（西北大学放射学系）
Entity recognition is a fundamental task in understanding document images. Traditional sequence labeling frameworks treat the entity types as class IDs and rely on extensive data and high-quality annotations to learn semantics which are typically expensive in practice. In this paper, we aim to build an entity recognition model requiring only a few shots of annotated document images. To overcome the data limitation, we propose to leverage the label surface names to better inform the model of the target entity type semantics and also embed the labels into the spatial embedding space to capture t…
Zhejiang University of Technology（浙江工业大学）；Tianjin University of Technology（天津理工大学）；The University of Adelaide（阿德莱德大学）
Compared with the progress made on human activity classification, much less success has been achieved on human interaction understanding (HIU). Apart from the latter task is much more challenging, the main cause is that recent approaches learn human interactive relations via shallow graphical models, which is inadequate to model complicated human interactions. In this paper, we propose a consistency-aware graph network, which combines the representative ability of graph network and the consistency-aware reasoning to facilitate the HIU task. Our network consists of three components, a backbone …
T2ID-CAS: Diffusion Model and Class Aware Sampling to Mitigate Class Imbalance in Neck Ultrasound Anatomical Landmark Detection
Department of Computer Science, University of Central Florida（计算机科学系，中央佛罗里达大学）；Department of Otolaryngology Head Neck Surgery, University of Cincinnati College of Medicine（耳鼻喉科与头颈外科系，辛辛那提大学医学院）；Department of Internal Medicine, University of Central Florida College of Medicine（内科系，中央佛罗里达大学医学院）
Automated Labeling of Intracranial Arteries with Uncertainty Quantification Using Deep Learning
Dept. of Molecular Medicine and Surgery, Karolinska Institutet（卡罗林斯卡研究所分子医学与外科部）；Biomedical Imaging Center, Pontificia Universidad Católica de Chile（智利天主教大学生物医学成像中心）；Department of Electrical Engineering, School of Engineering, Pontificia Universidad Católica de Chile（智利天主教大学工程学院电气工程系）；Millennium Institute for Intelligent Healthcare Engineering (iHEALTH), Santiago, Chile（智利智能健康工程研究院（iHEALTH））；Department of Medical Physics, Institute of Physics, University of Greifswald（格里夫斯瓦尔德大学物理研究所医学物理系）；Department of Radiology, Northwestern University（西北大学放射科）；Department of Neurological Surgery, Northwestern University（西北大学神经外科部）；Department of Neurology, Northwestern University（西北大学神经科）
Making a single network effectively address diverse contexts---learning the variations within a dataset or multiple datasets---is an intriguing step towards achieving generalized intelligence. Existing approaches of deepening, widening, and assembling networks are not cost effective in general. In view of this, networks which can allocate resources according to the context of the input and regulate flow of information across the network are effective. In this paper, we present Context-Aware Multipath Network (CAMNet), a multi-path neural network with data-dependant routing between parallel ten…
The existing person search methods use the annotated labels of person identities to train deep networks in a supervised manner that requires a huge amount of time and effort for human labeling. In this paper, we first introduce a novel framework of person search that is able to train the network in the absence of the person identity labels, and propose efficient unsupervised clustering methods to substitute the supervision process using annotated person identity labels. Specifically, we propose a hard negative mining scheme based on the uniqueness property that only a single person has the sam…
