This paper presents a machine-learning-enhanced longitudinal scanline method to extract vehicle trajectories from high-angle traffic cameras. The Dynamic Mode Decomposition (DMD) method is applied to extract vehicle strands by decomposing the Spatial-Temporal Map (STMap) into the sparse foreground and low-rank background. A deep neural network named Res-UNet+ was designed for the semantic segmentation task by adapting two prevalent deep learning architectures. The Res-UNet+ neural networks significantly improve the performance of the STMap-based vehicle detection, and the DMD model provides many interesting insights for understanding the evolution of underlying spatial-temporal structures preserved by STMap. The model outputs were compared with the previous image processing model and mainstream semantic segmentation deep neural networks. After a thorough evaluation, the model is proved to be accurate and robust against many challenging factors. Last but not least, this paper fundamentally addressed many quality issues found in NGSIM trajectory data. The cleaned high-quality trajectory data are published to support future theoretical and modeling research on traffic flow and microscopic vehicle control. This method is a reliable solution for video-based trajectory extraction and has wide applicability.
Norwegian Research Centre (NORCE)（挪威研究中心）；Hong Kong Baptist University（香港浸会大学）；Lingnan University（岭南大学）；Hong Kong Center for Cerebro-Cardiovascular Health Engineering（香港心脑血管健康工程中心）
Unets have become the standard method for semantic segmentation of medical images, along with fully convolutional networks (FCN). Unet++ was introduced as a variant of Unet, in order to solve some of the problems facing Unet and FCNs. Unet++ provided networks with an ensemble of variable depth Unets, hence eliminating the need for professionals estimating the best suitable depth for a task. While Unet and all its variants, including Unet++ aimed at providing networks that were able to train well without requiring large quantities of annotated data, none of them attempted to eliminate the need …
DSVM-UNet : Enhancing VM-UNet with Dual Self-distillation for Medical Image Segmentation
Faculty of Military Health Service, Naval Medical University, China（海军医学院军事卫生服务学院）；School of Computer Science and Technology, Shanghai University of Electric Power, China（上海电力大学计算机科学与技术学院）
UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Images
Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）；Key Laboratory of Target Cognition and Application Technology, CAS（中国科学院目标认知与应用技术重点实验室）；School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences（中国科学院大学电子电气与通信工程学院）
CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation
College of Information Science and Electronic Engineering, Zhejiang University（浙江大学信息与电子工程学院）；School of Aeronautics and Astronautics, Zhejiang University（浙江大学航空航天学院）；College of Computer Science, Zhejiang University（浙江大学计算机学院）
Wuhan University（武汉大学）；Key Laboratory of Natural Resources Monitoring in Tropical and Subtropical Area of South China, Ministry of Natural Resources（自然资源部华南热带亚热带自然资源监测重点实验室）；Lancaster University（兰卡斯特大学）；UK Centre for Ecology & Hydrology（英国生态与水文研究中心）；University of Twente（特文特大学）；University of Southampton（南安普顿大学）；Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences（中国科学院地理科学与资源研究所）
Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid developments in deep learning technologies, the convolutional neural network (CNN) has dominated semantic segmentation for many years. CNN adopts hierarchical feature representation, demonstrating strong capabilities for local information extraction. However, the local property of the convolution layer limits the network from capturing the global context. Recently,…
An Intuitionistic Fuzzy Logic Driven UNet architecture: Application to Brain Image segmentation
Department of Mathematics, Bareilly College, Bareilly (MJP Rohilkhand University), Uttar Pradesh, India（印度乌塔兰普尔邦巴雷利学院数学系）；Division of Newborn Medicine, Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, Harvard Medical School, Boston, MA 02115, USA（美国哈佛医学院波士顿儿童医院新生儿医学部）；Department of Pediatrics, Harvard Medical School, Boston, MA, USA（美国哈佛医学院儿科系）；CSIR–Central Electronics Engineering Research Institute, Pilani 333031, Rajasthan, India（印度拉贾斯坦邦比拉尼中央电子工程研究机构）；Academy of Scientific and Innovative Research (AcSIR), Ghaziabad 201002, India（印度德里阿齐亚德瓦学术与创新研究院）；CSIR–National Institute of Science Communication and Policy Research, New Delhi, India（印度新德里国家科学传播与政策研究所）
Wuhan Institute of Technology（武汉工程大学）；Huazhong University of Science and technology（华中科技大学）
Medical image segmentation plays an essential role in developing computer-assisted diagnosis and therapy systems, yet still faces many challenges. In the past few years, the popular encoder-decoder architectures based on CNNs (e.g., U-Net) have been successfully applied in the task of medical image segmentation. However, due to the locality of convolution operations, they demonstrate limitations in learning global context and long-range spatial relations. Recently, several researchers try to introduce transformers to both the encoder and decoder components with promising results, but the effic…
As an essential prerequisite for developing a medical intelligent assistant system, medical image segmentation has received extensive research and concentration from the neural network community. A series of UNet-like networks with encoder-decoder architecture has achieved extraordinary success, in which UNet2+ and UNet3+ redesign skip connections, respectively proposing dense skip connection and full-scale skip connection and dramatically improving compared with UNet in medical image segmentation. However, UNet2+ lacks sufficient information explored from the full scale, which will affect the…
Beijing Zoezen Robot Co Ltd（北京佐伊森机器人有限公司）；Beihang University（北京航空航天大学）
Medical image segmentation have drawn massive attention as it is important in biomedical image analysis. Good segmentation results can assist doctors with their judgement and further improve patients' experience. Among many available pipelines in medical image analysis, Unet is one of the most popular neural networks as it keeps raw features by adding concatenation between encoder and decoder, which makes it still widely used in industrial field. In the mean time, as a popular model which dominates natural language process tasks, transformer is now introduced to computer vision tasks and have …
SelfReg-UNet: Self-Regularized UNet for Medical Image Segmentation
School of Computing and Augmented Intelligence, Arizona State University（亚利桑那州立大学计算与增强智能学院）；McKeley School of Engineering, Washington University in St. Louis（圣路易斯华盛顿大学麦凯莱工程学院）；School of Computing, Clemson University（克莱姆森大学计算学院）
LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation
School of Computer Science, Peking University（北京大学计算机学院）；Institute of Artificial Intelligence, Beihang University（北京航空航天大学人工智能研究院）；Key Laboratory of High Confidence Software Technologies, Ministry of Education（教育部高可信软件技术重点实验室）；National Engineering Research Center for Software Engineering, Peking University（北京大学国家软件工程研究中心）
Optimizing Neural Network Architecture for Medical Image Segmentation Using Monte Carlo Tree Search
Xi'an Kedagaoxin University, Faculty of Science（西安科大新大学科学学院）；Xi'an Kedagaoxin University, School of International Education（西安科大新大学国际教育学院）；Saint Petersburg State University（圣彼得堡国立大学）
Recent advances of semantic image segmentation greatly benefit from deeper and larger Convolutional Neural Network (CNN) models. Compared to image segmentation in the wild, properties of both medical images themselves and of existing medical datasets hinder training deeper and larger models because of overfitting. To this end, we propose a novel two-stream UNET architecture for automatic end-to-end medical image segmentation, in which intensity value and gradient vector flow (GVF) are two inputs for each stream, respectively. We demonstrate that two-stream CNNs with more low-level features gre…
TM-UNet: Token-Memory Enhanced Sequential Modeling for Efficient Medical Image Segmentation
Dalian University of Technology（大连理工大学）；University of Lincoln（林肯大学）；University of Nottingham（诺丁汉大学）；Waseda University（早稻田大学）；University of Nottingham Ningbo China（宁波诺丁汉大学）；Yale University（耶鲁大学）
Medical Image Segmentation Using Advanced Unet: VMSE-Unet and VM-Unet CBAM+
School of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT) Deemed to be University（计算机工程学院，基灵加工业技术学院（KIIT）被认定为大学）；Department of Electrical and Electronics Engineering, BITS-Pilani, Pilani Campus（电气与电子工程系，BITS-帕利尼，帕利尼校区）
Nanjing University of Science and Technology（南京理工大学）
Change detection (CD) of remote sensing images is to detect the change region by analyzing the difference between two bitemporal images. It is extensively used in land resource planning, natural hazards monitoring and other fields. In our study, we propose a novel Siamese neural network for change detection task, namely Dual-UNet. In contrast to previous individually encoded the bitemporal images, we design an encoder differential-attention module to focus on the spatial difference relationships of pixels. In order to improve the generalization of networks, it computes the attention weights be…
ACM-UNet: Adaptive Integration of CNNs and Mamba for Efficient Medical Image Segmentation
Wuhan University of Technology（武汉理工大学）；Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院北京协和医学院）；Zhongnan Hospital of Wuhan University（武汉大学中南医院）
Technische Universität München（慕尼黑工业大学）；Fudan University（复旦大学）；Huawei Technologies（华为技术有限公司）
In the past few years, convolutional neural networks (CNNs) have achieved milestones in medical image analysis. Especially, the deep neural networks based on U-shaped architecture and skip-connections have been widely applied in a variety of medical image tasks. However, although CNN has achieved excellent performance, it cannot learn global and long-range semantic information interaction well due to the locality of the convolution operation. In this paper, we propose Swin-Unet, which is an Unet-like pure Transformer for medical image segmentation. The tokenized image patches are fed into the …
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University（上海交通大学电子信息与电气工程学院）；School of Biomedical Engineering, Shanghai Jiao Tong University（上海交通大学生物医学工程学院）
National Institutes of Health Clinical Center（美国国立卫生研究院临床中心）
This paper reports Deep LOGISMOS approach to 3D tumor segmentation by incorporating boundary information derived from deep contextual learning to LOGISMOS - layered optimal graph image segmentation of multiple objects and surfaces. Accurate and reliable tumor segmentation is essential to tumor growth analysis and treatment selection. A fully convolutional network (FCN), UNet, is first trained using three adjacent 2D patches centered at the tumor, providing contextual UNet segmentation and probability map for each 2D patch. The UNet segmentation is then refined by Gaussian Mixture Model (GMM) a…
VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation
State Key Laboratory for Novel Software Technology, Nanjing University（南京大学计算机软件新技术国家重点实验室）；Huazhong University of Science and Technology（华中科技大学）；Jiangsu Province Hospital of Chinese Medicine（江苏省中医院）
Lobachevsky State University（罗巴切夫斯基国立大学）；Intel（英特尔）
MRI analysis takes central position in brain tumor diagnosis and treatment, thus it's precise evaluation is crucially important. However, it's 3D nature imposes several challenges, so the analysis is often performed on 2D projections that reduces the complexity, but increases bias. On the other hand, time consuming 3D evaluation, like, segmentation, is able to provide precise estimation of a number of valuable spatial characteristics, giving us understanding about the course of the disease.\newline Recent studies, focusing on the segmentation task, report superior performance of Deep Learning …
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；Sir Run Run Shaw Hospital（邵逸夫医院）；College of Information Science and Engineering, Ritsumeikan University（立命馆大学信息科学与工程学院）；Research Center for Healthcare Data Science, Zhejiang Lab（之江实验室医疗数据科学研究中心）
Recently, a growing interest has been seen in deep learning-based semantic segmentation. UNet, which is one of deep learning networks with an encoder-decoder architecture, is widely used in medical image segmentation. Combining multi-scale features is one of important factors for accurate segmentation. UNet++ was developed as a modified Unet by designing an architecture with nested and dense skip connections. However, it does not explore sufficient information from full scales and there is still a large room for improvement. In this paper, we propose a novel UNet 3+, which takes advantage of f…
It is a challenge to segment the location and size of rectal cancer tumours through deep learning. In this paper, in order to improve the ability of extracting suffi-cient feature information in rectal tumour segmentation, attention enlarged ConvNeXt UNet (AACN-UNet), is proposed. The network mainly includes two improvements: 1) the encoder stage of UNet is changed to ConvNeXt structure for encoding operation, which can not only integrate multi-scale semantic information on a large scale, but al-so reduce information loss and extract more feature information from CT images; 2) CBAM attention m…
Xiamen University（厦门大学）；The University of Hong Kong（香港大学）
Recent medical image segmentation models are mostly hybrid, which integrate self-attention and convolution layers into the non-isomorphic architecture. However, one potential drawback of these approaches is that they failed to provide an intuitive explanation of why this hybrid combination manner is beneficial, making it difficult for subsequent work to make improvements on top of them. To address this issue, we first analyze the differences between the weight allocation mechanisms of the self-attention and convolution. Based on this analysis, we propose to construct a parallel non-isomorphic …
Vision Transformer-Conditioned UNet for Domain-Adaptive Semantic Segmentation
Helmholtz Pioneer Campus, Helmholtz Munich, Neuherberg, Germany（海德堡先锋校园，海德堡穆恩奇，纽赫尔伯格，德国）；School of Computation, Information and Technology, TUM, Garching, Germany（计算、信息与技术学院，技术大学慕尼黑，冈辛，德国）；Department of Chemistry, TUM, Garching, Germany（化学系，技术大学慕尼黑，冈辛，德国）
本文提出 ViTC-UNet，通过可学习令牌和双向注意力解码器将预训练 ViT 表示条件化于 UNet，以提升生物医学语义分割的精度与适应性。
L-UNet: An LSTM Network for Remote Sensing Image Change Detection
College of Life Sciences and Oceanography, Shenzhen University（深圳大学生命科学与海洋学院）；School of Computer Science, China University of Geosciences（中国地质大学（武汉）计算机学院）
The state-of-the-art models for medical image segmentation are variants of U-Net and fully convolutional networks (FCN). Despite their success, these models have two limitations: (1) their optimal depth is apriori unknown, requiring extensive architecture search or inefficient ensemble of models of varying depths; and (2) their skip connections impose an unnecessarily restrictive fusion scheme, forcing aggregation only at the same-scale feature maps of the encoder and decoder sub-networks. To overcome these two limitations, we propose UNet++, a new neural architecture for semantic and instance…
UNetVL: Enhancing 3D Medical Image Segmentation with Chebyshev KAN Powered Vision-LSTM
Electrical Engineering and Computer Science Department, University of Michigan, Ann Arbor, USA（密歇根大学电气工程与计算机科学系）；Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, USA（佐治亚理工学院和埃默里大学沃森·霍尔生物医学工程系）；Computer Science Department, University of Michigan, Ann Arbor, USA（密歇根大学计算机科学系）；Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology（佐治亚理工学院沃森·霍尔生物医学工程系）；Emory University, Atlanta, USA（埃默里大学）
Deep Multi-Threshold Spiking-UNet for Image Processing
University of Science and Technology of China（中国科学技术大学）；Institute of Artificial Intelligence, Hefei Comprehensive National Science Center（合肥综合性国家科学中心人工智能研究院）
Geoinformatics Center, Asian Institute of Technology（亚洲理工学院地理信息学中心）
In many applications of aerial/satellite image analysis (remote sensing), the generation of exact shapes of objects is a cumbersome task. In most remote sensing applications such as counting objects requires only location estimation of objects. Hence, locating object centroids in aerial/satellite images is an easy solution for tasks where the object's exact shape is not necessary. Thus, this study focuses on assessing the feasibility of using deep neural networks for locating object centroids in satellite images. Name of our model is Centroid-UNet. The Centroid-UNet model is based on classic U…
German Cancer Research Center (DKFZ)（德国癌症研究中心）；University of Heidelberg（海德堡大学）
Segmentation of endoscopic images is an essential processing step for computer and robotics-assisted interventions. The Robust-MIS challenge provides the largest dataset of annotated endoscopic images to date, with 5983 manually annotated images. Here we describe OR-UNet, our optimized robust residual 2D U-Net for endoscopic image segmentation. As the name implies, the network makes use of residual connections in the encoder. It is trained with the sum of Dice and cross-entropy loss and deep supervision. During training, extensive data augmentation is used to increase the robustness. In an 8-f…
Tecnologico de Monterrey（蒙特雷科技大学）；Universidad de las Americas Puebla（普埃布拉美洲大学）；Universitat Politècnica de Catalunya（加泰罗尼亚理工大学）
Jet fires are relatively small and have the least severe effects among the diverse fire accidents that can occur in industrial plants; however, they are usually involved in a process known as the domino effect, that leads to more severe events, such as explosions or the initiation of another fire, making the analysis of such fires an important part of risk analysis. This research work explores the application of deep learning models in an alternative approach that uses the semantic segmentation of jet fires flames to extract main geometrical attributes, relevant for fire risk assessments. A co…
RARE-UNet: Resolution-Aligned Routing Entry for Adaptive Medical Image Segmentation
Pioneer Centre for Artificial Intelligence, Department of Computer Science, University of Copenhagen, Copenhagen, Denmark（人工智能先锋中心、计算机科学系、哥本哈根大学、哥本哈根、丹麦）
School of Biomedical Engineering & Imaging Sciences, KCL（伦敦国王学院生物医学工程与影像科学学院）；Athinoula A. Martinos Center for Biomedical Imaging, MGH and HMS（马萨诸塞总医院与哈佛医学院阿西努拉·A·马蒂诺斯生物医学影像中心）；Wellcome Center for Human Neuroimaging, UCL（伦敦大学学院惠康人类神经影像中心）；Institute of Cognitive Neuroscience, UCL（伦敦大学学院认知神经科学研究所）；Institute of Neurology, UCL（伦敦大学学院神经病学研究所）
While convolutional neural networks (CNNs) trained by back-propagation have seen unprecedented success at semantic segmentation tasks, they are known to struggle on out-of-distribution data. Markov random fields (MRFs) on the other hand, encode simpler distributions over labels that, although less flexible than UNets, are less prone to over-fitting. In this paper, we propose to fuse both strategies by computing the product of distributions of a UNet and an MRF. As this product is intractable, we solve for an approximate distribution using an iterative mean-field approach. The resulting MRF-UNe…
