Ferrograph image segmentation is of significance for obtaining features of wear particles. However, wear particles are usually overlapped in the form of debris chains, which makes challenges to segment wear debris. An overlapping wear particle segmentation network (OWPSNet) is proposed in this study to segment the overlapped debris chains. The proposed deep learning model includes three parts: a region segmentation network, an edge detection network and a feature refine module. The region segmentation network is an improved U shape network, and it is applied to separate the wear debris form background of ferrograph image. The edge detection network is used to detect the edges of wear particles. Then, the feature refine module combines low-level features and high-level semantic features to obtain the final results. In order to solve the problem of sample imbalance, we proposed a square dice loss function to optimize the model. Finally, extensive experiments have been carried out on a ferrograph image dataset. Results show that the proposed model is capable of separating overlapping wear particles. Moreover, the proposed square dice loss function can improve the segmentation results, especially for the segmentation results of wear particle edge.
Singtel Cognitive and Artificial Intelligence Lab for Enterprises, Nanyang Technological University（新加坡南洋理工大学新电信企业认知与人工智能实验室）
Semi-supervised semantic segmentation learns from small amounts of labelled images and large amounts of unlabelled images, which has witnessed impressive progress with the recent advance of deep neural networks. However, it often suffers from severe class-bias problem while exploring the unlabelled images, largely due to the clear pixel-wise class imbalance in the labelled images. This paper presents an unbiased subclass regularization network (USRN) that alleviates the class imbalance issue by learning class-unbiased segmentation from balanced subclass distributions. We build the balanced sub…
In this paper we test the use of a deep learning approach to automatically count Wandering Albatrosses in Very High Resolution (VHR) satellite imagery. We use a dataset of manually labelled imagery provided by the British Antarctic Survey to train and develop our methods. We employ a U-Net architecture, designed for image segmentation, to simultaneously classify and localise potential albatrosses. We aid training with the use of the Focal Loss criterion, to deal with extreme class imbalance in the dataset. Initial results achieve peak precision and recall values of approximately 80%. Finally w…
Wearable-based behaviour interpolation for semi-supervised human activity recognition
Durham University（杜伦大学）；Newcastle University（纽卡斯尔大学）；Tencent YouTu Lab（腾讯优图实验室）；Chinese Academy of Sciences R&D Center for Internet of Things（中国科学院物联网研究发展中心）
VTT Technical Research Centre of Finland（芬兰VTT技术研究中心）；University of Oulu（奥卢大学）
Human Activity Recognition (HAR) from wearable sensor data identifies movements or activities in unconstrained environments. HAR is a challenging problem as it presents great variability across subjects. Obtaining large amounts of labelled data is not straightforward, since wearable sensor signals are not easy to label upon simple human inspection. In our work, we propose the use of neural networks for the generation of realistic signals and features using human activity monocular videos. We show how these generated features and signals can be utilized, instead of their real counterparts, to t…
The goal of our work is to perform pixel label semantic segmentation on 3D biomedical volumetric data. Manual annotation is always difficult for a large bio-medical dataset. So, we consider two cases where one dataset is fully labeled and the other dataset is assumed to be fully unlabelled. We first perform Semantic Segmentation on the fully labeled isotropic biomedical source data (FIBSEM) and try to incorporate the the trained model for segmenting the target unlabelled dataset(SNEMI3D)which shares some similarities with the source dataset in the context of different types of cellular bodies …
Centre for Computational Intelligence (CCI), De Montfort University（德蒙福特大学计算智能中心）；Instituto Tecnologico de Costa Rica（哥斯达黎加理工学院）；School of Computer Science, University of Nottingham（诺丁汉大学计算机科学学院）；Imágenes Médicas Dr Chavarría Estrada（查瓦里亚·埃斯特拉达医学影像中心）；Biomedic Research Institute of Málaga (IBIMA)（马拉加生物医学研究所）
The Corona Virus (COVID-19) is an internationalpandemic that has quickly propagated throughout the world. The application of deep learning for image classification of chest X-ray images of Covid-19 patients, could become a novel pre-diagnostic detection methodology. However, deep learning architectures require large labelled datasets. This is often a limitation when the subject of research is relatively new as in the case of the virus outbreak, where dealing with small labelled datasets is a challenge. Moreover, in the context of a new highly infectious disease, the datasets are also highly im…
University of Bristol（布里斯托大学）；Chulalongkorn University（朱拉隆功大学）
Identification of abnormalities in red blood cells (RBC) is key to diagnosing a range of medical conditions from anaemia to liver disease. Currently this is done manually, a time-consuming and subjective process. This paper presents an automated process utilising the advantages of machine learning to increase capacity and standardisation of cell abnormality detection, and its performance is analysed. Three different machine learning technologies were used: a Support Vector Machine (SVM), a classical machine learning technology; TabNet, a deep learning architecture for tabular data; U-Net, a se…
OSDMamba: Enhancing Oil Spill Detection from Remote Sensing Images Using Selective State Space Model
Department of Computer Science, University of Exeter（计算机科学系，埃克塞特大学）；College of Oceanography and Space Informatics, China University of Petroleum (East China)（海洋科学与空间信息学院，中国石油大学（华东））
Logo detection in unconstrained images is challenging, particularly when only very sparse labelled training images are accessible due to high labelling costs. In this work, we describe a model training image synthesising method capable of improving significantly logo detection performance when only a handful of (e.g., 10) labelled training images captured in realistic context are available, avoiding extensive manual labelling costs. Specifically, we design a novel algorithm for generating Synthetic Context Logo (SCL) training images to increase model robustness against unknown background clutt…
An interpretable imbalanced semi-supervised deep learning framework for improving differential diagnosis of skin diseases
School of Medicine, Xiamen University（厦门大学医学院）；National Institute for Data Science in Health and Medicine, Xiamen University（厦门大学健康医疗大数据国家研究院）；Data Mining Research Center, Xiamen University（厦门大学数据挖掘研究中心）；School of Economics and Management, East China Jiaotong University（华东交通大学经济管理学院）；Department of Pediatrics, the First Affiliated Hospital of Xiamen University（厦门大学附属第一医院儿科）；School of Management, Xiamen University（厦门大学管理学院）；School of Science, Hong Kong University of Science and Technology（香港科技大学理学院）；School of Mathematical Sciences, Ocean University of China（中国海洋大学数学科学学院）；National Economic Engineering Laboratory, Dongbei University of Finance and Economics（东北财经大学国民经济工程实验室）
Institute for Infocomm Research (I2R), A-STAR（新加坡科技研究局资讯通信研究院（I2R））
Recent work on curvilinear structure segmentation has mostly focused on backbone network design and loss engineering. The challenge of collecting labelled data, an expensive and labor intensive process, has been overlooked. While labelled data is expensive to obtain, unlabelled data is often readily available. In this work, we propose SemiCurv, a semi-supervised learning (SSL) framework for curvilinear structure segmentation that is able to utilize such unlabelled data to reduce the labelling burden. Our framework addresses two key challenges in formulating curvilinear segmentation in a semi-s…
PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation
Data and Knowledge Engineering Group, Faculty of Computer Science, Otto von Guericke University Magdeburg, Germany（数据与知识工程组，计算机科学系，奥托·冯·格里克大学马格德堡分校）；Genomics Research Centre, Human Technopole, Milan, Italy（基因组研究中心，人类技术pole，米兰，意大利）；Laboratory of Fluid Dynamics and Technical Flows, Otto von Guericke University Magdeburg, Germany（流体动力学与技术流动实验室，奥托·冯·格里克大学马格德堡分校）；Department of Biomedical Magnetic Resonance, Faculty of Natural Sciences, Otto von Guericke University Magdeburg, Germany（生物医学磁共振部门，自然科学系，奥托·冯·格里克大学马格德堡分校）；MedDigit, Department of Neurology, Medical Faculty, University Hospital, Magdeburg, Germany（MedDigit，神经病学部门，医学学院，大学医院，马格德堡，德国）；German Centre for Neurodegenerative Disease, Magdeburg, Germany（德国神经退行性疾病中心，马格德堡，德国）；Centre for Behavioural Brain Sciences, Magdeburg, Germany（行为脑科学中心，马格德堡，德国）；School of Mathematics & Statistics, UNSW Sydney and UNSW Data Science Hub（数学与统计学学院，悉尼大学和UNSW数据科学中心）
本文提出 PULASki，在 Probabilistic UNet 中引入基于统计距离的损失以建模专家标注差异，并在颅内血管和 MS 病灶任务上显著优于四种基线。
Sabaragamuwa University of Sri Lanka（斯里兰卡萨伯勒格穆沃大学）
Automatic tomato disease recognition from leaf images is vital to avoid crop losses by applying control measures on time. Even though recent deep learning-based tomato disease recognition methods with classical training procedures showed promising recognition results, they demand large labelled data and involve expensive training. The traditional deep learning models proposed for tomato disease recognition also consume high memory and storage because of a high number of parameters. While lightweight networks overcome some of these issues to a certain extent, they continue to show low performan…
We present OffRoadTranSeg, the first end-to-end framework for semi-supervised segmentation in unstructured outdoor environment using transformers and automatic data selection for labelling. The offroad segmentation is a scene understanding approach that is widely used in autonomous driving. The popular offroad segmentation method is to use fully connected convolution layers and large labelled data, however, due to class imbalance, there will be several mismatches and also some classes may not be detected. Our approach is to do the task of offroad segmentation in a semi-supervised manner. The a…
Human Activity Recognition~(HAR) is the classification of human movement, captured using one or more sensors either as wearables or embedded in the environment~(e.g. depth cameras, pressure mats). State-of-the-art methods of HAR rely on having access to a considerable amount of labelled data to train deep architectures with many train-able parameters. This becomes prohibitive when tasked with creating models that are sensitive to personal nuances in human movement, explicitly present when performing exercises. In addition, it is not possible to collect training data to cover all possible subje…
Convolutional neural networks have been applied to a wide variety of computer vision tasks. Recent advances in semantic segmentation have enabled their application to medical image segmentation. While most CNNs use two-dimensional kernels, recent CNN-based publications on medical image segmentation featured three-dimensional kernels, allowing full access to the three-dimensional structure of medical images. Though closely related to semantic segmentation, medical image segmentation includes specific challenges that need to be addressed, such as the scarcity of labelled data, the high class imb…
University of Pennsylvania（宾夕法尼亚大学）；Perelman School of Medicine（佩雷尔曼医学院）
Pulmonary nodule detection plays an important role in lung cancer screening with low-dose computed tomography (CT) scans. It remains challenging to build nodule detection deep learning models with good generalization performance due to unbalanced positive and negative samples. In order to overcome this problem and further improve state-of-the-art nodule detection methods, we develop a novel deep 3D convolutional neural network with an Encoder-Decoder structure in conjunction with a region proposal network. Particularly, we utilize a dynamically scaled cross entropy loss to reduce the false pos…
University of Sussex（萨塞克斯大学）；Imperial College London（伦敦帝国学院）；BCAM Severo Ochoa Strategic Lab on Trustworthy Machine Learning（BCAM塞韦罗·奥乔亚可信机器学习战略实验室）；Monash University, Indonesia（莫纳什大学印度尼西亚校区）
Machine learning classifiers are typically trained to minimise the average error across a dataset. Unfortunately, in practice, this process often exploits spurious correlations caused by subgroup imbalance within the training data, resulting in high average performance but highly variable performance across subgroups. Recent work to address this problem proposes model patching with CAMEL. This previous approach uses generative adversarial networks to perform intra-class inter-subgroup data augmentations, requiring (a) the training of a number of computationally expensive models and (b) suffici…
This paper addresses domain adaptation for the pixel-wise classification of remotely sensed data using deep neural networks (DNN) as a strategy to reduce the requirements of DNN with respect to the availability of training data. We focus on the setting in which labelled data are only available in a source domain DS, but not in a target domain DT. Our method is based on adversarial training of an appearance adaptation network (AAN) that transforms images from DS such that they look like images from DT. Together with the original label maps from DS, the transformed images are used to adapt a DNN…
Medical image classification is one of the most critical problems in the image recognition area. One of the major challenges in this field is the scarcity of labelled training data. Additionally, there is often class imbalance in datasets as some cases are very rare to happen. As a result, accuracy in classification task is normally low. Deep Learning models, in particular, show promising results on image segmentation and classification problems, but they require very large datasets for training. Therefore, there is a need to generate more of synthetic samples from the same distribution. Previ…
