An overview of artificial intelligence techniques for diagnosis of Schizophrenia based on magnetic resonance imaging modalities: Methods, challenges, and future works
K. N. Toosi University of Technology（K. N. 图西理工大学）；Deakin University（迪肯大学）；Universidad de Granada（格拉纳达大学）；University of Cambridge（剑桥大学）；University of Leicester（莱斯特大学）
Delaram Sadeghi, Afshin Shoeibi, Navid Ghassemi, Parisa Moridian, Ali Khadem, Roohallah Alizadehsani, Mohammad Teshnehlab, Juan M. Gorriz, Fahime Khozeimeh, Yu-… 展开作者
Delaram Sadeghi, Afshin Shoeibi, Navid Ghassemi, Parisa Moridian, Ali Khadem, Roohallah Alizadehsani, Mohammad Teshnehlab, Juan M. Gorriz, Fahime Khozeimeh, Yu-Dong Zhang, Saeid Nahavandi, U Rajendra Acharya
Schizophrenia (SZ) is a mental disorder that typically emerges in late adolescence or early adulthood. It reduces the life expectancy of patients by 15 years. Abnormal behavior, perception of emotions, social relationships, and reality perception are among its most significant symptoms. Past studies have revealed that SZ affects the temporal and anterior lobes of hippocampus regions of the brain. Also, increased volume of cerebrospinal fluid (CSF) and decreased volume of white and gray matter can be observed due to this disease. Magnetic resonance imaging (MRI) is the popular neuroimaging technique used to explore structural/functional brain abnormalities in SZ disorder, owing to its high spatial resolution. Various artificial intelligence (AI) techniques have been employed with advanced image/signal processing methods to accurately diagnose SZ. This paper presents a comprehensive overview of studies conducted on the automated diagnosis of SZ using MRI modalities. First, an AI-based computer aided-diagnosis system (CADS) for SZ diagnosis and its relevant sections are presented. Then, this section introduces the most important conventional machine learning (ML) and deep learning (DL) techniques in the diagnosis of diagnosing SZ. A comprehensive comparison is also made between ML and DL studies in the discussion section. In the following, the most important challenges in diagnosing SZ are addressed. Future works in diagnosing SZ using AI techniques and MRI modalities are recommended in another section. Results, conclusion, and research findings are also presented at the end.
Indian Institute of Technology Indore（印度理工学院印多尔分校）；University of Manitoba（曼尼托巴大学）
Machine learning models have been successfully employed in the diagnosis of Schizophrenia disease. The impact of classification models and the feature selection techniques on the diagnosis of Schizophrenia have not been evaluated. Here, we sought to access the performance of classification models along with different feature selection approaches on the structural magnetic resonance imaging data. The data consist of 72 subjects with Schizophrenia and 74 healthy control subjects. We evaluated different classification algorithms based on support vector machine (SVM), random forest, kernel ridge r…
Northumbria University（诺森比亚大学）；Durham University（杜伦大学）；University of Lagos（拉各斯大学）
Schizophrenia is a severe mental health condition that requires a long and complicated diagnostic process. However, early diagnosis is vital to control symptoms. Deep learning has recently become a popular way to analyse and interpret medical data. Past attempts to use deep learning for schizophrenia diagnosis from brain-imaging data have shown promise but suffer from a large training-application gap - it is difficult to apply lab research to the real world. We propose to reduce this training-application gap by focusing on readily accessible data. We collect a data set of psychiatric observati…
NIT Silchar（锡尔恰尔国立理工学院）；Indian Institute of Technology Indore（印度理工学院印多尔分校）；Nantong University（南通大学）
Schizophrenia (SCZ) is a brain disorder where different people experience different symptoms, such as hallucination, delusion, flat-talk, disorganized thinking, etc. In the long term, this can cause severe effects and diminish life expectancy by more than ten years. Therefore, early and accurate diagnosis of SCZ is prevalent, and modalities like structural magnetic resonance imaging (sMRI), functional MRI (fMRI), diffusion tensor imaging (DTI), and electroencephalogram (EEG) assist in witnessing the brain abnormalities of the patients. Moreover, for accurate diagnosis of SCZ, researchers have …
Technische Hochschule Aschaffenburg（阿沙芬堡应用技术大学）；Universidade de São Paulo (USP)（圣保罗大学）
Mental disorders are among the leading causes of disability worldwide. The first step in treating these conditions is to obtain an accurate diagnosis, but the absence of established clinical tests makes this task challenging. Machine learning algorithms can provide a possible solution to this problem, as we describe in this work. We present a method for the automatic diagnosis of mental disorders based on the matrix of connections obtained from EEG time series and deep learning. We show that our approach can classify patients with Alzheimer's disease and schizophrenia with a high level of accu…
National Institute of Technology Silchar（西尔查尔国家理工学院）；Indian Institute of Technology, Indore（印多尔印度理工学院）
Structural alterations have been thoroughly investigated in the brain during the early onset of schizophrenia (SCZ) with the development of neuroimaging methods. The objective of the paper is an efficient classification of SCZ in 2 different classes: Cognitive Normal (CN), and SCZ using magnetic resonance imaging (MRI) images. This paper proposed a lightweight 3D convolutional neural network (CNN) based framework for SCZ diagnosis using MRI images. In the proposed model, lightweight 3D CNN is used to extract both spatial and spectral features simultaneously from 3D volume MRI scans, and classi…
Schizophrenia is a complex psychiatric disorder involving changes in thought patterns, perception, mood, and behavior. The diagnosis of schizophrenia is challenging and requires that patients show two or more positive symptoms for at least one month. Delays in identifying this debilitating disorder can impede a patient ability to receive much needed treatment. Advances in neuroimaging and machine learning algorithms can facilitate the diagnosis of schizophrenia and help clinicians to provide an accurate diagnosis of the disease. This paper presents a methodology for analyzing spectral images o…
K. N. Toosi University of Technology（K.N.托西理工大学）；Ferdowsi University of Mashhad（马什哈德菲尔多西大学）；Islamic Azad University（伊斯兰阿扎德大学）；Deakin University（迪肯大学）；Universidad de Granada（格拉纳达大学）；Ngee Ann Polytechnic（义安理工学院）；Asia University（亚洲大学）；Singapore University of Social Sciences（新加坡社会科学大学）
Nowadays, many people worldwide suffer from brain disorders, and their health is in danger. So far, numerous methods have been proposed for the diagnosis of Schizophrenia (SZ) and attention deficit hyperactivity disorder (ADHD), among which functional magnetic resonance imaging (fMRI) modalities are known as a popular method among physicians. This paper presents an SZ and ADHD intelligent detection method of resting-state fMRI (rs-fMRI) modality using a new deep learning method. The University of California Los Angeles dataset, which contains the rs-fMRI modalities of SZ and ADHD patients, has…
Empowering Precision Medicine: AI-Driven Schizophrenia Diagnosis via EEG Signals: A Comprehensive Review from 2002-2023
The Graduate School of Biomedical Engineering, UNSW Sydney（新南威尔士大学悉尼分校生物医学工程研究生院）；Data Science and Computational Intelligence Institute, University of Granada（格拉纳达大学数据科学与计算智能研究所）；UNSW Data Science Hub, The University of New South Wales（新南威尔士大学数据科学中心）；Centre for Applied Artificial Intelligence, Macquarie University（麦考瑞大学应用人工智能中心）；School of Computing, Macquarie University（麦考瑞大学计算学院）；School of Mathematics, Physics and Computing, University of Southern Queensland（南昆士兰大学数学、物理与计算学院）；Department of Psychiatry, University of Cambridge（剑桥大学精神病学系）
K. N. Toosi University of Technology（K. N. 图西理工大学）；Islamic Azad University（伊斯兰阿扎德大学）；University of La Rioja（拉里奥哈大学）；Deakin University（迪肯大学）；Macquarie University（麦考瑞大学）；Harvard University（哈佛大学）；University of Leicester（莱斯特大学）；Universidad de Granada（格拉纳达大学）；University of Cambridge（剑桥大学）
Schizophrenia (SZ) is a mental disorder whereby due to the secretion of specific chemicals in the brain, the function of some brain regions is out of balance, leading to the lack of coordination between thoughts, actions, and emotions. This study provides various intelligent deep learning (DL)-based methods for automated SZ diagnosis via electroencephalography (EEG) signals. The obtained results are compared with those of conventional intelligent methods. To implement the proposed methods, the dataset of the Institute of Psychiatry and Neurology in Warsaw, Poland, has been used. First, EEG sig…
Institute of Mental Health, Singapore（新加坡精神卫生研究院）；National University of Singapore（新加坡国立大学）；Nanyang Technological University（南洋理工大学）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）
Convolutional Neural Network (CNN) has been successfully applied on classification of both natural images and medical images but not yet been applied to differentiating patients with schizophrenia from healthy controls. Given the subtle, mixed, and sparsely distributed brain atrophy patterns of schizophrenia, the capability of automatic feature learning makes CNN a powerful tool for classifying schizophrenia from controls as it removes the subjectivity in selecting relevant spatial features. To examine the feasibility of applying CNN to classification of schizophrenia and controls based on str…
King’s College London（伦敦国王学院）；Birkbeck College, London（伦敦大学伯贝克学院）；National Institute of Mental Health（国家精神卫生研究所）；Universidade Federal do ABC（ABC联邦大学）
Despite the impact of psychiatric disorders on clinical health, early-stage diagnosis remains a challenge. Machine learning studies have shown that classifiers tend to be overly narrow in the diagnosis prediction task. The overlap between conditions leads to high heterogeneity among participants that is not adequately captured by classification models. To address this issue, normative approaches have surged as an alternative method. By using a generative model to learn the distribution of healthy brain data patterns, we can identify the presence of pathologies as deviations or outliers from th…
Johns Hopkins University（约翰斯·霍普金斯大学）；Lieber Institute for Brain Development（利伯大脑发育研究所）；University of Bari Aldo Moro（巴里大学阿尔多·莫罗大学）；Azienda Ospedaliero-Universitaria Consorziale Policlinico（巴里大学联合综合医院）
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. Our model consists of an encoder, a decoder and a classifier. The encoder learns a non-linear subspace shared between the input data modalities. The classifier and the decoder act as regularizers to ensure that the low-dimensional encoding captures predictive differences between patients and controls. We use a learnable dropout layer to extract interpretable biomarkers from the data, and our unique training strategy can easily accommodate m…
Shahid Beheshti University of Medical Sciences（沙希德·贝赫什提医科大学）；Student Research Committee（学生研究委员会）；School of Allied Medical Science（Allied Medical Science学院）；Department of Health Information Technology and Management（卫生信息技术与管理系）
Purpose: Early detection and diagnosis of Covid-19 and accurate separation of patients with non-Covid-19 cases at the lowest cost and in the early stages of the disease are one of the main challenges in the epidemic of Covid-19. Concerning the novelty of the disease, the diagnostic methods based on radiological images suffer shortcomings despite their many uses in diagnostic centers. Accordingly, medical and computer researchers tended to use machine-learning models to analyze radiology images. Methods: Present systematic review was conducted by searching three databases of PubMed, Scopus, and…
A Generative Imputation Method for Multimodal Alzheimer's Disease Diagnosis
School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA（电气与计算机工程学院，佐治亚理工学院，亚特兰大，GA，USA）；Courtesy Faculty Appointment, College of Pharmacy, University of Florida, Gainesville, FL, USA（佛罗里达大学药学院荣誉教职）
Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State, Georgia Tech, Emory（三机构神经影像与数据科学转化研究中心（TReNDS），佐治亚州立大学、佐治亚理工学院、埃默里大学）；Faculty of Electrical Engineering, Mathematics & Computer Science, TU Delft（代尔夫特理工大学电气工程、数学与计算机科学学院）；Lambert High School（兰伯特高中）
Neuroimaging studies often involve the collection of multiple data modalities. These modalities contain both shared and mutually exclusive information about the brain. This work aims at finding a scalable and interpretable method to fuse the information of multiple neuroimaging modalities using a variational autoencoder (VAE). To provide an initial assessment, this work evaluates the representations that are learned using a schizophrenia classification task. A support vector machine trained on the representations achieves an area under the curve for the classifier's receiver operating characte…
Alzheimer's Disease (AD) is the most common neurodegenerative disorder with one of the most complex pathogeneses, making effective and clinically actionable decision support difficult. The objective of this study was to develop a novel multimodal deep learning framework to aid medical professionals in AD diagnosis. We present a Multimodal Alzheimer's Disease Diagnosis framework (MADDi) to accurately detect the presence of AD and mild cognitive impairment (MCI) from imaging, genetic, and clinical data. MADDi is novel in that we use cross-modal attention, which captures interactions between moda…
Accurate diagnosis of psychiatric disorders plays a critical role in improving the quality of life for patients and potentially supports the development of new treatments. Many studies have been conducted on machine learning techniques that seek brain imaging data for specific biomarkers of disorders. These studies have encountered the following dilemma: A direct classification overfits to a small number of high-dimensional samples but unsupervised feature-extraction has the risk of extracting a signal of no interest. In addition, such studies often provided only diagnoses for patients without…
Shanghai Institute for Advanced Communication and Data Science（上海先进通信与数据科学研究院）；The First Affiliated Hospital of Anhui Medical University（安徽医科大学第一附属医院）；Fudan University Shanghai Cancer Center（复旦大学附属肿瘤医院）；Shanghai Medical College, Fudan University（复旦大学上海医学院）；School of Science, Shanghai University（上海大学理学院）
Elastography ultrasound (EUS) provides additional bio-mechanical in-formation about lesion for B-mode ultrasound (BUS) in the diagnosis of breast cancers. However, joint utilization of both BUS and EUS is not popular due to the lack of EUS devices in rural hospitals, which arouses a novel modality im-balance problem in computer-aided diagnosis (CAD) for breast cancers. Current transfer learning (TL) pay little attention to this special issue of clinical modality imbalance, that is, the source domain (EUS modality) has fewer labeled samples than those in the target domain (BUS modality). Moreov…
Revolutionizing Disease Diagnosis with simultaneous functional PET/MR and Deeply Integrated Brain Metabolic, Hemodynamic, and Perfusion Networks
School of Biomedical Engineering, ShanghaiTech University（上海科技大学生物医学工程学院）；Zhongshan Hospital（中山医院）；State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University（上海科技大学先进医用材料与器件国家重点实验室）；Shanghai Clinical Research and Trial Center（上海临床研究与试验中心）
Center for Advanced Technology and Education（先进技术与教育中心）；Florida International University（佛罗里达国际大学）
Multiple modalities of biomarkers have been proved to be very sensitive in assessing the progression of Alzheimer's disease (AD), and using these modalities and machine learning algorithms, several approaches have been proposed to assist in the early diagnosis of AD. Among the recent investigated state-of-the-art approaches, Gaussian discriminant analysis (GDA)-based approaches have been demonstrated to be more effective and accurate in the classification of AD, especially for delineating its prodromal stage of mild cognitive impairment (MCI). Moreover, among those binary classification invest…
A dataset of primary nasopharyngeal carcinoma MRI with multi-modalities segmentation
The First People’s Hospital of Foshan, China（佛山市第一人民医院）；The Second Affiliated Hospital of Anhui Medical University, China（安徽医科大学第二附属医院）；Zhongshan Hospital, Fudan University, Shanghai, China（复旦大学中山医院）；ELTE University, Budapest, Hungary（ELTE大学）；Foundation Robotics Labs, Munich, Germany（Foundation Robotics Labs）
Institute for Systems and Robotics（系统与机器人研究所）；Interactive Technologies Institute（交互技术研究所）
This paper describes the field research, design and comparative deployment of a multimodal medical imaging user interface for breast screening. The main contributions described here are threefold: 1) The design of an advanced visual interface for multimodal diagnosis of breast cancer (BreastScreening); 2) Insights from the field comparison of single vs multimodality screening of breast cancer diagnosis with 31 clinicians and 566 images, and 3) The visualization of the two main types of breast lesions in the following image modalities: (i) MammoGraphy (MG) in both Craniocaudal (CC) and Mediolat…
Research Institute of Trustworthy Autonomous Systems（可信自主系统研究院）；Southern University of Science and Technology（南方科技大学）
Cataracts are the leading cause of visual impairment and blindness globally. Over the years, researchers have achieved significant progress in developing state-of-the-art machine learning techniques for automatic cataract classification and grading, aiming to prevent cataracts early and improve clinicians' diagnosis efficiency. This survey provides a comprehensive survey of recent advances in machine learning techniques for cataract classification/grading based on ophthalmic images. We summarize existing literature from two research directions: conventional machine learning methods and deep le…
University of Salzburg（萨尔茨堡大学）；St. Anna Children’s Hospital（圣安娜儿童医院）；Salzburg University of Applied Sciences（萨尔茨堡应用科学大学）
Novel imaging technologies raise many questions concerning the adaptation of computer-aided decision support systems. Classification models either need to be adapted or even newly trained from scratch to exploit the full potential of enhanced techniques. Both options typically require the acquisition of new labeled training data. In this work we investigate the applicability of image-to-image translation to endoscopic images showing different imaging modalities, namely conventional white-light and narrow-band imaging. In a study on computer-aided celiac disease diagnosis, we explore whether im…
College of Computer Science and Technology, Nanjing Forestry University（南京林业大学计算机科学与技术学院）；College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics（南京航空航天大学计算机科学与技术学院）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）
Deep learning has been recently used for the analysis of neuroimages, such as structural magnetic resonance imaging (MRI), functional MRI, and positron emission tomography (PET), and has achieved significant performance improvements over traditional machine learning in computer-aided diagnosis of brain disorders. This paper reviews the applications of deep learning methods for neuroimaging-based brain disorder analysis. We first provide a comprehensive overview of deep learning techniques and popular network architectures, by introducing various types of deep neural networks and recent develop…
Enriched text-guided variational multimodal knowledge distillation network (VMD) for automated diagnosis of plaque vulnerability in 3D carotid artery MRI
department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University（放射医学与核医学科，宣武医院，首都医科大学）；Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics（北京磁共振成像与脑信息学重点实验室）；Beijing United Imaging Research Institute of Intelligent Imaging（北京智能成像联合研究院）
University of Granada（格拉纳达大学）；Islamic Azad University（伊斯兰阿扎德大学）；Ferdowsi University of Mashhad（马什哈德菲尔多西大学）；Semnan University（塞姆南大学）；Deakin University（迪肯大学）；Macquarie University（麦考瑞大学）；Universidad de Granada（格拉纳达大学）
Epilepsy is a disorder of the brain denoted by frequent seizures. The symptoms of seizure include confusion, abnormal staring, and rapid, sudden, and uncontrollable hand movements. Epileptic seizure detection methods involve neurological exams, blood tests, neuropsychological tests, and neuroimaging modalities. Among these, neuroimaging modalities have received considerable attention from specialist physicians. One method to facilitate the accurate and fast diagnosis of epileptic seizures is to employ computer-aided diagnosis systems (CADS) based on deep learning (DL) and neuroimaging modaliti…
Lehigh University（里海大学）；University of Pennsylvania（宾夕法尼亚大学）
Identification of brain regions related to the specific neurological disorders are of great importance for biomarker and diagnostic studies. In this paper, we propose an interpretable Graph Convolutional Network (GCN) framework for the identification and classification of Alzheimer's disease (AD) using multi-modality brain imaging data. Specifically, we extended the Gradient Class Activation Mapping (Grad-CAM) technique to quantify the most discriminative features identified by GCN from brain connectivity patterns. We then utilized them to find signature regions of interest (ROIs) by detecting…
Islamic Azad University（伊斯兰阿扎德大学）；Ferdowsi University of Mashhad（马什哈德菲尔多西大学）；Semnan University（塞姆南大学）；Qatar Biomedical Research Institute（卡塔尔生物医学研究所）；Hamad Bin Khalifa University（哈马德·本·哈利法大学）；University of Granada（格拉纳达大学）；Deakin University（迪肯大学）；University of Technology Sydney（悉尼科技大学）；University of Turku（图尔库大学）；Effat University（埃法特大学）；Ngee Ann Polytechnic（义安理工学院）；Asia University（亚洲大学）；Singapore University of Social Sciences（新加坡社会科学大学）
Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and struc…
University of Waterloo（滑铁卢大学）；University of Calgary（卡尔加里大学）
Novel coronavirus (COVID-19) outbreak, has raised a calamitous situation all over the world and has become one of the most acute and severe ailments in the past hundred years. The prevalence rate of COVID-19 is rapidly rising every day throughout the globe. Although no vaccines for this pandemic have been discovered yet, deep learning techniques proved themselves to be a powerful tool in the arsenal used by clinicians for the automatic diagnosis of COVID-19. This paper aims to overview the recently developed systems based on deep learning techniques using different medical imaging modalities l…
Skin conditions are a global health concern, ranking the fourth highest cause of nonfatal disease burden when measured as years lost due to disability. As diagnosing, or classifying, skin diseases can help determine effective treatment, dermatologists have extensively researched how to diagnose conditions from a patient's history and the lesion's visual appearance. Computer vision researchers are attempting to encode this diagnostic ability into machines, and several recent studies report machine level performance comparable with dermatologists. This report reviews machine approaches to classi…
Lehigh University（理海大学）；University of Pittsburgh（匹兹堡大学）；The Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）
The assessment of Alzheimer's Disease (AD) and Mild Cognitive Impairment (MCI) associated with brain changes remains a challenging task. Recent studies have demonstrated that combination of multi-modality imaging techniques can better reflect pathological characteristics and contribute to more accurate diagnosis of AD and MCI. In this paper, we propose a novel tensor-based multi-modality feature selection and regression method for diagnosis and biomarker identification of AD and MCI from normal controls. Specifically, we leverage the tensor structure to exploit high-level correlation informati…
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)（德国人工智能研究中心）；TU Kaiserslautern（凯泽斯劳滕工业大学）
Early detection of skin cancers like melanoma is crucial to ensure high chances of survival for patients. Clinical application of Deep Learning (DL)-based Decision Support Systems (DSS) for skin cancer screening has the potential to improve the quality of patient care. The majority of work in the medical AI community focuses on a diagnosis setting that is mainly relevant for autonomous operation. Practical decision support should, however, go beyond plain diagnosis and provide explanations. This paper provides an overview of works towards explainable, DL-based decision support in medical appli…
Advancements in Machine Learning and Deep Learning for Early Detection and Management of Mental Health Disorder
Department of Computer Science and Engineering, Mepco Schlenk Engineering College（梅科斯伦克工程学院计算机科学与工程系）；Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College（梅科斯伦克工程学院电子与通信工程系）；School of Electronics Engineering (SENSE), VIT-AP University（VIT-AP大学电子工程学院（SENSE））；The Institute for Mental and Physical Health and Clinical Translation (IMPACT), School of Medicine, Deakin University（德金大学医学院心理健康与身体健康及临床转化研究所（IMPACT））；Biostatistics Unit, Faculty of Health, Deakin University（德金大学健康学院生物统计学单位）；School of Medicine, Deakin University（德金大学医学院）
K. N. Toosi University of Technology（K. N. 图西理工大学）；Ferdowsi University of Mashhad（马什哈德菲尔多西大学）；Semnan University（塞姆南大学）；Deakin University（迪肯大学）；University of California, San Francisco（加州大学旧金山分校）
A variety of screening approaches have been proposed to diagnose epileptic seizures, using electroencephalography (EEG) and magnetic resonance imaging (MRI) modalities. Artificial intelligence encompasses a variety of areas, and one of its branches is deep learning (DL). Before the rise of DL, conventional machine learning algorithms involving feature extraction were performed. This limited their performance to the ability of those handcrafting the features. However, in DL, the extraction of features and classification are entirely automated. The advent of these techniques in many areas of med…
Bipolar disorder is a mental health disorder that causes mood swings that range from depression to mania. Diagnosis of bipolar disorder is usually done based on patient interviews, and reports obtained from the caregivers of the patients. Subsequently, the diagnosis depends on the experience of the expert, and it is possible to have confusions of the disorder with other mental disorders. Automated processes in the diagnosis of bipolar disorder can help providing quantitative indicators, and allow easier observations of the patients for longer periods. Furthermore, the need for remote treatment…
Donghua University（东华大学）；JD AI Research（京东人工智能研究院）；Columbia University（哥伦比亚大学）
Existing works about fashion outfit compatibility focus on predicting the overall compatibility of a set of fashion items with their information from different modalities. However, there are few works explore how to explain the prediction, which limits the persuasiveness and effectiveness of the model. In this work, we propose an approach to not only predict but also diagnose the outfit compatibility. We introduce an end-to-end framework for this goal, which features for: (1) The overall compatibility is learned from all type-specified pairwise similarities between items, and the backpropagati…
