Information systems increasingly leverage artificial intelligence (AI) and machine learning (ML) to generate value from vast amounts of data. However, ML models are imperfect and can generate incorrect classifications. Hence, human-in-the-loop (HITL) extensions to ML models add a human review for instances that are difficult to classify. This study argues that continuously relying on human experts to handle difficult model classifications leads to a strong increase in human effort, which strains limited resources. To address this issue, we propose a hybrid system that creates artificial experts that learn to classify data instances from unknown classes previously reviewed by human experts. Our hybrid system assesses which artificial expert is suitable for classifying an instance from an unknown class and automatically assigns it. Over time, this reduces human effort and increases the efficiency of the system. Our experiments demonstrate that our approach outperforms traditional HITL systems for several benchmarks on image classification.
Adding Seemingly Uninformative Labels Helps in Low Data Regimes
KTH Royal Institute of Technology(瑞典皇家理工学院);Science for Life Laboratory(生命科学实验室);AstraZeneca(阿斯利康);Karolinska Institutet(卡罗林斯卡学院);Capio Sankt Göran Hospital(卡皮奥圣约兰医院);Karolinska University Hospital(卡罗林斯卡大学医院)
Materials Expert-Artificial Intelligence for Materials Discovery
Department of Physics, Cornell University, Ithaca, NY 14853, USA;Department of Chemistry, Princeton University, Princeton, New Jersey 08544, United States;Department of Chemistry, North Carolina State University, Raleigh, NC, USA;New York University, New York, NY 10011, USA;Fraunhofer Research Institution for Materials Recycling;Department of Physics, Ewha Womans University, Seoul, South Korea
A Comparative Approach to Explainable Artificial Intelligence Methods in Application to High-Dimensional Electronic Health Records: Examining the Usability of XAI
Cooperative learning of Pl@ntNet's Artificial Intelligence algorithm: how does it work and how can we improve it?
Univ. Montpellier(蒙彼利埃大学);CNRS(法国国家科学研究中心);IMAG(蒙彼利埃计算机科学与应用数学研究所);Inria(法国国家信息与自动化研究所);LIRMM(蒙彼利埃电子与计算机科学实验室);CIRAD(法国农业国际合作研究发展中心);AMAP(植物与微生物环境适应数学、信息与物理模型实验室);Institut Universitaire de France (IUF)(法国大学研究院)
Using Artificial Intuition in Distinct, Minimalist Classification of Scientific Abstracts for Management of Technology Portfolios
Information Sciences Institute, Viterbi School of Engineering, University of Southern California(信息科学研究所,工程学院,南加州大学);Sol Price School of Public Policy, University of Southern California(索尔价格公共政策学院,南加州大学)