arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.03003cs.LG
收藏

提高人在回路系统的效率:为人类专家增加人工专家

Improving the Efficiency of Human-in-the-Loop Systems: Adding Artificial to Human Experts

Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)

Johannes Jakubik, Daniel Weber, Patrick Hemmer, Michael Vössing, Gerhard Satzger

AI总结:

本文针对人在回路系统中人类专家负担过重的问题,提出一种创建并自动分配人工专家处理未知类别实例的混合系统,实验证明其在多个图像分类基准上优于传统方法。

摘要:

信息系统越来越多地利用人工智能(AI)和机器学习(ML)从海量数据中创造价值。然而,ML模型并不完美,可能产生错误分类。因此,人在回路(HITL)扩展在难以分类的实例上增加了人工审核。本研究认为,持续依赖人类专家处理困难的模型分类会导致人工工作量大幅增加,从而给有限资源带来压力。为解决这一问题,我们提出一种混合系统,该系统创建人工专家,学习对先前由人类专家审核过的未知类别数据实例进行分类。我们的混合系统评估哪个人工专家适合对来自未知类别的实例进行分类,并自动进行分配。随着时间推移,这减少了人工工作量并提高了系统效率。我们的实验表明,在多个图像分类基准上,我们的方法优于传统的HITL系统。

英文摘要:

Information systems increasingly leverage artificial intelligence (AI) and machine learning (ML) to generate value from vast amounts of data. However, ML models are imperfect and can generate incorrect classifications. Hence, human-in-the-loop (HITL) extensions to ML models add a human review for instances that are difficult to classify. This study argues that continuously relying on human experts to handle difficult model classifications leads to a strong increase in human effort, which strains limited resources. To address this issue, we propose a hybrid system that creates artificial experts that learn to classify data instances from unknown classes previously reviewed by human experts. Our hybrid system assesses which artificial expert is suitable for classifying an instance from an unknown class and automatically assigns it. Over time, this reduces human effort and increases the efficiency of the system. Our experiments demonstrate that our approach outperforms traditional HITL systems for several benchmarks on image classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑