arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.16561cs.HC
收藏

通过人类概念学习与认知理论支持协同自适应机器教学

Supporting Co-Adaptive Machine Teaching through Human Concept Learning and Cognitive Theories

Simret Araya Gebreegziabher, Yukun Yang, Elena L. Glassman, Toby Jia-Jun Li

AI总结:

本文提出交互式机器学习工具MOCHA,结合变异理论与结构对齐理论,通过反事实数据生成和分组呈现帮助用户与模型实现双向对齐,并在18人实验中验证其有效性与可用性。

摘要:

交互式机器学习中的一个重要挑战,尤其是在主观或模糊领域,是促进人与模型之间的双向对齐。用户通过数据标注向模型传授他们的概念定义,同时在整个过程中不断完善自身的理解。为促进这一过程,我们引入了MOCHA,一个基于两种人类概念学习与认知理论的交互式机器学习工具。首先,它利用神经符号流水线支持基于变异理论的反事实数据生成。通过要求用户标注那些在句法和语义上与已标注数据相似但被预测为具有不同标签的反例,系统能够更有效地学习,同时帮助用户理解模型并反思自己的标签定义。其次,MOCHA使用结构对齐理论来呈现成组的反例,帮助用户理解数据项之间可对齐的差异并进行批量标注。我们通过一项有18名参与者参加的实验室研究验证了MOCHA的有效性和可用性。

英文摘要:

An important challenge in interactive machine learning, particularly in subjective or ambiguous domains, is fostering bi-directional alignment between humans and models. Users teach models their concept definition through data labeling, while refining their own understandings throughout the process. To facilitate this, we introduce MOCHA, an interactive machine learning tool informed by two theories of human concept learning and cognition. First, it utilizes a neuro-symbolic pipeline to support Variation Theory-based counterfactual data generation. By asking users to annotate counterexamples that are syntactically and semantically similar to already-annotated data but predicted to have different labels, the system can learn more effectively while helping users understand the model and reflect on their own label definitions. Second, MOCHA uses Structural Alignment Theory to present groups of counterexamples, helping users comprehend alignable differences between data items and annotate them in batch. We validated MOCHA's effectiveness and usability through a lab study with 18 participants.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑