arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.07910cs.HC
收藏

基于多模态和大型语言模型的教育推荐系统解释的实验界面

Experimental Interface for Multimodal and Large Language Model Based Explanations of Educational Recommender Systems

Hasan Abu-Rasheed, Christian Weber, Madjid Fathi

AI总结:

提出一种基于Web的实验工具,用于评估基于多模态和大型语言模型的教育推荐系统可解释性方法,支持模块化、交互式和可定制的解释组件,两阶段评估初步结果显示其组件接受度高且能激发学习者探索信息的动机。

摘要:

在人工智能(AI)时代,为学习者提供关于基于AI的推荐算法输出的适当且充分的解释,使其能够对此做出明智决策变得至关重要。然而,教育推荐AI方法及其可解释性的快速发展,并未伴随着同等水平的基于证据的实验来评估这些解释的学习效果。为了解决这个问题,我们提出了一种基于Web的实验工具,用于评估基于多模态和大型语言模型(LLM)的可解释性方法。我们的工具提供了一套全面的模块化、交互式和可定制的可解释性组件,研究人员和教育工作者可以利用这些组件来研究单一和混合可解释性方法的作用。我们针对所提出的工具设计了两阶段评估,分别面向学习者和教育工作者。第一阶段的初步结果显示,该工具的组件获得了高度认可,具有良好的用户友好性,并激发了使用解释来探索更多推荐信息的动机。

英文摘要:

In the age of artificial intelligence (AI), providing learners with suitable and sufficient explanations of AI-based recommendation algorithm's output becomes essential to enable them to make an informed decision about it. However, the rapid development of AI approaches for educational recommendations and their explainability is not accompanied by an equal level of evidence-based experimentation to evaluate the learning effect of those explanations. To address this issue, we propose an experimental web-based tool for evaluating multimodal and large language model (LLM) based explainability approaches. Our tool provides a comprehensive set of modular, interactive, and customizable explainability elements, which researchers and educators can utilize to study the role of individual and hybrid explainability methods. We design a two-stage evaluation of the proposed tool, with learners and with educators. Our preliminary results from the first stage show high acceptance of the tool's components, user-friendliness, and an induced motivation to use the explanations for exploring more information about the recommendation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑