发表机构
George Mason University; Youngstown State University（乔治梅森大学; 扬斯敦州立大学）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
该研究开发了可公开使用的综合AI知识评估调查工具，在高等教育中验证其能诊断学生AI与GenAI知识的常见误解，助力开展针对性教学。
AI 中文摘要
本研究到实践类论文介绍了一种可用于评估学生AI知识的调查工具。随着人工智能（AI）包括生成式人工智能（GenAI）的使用日益普及，教育学生相关知识的需求也随之增长。一系列AI素养框架已被提出，概述了学生应掌握的必备知识，同时也开发了不同的AI知识评估方式。然而，目前仍缺乏能够评估学生多种知识形式的评估工具，包括技术概念、实际应用以及AI使用的伦理问题。在本文中，我们介绍了一项实施综合工具评估AI知识的研究。该工具结合了多个量表的测量指标，以捕捉一系列素养特征和实际知识。我们在高等教育环境中实施了该工具，以评估其可行性和实用性，发现该工具展现出有用的诊断能力，能够识别学生中的常见误解。尽管学生整体表现良好，但对AI尤其是GenAI系统的运作方式存在显著误解，还发现学生缺乏更高层次的知识。该工具可公开供他人使用，我们预见其作为诊断工具的实用性，不仅能了解学生对AI和GenAI使用的态度与感知，还能测试学生知识和概念理解的多个方面，这有助于开展针对性教学。
英文摘要
In this research-to-practice paper we present a survey that can be used to assess students' AI knowledge. As the use of artificial intelligence (AI), including generative artificial intelligence (GenAI), has proliferated, so has the need to educate students about the topic. A range of AI literacy frameworks have been proposed, outlining the essential knowledge that students should have. Alongside, different ways of assessing AI knowledge have been developed. As yet, there is a lack of assessment instruments capable of evaluating multiple forms of student knowledge, including technical concepts, practical applications, and ethical concerns about AI use. In this article, we present a study implementing a comprehensive instrument to assess AI knowledge. The instrument combines measures from multiple scales to capture a range of literacy features and actual knowledge. We implemented the instrument in a higher education setting to assess its viability and usefulness and found that the instrument exhibited useful diagnostic capabilities and was able to identify common misconceptions among students. Although students performed well overall, there was a significant misunderstanding of how AI, especially GenAI systems, work. It also identified a lack of higher-level knowledge. The instrument is publicly available for use by others. We foresee its usefulness as a diagnostic that goes beyond understanding students' attitudes and perceptions of AI and GenAI use and tests multiple aspects of students' knowledge and conceptual understanding. This can enable the development of targeted instruction.
CommentsUnder review
