Artificial Intelligence (AI), with ChatGPT as a prominent example, has recently taken center stage in various domains including higher education, particularly in Computer Science and Engineering (CSE). The AI revolution brings both convenience and controversy, offering substantial benefits while lacking formal guidance on their application. The primary objective of this work is to comprehensively analyze the pedagogical potential of ChatGPT in CSE education, understanding its strengths and limitations from the perspectives of educators and learners. We employ a systematic approach, creating a diverse range of educational practice problems within CSE field, focusing on various subjects such as data science, programming, AI, machine learning, networks, and more. According to our examinations, certain question types, like conceptual knowledge queries, typically do not pose significant challenges to ChatGPT, and thus, are excluded from our analysis. Alternatively, we focus our efforts on developing more in-depth and personalized questions and project-based tasks. These questions are presented to ChatGPT, followed by interactions to assess its effectiveness in delivering complete and meaningful responses. To this end, we propose a comprehensive five-factor reliability analysis framework to evaluate the responses. This assessment aims to identify when ChatGPT excels and when it faces challenges. Our study concludes with a correlation analysis, delving into the relationships among subjects, task types, and limiting factors. This analysis offers valuable insights to enhance ChatGPT's utility in CSE education, providing guidance to educators and students regarding its reliability and efficacy.
Can AI be a Teaching Partner? Evaluating ChatGPT, Gemini, and DeepSeek across Three Teaching Strategies
Federal Institute of São Paulo (IFSP)(圣保罗联邦学院);Graduate School of Education of University of Pennsylvania (UPENN)(宾夕法尼亚大学教育研究生院);Institute of Mathematics and Computer Sciences of University of São Paulo (USP)(圣保罗大学数学与计算机科学研究所);Nucleus of Excellence in Social Technologies (NEES) of Federal University of Alagoas (UFAL)(阿拉戈斯联邦大学社会技术卓越中心)
The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie
Department of English literature and language(英语文学与语言系);St.Mary’s University of San Antonio(圣玛丽大学);Foster School of Businesses(商学院);University of Washington(华盛顿大学);Department of Civil and Environmental Engineering(土木与环境工程系);Florida International University(佛罗里达国际大学);Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Florida Atlantic University(佛罗里达Atlantic大学)
Measuring the technological pedagogical content knowledge (TPACK) of in-service teachers of computer science who teach algorithms and programming in upper secondary education
本研究基于技术教学与内容知识(TPACK)框架(Mishra & Koehler,2006)和Schmidt et al.(2009)的TPACK工具,考察了全国1032名计算机科学中学教师的技术、教学、内容知识及其组合。研究结果表明,内容知识和技术知识的评分很高(平均值分别为4.38和4.16),似乎中学教师对他们的教学内容知识和他们的技术内容知识的信心较低(平均值分别为3.51和3.68)。
Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbots
Queen Mary University of London(伦敦玛丽女王大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Raygun Performance Monitoring(雷根性能监测公司);Tianjin University(天津大学);Kings Education(金斯教育);Cymax Group Technologies(赛马克斯集团科技公司);University of Texas at Austin(德克萨斯大学奥斯汀分校);Indian Institute of Tropical Meteorology(印度热带气象研究所);Microsoft(微软公司);University of Cambridge(剑桥大学);University of Ljubljana(卢布尔雅那大学);Machine Intelligence Research Labs(机器智能研究实验室);University of Western Ontario(西安大略大学);The University of New South Wales(新南威尔士大学);University of Birmingham(伯明翰大学);Cardiff University(卡迪夫大学);Vienna University of Technology(维也纳技术大学);University of Manchester(曼彻斯特大学);The University of Melbourne(墨尔本大学)
ChatGPT is all you need to decolonize sub-Saharan Vocational Education
Boston University(波士顿大学);National and Kapodistrian University of Athens(雅典国立卡波迪斯特里亚大学);Rutgers, the State University of New Jersey(罗格斯新泽西州立大学);University of Pennsylvania(宾夕法尼亚大学)
Performance of ChatGPT on USMLE: Unlocking the Potential of Large Language Models for AI-Assisted Medical Education
University of Massachusetts Boston(马萨诸塞大学波士顿分校);Texas Tech University(德克萨斯理工大学);Coventry University(考文垂大学);MacNeal Hospital(麦克尼尔医院);Washington State University(华盛顿州立大学)
本研究评估了 ChatGPT 回答复杂医学临床问题的可靠性,发现其在 USMLE 等测试中表现出较好的演绎推理能力,伦理问题得分达 60%,逻辑问题达 58.8%,证明其可作为 AI 辅助医学教育的潜力工具,但准确性仍待提升。
Distance Learning and Multilingual Education: A Case Study of Challenges and Pedagogical Perspectives in the Greek Border Region
Aristotle University of Thessaloniki(塞萨洛尼基亚里士多德大学);Heriot-Watt University(赫瑞-瓦特大学);Democritus University of Thrace(色雷斯德谟克利特大学);Hellenic Open University(希腊开放大学)
Performance of ChatGPT on the US Fundamentals of Engineering Exam: Comprehensive Assessment of Proficiency and Potential Implications for Professional Environmental Engineering Practice
IIHR – Hydroscience & Engineering, University of Iowa(爱荷华大学IIHR水文科学与工程研究所);Civil and Environmental Engineering, University of Iowa(爱荷华大学土木与环境工程学院);Electrical and Computer Engineering, University of Iowa(爱荷华大学电气与计算机工程学院)
本文评估基于 GPT-4 的 ChatGPT 在美国 FE 环境考试中的表现,发现非侵入式提示词修改可显著提升准确率,并探讨其教育应用、局限及考试诚信意义。