LLMs such as ChatGPT have been widely adopted by students in higher education as tools for learning programming and related concepts. However, it remains unclear how effective students are and what strategies students use while learning with LLMs. Since the majority of students' experiences in online self-learning have come through using search engines such as Google, evaluating AI tools in this context can help us address these gaps. In this mixed methods research, we conducted an exploratory within-subjects study to understand how CS2 students learn programming concepts using both LLMs as well as traditional online methods such as educational websites and videos to examine how students approach learning within and across both scenarios. We discovered that students found it easier to learn a more difficult concept using traditional methods than using ChatGPT. We also found that students ask fewer follow-ups and use more keyword-based queries for search engines while their prompts to LLMs tend to explicitly ask for information.
Gender and content bias in Large Language Models: a case study on Google Gemini 2.0 Flash Experimental
University of Perugia(佩鲁贾大学);Chapin Hall at University of Chicago(芝加哥大学查平学院);Berdyansk State Pedagogical University(别尔江斯克国立师范大学);Università di Bologna(博洛尼亚大学);University of North Texas(北得克萨斯大学);Chapin Hall(查平学院)
Performance of ChatGPT on USMLE: Unlocking the Potential of Large Language Models for AI-Assisted Medical Education
University of Massachusetts Boston(马萨诸塞大学波士顿分校);Texas Tech University(德克萨斯理工大学);Coventry University(考文垂大学);MacNeal Hospital(麦克尼尔医院);Washington State University(华盛顿州立大学)
本研究评估了 ChatGPT 回答复杂医学临床问题的可靠性,发现其在 USMLE 等测试中表现出较好的演绎推理能力,伦理问题得分达 60%,逻辑问题达 58.8%,证明其可作为 AI 辅助医学教育的潜力工具,但准确性仍待提升。
Authority Signals in AI Cited Health Sources: A Framework for Evaluating Source Credibility in ChatGPT Responses
York College, The City University of New York(纽约市立大学约克学院);Teachers College, Columbia University(哥伦比亚大学教师学院);William Paterson University(威廉帕特森大学);CUNY School of Public Health(纽约市立大学公共卫生学院)
PlatoLM: Teaching LLMs in Multi-Round Dialogue via a User Simulator
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Research Institute of Big Data(深圳大数据研究院);Soochow University(苏州大学);University of Science and Technology(科技大学)
Antisocial Analagous Behavior, Alignment and Human Impact of Google AI Systems: Evaluating through the lens of modified Antisocial Behavior Criteria by Human Interaction, Independent LLM Analysis, and AI Self-Reflection
Adversarial Attacks and Defenses in Large Language Models: Old and New Threats
Technical University of Munich(慕尼黑工业大学);Munich Data Science Institute(慕尼黑数据科学研究所);Université de Montréal(蒙特利尔大学);Mila Quebec AI Institute(米拉魁北克人工智能研究所)
Large Language Models (LLMs) and Generative AI in Cybersecurity and Privacy: A Survey of Dual-Use Risks, AI-Generated Malware, Explainability, and Defensive Strategies
Virelya Intelligence Research Labs(Virelya智能研究实验室);Google(谷歌)
OntoChatGPT Information System: Ontology-Driven Structured Prompts for ChatGPT Meta-Learning
Glushkov Institute of Cybernetics of the National Academy of Sciences of Ukraine(乌克兰国家科学院格鲁什科夫控制论研究所);Frantsevic Institute for Problems in Material Science of the National Academy of Sciences of Ukraine(乌克兰国家科学院弗兰采维奇材料科学问题研究所)