Learning to Prompt in the Classroom to Understand AI Limits: A pilot study
Università degli Studi di Milano Bicocca(米兰比可卡大学);Universitat Pompeu Fabra(庞培法布拉大学);University of Regensburg(雷根斯堡大学);Politecnico di Milano(米兰理工大学);Università degli Studi di Milano(米兰大学);Istituto per le Tecnologie Didattiche (ITD-CNR)(意大利国家研究委员会教育技术研究所)
Artificial intelligence's (AI) progress holds great promise in tackling pressing societal concerns such as health and climate. Large Language Models (LLM) and the derived chatbots, like ChatGPT, have highly improved the natural language processing capabilities of AI systems allowing them to process an unprecedented amount of unstructured data. However, the ensuing excitement has led to negative sentiments, even as AI methods demonstrate remarkable contributions (e.g. in health and genetics). A key factor contributing to this sentiment is the misleading perception that LLMs can effortlessly provide solutions across domains, ignoring their limitations such as hallucinations and reasoning constraints. Acknowledging AI fallibility is crucial to address the impact of dogmatic overconfidence in possibly erroneous suggestions generated by LLMs. At the same time, it can reduce fear and other negative attitudes toward AI. This necessitates comprehensive AI literacy interventions that educate the public about LLM constraints and effective usage techniques, i.e prompting strategies. With this aim, a pilot educational intervention was performed in a high school with 21 students. It involved presenting high-level concepts about intelligence, AI, and LLMs, followed by practical exercises involving ChatGPT in creating natural educational conversations and applying established prompting strategies. Encouraging preliminary results emerged, including high appreciation of the activity, improved interaction quality with the LLM, reduced negative AI sentiments, and a better grasp of limitations, specifically unreliability, limited understanding of commands leading to unsatisfactory responses, and limited presentation flexibility. Our aim is to explore AI acceptance factors and refine this approach for more controlled future studies.
Improving Student-AI Interaction Through Pedagogical Prompting: An Example in Computer Science Education
Carnegie Mellon University(卡内基梅隆大学);University of Michigan(密歇根大学);University of Toronto(多伦多大学);Colgate University(科尔盖特大学);University of Toronto Mississauga(多伦多大学密西根分校)
KFinEval-Pilot: A Comprehensive Benchmark Suite for Korean Financial Language Understanding
Korea Financial Telecommunications and Clearings Institute(韩国金融电信与清算院);Teddysum Inc.(泰迪萨姆公司);SELECTSTAR Inc.(SELECTSTAR公司);Konyang University(建阳大学);Seoultech(首尔科技大学);KAIST(韩国科学技术院)
Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulator
Idiap Research Institute(Idiap 研究所);Brno University of Technology(布尔诺理工大学);Ecole Polytechnique Federale de Lausanne(洛桑联邦理工学院);University of Zurich(苏黎世大学)
Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models
Faculty of Electronic and Information Engineering, Xi’an Jiaotong University(西安交通大学电子与信息工程学院);Queen Mary University of London(伦敦玛丽女王大学);University of Chicago(芝加哥大学)
Cog-TiPRO: Iterative Prompt Refinement with LLMs to Detect Cognitive Decline via Longitudinal Voice Assistant Commands
Computer Science, University of Massachusetts, Boston, MA, USA(计算机科学,马萨诸塞大学,波士顿,马萨诸塞州,美国);School of Medicine, University of North Carolina, Chapel Hill, NC, USA(医学院,北卡罗来纳大学,夏洛特,北卡罗来纳州,美国)
Composable Cross-prompt Essay Scoring by Merging Models
National Key Laboratory for Multimedia Information Processing(国家多媒体信息处理重点实验室);Peking University School of Computer Science(北京大学计算机学院);Peking University(北京大学)
Automating Bibliometric Analysis with Sentence Transformers and Retrieval-Augmented Generation (RAG): A Pilot Study in Semantic and Contextual Search for Customized Literature Characterization for High-Impact Urban Research
Oak Ridge National Laboratory(橡树岭国家实验室);The University of Tennessee(田纳西大学)
Secure On-Premise Deployment of Open-Weights Large Language Models in Radiology: An Isolation-First Architecture with Prospective Pilot Evaluation
Department of Diagnostic and Interventional Radiology, University Hospital Bonn(诊断与介入放射科,波恩大学医院);Department of Research-IT, University Hospital Bonn(研究-IT部门,波恩大学医院)