This paper systematically investigates the generation of code explanations by Large Language Models (LLMs) for code examples commonly encountered in introductory programming courses. Our findings reveal significant variations in the nature of code explanations produced by LLMs, influenced by factors such as the wording of the prompt, the specific code examples under consideration, the programming language involved, the temperature parameter, and the version of the LLM. However, a consistent pattern emerges for Java and Python, where explanations exhibit a Flesch-Kincaid readability level of approximately 7-8 grade and a consistent lexical density, indicating the proportion of meaningful words relative to the total explanation size. Additionally, the generated explanations consistently achieve high scores for correctness, but lower scores on three other metrics: completeness, conciseness, and specificity.
SenseCF: LLM-Prompted Counterfactuals for Intervention and Sensor Data Augmentation
College of Health Solutions, Arizona State University(亚利桑那州立大学健康解决方案学院);School of Computing and Augmented Intelligence, Arizona State University(亚利桑那州立大学计算与增强智能学院);School of Nutritional Sciences and Wellness, University of Arizona(亚利桑那大学营养科学与健康学院)
From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment
Technical University of Munich(慕尼黑技术大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Lund University(吕勒奥大学);University of Tübingen(图宾根大学);Stanford Graduate School of Education(斯坦福大学教育研究生院);Harvard Graduate School of Education(哈佛大学教育研究生院)
Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Study
Technical University of Munich, School of Computation, Information and Technology, Department of Computer Science, Munich, Germany(慕尼黑技术大学,计算、信息与技术学院,计算机科学系,德国慕尼黑)
In-Context Impersonation Reveals Large Language Models' Strengths and Biases
University of Tübingen(图宾根大学);Tübingen AI Center(图宾根人工智能中心);University of Porto(波尔图大学);INESC TEC(葡萄牙系统与计算机工程研究所(技术与科学));Max Planck Institute for Biological Cybernetics(马克斯·普朗克生物控制论研究所)
Reasoning-Token Spikes Under Prompted Untruthful Responses in Large Language Models
Chapman University(查普曼大学);INSERM U992, Cognitive Neuroimaging Unit, NeuroSpin Center(法国国家健康与医学研究院U992认知神经影像单元,神经自旋中心);University of California, Los Angeles(加州大学洛杉矶分校);California Institute of Technology(加州理工学院)
Deceptive AI systems that give explanations are more convincing than honest AI systems and can amplify belief in misinformation
Massachusetts Institute of Technology(麻省理工学院);MIT Media Lab(麻省理工学院媒体实验室);Kellogg School of Management(凯洛格管理学院);Northwestern University(西北大学);Institute for Human-Centered AI(以人为中心的人工智能研究所);Stanford University(斯坦福大学)
Disentangling Hallucinations: Orthogonal Semantic Projection for Robust Interpretability
U2IS, ENSTA, Institut Polytechnique de Paris(巴黎综合理工学院ENSTA学院U2IS实验室);ISIR, Université Sorbonne, Pierre et Marie Curie(索邦大学皮埃尔和玛丽·居里分校ISIR实验室);AMIAD, Pôle Recherche(AMIAD研究部)