Despite their remarkable capabilities, Large Language Models (LLMs) are found to be surprisingly sensitive to minor variations in prompts, often generating significantly divergent outputs in response to minor variations in the prompts, such as spelling errors, alteration of wording or the prompt template. However, while assessing the quality of an LLM, the focus often tends to be solely on its performance on downstream tasks, while very little to no attention is paid to prompt sensitivity. To fill this gap, we propose POSIX - a novel PrOmpt Sensitivity IndeX as a reliable measure of prompt sensitivity, thereby offering a more comprehensive evaluation of LLM performance. The key idea behind POSIX is to capture the relative change in loglikelihood of a given response upon replacing the corresponding prompt with a different intent-preserving prompt. We provide thorough empirical evidence demonstrating the efficacy of POSIX in capturing prompt sensitivity and subsequently use it to measure and thereby compare prompt sensitivity of various open-source LLMs. We find that merely increasing the parameter count or instruction tuning does not necessarily reduce prompt sensitivity whereas adding some few-shot exemplars, even just one, almost always leads to significant decrease in prompt sensitivity. We also find that alterations to prompt template lead to the highest sensitivity in the case of MCQ type tasks, whereas paraphrasing results in the highest sensitivity in open-ended generation tasks. The code for reproducing our results is open-sourced at https://github.com/kowndinya-renduchintala/POSIX.
SICI: A Semantic-Pragmatic Complexity Index Reveals Regime Shifts in LLM Stance Detection
School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络空间安全学院);School of Artificial Intelligence, Shenzhen Technology University(深圳技术大学人工智能学院)
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles
Indian Institute of Technology Kharagpur(印度理工学院Khargapur分校);Rochester Institute of Technology(罗切斯特理工学院);Researcher, Fatima Fellowship(研究员,Fatima fellowship);AI Institute, University of South Carolina(人工智能研究所,南卡罗来纳大学);Amazon GenAI(亚马逊生成人工智能);Stanford University(斯坦福大学);James Silberrad Brown Center for AI, San Diego State University(詹姆斯·西伯拉德·布朗人工智能中心,圣地亚哥州立大学)
An Evaluation of the Pedagogical Soundness and Usability of AI-Generated Lesson Plans Across Different Models and Prompt Frameworks in High-School Physics
College of Computer Science and Information Systems(计算机科学与信息系统学院);Najran University(纳杰兰大学);Knight Foundation School of Computing and Information Sciences(骑士基金会计算与信息科学学院)
From Commands to Prompts: LLM-based Semantic File System for AIOS
Dalian University of Technology(大连理工大学);Rutgers University(罗格斯大学);Purdue University(普渡大学);New Jersey Institute of Technology(新泽西理工学院);EPFL(洛桑联邦理工学院);University of Minnesota(明尼苏达大学)