Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias, potential for unsafe actions, dataset poisoning, lack of explainability, hallucinations, and non-reproducibility. These risks necessitate the development of "guardrails" to align LLMs with desired behaviors and mitigate potential harm.
This work explores the risks associated with deploying LLMs and evaluates current approaches to implementing guardrails and model alignment techniques. We examine intrinsic and extrinsic bias evaluation methods and discuss the importance of fairness metrics for responsible AI development. The safety and reliability of agentic LLMs (those capable of real-world actions) are explored, emphasizing the need for testability, fail-safes, and situational awareness.
Technical strategies for securing LLMs are presented, including a layered protection model operating at external, secondary, and internal levels. System prompts, Retrieval-Augmented Generation (RAG) architectures, and techniques to minimize bias and protect privacy are highlighted.
Effective guardrail design requires a deep understanding of the LLM's intended use case, relevant regulations, and ethical considerations. Striking a balance between competing requirements, such as accuracy and privacy, remains an ongoing challenge. This work underscores the importance of continuous research and development to ensure the safe and responsible use of LLMs in real-world applications.
HE-Guardrail: A Homomorphic Guardrail Against Jailbreak Attacks for Encrypted Large Language Model Inference
Pohang University of Science and Technology (POSTECH)(浦项科技大学);Inha University(仁荷大学);Daegu Gyeongbuk Institute of Science and Technology (DGIST)(大邱庆北科学技术院)
RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Virginia Tech(弗吉尼亚理工大学);Salesforce Research(Salesforce研究院);University of California Berkeley(加州大学伯克利分校);University of Chicago(芝加哥大学)
Intrinsic Guardrails: How Semantic Geometry of Personality Interacts with Emergent Misalignment in LLMs
International Institute of Information Technology, Hyderabad(国际信息研究所,海得拉巴);Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi(Mohamed bin Zayed人工智能大学,阿布扎比)
University of Liverpool(利物浦大学);Key Laboratory of System Software (Chinese Academy of Sciences)(中国科学院系统软件重点实验室);State Key Laboratory of Computer Science(计算机科学国家重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Warwick(华威大学);Institute of Digital Technologies, Loughborough University London(拉夫堡大学伦敦数字技术研究所)
StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Beihang University(北京航空航天大学);Fudan University(复旦大学);Renmin University of China(中国人民大学);KAUST(阿卜杜拉国王科技大学)
SafeHarbor: Defining Precise Decision Boundaries via Hierarchical Memory-Augmented Guardrail for LLM Agent Safety
School of Cyber Science and Technology, Beihang University, Beijing, China(北京航空航天大学网络安全学院);Institute of Artificial Intelligence, Beihang University, Beijing, China(北京航空航天大学人工智能研究院);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学);AI Security Lab, Beijing, China(360人工智能安全实验室)
Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation
Boise State University(博伊州立大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Pittsburgh(匹兹堡大学);New York University(纽约大学);Florida International University(佛罗里达国际大学)
The Need for Guardrails with Large Language Models in Medical Safety-Critical Settings: An Artificial Intelligence Application in the Pharmacovigilance Ecosystem
Harvard-MIT Department of Health Sciences and Technology(哈佛-麻省理工卫生科学与技术部);GlaxoSmithKline(葛兰素史克公司);London School of Hygiene and Tropical Medicine(伦敦卫生与热带医学院);Harvard T.H. Chan School of Public Health(哈佛陈曾熙公共卫生学院)