The open-sourcing of large language models (LLMs) accelerates application development, innovation, and scientific progress. This includes both base models, which are pre-trained on extensive datasets without alignment, and aligned models, deliberately designed to align with ethical standards and human values. Contrary to the prevalent assumption that the inherent instruction-following limitations of base LLMs serve as a safeguard against misuse, our investigation exposes a critical oversight in this belief. By deploying carefully designed demonstrations, our research demonstrates that base LLMs could effectively interpret and execute malicious instructions. To systematically assess these risks, we introduce a novel set of risk evaluation metrics. Empirical results reveal that the outputs from base LLMs can exhibit risk levels on par with those of models fine-tuned for malicious purposes. This vulnerability, requiring neither specialized knowledge nor training, can be manipulated by almost anyone, highlighting the substantial risk and the critical need for immediate attention to the base LLMs' security protocols.
Jailbreak-as-a-Service++: Unveiling Distributed AI-Driven Malicious Information Campaigns Powered by LLM Crowdsourcing
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);China People’s Public Security University(中国人民公安大学);Tongji University(同济大学);South China Normal University(华南师范大学);Tsing Hua University(清华大学)
Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Illinois Chicago(伊利诺伊大学香槟分校);State Key Laboratory of Media Convergence and Communication, Communication University of China(中国传媒大学媒体融合与传播国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学)
Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation
School of Data Science, Fudan University(复旦大学数据科学学院);Research Institute of Intelligent and Complex Systems, Fudan University(复旦大学智能与复杂系统研究院);School of Computer Science, Fudan University(复旦大学计算机科学学院);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海市智能视觉计算协同创新中心)