Large Language Models (LLMs) have the potential to significantly enhance threat intelligence by automating the collection, preprocessing, and analysis of threat data. However, the usability of these tools is critical to ensure their effective adoption by security professionals. Despite the advanced capabilities of LLMs, concerns about their reliability, accuracy, and potential for generating inaccurate information persist. This study conducts a comprehensive usability evaluation of five LLMs ChatGPT, Gemini, Cohere, Copilot, and Meta AI focusing on their user interface design, error handling, learning curve, performance, and integration with existing tools in threat intelligence enrichment. Utilizing a heuristic walkthrough and a user study methodology, we identify key usability issues and offer actionable recommendations for improvement. Our findings aim to bridge the gap between LLM functionality and user experience, thereby promoting more efficient and accurate threat intelligence practices by ensuring these tools are user-friendly and reliable.
Attack and defense techniques in large language models: A survey and new perspectives
School of Computer Engineering, Jimei University, Xiamen, China（集美大学计算机工程学院）；College of Science, Mathematics and Technology, Wenzhou-Kean University, Wenzhou, China（温州市凯恩大学科学、数学与技术学院）；School of Smart Education, Jiangsu Normal University, Xuzhou, China（江苏师范大学智能教育学院）
Representation Bending for Large Language Model Safety
Seoul National University（首尔国立大学）；Yonsei University（延世大学）；AIM Intelligence（AIM智能）；University of Michigan（密歇根大学）；Stanford University（斯坦福大学）；Amazon AWS（亚马逊AWS）
A SoK for SoCs: Reading the TI Leaves on AI for Cyber Threat Intelligence Generation and Sharing
UC Santa Barbara（加州大学圣塔芭芭拉分校）；UIUC（伊利诺伊大学厄巴纳-香槟分校）；Georgia Tech（佐治亚理工学院）；Purdue University（普渡大学）；University of Chicago（芝加哥大学）；Broadcom（博通）；University of Virginia（弗吉尼亚大学）
CAHICHA: Computer Automated Hardware Interaction test to tell Computer and Humans Apart
Centre of Excellence, Artificial Intelligence & Robotics (AIR), School of Computer Science and Engineering VIT-AP University（VIT-AP大学计算机科学与工程学院人工智能与机器人卓越中心）；DigitalFortress Private Limited（DigitalFortress私人有限公司）；Centre of Excellence, Artificial Intelligence & Robotics (AIR), Department of CS (Cyber Security), School of Computer Science and Engineering School of Engineering, VIT-AP University（VIT-AP大学工程学院计算机科学与工程学院网络安全系人工智能与机器人卓越中心）；Dayananda Sagar University（达亚南达萨加尔大学）
