Detecting harmful and non-inclusive terminology in technical contexts is critical for fostering inclusive environments in computing. This study explores the impact of model architecture on harmful language detection by evaluating a curated database of technical terms, each paired with specific use cases. We tested a range of encoder, decoder, and encoder-decoder language models, including BERT-base-uncased, RoBERTa large-mnli, Gemini Flash 1.5 and 2.0, GPT-4, Claude AI Sonnet 3.5, T5-large, and BART-large-mnli. Each model was presented with a standardized prompt to identify harmful and non-inclusive language across 64 terms. Results reveal that decoder models, particularly Gemini Flash 2.0 and Claude AI, excel in nuanced contextual analysis, while encoder models like BERT exhibit strong pattern recognition but struggle with classification certainty. We discuss the implications of these findings for improving automated detection tools and highlight model-specific strengths and limitations in fostering inclusive communication in technical domains.
StealthGraph: Exposing Domain-Specific Risks in LLMs through Knowledge-Graph-Guided Harmful Prompt Generation
School of Software Technology, Zhejiang University(浙江大学软件学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);State Key Lab of CAD&CG, Zhejiang University(浙江大学CAD&CG国家重点实验室)
From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation
School of Computation, Information and Technology, TU Munich(慕尼黑工业大学计算、信息与技术学院);Munich Center for Machine Learning(慕尼黑机器学习中心);Munich Data Science Institute(慕尼黑数据科学研究所)
Don't Erase, Inform! Detecting and Contextualizing Harmful Language in Cultural Heritage Collections
National Technical University of Athens(希腊国家技术大学);DFF - Deutsches Filminstitut & Filmmuseum(德国电影学院及电影博物馆);Europeana Foundation(欧洲ana基金会);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学)
University of California, Berkeley(加州大学伯克利分校);HUMAIN;King Abdulaziz City for Science and Technology(国王阿卜杜勒阿齐兹科学与技术城);University of Washington, Seattle(华盛顿大学(西雅图))
HarmMetric Eval: Benchmarking Metrics and Judges for LLM Harmfulness Assessment
The State Key Laboratory of Blockchain and Data Security(区块链与数据安全国家重点实验室);Zhejiang University(浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院);Pretraining Team, xAI(预训练团队,xAI);Hong Kong University of Science and Technology (GuangZhou)(香港科技大学(广州))
Towards Comprehensive Detection of Chinese Harmful Memes
School of Computer Science and Technology(计算机科学与技术学院);School of Foreign Languages(外国语学院);Key Laboratory of Social Computing and Cognitive Intelligence(社会计算与认知智能重点实验室);Dalian University of Technology(大连理工大学)
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training
School of Data Science, The Chinese University of Hong Kong, Shenzhen, China(数据科学学院,香港中文大学(深圳));Tencent AI Lab(腾讯人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Shenzhen Research Institute of Big Data, China(深圳大数据研究院)
from Benign import Toxic: Jailbreaking the Language Model via Adversarial Metaphors
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);People’s Public Security University of China(中国人民公安大学);Tsinghua University(清华大学)
Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMs
Georgia Institute of Technology(佐治亚理工学院);University of Bristol(布里斯托大学);University of Maryland(马里兰大学);University College London(伦敦大学学院);MATS;Astra;MIT CSAIL(麻省理工学院计算机科学与人工智能实验室)
ManagerBench: Evaluating the Safety-Pragmatism Trade-off in Autonomous LLMs
Technion – Israel Institute of Technology(技术学院–以色列理工学院);Google Research(谷歌研究);University of Zagreb(Zagreb大学);Kempner Institute, Harvard University(哈佛大学凯普勒研究所)
Revisiting Backdoor Attacks on LLMs: A Stealthy and Practical Poisoning Framework via Harmless Inputs
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院,清华大学);Department of Software Engineering, Harbin Institute of Technology(哈尔滨工业大学软件工程系);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳校区计算机科学与技术学院);Institute for Network Sciences and Cyberspace, Tsinghua University(清华大学网络科学与空间研究院)