We consider the problem of red teaming LLMs on elementary calculations and algebraic tasks to evaluate how various prompting techniques affect the quality of outputs. We present a framework to procedurally generate numerical questions and puzzles, and compare the results with and without the application of several red teaming techniques. Our findings suggest that even though structured reasoning and providing worked-out examples slow down the deterioration of the quality of answers, the gpt-3.5-turbo and gpt-4 models are not well suited for elementary calculations and reasoning tasks, also when being red teamed.
"Not Aligned" is Not "Malicious": Being Careful about Hallucinations of Large Language Models' Jailbreak
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);UCLA(加州大学洛杉矶分校);University of California, Merced(加州大学默塞德分校);Tsinghua University(清华大学)
Tackling the Inherent Difficulty of Noise Filtering in RAG
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(北京大数据管理与分析方法重点实验室);School of Software Tsinghua University(清华大学软件学院)
SearchAttack: Red-Teaming LLMs against Knowledge-to-Action Threats under Online Web Search
Institute of Computing Technology, CAS(计算技术研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);People's Public Security University of China(中国人民公安大学);University of Science and Technology of China(中国科学技术大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy(广东人工智能与数字经济实验室);Tsinghua University(清华大学)
Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models
Beijing University of Posts and Telecommunications(北京邮电大学);Shihezi University(石河子大学);Beihang University(北航);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Jilin University(吉林大学);Central South University(中南大学);Jinan University(暨南大学)
KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents
Zhejiang University(浙江大学);ZJU-Ant Group Joint Research Center for Knowledge Graphs(浙江大学-蚂蚁集团知识图谱联合研究中心);Ant Group(蚂蚁集团);National University of Singapore(新加坡国立大学)
Are Large Language Models Good Fact Checkers: A Preliminary Study
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
TinyLVLM-eHub: Towards Comprehensive and Efficient Evaluation for Large Vision-Language Models
The University of Hong Kong(香港大学);Peking University(北京大学);OpenGVLab(开放智能机器研究中心);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
Learning to Prompt in the Classroom to Understand AI Limits: A pilot study
Università degli Studi di Milano Bicocca(米兰比可卡大学);Universitat Pompeu Fabra(庞培法布拉大学);University of Regensburg(雷根斯堡大学);Politecnico di Milano(米兰理工大学);Università degli Studi di Milano(米兰大学);Istituto per le Tecnologie Didattiche (ITD-CNR)(意大利国家研究委员会教育技术研究所)
Cantor: Inspiring Multimodal Chain-of-Thought of MLLM
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(厦门大学 多媒体可信感知与高效计算重点实验室(教育部));Tencent Youtu Lab(腾讯优图实验室)