Large Language Models (LLMs) demonstrate ever-increasing abilities in mathematical and algorithmic tasks, yet their geometric reasoning skills are underexplored. We investigate LLMs' abilities in constructive geometric problem-solving one of the most fundamental steps in the development of human mathematical reasoning. Our work reveals notable challenges that the state-of-the-art LLMs face in this domain despite many successes in similar areas. LLMs exhibit biases in target variable selection and struggle with 2D spatial relationships, often misrepresenting and hallucinating objects and their placements. To this end, we introduce a framework that formulates an LLMs-based multi-agents system that enhances their existing reasoning potential by conducting an internal dialogue. This work underscores LLMs' current limitations in geometric reasoning and improves geometric reasoning capabilities through self-correction, collaboration, and diverse role specializations.
Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing Wenge Technology Co., Ltd(北京文格科技有限公司)
Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoning
University of California, Santa Barbara(加州大学圣巴巴拉分校);The University of Texas at Dallas(德克萨斯大学达拉斯分校);The University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Maryland, College Park(马里兰大学帕克分校)
Unveiling the Landscape of Clinical Depression Assessment: From Behavioral Signatures to Psychiatric Reasoning
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);CoAI Group, DCST, IAI, BNRIST, Tsinghua University(清华大学);University of International Relations(国际关系大学);Central China Normal University(华中师范大学);Lingxin AI(灵心AI);Yuquan Hospital, Tsinghua University(清华大学友谊医院)
Unveiling the Reasoning Process of Large Language Models
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?
Intelligent Game and Decision Lab(智能游戏与决策实验室);National University of Defense Technology(国防科技大学);University of Melbourne(墨尔本大学);University of Sydney(悉尼大学);Hong Kong Baptist University(香港 Baptist 大学)
Beyond Surface Reasoning: Unveiling the True Long Chain-of-Thought Capacity of Diffusion Large Language Models
LARG, Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology(LARG,社会计算与交互机器人研究中心,哈尔滨工业大学);School of Computer Science and Engineering, Central South University(计算机科学与工程学院,中南大学);The University of Hong Kong(香港大学);Shanghai Jiao Tong University(上海交通大学);ByteDance Seed (China)(字节跳动种子(中国))
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);Ningbo Key Laboratory of Spatial Intelligence and Digital Derivative(宁波空间智能与数字衍生关键实验室);Institute of Digital Twin, EIT(数字孪生研究院);Saarland University(萨尔兰大学);Meituan Inc.(美团公司)
Unveiling the Magic of Code Reasoning through Hypothesis Decomposition and Amendment
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学 龙城人工智能学院);South China Agricultural University(华南农业大学);South China Normal University(华南师范大学);Monash University(莫纳什大学);Jishou University(吉首大学);Hong Kong University of Science and Technology(香港科技大学);Tsinghua University(清华大学)
Are Tools All We Need? Unveiling the Tool-Use Tax in LLM Agents
University of Houston(休斯顿大学);University of Southern California(南加州大学);New York University(纽约大学);Texas A&M University(德克萨斯农工大学);University of California, San Diego(加州大学圣地亚哥分校)
UNVEILING: What Makes Linguistics Olympiad Puzzles Tricky for LLMs?
Mohamed Bin Zayed University of Artificial Intelligence(Mohamed Bin Zayed人工智能大学);IIT Gandhinagar(印度加尔各答理工学院);Harvard University(哈佛大学);VinUniversity(文大学);Universitas Indonesia(印度尼西亚大学)
Unveiling Trust in Multimodal Large Language Models: Evaluation, Analysis, and Mitigation
Department of Computer Science and Technology, College of AI, Institute for AI, Tsinghua-Bosch Joint ML Center, THBI Lab, BNRist Center, Tsinghua University(计算机科学与技术系、人工智能学院、人工智能研究所、清华-博世联合机器学习中心、THBI实验室、BNRist中心、清华大学);Institute of Artificial Intelligence, Beihang University(人工智能研究院、北航);RealAI
Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Study
Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou), China(香港科学与技术大学人工智能研究所);Department of Computer Science and Engineering, The Hong Kong University of Science and Technology Hong Kong SAR, China(香港科学与技术大学计算机科学与工程系);Microsoft Research Asia(微软亚洲研究院);University of Cambridge(剑桥大学);Microsoft(微软)
Unveiling the Potential of Diffusion Large Language Model in Controllable Generation
University of Southern California(南加州大学);University of Queensland(昆士兰大学);University of California, San Diego(加州大学圣地亚哥分校);University of California, Merced(加州大学默塞德分校)
When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所信息处理实验室);University of Chinese Academy of Sciences(中国科学院大学)