In this manuscript, I present an analysis on the performance of OpenAI O1-preview model in solving random K-SAT instances for K$\in {2,3,4}$ as a function of $α=M/N$ where $M$ is the number of clauses and $N$ is the number of variables of the satisfiable problem. I show that the model can call an external SAT solver to solve the instances, rather than solving them directly. Despite using external solvers, the model reports incorrect assignments as output. Moreover, I propose and present an analysis to quantify whether the OpenAI O1-preview model demonstrates a spark of intelligence or merely makes random guesses when outputting an assignment for a Boolean satisfiability problem.
Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
Peking University（北京大学）；University of Wisconsin - Madison（威斯康星大学麦迪逊分校）；Shanghai Jiao Tong University（上海交通大学）；The University of Hong Kong（香港大学）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所）；Alibaba Group（阿里巴巴集团）；University of Waterloo（滑铁卢大学）；Zhongguancun Laboratory（中关村实验室）；Engineering Research Center of Information Networks（信息网络工程研究中心）
The Idola Tribus of AI: Large Language Models tend to perceive order where none exists
Graduate School of Artificial Intelligence and Science, Rikkyo University（人工智能与科学研究生院，立命馆大学）；Strategic Digital Business Unit, Mamezou Co., Ltd.（战略数字商务部，麦迈株式会社）
LR^2Bench: Evaluating Long-chain Reflective Reasoning Capabilities of Large Language Models via Constraint Satisfaction Problems
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Zhongguancun Academy（中关村学院）；Wuhan AI Research（武汉人工智能研究院）
Evaluation of OpenAI o1: Opportunities and Challenges of AGI
Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, Canada（阿尔伯塔大学数学与统计学系）；School of Computing, University of Georgia, GA, USA（佐治亚大学计算机科学学院）；Institute of Medical Research, Northwestern Polytechnical University, Xi’an, China（西北工业大学医学研究所）；Department of Computer Science and Engineering, University of Texas at Arlington, TX, USA（德克萨斯大学阿灵顿分校计算机科学与工程系）；College of Arts and Sciences, University of Georgia, Athens, USA（佐治亚大学文理学院）；Institute of Plant Breeding, Genetics & Genomics, University of Georgia, Athens, GA, USA（佐治亚大学植物育种、遗传与基因组研究所）；School of Computer Science, Northwestern Polytechnical University, Xi’an, China（西北工业大学计算机科学学院）；School of Automation, Northwestern Polytechnical University, Xi’an, China（西北工业大学自动化学院）
