Beyond Pass@k: Breadth-Depth Metrics for Reasoning Boundaries
机构 * Bitdefender(Bitdefender公司)
专题命中 数学推理 :reasoning(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments 10 pages, 3 figures. v2 adds discussion of related work (G-Pass@k)
AI 大模型
大模型数学、逻辑、规划、多步推理和测试时计算能力。
机构 * Bitdefender(Bitdefender公司)
专题命中 数学推理 :reasoning(title,abstract);分类 cs.CL、cs.AI、cs.LG
Comments 10 pages, 3 figures. v2 adds discussion of related work (G-Pass@k)
机构 * Virginia Tech(弗吉尼亚理工大学) ; College of William and Mary(威廉与玛丽学院) ; Amazon Alexa AI(亚马逊Alexa人工智能)
专题命中 数学推理 :reasoning(title,abstract);分类 cs.AI
Comments 8 pages for main content
机构 * Arizona State University(亚利桑那州立大学)
专题命中 数学推理 :reasoning(abstract);分类 cs.AI、cs.LG
Comments 4 pages, 2 figures
机构 * Department of Computer Science(计算机科学系) ; Department of Artificial Intelligence(人工智能系) ; Department of Future Mobility(未来移动部门)
专题命中 数学推理 :reasoning(abstract);分类 cs.CL、cs.AI
Comments NeurIPS 2025
专题命中 数学推理 :reasoning(abstract)
Comments 9 pages, 5 figures
机构 * University of California, Davis(加州大学戴维斯分校) ; University of Hong Kong(香港大学)
专题命中 代码与定理证明 :reasoning(title,abstract);test-time compute(abstract);分类 cs.CL
Comments NeurIPS '25, package released at: https://github.com/SecurityLab-UCD/TF-Bench
机构 * Electrical and Computer Engineering(电气与计算机工程系) ; University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
专题命中 代码与定理证明 :verifier(abstract);分类 cs.AI
机构 * School of Automation, Guangdong University of Technology(广东科技大學自動化學院) ; College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大學計算機科學與技術學院) ; School of Cyberspace Science and Technology, Beijing Jiaotong University(北京交通大學網絡空間科學與技術學院) ; School of Computer Science and Technology, Guangdong University of Technology(廣東科技大學計算機科學與技術學院) ; College of Computing and Data Science, Nanyang Technological University(南洋理工大學計算與數據科學學院)
专题命中 代码与定理证明 :chain-of-thought(abstract);分类 cs.AI
专题命中 代码与定理证明 :reasoning(abstract)
Comments 12 pages, 7 figures. Camera-ready version. Accepted to the 5th International Workshop on Scientific Knowledge: Representation, Discovery, and Assessment; 2 November 2025 - Nara, Japan; co-located with The 24th International Semantic Web Conference, ISWC 2025. Published in CEUR proceedings Vol-4065, pages 45-56
机构 * Tianjin University, College of Intelligence and Computing(天津大学智能与计算学院) ; University of Manchester, Department of Computer Science(曼彻斯特大学计算机科学系)
专题命中 逻辑推理 :reasoning(abstract);分类 cs.CL、cs.AI
机构 * University of Texas at Tyler(德克萨斯理工大学) ; Florida Gulf Coast University(佛罗里达盖恩斯维尔大学)
专题命中 逻辑推理 :reasoning(abstract);分类 cs.CL、cs.AI
专题命中 逻辑推理 :reasoning(abstract)
Comments Updated manuscript of our previous version (arXiv:2502.01714). Under review
机构 * IBM Research(IBM研究院)
专题命中 规划推理 :reasoning(title,abstract);chain-of-thought(title,abstract);CoT(abstract);分类 cs.CL、cs.AI
Comments Accepted at EMNLP 2025
专题命中 规划推理 :reasoning(title,abstract);分类 cs.CL、cs.AI
Comments We have come across a recent approach that has not been properly attributed at the time of submission and compared in a fair setting. Therefore, we would like to withdraw the paper to address these concerns
机构 * Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所) ; University of Chinese Academy of Sciences(中国科学院大学) ; City University of Hong Kong(香港城市大学)
专题命中 规划推理 :reasoning(abstract);chain-of-thought(abstract);CoT(abstract);分类 cs.CL、cs.AI、cs.LG
Comments Accepted at NeurIPS 2025
机构 * UCL Hawkes Institute \& Department of Medical Physics ; Biomedical Engineering, University College London, United Kingdom Aga Khan University Hospital, Pakistan Centre for Bioengineering \& School of Engineering ; Materials Science \& Digital Environment Research Institute, Queen Mary University of London, United Kingdom
专题命中 规划推理 :planning(title,abstract)
Comments Accepted at MICAD (Medical Imaging and Computer-Aided Diagnosis) 2025
专题命中 规划推理 :reasoning(abstract);chain-of-thought(abstract);CoT(abstract)
机构 * The University of Edinburgh(爱丁堡大学)
专题命中 规划推理 :reasoning(abstract);planning(abstract);分类 cs.CL、cs.AI、cs.LG
机构 * Dept. of Electrical and Biomedical Engineering, The University of Vermont(维珍尼亚大学电气与生物医学工程系) ; Dept. of Electrical and Computer Engineering, The University of Texas at Austin(德克萨斯大学奥斯汀分校电气与计算机工程系)
专题命中 规划推理 :reasoning(abstract);planning(abstract);分类 cs.AI
机构 * University of Hull(赫尔大学) ; Fraunhofer IESE(弗劳恩霍夫研究所)
专题命中 规划推理 :reasoning(abstract);分类 cs.CL、cs.AI、cs.LG
机构 * The Conversational Artificial Intelligence (CoAI) Group, Tsinghua University(清华大学对话人工智能(CoAI)小组) ; Zhipu AI(智谱AI) ; The Knowledge Engineering Group (KEG), Tsinghua University(清华大学知识工程小组(KEG))
专题命中 规划推理 :reasoning(abstract);分类 cs.CL、cs.LG
机构 * Tejas Networks ; IMDEA Networks Institute ; Northeastern University
专题命中 规划推理 :verifier(abstract);分类 cs.AI
机构 * School of Business(商学院) ; School of Computing and Engineering(计算与工程学院) ; Quinnipiac University(昆尼皮亚克大学)
专题命中 规划推理 :reasoning(abstract);分类 cs.AI
Comments Accepted for publication at IEEE International Conference on e-Business Engineering ICEBE 2025, November 10-12, Buraydah, Saudi Arabia. 8 pages, 5 figures
机构 * University of Maryland, Baltimore County(马里兰大学巴尔的摩县)
专题命中 规划推理 :planning(abstract);分类 cs.LG
Comments 9 pages, under review submitted to ICLR 2025
专题命中 规划推理 :planning(abstract);分类 cs.LG
Comments NeurIPS 2025 Datasets and Benchmarks track
机构 * University of Pennsylvania(宾夕法尼亚大学) ; Arizona State University(亚利桑那州立大学)
专题命中 规划推理 :planning(abstract);分类 cs.CL
Journal ref ICLR 2025 (Oral)
专题命中 规划推理 :chain-of-thought(abstract)
Comments 19 pages, 8 figures
专题命中 规划推理 :reasoning(abstract)
Comments Under review
专题命中 视觉空间推理 :reasoning(title,abstract);分类 cs.AI
专题命中 视觉空间推理 :reasoning(title,abstract);分类 cs.AI
Comments 13 pages, 4 figures