Aletheia: 通过正则化逆混淆矩阵量化推理模型中的认知信念
Aletheia: Quantifying Cognitive Conviction in Reasoning Models via Regularized Inverse Confusion Matrix
AI总结:
Aletheia通过正则化逆混淆矩阵量化推理模型中的认知信念,探索AI科学诚信的测量方法。
摘要:
在向人工通用智能(AGI)迈进的渐进过程中,当前的评估范式面临一个认识论危机。静态基准测试测量知识的广度,但无法量化信念的深度。虽然Simhi等人(2025)在标准问答中定义了CHOKE现象,我们扩展了这一框架,以量化系统2推理模型中的“认知信念”。我们提出了Project Aletheia,一个认知物理框架,该框架使用Tikhonov正则化来反转裁判的混淆矩阵。为了在不依赖于opaque私人数据的情况下验证这一方法,我们实施了一个合成代理协议。我们对2025基准(如DeepSeek-R1、OpenAI o1)的初步试点研究表明,尽管推理模型充当“认知缓冲器”,但在对抗压力下,它们可能会表现出“防御性过度思考”。此外,我们引入了对齐信念分数(S_aligned)来验证信念不会影响安全性。这项工作为测量AI科学诚信提供了蓝图。
英文摘要:
In the progressive journey toward Artificial General Intelligence (AGI), current evaluation paradigms face an epistemological crisis. Static benchmarks measure knowledge breadth but fail to quantify the depth of belief. While Simhi et al. (2025) defined the CHOKE phenomenon in standard QA, we extend this framework to quantify "Cognitive Conviction" in System 2 reasoning models. We propose Project Aletheia, a cognitive physics framework that employs Tikhonov Regularization to invert the judge's confusion matrix. To validate this methodology without relying on opaque private data, we implement a Synthetic Proxy Protocol. Our preliminary pilot study on 2025 baselines (e.g., DeepSeek-R1, OpenAI o1) suggests that while reasoning models act as a "cognitive buffer," they may exhibit "Defensive OverThinking" under adversarial pressure. Furthermore, we introduce the Aligned Conviction Score (S_aligned) to verify that conviction does not compromise safety. This work serves as a blueprint for measuring AI scientific integrity.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。