迈向LLMs的IIT启发意识:基于奖励的学习框架
Toward IIT-Inspired Consciousness in LLMs: A Reward-Based Learning Framework
AI总结:
本文提出基于奖励的学习框架,旨在通过整合信息理论提升语言模型的意识水平,实验显示该方法能有效提升文本生成效率并保持准确性。
摘要:
在语言模型发展中,追求人工通用智能(AGI)是一个核心目标,其中类似意识的处理可能成为关键促进因素。尽管当前语言模型并不具备意识,但它们表现出某些意识方面的类比行为。本文通过基于奖励的学习范式,探讨了将意识的领先理论——整合信息理论(IIT)——在语言模型中实现的可能性。IIT提供了一个形式化的、基于公理的数学框架,用于量化意识。受其核心原理的启发,我们提出了一种新的奖励函数,用于量化文本的因果性、连贯性和整合性,这些特征与意识处理相关。实证研究表明,优化这种IIT启发的奖励函数可导致更简洁的文本生成。在领域外任务中,经过仔细调优,输出长度可减少高达31%,同时保持与基模型相当的准确性水平。除了主要任务表现外,还分析了这种训练方法对模型置信度校准和测试时计算扩展的广泛影响。所提出的框架具有显著的实用优势:它在概念上简单,计算高效,不需要外部数据或辅助模型,并利用一个通用的能力驱动信号,而不是特定任务的启发式方法。代码可在https://github.com/MH-Sameti/LLM_PostTraining.git获取。
英文摘要:
The pursuit of Artificial General Intelligence (AGI) is a central goal in language model development, in which consciousness-like processing could serve as a key facilitator. While current language models are not conscious, they exhibit behaviors analogous to certain aspects of consciousness. This paper investigates the implementation of a leading theory of consciousness, Integrated Information Theory (IIT), within language models via a reward-based learning paradigm. IIT provides a formal, axiom-based mathematical framework for quantifying consciousness. Drawing inspiration from its core principles, we formulate a novel reward function that quantifies a text's causality, coherence and integration, characteristics associated with conscious processing. Empirically, it is found that optimizing for this IIT-inspired reward leads to more concise text generation. On out of domain tasks, careful tuning achieves up to a 31% reduction in output length while preserving accuracy levels comparable to the base model. In addition to primary task performance, the broader effects of this training methodology on the model's confidence calibration and test-time computational scaling is analyzed. The proposed framework offers significant practical advantages: it is conceptually simple, computationally efficient, requires no external data or auxiliary models, and leverages a general, capability-driven signal rather than task-specific heuristics. Code available at https://github.com/MH-Sameti/LLM_PostTraining.git
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。