arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.10480cs.CL
收藏

神经符号协同用于交互世界建模

Neuro-Symbolic Synergy for World Modeling

Hongyu Zhao, Siyu Zhou, Haolin Yang, Zengyi Qin, Tianyi Zhou

AI总结:

NeSyS通过结合LLMs的概率语义先验与可执行符号规则,实现交互世界建模的表达力与鲁棒性,提升预测准确性和数据效率。

摘要:

大型语言模型(LLMs)表现出强大的通用推理能力,但当用作世界模型(WMs)时,常常会生成虚假信息,特别是在需要严格遵守确定性转移规则的边缘情况下。相比之下,符号世界模型提供逻辑一致性,但缺乏语义表达能力。为弥合这一差距,我们提出了神经符号协同(NeSyS),一种框架,将LLMs的概率语义先验与可执行的符号规则相结合,以实现表达力和鲁棒性的平衡。NeSyS通过交替训练两个模型,利用无法被另一个模型充分解释的轨迹进行训练。与基于规则的提示不同,符号世界模型直接通过修改LLM的输出概率分布来约束它。神经世界模型仅在未被符号规则覆盖的轨迹上进行微调,从而将训练数据减少50%而不影响准确性。在三个不同的交互环境,即ScienceWorld、Webshop和Plancraft上进行的广泛实验表明,NeSyS在世界模型预测准确性和数据效率方面均优于基线方法。我们的模型和代码可在https://github.com/tianyi-lab/NeSyS上获取。

英文摘要:

Large language models (LLMs) exhibit strong general-purpose reasoning capabilities, yet they frequently hallucinate when used as world models (WMs), where strict compliance with deterministic transition rules--particularly in corner cases--is essential. In contrast, Symbolic WMs provide logical consistency but lack semantic expressivity. To bridge this gap, we propose Neuro-Symbolic Synergy (NeSyS), a framework that integrates the probabilistic semantic priors of LLMs with executable symbolic rules to achieve both expressivity and robustness. NeSyS alternates training between the two models using trajectories inadequately explained by the other. Unlike rule-based prompting, the symbolic WM contributes candidate-level scores through log-linear reranking, without requiring the LLM to interpret rule text. Rule-guided sampling prioritizes transitions that are weakly covered by symbolic rules, using 35--60% of the training pairs while outperforming full-data supervised fine-tuning in five of six settings. Experiments on ScienceWorld, WebShop, and PlanCraft demonstrate consistent gains in WM prediction accuracy and data efficiency; one-step lookahead on open-ended WebShop also improves agent reward. Our models, rules, and code are available at https://github.com/tianyi-lab/NeSyS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑