arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.23337cs.CL

基于八字的人物仿真基准:评估人工智能在时间与角色推理上的能力

BaZi-Based Character Simulation Benchmark: Evaluating AI on Temporal and Persona Reasoning

Siyuan Zheng, Pai Liu, Xi Chen, Jizheng Dong, Sihan Jia

AI总结:

本文提出首个基于八字的角色推理基准和八字-大语言模型系统,结合符号推理与LLM生成动态虚拟角色,相比主流模型准确率提升30.3%-62.6%。

摘要:

类人虚拟角色对于游戏、叙事和虚拟现实至关重要,然而当前方法严重依赖标注数据或手工设计的角色提示,难以扩展并生成现实且上下文连贯的角色。我们创建了首个基于八字的角色推理问答数据集,其中将真实人类经历按财富、健康、亲属关系、职业和人际关系分类,表示为生活事件问答对。此外,我们提出了首个八字-大语言模型系统,将符号推理与大语言模型相结合,以生成时间动态且细粒度的虚拟角色。与DeepSeek-v3和GPT-5-mini等主流大语言模型相比,我们的方法实现了30.3%至62.6%的准确率提升。此外,当使用错误的八字信息时,我们模型的准确率下降20%至45%,这表明了文化根基的符号-大语言模型集成在现实角色模拟中的潜力。

英文摘要:

Human-like virtual characters are crucial for games, storytelling, and virtual reality, yet current methods rely heavily on annotated data or handcrafted persona prompts, making it difficult to scale up and generate realistic, contextually coherent personas. We create the first QA dataset for BaZi-based persona reasoning, where real human experiences categorized into wealth, health, kinship, career, and relationships are represented as life-event questions and answers. Furthermore, we propose the first BaZi-LLM system that integrates symbolic reasoning with large language models to generate temporally dynamic and fine-grained virtual personas. Compared with mainstream LLMs such as DeepSeek-v3 and GPT-5-mini, our method achieves a 30.3%-62.6% accuracy improvement. In addition, when incorrect BaZi information is used, our model's accuracy drops by 20%-45%, showing the potential of culturally grounded symbolic-LLM integration for realistic character simulation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑