arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.02081cond-mat.stat-mech
收藏

动力学Ising模型的Bellman方程与最优局部翻转策略

The Bellman equation and optimal local flipping strategies for kinetic Ising models

Francesco Caravelli

AI总结:

本研究在Ising模型框架下,基于Bellman方程求解满足细致平衡的能量提取智能体(kobold)的最优局部翻转策略,通过数值与解析分析发现其行为随策略参数发生转变,拓展了热力学与信息关联的研究。

摘要:

热力学、信息与功提取之间存在深刻联系。自热力学诞生以来,人们提出了各类麦克斯韦妖(Maxwell demon),以深化对热力学第二定律的理解。借助这些研究,学界已证实热系统中热力学与信息、信息与功之间存在深层关联。本文研究满足细致平衡的热力学系统的能量提取问题:在Ising模型语境下,由拥有完美信息的智能体(其最优策略由Bellman方程的解给出)执行能量提取。我们将这类智能体称为kobold(地精),以区别于不一定需要满足细致平衡的麦克斯韦妖。这与典型的蒙特卡罗(Monte Carlo)算法形成鲜明对比,后者在每个时间步都随机选择动作,因此将kobold的行为与Metropolis算法进行比较是十分自然的。针对多种Ising模型,我们通过数值与解析方式研究了最优策略的性质,结果表明,随着表征其策略的参数变化,kobold的行为会发生转变。

英文摘要:

There is a deep connection between thermodynamics, information and work extraction. Ever since the birth of thermodynamics, various types of Maxwell demons have been introduced in order to deepen our understanding of the second law. Thanks to them it has been shown that there is a deep connection between thermodynamics and information, and between information and work in a thermal system. In this paper, we study the problem of energy extraction from a thermodynamic system satisfying detailed balance, from an agent with perfect information, e.g. that has an optimal strategy, given by the solution of the Bellman equation, in the context of Ising models. We call these agents kobolds, in contrast to Maxwell's demons which do not necessarily need to satisfy detailed balance. This is in stark contrast with typical Monte Carlo algorithms, which choose an action at random at each time step. It is thus natural to compare the behavior of these kobolds to a Metropolis algorithm. For various Ising models, we study numerically and analytically the properties of the optimal strategies, showing that there is a transition in the behavior of the kobold as a function of the parameter characterizing its strategy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑