arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.03793cs.ROeess.SP
收藏

循环图上的贝叶斯粒子

Bayesian Particles on Cyclic Graphs

Northwestern University(西北大学)

Ana Pervan, Todd Murphey

摘要:

我们考虑设计合成细胞以实现复杂目标的问题(例如,通过寻找入侵者来模仿免疫系统)在复杂环境中(例如,循环系统),在那里它们可能不得不改变它们的控制策略,相互通信,并处理包括假阳性和假阴性的随机性-所有这些都具有最小的能力和只有几位内存。我们使用循环,迷宫般的环境模拟免疫反应,并使用未知位置的目标来代表入侵细胞。只使用几位内存,合成细胞被编程执行强化学习类型的算法,它们根据与其他细胞的随机遭遇更新其控制策略。当合成细胞一起工作以找到目标时,它们作为整体的相互作用作为贝叶斯更新的物理实现。也就是说,粒子充当粒子过滤器。该结果提供了关于合成细胞系综的行为的形式属性,其可用于确保鲁棒性和安全性。这种简化的强化学习方法在模拟中进行评估,并应用于人体循环系统的实际模型。

英文摘要:

We consider the problem of designing synthetic cells to achieve a complex goal (e.g., mimicking the immune system by seeking invaders) in a complex environment (e.g., the circulatory system), where they might have to change their control policy, communicate with each other, and deal with stochasticity including false positives and negatives---all with minimal capabilities and only a few bits of memory. We simulate the immune response using cyclic, maze-like environments and use targets at unknown locations to represent invading cells. Using only a few bits of memory, the synthetic cells are programmed to perform a reinforcement learning-type algorithm with which they update their control policy based on randomized encounters with other cells. As the synthetic cells work together to find the target, their interactions as an ensemble function as a physical implementation of a Bayesian update. That is, the particles act as a particle filter. This result provides formal properties about the behavior of the synthetic cell ensemble that can be used to ensure robustness and safety. This method of simplified reinforcement learning is evaluated in simulations, and applied to an actual model of the human circulatory system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑