arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.11264cs.DCcs.AIcs.LGcs.MA
收藏

面向人工智能计算的区块链框架

Blockchain Framework for Artificial Intelligence Computation

Dasudian Technologies Ltd.(达算科技有限公司);Heidelberg University(海德堡大学)

Jie You

AI总结:

本文将区块链工作量证明建模为马尔可夫决策过程,用深度强化学习设计区块验证与共识机制,使节点在维护区块链的同时并行训练同一深度神经网络,从而节省算力并促进数据共享与AI模型设计。

摘要:

区块链本质上是一种分布式数据库,记录参与各方之间的所有交易或数字事件。记录中的每一笔交易都需通过系统中参与者的共识进行批准和验证,这要求解决一个困难的数学难题,即所谓的工作量证明。为了使已批准的记录不可篡改,该数学难题并非轻易可解,因此会消耗大量计算资源。然而,在区块链中安装许多计算节点,仅仅通过解决一个无意义的难题来竞争批准记录,是浪费能源的。在此,我们将工作量证明建模为一个强化学习问题,将区块链的增长建模为马尔可夫决策过程,其中学习智能体根据环境状态做出最优决策,同时新区块被添加并验证。具体而言,我们将区块验证和共识机制设计为一个深度强化学习迭代过程。因此,我们的方法利用马尔可夫决策过程的状态转移确定性和动作选择随机性,以及深度神经网络的计算复杂性,共同使区块不易被重新计算并保持交易顺序,同时利用区块链节点并行地用不同数据样本(状态-动作对)训练同一个深度神经网络,使模型能够在多个计算节点上同时经历多个回合。我们的方法用于设计下一代公有区块链网络,这不仅有潜力为工业应用节省计算资源,而且还能鼓励数据共享和针对常见问题的人工智能模型设计。

英文摘要:

Blockchain is an essentially distributed database recording all transactions or digital events among participating parties. Each transaction in the records is approved and verified by consensus of the participants in the system that requires solving a hard mathematical puzzle, which is known as proof-of-work. To make the approved records immutable, the mathematical puzzle is not trivial to solve and therefore consumes substantial computing resources. However, it is energy-wasteful to have many computational nodes installed in the blockchain competing to approve the records by just solving a meaningless puzzle. Here, we pose proof-of-work as a reinforcement-learning problem by modeling the blockchain growing as a Markov decision process, in which a learning agent makes an optimal decision over the environment's state, whereas a new block is added and verified. Specifically, we design the block verification and consensus mechanism as a deep reinforcement-learning iteration process. As a result, our method utilizes the determination of state transition and the randomness of action selection of a Markov decision process, as well as the computational complexity of a deep neural network, collectively to make the blocks not easy to recompute and to preserve the order of transactions, while the blockchain nodes are exploited to train the same deep neural network with different data samples (state-action pairs) in parallel, allowing the model to experience multiple episodes across computing nodes but at one time. Our method is used to design the next generation of public blockchain networks, which has the potential not only to spare computational resources for industrial applications but also to encourage data sharing and AI model design for common problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑