arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.04575cs.LGcs.AIstat.APstat.ML
收藏

基于多模态潜在动态模型与深度强化学习的地质碳封存作业优化

Optimization of geological carbon storage operations with multimodal latent dynamic model and deep reinforcement learning

College of Engineering, Peking University(北京大学工学院);Ningbo Institute of Digital Twin, Eastern Institute of Technology(东方理工大学宁波数字孪生研究院);The University of Hong Kong(香港大学);Peng Cheng Laboratory(鹏城实验室)

Zhongzheng Wang, Yuntian Chen, Guodong Chen, Dongxiao Zhang

AI总结:

本文提出多模态潜在动态(MLD)深度学习模型,结合软演员-评论家(SAC)深度强化学习,用于地质碳封存井控优化,在将计算资源降低60%以上的同时实现最高净现值,并展现出对新场景的强泛化能力。

摘要:

在地质碳封存(GCS)中最大化封存性能对于商业部署至关重要,但传统优化需要资源密集型的模拟,带来了计算挑战。本研究引入了多模态潜在动态(MLD)模型,这是一个用于GCS中快速流动预测和井控优化的深度学习框架。MLD模型包括一个用于压缩潜在表示的表示模块、一个用于系统状态演化的转移模块,以及一个用于流动响应的预测模块。一种结合回归损失和联合嵌入一致性损失的新型训练策略增强了时间一致性和多步预测精度。与现有模型不同,MLD支持多种输入模态,允许全面的数据交互。MLD模型类似于马尔可夫决策过程(MDP),可以训练深度强化学习智能体,具体使用软演员-评论家(SAC)算法,通过持续交互来最大化净现值(NPV)。该方法优于传统方法,实现了最高的NPV,同时将计算资源减少了60%以上。它还展示了强大的泛化性能,基于先前场景的知识为新场景提供改进的决策。

英文摘要:

Maximizing storage performance in geological carbon storage (GCS) is crucial for commercial deployment, but traditional optimization demands resource-intensive simulations, posing computational challenges. This study introduces the multimodal latent dynamic (MLD) model, a deep learning framework for fast flow prediction and well control optimization in GCS. The MLD model includes a representation module for compressed latent representations, a transition module for system state evolution, and a prediction module for flow responses. A novel training strategy combining regression loss and joint-embedding consistency loss enhances temporal consistency and multi-step prediction accuracy. Unlike existing models, the MLD supports diverse input modalities, allowing comprehensive data interactions. The MLD model, resembling a Markov decision process (MDP), can train deep reinforcement learning agents, specifically using the soft actor-critic (SAC) algorithm, to maximize net present value (NPV) through continuous interactions. The approach outperforms traditional methods, achieving the highest NPV while reducing computational resources by over 60%. It also demonstrates strong generalization performance, providing improved decisions for new scenarios based on knowledge from previous ones.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑