In this paper we introduce a class of Markov decision processes that arise as a natural model for many renewable resource allocation problems. Upon extending results from the inventory control literature, we prove that they admit a closed form solution and we show how to exploit this structure to speed up its computation. We consider the application of the proposed framework to several problems arising in very different domains, and as part of the ongoing effort in the emerging field of Computational Sustainability we discuss in detail its application to the Northern Pacific Halibut marine fishery. Our approach is applied to a model based on real world data, obtaining a policy with a guaranteed lower bound on the utility function that is structurally very different from the one currently employed.
Comparing Socially-Equitable Renewable Energy Budget Allocation MDP Policies in Mature and Emerging Economies
Management \& Technology University of Pennsylvania Philadelphia, PA, USA;Systems Engineering Institute Technology of Sepuluh Nopember (ITS) Surabaya, Indonesia;Systems Engineering King Fahd University of Petroleum
eXascale Infolab(eXascale信息实验室);University of Fribourg, Switzerland(瑞士弗里堡大学);Game Innovation Lab(游戏创新实验室);Tandon School of Engineering(坦登工程学院);New York University, NY, USA(美国纽约大学)
Optimal trajectory-guided stochastic co-optimization for e-fuel system design and real-time operation
Department of Chemical Engineering(化学工程系);Massachusetts Institute of Technology(麻省理工学院);Department of Chemical and Biomolecular Engineering(化学与生物分子工程系);Yonsei University(延世大学);Department of Chemical Engineering and Materials Science(化学工程与材料科学系);Ewha Womans University(成均馆大学);Institute for Multiscale Matter and Systems (IMMS)(多尺度物质与系统研究所)
Learning Explainable Representations of Complex Game-playing Strategies
North Carolina State University(北卡罗来纳州立大学);Indian Institute of Technology Bombay(印度理工学院孟买分校);Tata Research Development and Design Centre(塔塔研究开发与设计中心);Northeastern University(东北大学)
Neural Network-based Information Set Weighting for Playing Reconnaissance Blind Chess
Institute for Application-Oriented Knowledge-Processing at the Johannes Kepler University Linz(约翰内斯·开普勒林茨大学应用导向知识处理研究所);LIT Artificial Intelligence Lab(LIT人工智能实验室);University of Alberta(阿尔伯塔大学);Alberta Machine Intelligence Institute(阿尔伯塔机器智能研究所)