A Semantic Framework for Enabling Radio Spectrum Policy Management and Evaluation
Rensselaer Polytechnic Institute(伦斯勒理工学院);Memory Based Research LLC(Memory Based Research有限责任公司);The Rensselaer Institute for Data Exploration and Applications(伦斯勒数据探索与应用研究所);Capraro Technologies Inc.(Capraro科技公司);CACI International Inc.(CACI国际公司);Air Force Research Laboratory(空军研究实验室)
H. Santos, A. Mulvehill, J. S. Erickson, J. P. McCusker, M. Gordon, O. Xie, S. Stouffer, G. Capraro, A. Pidwerbetsky, J. Burgess, A. Berlinsky, K. Turck, J. Ash… 展开作者
H. Santos, A. Mulvehill, J. S. Erickson, J. P. McCusker, M. Gordon, O. Xie, S. Stouffer, G. Capraro, A. Pidwerbetsky, J. Burgess, A. Berlinsky, K. Turck, J. Ashdown, D. L. McGuinness
发表信息:
The Semantic Web - ISWC 2020. ISWC 2020. Lecture Notes in Computer Science, vol 12507
Because radio spectrum is a finite resource, its usage and sharing is regulated by government agencies. These agencies define policies to manage spectrum allocation and assignment across multiple organizations, systems, and devices. With more portions of the radio spectrum being licensed for commercial use, the importance of providing an increased level of automation when evaluating such policies becomes crucial for the efficiency and efficacy of spectrum management. We introduce our Dynamic Spectrum Access Policy Framework for supporting the United States government's mission to enable both federal and non-federal entities to compatibly utilize available spectrum. The DSA Policy Framework acts as a machine-readable policy repository providing policy management features and spectrum access request evaluation. The framework utilizes a novel policy representation using OWL and PROV-O along with a domain-specific reasoning implementation that mixes GeoSPARQL, OWL reasoning, and knowledge graph traversal to evaluate incoming spectrum access requests and explain how applicable policies were used. The framework is currently being used to support live, over-the-air field exercises involving a diverse set of federal and commercial radios, as a component of a prototype spectrum management system.
Action Set Based Policy Optimization for Safe Power Grid Management
Baidu Inc.(百度公司)
由于电力消耗波动、可再生能源供电不稳定以及人为和自然灾害等不可预测的事故,维持现代电网的稳定性变得越来越困难。由于电网运行必须考虑其对未来稳定性的影响,因此强化学习(RL)已被用于提供电网管理中的顺序决策。然而,现有的方法没有考虑环境约束。因此,学习策略具有在紧急情况下选择违反约束的行为的风险,这将升级过载的电力线的问题,并导致大规模停电。在这项工作中,我们提出了一种新的方法来解决这个问题,它建立在基于搜索的规划算法之上。在规划阶段,搜索空间被限制在由策略产生的动作集。所选择的动作严格遵循约束条件,通过系统提供的模拟功能对其结果进行测试。在学习阶段,为了解决梯度不能传播到策略的问题,我们引入了具有黑箱策略优化的进化策略(ES)来直接改进策略,从而最大化长期收益。在NeurIPS 2020 Learning to Run Power Network(L2RPN)竞赛中,我们的解决方案安全地管理了电网,并在两个赛道中均名列第一。
DeepStock: Reinforcement Learning with Policy Regularizations for Inventory Management
Booth School of Business, University of Chicago(芝加哥大学商学院);Taobao & Tmall Group(淘宝与天猫集团);School of Economics, Sichuan University(四川大学经济学院);Graduate School of Business, Columbia University(哥伦比亚大学商学院);School of Operations Research and Information Engineering, Cornell University(康奈尔大学运筹学与信息工程学院)
Towards Scalable O-RAN Resource Management: Graph-Augmented Proximal Policy Optimization
Nantes University, École Centrale Nantes, IMT Atlantique, CNRS, INRIA, LS2N, UMR 6004, Nantes, France(南特大学、中央理工学院南特校区、IMT阿蒂安特、CNRS、INRIA、LS2N、UMR 6004、法国南特);SnT, SIGCOM, University of Luxembourg, Luxembourg(SnT、SIGCOM、卢森堡大学、卢森堡)
Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression and Challenge
National University of Defense Technology(中国人民解放军国防科技大学);Kings College London(伦敦国王学院);Cranfield University(克兰菲尔德大学);Alan Turing Institute(艾伦·图灵研究所);Queen Mary University of London(伦敦玛丽女王大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)