A sequential decision-making agent balances between exploring to gain new knowledge about an environment and exploiting current knowledge to maximize immediate reward. For environments studied in the traditional literature, optimal decisions gravitate over time toward exploitation as the agent accumulates sufficient knowledge and the benefits of further exploration vanish. What if, however, the environment offers an unlimited amount of useful knowledge and there is large benefit to further exploration no matter how much the agent has learned? We offer a simple, quintessential example of such a complex environment. In this environment, rewards are unbounded and an agent can always increase the rate at which rewards accumulate by exploring to learn more. Consequently, an optimal agent forever maintains a propensity to explore.
DSAC: Distributional Soft Actor-Critic for Risk-Sensitive Reinforcement Learning
Department of Automation, Tsinghua University(清华大学自动化系);School of Engineering and Applied Science, Columbia University(哥伦比亚大学工程与应用科学学院);School of Business, Sun Yat-sen University(中山大学商学院);Stern School of Business, New York University(纽约大学斯特恩商学院)
Residual Bootstrap Exploration for Bandit Algorithms
Department of Statistics, Purdue University(普渡大学统计系);Department of Electrical Engineering, Princeton University(普林斯顿大学电气工程系);Purdue University(普渡大学);Princeton University(普林斯顿大学)
Spook the Machine: Gamified Exploration of Human Imagination of Machine Fear
Max Planck Institute for Human Development(马克斯·普朗克人类发展研究所);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所);Tallinn University(塔林大学);Technische Universität Berlin(柏林工业大学)
本研究通过游戏化平台Spook the Machine探索人类对AI恐惧的反应,发现情感表达加深参与度,而奖励新颖性维持创作多样性,二者互补引导集体人机交互。
Guarded Policy Optimization with Imperfect Online Demonstrations
Nanyang Technological University(南洋理工大学);University of California, Los Angeles(加州大学洛杉矶分校);The University of Edinburgh(爱丁堡大学);Northwestern University(西北大学)
SelfAI: A self-directed framework for long-horizon scientific discovery
University of Electronic Science and Technology of China(电子科技大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Xian Jiaotong University(西安交通大学);Yale University(耶鲁大学);Washington University in St. Louis(圣路易斯华盛顿大学);Monash University(莫纳什大学)
Mastering Continual Reinforcement Learning through Fine-Grained Sparse Network Allocation and Dormant Neuron Exploration
IHPC, Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局IHPC);College of Computing and Data Science, Nanyang Technological University (NTU)(南洋理工大学计算与数据科学学院)
Diffusion-Guided Cooperative Policy Learning for Target Tracking Based on Underwater Mobile Agent Networks
Software College, Northeastern University(东北大学软件学院);Key Laboratory of Maritime Intelligent Network Information Technology, Ministry of Education, Hohai University(河海大学教育部海事智能网络信息技术重点实验室);College of Computer Science and Software Engineering, Hohai University(河海大学计算机与软件学院);College of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院)