The increasing scale of manycore systems poses significant challenges in managing reliability while meeting performance demands. Simultaneously, these systems become more susceptible to different aging mechanisms such as negative-bias temperature instability (NBTI), hot carrier injection (HCI), and thermal cycling (TC), as well as the electromigration (EM) phenomenon. In this paper, we propose a reinforcement learning (RL)-based task mapping method to improve the reliability of manycore systems considering the aforementioned aging mechanisms, which consists of three steps including bin packing, task-to-bin mapping, and task-to-core mapping. In the initial step, a density-based spatial application with noise (DBSCAN) clustering method is employed to compose some clusters (bins) based on the cores temperature. Then, the Q-learning algorithm is used for the two latter steps, to map the arrived task on a core such that the minimum thermal variation is occurred among all the bins. Compared to the state-of-the-art works, the proposed method is performed during runtime without requiring any parameter to be calculated offline. The effectiveness of the proposed technique is evaluated on 16, 32, and 64 cores systems using SPLASH2 and PARSEC benchmark suite applications. The results demonstrate up to 27% increase in the mean time to failure (MTTF) compared to the state-of-the-art task mapping techniques.
Generalized Fitted Q-Iteration with Clustered Data
Department of Statistics, London School of Economics and Political Science, London, UK(伦敦政治经济学院统计系);Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, USA(密歇根大学生物统计学系);Michigan Institute for Data and AI in Society (MIDAS), University of Michigan, Ann Arbor, Michigan, USA(密歇根大学数据与人工智能社会研究所)
Comprehend, Divide, and Conquer: Feature Subspace Exploration via Multi-Agent Hierarchical Reinforcement Learning
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);Great Bay University(Great Bay大学);Duke-NUS Medical School, National University of Singapore(新加坡国立大学杜克-奈素医学院)
ULTHO: Ultra-Lightweight yet Efficient Hyperparameter Optimization in Deep Reinforcement Learning
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);Ningbo Institute of Digital Twin, Eastern Institute of Technology(宁波数字孪生研究所);Ningbo Key Laboratory of Spatial Intelligence and Digital Derivative(宁波空间智能与数字衍生关键实验室)
Prototypical context-aware dynamics generalization for high-dimensional model-based reinforcement learning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室)
Harnessing Data from Clustered LQR Systems: Personalized and Collaborative Policy Optimization
Department of Electrical and Computer Engineering(电气与计算机工程系);North Carolina State University(北卡罗来纳州立大学);The Elmore Family School of Electrical and Computer Engineering(埃尔莫尔家族电气与计算机工程学院);Purdue University(普渡大学)