arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1804.07047cs.AIcs.DC
收藏

稀疏移动人群感知中基于深度强化学习的小区选择

Cell Selection with Deep Reinforcement Learning in Sparse Mobile Crowdsensing

Hong Kong University of Science and Technology(香港科技大学);Jilin University(吉林大学);Peking University(北京大学)

Leye Wang, Wenbin Liu, Daqing Zhang, Yasha Wang, En Wang, Yongjian Yang

摘要:

稀疏移动人群感知(MCS)是一种新的MCS范式,其中数据推理被纳入MCS过程中,以降低感知成本,同时保证其质量。由于来自目标感测区域的不同单元(子区域)的感测数据将可能导致不同水平的推断数据质量,因此单元选择(即,选择目标区域的哪些单元来收集来自参与者的感测数据)是将影响需要收集的数据总量的关键问题(即,数据汇集成本)以确保一定的质量水平。为了解决这个问题,本文提出了一种基于深度强化学习的稀疏MCS小区选择机制,称为DR-Cell。首先,我们对强化学习中的关键概念(包括状态、动作和奖励)进行了适当的建模,然后提出使用深度递归Q网络来学习Q函数,该Q函数可以帮助决定在细胞选择过程中,在特定状态下哪个细胞是更好的选择。此外,我们利用迁移学习技术来减少训练Q函数所需的数据量,如果有多个相关的MCS任务需要在同一目标区域进行。在各种真实感测数据集上的实验验证了DR-Cell在稀疏MCS中最先进的单元选择机制上的有效性,在相同的数据推理质量保证下减少了多达15%的感测单元。

英文摘要:

Sparse Mobile CrowdSensing (MCS) is a novel MCS paradigm where data inference is incorporated into the MCS process for reducing sensing costs while its quality is guaranteed. Since the sensed data from different cells (sub-areas) of the target sensing area will probably lead to diverse levels of inference data quality, cell selection (i.e., choose which cells of the target area to collect sensed data from participants) is a critical issue that will impact the total amount of data that requires to be collected (i.e., data collection costs) for ensuring a certain level of quality. To address this issue, this paper proposes a Deep Reinforcement learning based Cell selection mechanism for Sparse MCS, called DR-Cell. First, we properly model the key concepts in reinforcement learning including state, action, and reward, and then propose to use a deep recurrent Q-network for learning the Q-function that can help decide which cell is a better choice under a certain state during cell selection. Furthermore, we leverage the transfer learning techniques to reduce the amount of data required for training the Q-function if there are multiple correlated MCS tasks that need to be conducted in the same target area. Experiments on various real-life sensing datasets verify the effectiveness of DR-Cell over the state-of-the-art cell selection mechanisms in Sparse MCS by reducing up to 15% of sensed cells with the same data inference quality guarantee.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑