Multi-agent settings remain a fundamental challenge in the reinforcement learning (RL) domain due to the partial observability and the lack of accurate real-time interactions across agents. In this paper, we propose a new method based on local communication learning to tackle the multi-agent RL (MARL) challenge within a large number of agents coexisting. First, we design a new communication protocol that exploits the ability of depthwise convolution to efficiently extract local relations and learn local communication between neighboring agents. To facilitate multi-agent coordination, we explicitly learn the effect of joint actions by taking the policies of neighboring agents as inputs. Second, we introduce the mean-field approximation into our method to reduce the scale of agent interactions. To more effectively coordinate behaviors of neighboring agents, we enhance the mean-field approximation by a supervised policy rectification network (PRN) for rectifying real-time agent interactions and by a learnable compensation term for correcting the approximation bias. The proposed method enables efficient coordination as well as outperforms several baseline approaches on the adaptive traffic signal control (ATSC) task and the StarCraft II multi-agent challenge (SMAC).
Do All MobileNets Quantize Poorly? Gaining Insights into the Effect of Quantization on Depthwise Separable Convolutional Networks Through the Eyes of Multi-scale Distributional Dynamics
University of Waterloo(滑铁卢大学);Waterloo Artificial Intelligence Institute(滑铁卢人工智能研究所)
Parameter-Efficient 3D Segmentation of Liver and Liver tumors: Depthwise factorization Scales Better Than Dense Convolution with Spatial Dimensionality
Utterance Weighted Multi-Dilation Temporal Convolutional Networks for Monaural Speech Dereverberation
The University of Sheffield(谢菲尔德大学)
语音去混响是许多语音技术应用中的一个重要阶段。最近在这一领域的工作一直由深度神经网络模型主导。时间卷积网络(TCN)是深度学习模型,已被提出用于语音去混响任务中的序列建模。在这项工作中,加权多膨胀深度可分离卷积提出了取代标准的深度可分离卷积TCN模型。这种建议的卷积使TCN能够动态地关注网络中每个卷积块的感受野中或多或少的局部信息。结果表明,这种加权多膨胀时间卷积网络(WD-TCN)在各种模型配置中始终优于TCN,并且使用WD-TCN模型是一种比增加卷积块数量更有效的参数方法来提高模型的性能。与基线TCN相比,最佳性能改善为0.55 dB尺度不变信号失真比(SISDR),而WD-TCN模型在WHAMR数据集上的最佳性能达到12.26 dB SISDR。
WBMM: Windowed Batch Matrix Multiplication for Efficient Large Receptive Field Convolution
Hefei University of Technology, Hefei, China(合肥工业大学);Lingyang Industrial Internet Co., Ltd., Hefei, China(灵阳工业互联网有限公司);Kochi University of Technology, Kochi, Japan(Kochi大学技术)
Group-Shared Low-Rank Approximation for Mobile-Efficient Pointwise Convolutions in Large-Kernel CNNs
Northwestern Polytechnical University(西北工业大学);Nanchang University(南昌大学);China Mobile Chengdu Institute of Research and Development(中国移动成都研究院);Hong Kong University of Science and Technology(香港科技大学);Institute of AI for Industries, Chinese Academy of Sciences(中国科学院人工智能产业研究院);University of Electronic Science and Technology of China(电子科技大学)