独立模块化网络
Independent Modular Networks
AI总结:
针对单体网络忽视数据组合性及现有模块化网络角色不清、模块崩溃等问题,本文提出具有预定模块角色的独立模块化网络架构,并引入正则化以提升抗崩溃能力和分解准确率。
摘要:
使用单一权重集合来学习下游任务有用表示的单体神经网络,明确忽视了数据生成过程的组合性。这一特征存在于这样的数据中:每个实例都可以被视为一个身份概念(例如物体的形状)与若干修饰概念(例如方向、颜色和尺寸)的组合。对组合性的忽视在机器人领域尤其有害,因为状态估计严重依赖物理机制(例如旋转和变换)的组合性质来对交互进行建模。为适应这种数据特征,研究人员提出了模块化网络。然而,每个模块角色缺乏结构,以及模块崩溃等模块化网络特有的问题,限制了它们的可用性。我们提出一种模块化网络架构,通过一种独特结构将模块划分为预先确定的角色,从而容纳上述分解概念。此外,我们提供了正则化方法,可提高模块化网络对模块崩溃问题的抵御能力,同时提升模型的分解准确率。
英文摘要:
Monolithic neural networks that make use of a single set of weights to learn useful representations for downstream tasks explicitly dismiss the compositional nature of data generation processes. This characteristic exists in data where every instance can be regarded as the combination of an identity concept, such as the shape of an object, combined with modifying concepts, such as orientation, color, and size. The dismissal of compositionality is especially detrimental in robotics, where state estimation relies heavily on the compositional nature of physical mechanisms (e.g., rotations and transformations) to model interactions. To accommodate this data characteristic, modular networks have been proposed. However, a lack of structure in each module's role, and modular network-specific issues such as module collapse have restricted their usability. We propose a modular network architecture that accommodates the mentioned decompositional concept by proposing a unique structure that splits the modules into predetermined roles. Additionally, we provide regularizations that improve the resiliency of the modular network to the problem of module collapse while improving the decomposition accuracy of the model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。