arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.11450cs.LGstat.ML
收藏

训练多模式系统实现多目标分类

Training Multimodal Systems for Classification with Multiple Objectives

University of Bonn(波恩大学);Fraunhofer IAIS(弗劳恩霍夫研究所人工智能研究所 (IAIS))

Jason Armitage, Shramana Thakur, Rishi Tripathi, Jens Lehmann, Maria Maleshkova

摘要:

我们从各种各样的感官信息中了解世界。自动化系统缺乏这种能力,因为调查集中在处理以单一形式呈现的信息上。调整架构以从多种模态中学习,创造了学习世界丰富表征的潜力-但当前的多模态系统仅对单峰方法进行了边际改进。神经网络在训练过程中学习采样噪声,结果是对不可见数据的性能下降。本研究介绍了第二个目标的多模态融合过程中学习变分推理。正则化方法在内部训练循环中实现,以控制方差,模块化结构在向层添加额外的神经元时稳定性能。这个框架进行评估的多标签分类任务与文本和视觉输入,以证明多个目标和概率的方法,以降低方差和提高泛化的潜力。

英文摘要:

We learn about the world from a diverse range of sensory information. Automated systems lack this ability as investigation has centred on processing information presented in a single form. Adapting architectures to learn from multiple modalities creates the potential to learn rich representations of the world - but current multimodal systems only deliver marginal improvements on unimodal approaches. Neural networks learn sampling noise during training with the result that performance on unseen data is degraded. This research introduces a second objective over the multimodal fusion process learned with variational inference. Regularisation methods are implemented in the inner training loop to control variance and the modular structure stabilises performance as additional neurons are added to layers. This framework is evaluated on a multilabel classification task with textual and visual inputs to demonstrate the potential for multiple objectives and probabilistic methods to lower variance and improve generalisation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑