婴儿通过视觉学习的概念可以促进AI模型中的视觉学习和理解
Concepts Learned Visually by Infants Can Contribute to Visual Learning and Understanding in AI Models
AI总结:
研究探讨婴儿早期视觉学习概念如何促进AI模型学习,通过比较早期概念与标准深度网络模型,发现早期概念提升学习准确性和效率,改善模型表征和泛化能力。
摘要:
在发育早期,婴儿能提取复杂的视觉场景特征,并初步理解这些概念的含义、因果关系及预测未来事件。这种学习通常在少量示例和无监督条件下完成,与当前网络模型不同。实证研究表明,在物体和人机交互领域,早期获得的概念常用于学习更复杂概念。本文模型了早期概念在后续概念学习中的作用,并与标准深度网络模型比较。特别关注动性概念和目标归因在动态视觉场景中预测未来事件的学习过程。结果显示,使用早期概念可提高学习准确性和效率,早期与新概念的结合塑造了模型获取的概念表征并提升泛化能力。进一步比较先进视觉语言模型与人类研究在理解动性与非动性代理行为任务中的表现,结果支持早期概念对视觉理解的贡献。最后讨论将人类视觉学习纳入计算机视觉模型的潜在益处。
英文摘要:
Early in development, infants learn to extract surprisingly complex aspects of visual scenes. This early learning comes together with an initial understanding of the extracted concepts, such as their implications, causality, and using them to predict likely future events. In many cases, this learning is obtained with little or no supervision, and from relatively few examples, compared to current network models. Empirical studies of visual perception in early development have shown that in the domain of objects and human-object interactions, early-acquired concepts are often used in the process of learning additional, more complex concepts. In the current work, we model how early-acquired concepts are used in the learning of subsequent concepts, and compare the results with standard deep network modeling. We focused in particular on the use of the concepts of animacy and goal attribution in learning to predict future events in dynamic visual scenes. We show that the use of early concepts in the learning of new concepts leads to better learning (higher accuracy) and more efficient learning (requiring less data), and that the combination of early and new concepts shapes the representation of the concepts acquired by the model and improves its generalization. We further compare advanced vision-language models to a human study in a task that requires an understanding of the behavior of animate vs. inanimate agents, with results supporting the contribution of early concepts to visual understanding. We finally briefly discuss the possible benefits of incorporating aspects of human-like visual learning into computer vision models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。