arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.03207cs.CVcs.AIcs.LG
收藏

使用视频描述促进身体活动

The Use of Video Captioning for Fostering Physical Activity

The University of Georgia(佐治亚大学)

Soheyla Amirian, Abolfazl Farahani, Hamid R. Arabnia, Khaled Rasheed, Thiab R. Taha

摘要:

视频描述被认为是计算机视觉领域最具挑战性的问题之一。视频描述涉及不同深度学习模型的组合,以通过处理图像帧序列来执行目标检测、动作检测和定位。考虑视频中的动作序列是至关重要的,以便生成对整个动作事件的有意义的描述。可靠、准确和实时的视频描述方法可以用于许多应用中。然而,本文着重于一个应用:视频描述,以促进和促进体育活动。从广义上讲,这项工作可以被视为辅助技术。由于许多因素,缺乏身体活动在许多国家似乎越来越普遍,其中最重要的是技术在工作场所提供的便利。久坐不动的生活方式正在成为一个重要的公共健康问题。因此,将更多的身体运动融入我们的日常生活中至关重要。跟踪一个人的日常身体活动将提供一个基础,与随后几天进行的活动进行比较。考虑到上述情况,本文提出了一个视频描述框架,旨在描述视频中的活动,并估计一个人的日常身体活动水平。这个框架可以帮助人们追踪他们的日常活动,以减少不活跃的生活方式的健康风险。本文提出的工作仍处于起步阶段。本文概述了应用程序的初始步骤。根据我们的初步研究,这个项目有很大的优点。

英文摘要:

Video Captioning is considered to be one of the most challenging problems in the field of computer vision. Video Captioning involves the combination of different deep learning models to perform object detection, action detection, and localization by processing a sequence of image frames. It is crucial to consider the sequence of actions in a video in order to generate a meaningful description of the overall action event. A reliable, accurate, and real-time video captioning method can be used in many applications. However, this paper focuses on one application: video captioning for fostering and facilitating physical activities. In broad terms, the work can be considered to be assistive technology. Lack of physical activity appears to be increasingly widespread in many nations due to many factors, the most important being the convenience that technology has provided in workplaces. The adopted sedentary lifestyle is becoming a significant public health issue. Therefore, it is essential to incorporate more physical movements into our daily lives. Tracking one's daily physical activities would offer a base for comparison with activities performed in subsequent days. With the above in mind, this paper proposes a video captioning framework that aims to describe the activities in a video and estimate a person's daily physical activity level. This framework could potentially help people trace their daily movements to reduce an inactive lifestyle's health risks. The work presented in this paper is still in its infancy. The initial steps of the application are outlined in this paper. Based on our preliminary research, this project has great merit.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑