视频转换器视频转换器
Horizontal-to-Vertical Video Conversion
摘要:
随着移动视频的普及,公众倾向于在手持设备上消费垂直视频。为了恢复水平内容的曝光,我们在此阐述了利用我们提出的H2 V框架对自动水平到垂直(简称为H2 V)视频转换的探索,并附有准确注释的H2 V-142 K数据集。具体来说,H2 V框架集成了视频镜头边界检测、主题选择和多目标跟踪等技术,实现了主题保持转换,其中主题选择是关键。为了实现这一目标,我们提出了一个排名SS模块,检测人体对象,然后选择主题,通过利用位置,外观和突出的线索,以保持。之后,框架自动裁剪主题周围的视频,以从水平源生成垂直内容。为了构建和评估我们的H2 V框架,H2 V-142 K数据集使用125个视频的主题边界框进行了密集注释,这些视频具有132 K帧和9,500个视频封面,与传统的显着方法相比,我们展示了优越的主题选择性能,并表现出整体上有希望的水平到垂直转换性能。通过公开这个数据集以及我们的方法,我们希望为水平到垂直视频转换任务上更有价值的努力铺平道路。
英文摘要:
Alongside the prevalence of mobile videos, the general public leans towards consuming vertical videos on hand-held devices. To revitalize the exposure of horizontal contents, we hereby set forth the exploration of automated horizontal-to-vertical (abbreviated as H2V) video conversion with our proposed H2V framework, accompanied by an accurately annotated H2V-142K dataset. Concretely, H2V framework integrates video shot boundary detection, subject selection and multi-object tracking to facilitate the subject-preserving conversion, wherein the key is subject selection. To achieve so, we propose a Rank-SS module that detects human objects, then selects the subject-to-preserve via exploiting location, appearance, and salient cues. Afterward, the framework automatically crops the video around the subject to produce vertical contents from horizontal sources. To build and evaluate our H2V framework, H2V-142K dataset is densely annotated with subject bounding boxes for 125 videos with 132K frames and 9,500 video covers, upon which we demonstrate superior subject selection performance comparing to traditional salient approaches, and exhibit promising horizontal-to-vertical conversion performance overall. By publicizing this dataset as well as our approach, we wish to pave the way for more valuable endeavors on the horizontal-to-vertical video conversion task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。