arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.08846cs.CVcs.LG
收藏

Vis-DSS:一个用于可视化数据选择和摘要的开源工具包

Vis-DSS: An Open-Source toolkit for Visual Data Selection and Summarization

Microsoft Corporation(微软公司);AitoeLabs;IIT Bombay(印度理工学院孟买分校)

Rishabh Iyer, Pratik Dubal, Kunal Dargan, Suraj Kothawade, Rohan Mahadev, Vishal Kaushal

摘要:

随着越来越多的视频和图像形式的视觉数据被创建,视觉数据的选择和摘要正在成为越来越多的问题。我们提出了Vis-DSS,一个用于可视化数据选择和汇总的开源工具包。Vis-DSS实现了一个使用子模块功能进行汇总和数据子集选择的模型框架,这些功能在这些问题中变得越来越流行。我们提出了几类模型,捕捉多样性,覆盖范围,代表性和重要性的概念,以及优化/推理和学习算法。Vis-DSS是第一个用于数据选择和摘要任务的开源工具包,包括图像收集摘要,视频摘要,分类和多样化主动学习的训练数据选择。我们在所有这些任务上展示了最先进的性能,并展示了我们如何扩展到大型问题。Vis-DSS允许轻松集成在其上构建的应用程序,也可以作为一个通用的框架,可以扩展到几个用例,包括用于创建GIF的视频和图像共享平台,图像蒙太奇创建,或作为监控系统的组件,我们通过提供基于Qt框架构建的图形用户界面(GUI)桌面应用程序来演示这一点。Vis-DSS可在https://github.com/rishabhk108/vis-dss上获得

英文摘要:

With increasing amounts of visual data being created in the form of videos and images, visual data selection and summarization are becoming ever increasing problems. We present Vis-DSS, an open-source toolkit for Visual Data Selection and Summarization. Vis-DSS implements a framework of models for summarization and data subset selection using submodular functions, which are becoming increasingly popular today for these problems. We present several classes of models, capturing notions of diversity, coverage, representation and importance, along with optimization/inference and learning algorithms. Vis-DSS is the first open source toolkit for several Data selection and summarization tasks including Image Collection Summarization, Video Summarization, Training Data selection for Classification and Diversified Active Learning. We demonstrate state-of-the art performance on all these tasks, and also show how we can scale to large problems. Vis-DSS allows easy integration for applications to be built on it, also can serve as a general skeleton that can be extended to several use cases, including video and image sharing platforms for creating GIFs, image montage creation, or as a component to surveillance systems and we demonstrate this by providing a graphical user-interface (GUI) desktop app built over Qt framework. Vis-DSS is available at https://github.com/rishabhk108/vis-dss

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑