arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.04068cs.DBcs.CVcs.SDeess.AS
收藏

VOCALExplore:按需付费的视频数据探索与模型构建[技术报告]

VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building [Technical Report]

University of Washington(华盛顿大学);Microsoft Gray Systems Lab(微软格雷系统实验室)

Maureen Daum, Enhao Zhang, Dong He, Stephen Mussmann, Brandon Haynes, Ranjay Krishna, Magdalena Balazinska

AI总结:

提出 VOCALExplore 系统,通过基于标签偏斜的自动样本选择、上升赌博机特征选择及低延迟优化,支持视频数据的交互式标注与领域模型构建。

摘要:

我们介绍 VOCALExplore,这是一个旨在支持用户在视频数据集上构建特定领域模型的系统。VOCALExplore 支持交互式标注会话,并使用用户提供的标签训练模型。VOCALExplore 通过根据所收集标签中观察到的偏斜自动决定如何选择样本,来最大化模型质量。它还通过将特征选择建模为上升赌博机问题,选择训练模型时使用的最佳视频表示。最后,VOCALExplore 实施了优化,以在不牺牲模型性能的情况下实现低延迟。我们证明,在给定候选采集函数和特征提取器的情况下,VOCALExplore 达到了接近最佳可能水平的模型质量,并且以较低的可见延迟(每轮迭代约 1 秒)完成,且无需昂贵的预处理。

英文摘要:

We introduce VOCALExplore, a system designed to support users in building domain-specific models over video datasets. VOCALExplore supports interactive labeling sessions and trains models using user-supplied labels. VOCALExplore maximizes model quality by automatically deciding how to select samples based on observed skew in the collected labels. It also selects the optimal video representations to use when training models by casting feature selection as a rising bandit problem. Finally, VOCALExplore implements optimizations to achieve low latency without sacrificing model performance. We demonstrate that VOCALExplore achieves close to the best possible model quality given candidate acquisition functions and feature extractors, and it does so with low visible latency (~1 second per iteration) and no expensive preprocessing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑