arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.04736cs.CV
收藏

BU-CVKit:用于物种无关追踪与分析的可扩展计算机视觉框架

BU-CVKit: Extendable Computer Vision Framework for Species Independent Tracking and Analysis

Boston University(波士顿大学)

Mahir Patel, Lucas Carstensen, Yiwen Gu, Michael E. Hasselmo, Margrit Betke

AI总结:

本文提出可扩展计算机视觉框架BU-CVKit,通过可链式Processor与插件机制促进模型复用,并配套MuSeqPose Kit支持姿态估计及行为神经科学研究流水线。

摘要:

跨学科计算机视觉(CV)研究的一个主要瓶颈是缺少一种框架,使CV研究者与非CV研究者都能便捷地复用和抽象最先进的CV模型。我们在此提出BU-CVKit,这是一种计算机视觉框架,允许通过可链式连接的Processor创建研究流水线。社区可以为该框架创建其工作的插件,从而以最小开销提升其工作的可复用性、可访问性和曝光度。此外,我们提供MuSeqPose Kit,这是BU-CVKit姿态估计软件包的用户界面,可自动扫描已安装插件,并根据用户提供的元数据以编程方式为其生成界面。它还为标注、三维重建、重投影和相机标定等标准姿态估计功能提供软件支持。最后,我们展示了通过为该框架创建的示例插件所构建的行为神经科学流水线示例。

英文摘要:

A major bottleneck of interdisciplinary computer vision (CV) research is the lack of a framework that eases the reuse and abstraction of state-of-the-art CV models by CV and non-CV researchers alike. We present here BU-CVKit, a computer vision framework that allows the creation of research pipelines with chainable Processors. The community can create plugins of their work for the framework, hence improving the re-usability, accessibility, and exposure of their work with minimal overhead. Furthermore, we provide MuSeqPose Kit, a user interface for the pose estimation package of BU-CVKit, which automatically scans for installed plugins and programmatically generates an interface for them based on the metadata provided by the user. It also provides software support for standard pose estimation features such as annotations, 3D reconstruction, reprojection, and camera calibration. Finally, we show examples of behavioral neuroscience pipelines created through the sample plugins created for our framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑