arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.02491cs.CVcs.LG
收藏

联合分布外过滤与数据发现的主动学习

Joint Out-of-Distribution Filtering and Data Discovery Active Learning

Technical University of Munich(慕尼黑工业大学);BMW Group(宝马集团);SPRIND

Sebastian Schmidt, Leonard Schenk, Leo Schwinn, Stephan Günnemann

AI总结:

提出联合分布外过滤与数据发现主动学习(Joda),通过将训练与过滤选择深度纠缠构建公共特征空间,同时解决OOD过滤与类别发现挑战,无需辅助模型即实现最优平衡。

摘要:

随着深度学习模型对数据需求的增加,主动学习(AL)变得至关重要,它通过策略性地选择样本进行标注,最大化数据效率并降低训练成本。现实场景需要在AL中考虑不完整的数据知识。先前的工作处理了分布外(OOD)数据,而另一个研究方向则聚焦于类别发现。然而,将AL与分布外数据和类别发现相结合的现实考量联合分析仍未被探索。为了填补这一空白,我们提出了联合分布外过滤与数据发现主动学习(Joda),通过在选择候选标注样本之前过滤掉OOD数据,独特地同时解决这两个挑战。与以往方法不同,我们将训练过程与过滤和选择深度纠缠,以构建一个公共特征空间,该空间对齐已知和新颖类别,同时分离OOD样本。与以往工作不同,Joda高度高效,完全省去了辅助模型以及对未标记池的训练访问来进行过滤或选择。在18种配置和3个指标的广泛实验中,与最先进的竞争方法相比,Joda始终取得最高准确率,并具有最佳的类别发现与OOD过滤平衡。

英文摘要:

As the data demand for deep learning models increases, active learning (AL) becomes essential to strategically select samples for labeling, which maximizes data efficiency and reduces training costs. Real-world scenarios necessitate the consideration of incomplete data knowledge within AL. Prior works address handling out-of-distribution (OOD) data, while another research direction has focused on category discovery. However, a combined analysis of real-world considerations combining AL with out-of-distribution data and category discovery remains unexplored. To address this gap, we propose Joint Out-of-distribution filtering and data Discovery Active learning (Joda) , to uniquely address both challenges simultaneously by filtering out OOD data before selecting candidates for labeling. In contrast to previous methods, we deeply entangle the training procedure with filter and selection to construct a common feature space that aligns known and novel categories while separating OOD samples. Unlike previous works, Joda is highly efficient and completely omits auxiliary models and training access to the unlabeled pool for filtering or selection. In extensive experiments on 18 configurations and 3 metrics, \ours{} consistently achieves the highest accuracy with the best class discovery to OOD filtering balance compared to state-of-the-art competitor approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑