SSE:用于工业级数据同化的多模态语义数据选择与增强
SSE: Multimodal Semantic Data Selection and Enrichment for Industrial-scale Data Assimilation
AI总结:
针对工业级AI数据过载问题,提出SSE框架,通过基础模型进行多模态语义数据选择与增强,在缩减数据集规模下维持或提升模型性能,证明语义多样性对数据选择至关重要。
摘要:
近年来,为人工智能收集的数据量已增长到难以管理的程度。特别是在自动驾驶等工业应用中,模型训练的计算预算正在被超越,同时模型性能正趋于饱和——然而更多数据仍在不断涌入。为了应对数据洪流,我们提出了一种框架,用于选择语义上最具多样性和重要性的数据集部分。然后,我们通过从海量未标记数据池中发现有意义的新数据,进一步对其进行语义增强。重要的是,我们通过利用基础模型为每个数据点生成语义,从而提供可解释性。我们定量地表明,我们的语义选择与增强框架(SSE)能够 a) 成功地用较小的训练数据集维持模型性能,以及 b) 通过增强较小的数据集来提升模型性能,同时不超过原始数据集的大小。因此,我们证明了语义多样性对于最优数据选择和模型性能是至关重要的。
英文摘要:
In recent years, the data collected for artificial intelligence has grown to an unmanageable amount. Particularly within industrial applications, such as autonomous vehicles, model training computation budgets are being exceeded while model performance is saturating -- and yet more data continues to pour in. To navigate the flood of data, we propose a framework to select the most semantically diverse and important dataset portion. Then, we further semantically enrich it by discovering meaningful new data from a massive unlabeled data pool. Importantly, we can provide explainability by leveraging foundation models to generate semantics for every data point. We quantitatively show that our Semantic Selection and Enrichment framework (SSE) can a) successfully maintain model performance with a smaller training dataset and b) improve model performance by enriching the smaller dataset without exceeding the original dataset size. Consequently, we demonstrate that semantic diversity is imperative for optimal data selection and model performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。