arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.13632cs.CV
收藏

FungiTastic:一个用于图像分类的多模态数据集与基准

FungiTastic: A multi-modal dataset and benchmark for image categorization

University of West Bohemia & Inria, CTU in Prague(西波西米亚大学及Inria、布拉格CTU)

Lukas Picek, Klara Janouskova, Vojtech Cermak, Jiri Matas

AI总结:

本文提出FungiTastic,一个基于20年真菌记录、含约35万专家标注多模态观测和6千物种类别、支持多种分类任务并提供预训练模型与训练框架的基准数据集。

摘要:

我们引入了一个新的、具有挑战性的基准和数据集FungiTastic,该数据集基于二十年间持续收集的真菌记录。该数据集由专家标注和整理,包含约35万个多模态观测数据,涵盖6千个细粒度类别(物种)。真菌观测包括照片以及附加数据,例如气象和气候数据、卫星图像以及身体部位分割掩膜。FungiTastic是少数几个包含具有前所未有的标签可靠性的DNA测序真实标签测试集的基准之一。该基准设计用于支持(i)标准闭集分类,(ii)开集分类,(iii)多模态分类,(iv)少样本学习,(v)域偏移等。我们为许多用例提供了定制基线,在https://huggingface.co/collections/BVRA/fungitastic-66a227ce0520be533dc6403b上提供了大量即用型预训练模型,以及一个模型训练框架。文档和基线可在https://github.com/BohemianVRA/FungiTastic/和https://www.kaggle.com/datasets/picekl/fungitastic获取。

英文摘要:

We introduce a new, challenging benchmark and a dataset, FungiTastic, based on fungal records continuously collected over a twenty-year span. The dataset is labelled and curated by experts and consists of about 350k multimodal observations of 6k fine-grained categories (species). The fungi observations include photographs and additional data, e.g., meteorological and climatic data, satellite images, and body part segmentation masks. FungiTastic is one of the few benchmarks that include a test set with DNA-sequenced ground truth of unprecedented label reliability. The benchmark is designed to support (i) standard closed-set classification, (ii) open-set classification, (iii) multi-modal classification, (iv) few-shot learning, (v) domain shift, and many more. We provide tailored baselines for many use cases, a multitude of ready-to-use pre-trained models on https://huggingface.co/collections/BVRA/fungitastic-66a227ce0520be533dc6403b, and a framework for model training. The documentation and the baselines are available at https://github.com/BohemianVRA/FungiTastic/ and https://www.kaggle.com/datasets/picekl/fungitastic.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑