arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2606.22497cs.CV

用于植物显微图像理解的视觉语言模型基准测试

Benchmarking Vision-Language Models for Microscopic Plant Image Understanding

The University of Queensland(昆士兰大学);Adelaide University(阿德莱德大学);University of Southern Queensland(南昆士兰大学)

Tianqi Wei, Xin Yu, Zhi Chen, Scott Chapman, Zi Huang

AI总结:

提出PlantMicro基准,包含5000+图像和9000+VQA对,评估视觉语言模型在植物显微图像理解上的能力,发现现有模型在细粒度识别和生物学推理上表现不佳。

摘要:

显微成像为在细胞和亚细胞水平研究植物生物学和病理学提供了重要的视觉证据。然而,现有的视觉语言模型基准主要关注宏观植物图像,而微观领域仍未得到充分探索。为填补这一空白,我们提出了PlantMicro,一个用于评估视觉语言模型在植物显微图像中表现的综合基准。PlantMicro整合了来自不同宿主、生物学领域和成像模态的5000多张图像。基于这种多样性,我们设计了一组互补的任务,以捕捉显微图像理解的不同方面。为支持这些任务,我们构建了超过9000个VQA对,系统评估视觉语言模型的能力。在PlantMicro上的实验表明,当前的视觉语言模型在细粒度识别和基于生物学的推理方面存在困难。例如,GPT-5在病原体分类任务上仅达到34.93%的准确率,仅略高于随机猜测基线。结果凸显了当前视觉语言模型在理解植物显微图像方面的显著差距。PlantMicro为推动视觉语言模型向可靠且全面的显微镜级植物理解提供了标准化基础。

英文摘要:

Microscopic imaging provides essential visual evidence for studying plant biology and pathology at the cellular and subcellular levels. However, existing benchmarks on vision-language models primarily focus on macroscopic plant imagery, while the microscopic domain remains underexplored. To address this gap, we present PlantMicro, a comprehensive benchmark for evaluating vision-language models (VLMs) in microscopic plant imagery. PlantMicro integrates more than 5,000 images collected across diverse hosts, biological domains, and imaging modalities. Building on this diversity, we design a set of complementary tasks that capture different facets of microscopic image understanding. To support these tasks, we construct over 9,000 VQA pairs that systematically evaluate the capabilities of VLMs. Experiments on PlantMicro show that current VLMs struggle with fine-grained recognition and biologically grounded reasoning. For example, GPT-5 achieves 34.93% accuracy on the pathogen classification task, which is only modestly above the random-guessing baseline. The results highlight a significant gap in current VLMs' ability to comprehend plant microscopic images. PlantMicro provides a standardized foundation for advancing VLMs toward reliable and comprehensive microscopy-level plant understanding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑