AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Rice University(Rice大学);Carnegie Mellon University(卡内基梅隆大学);AIFARMS;Center for Digital Agriculture at UIUC(伊利诺伊大学厄巴纳-香槟分校数字农业中心)
Aruna Gauba, Irene Pi, Yunze Man, Ziqi Pang, Vikram S. Adve, Yu-Xiong Wang
We present AgMMU, a challenging real-world benchmark for evaluating and advancing vision-language models (VLMs) in the knowledge-intensive domain of agriculture. Unlike prior datasets that rely on crowdsourced prompts, AgMMU is distilled from 116,231 authentic dialogues between everyday growers and USDA-authorized Cooperative Extension experts. Through a three-stage pipeline: automated knowledge extraction, QA generation, and human verification, we construct (i) AgMMU, an evaluation set of 746 multiple-choice questions (MCQs) and 746 open-ended questions (OEQs), and (ii) AgBase, a development corpus of 57,079 multimodal facts covering five high-stakes agricultural topics: insect identification, species identification, disease categorization, symptom description, and management instruction. Benchmarking 12 leading VLMs reveals pronounced gaps in fine-grained perception and factual grounding. Open-sourced models trail after proprietary ones by a wide margin. Simple fine-tuning on AgBase boosts open-sourced model performance on challenging OEQs for up to 11.6% on average, narrowing this gap and also motivating future research to propose better strategies in knowledge extraction and distillation from AgBase. We hope AgMMU stimulates research on domain-specific knowledge integration and trustworthy decision support in agriculture AI development.
Agri-LLaVA: Knowledge-Infused Large Multimodal Assistant on Agricultural Pests and Diseases
China Three Gorges University(三峡大学);College of Computer and Information Technology, China Three Gorges University(三峡大学计算机与信息学院);University of Birmingham(伯明翰大学);Southern University of Science and Technology(南方科技大学)
AgroTools: A Benchmark for Tool-Augmented Multimodal Agents in Agriculture
Sun Yat-Sen University(中山大学);Southwest University(西南大学);Northeastern University(东北大学);National Supercomputing Center in Shenzhen(深圳国家超算中心);Southwest Jiaotong University(西南交通大学);China Agricultural University(中国农业大学);Tsinghua University(清华大学)
AgriDoctor: A Multimodal Intelligent Assistant for Agriculture
State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Farm-LightSeek: An Edge-centric Multimodal Agricultural IoT Data Analytics Framework with Lightweight LLMs
School of Computer Science and Artificial Intelligence, Wuhan University of Technology(武汉理工大学计算机科学与人工智能学院);School of Engineering, Swinburne University of Technology(斯威本科技大学工程学院);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);School of Computing, Engineering and Mathematical Sciences, La Trobe University(拉筹伯大学计算、工程与数学科学学院)
AgroOmni: A Large-Scale Multi-view Agricultural Dataset for Cross-Scale Multimodal Reasoning
Sun Yat-sen University(中山大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);HuanTian Wisdom Technology Co., Ltd.(慧天智慧科技有限公司);China Agricultural University(中国农业大学);Southwest Jiaotong University(西南交通大学);National Supercomputing Center in Shenzhen(深圳国家超算中心);The Chinese University of Hong Kong(香港中文大学)
BioAutoML-NAS: An End-to-End AutoML Framework for Multimodal Insect Classification via Neural Architecture Search on Large-Scale Biodiversity Data
Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh(乌姆国际大学计算机科学与工程系,达卡,孟加拉国);Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory, 1217, Dhaka, Bangladesh(应用人工智能与智能系统实验室(AAIINS),1217号,达卡,孟加拉国);Department of Computer Science and Engineering, Penn State University, University Park, PA, USA(宾夕法尼亚州立大学计算机科学与工程系,University Park,PA,美国);Faculty of Science and Information Technology, Charles Darwin University, Sydney, NSW, Australia(查尔斯达尔文大学科学与信息技术学院,悉尼,新南威尔士州,澳大利亚);Faculty of Science and Technology, Charles Darwin University, Casuarina, 0909, NT, Australia(查尔斯达尔文大学科学与技术学院,Casuarina,0909,北领地,澳大利亚)
Cattle-CLIP: A Multimodal Framework for Dairy Cattle Behaviour Recognition from Video
Bristol Veterinary School, University of Bristol(布里斯托尔大学布里斯托尔兽医学院);School of Computer Science, University of Bristol(布里斯托尔大学计算机科学学院);Joint Institute of Qingdao Huanghai University and WeITec, Qingdao Huanghai University(青岛黄海学院与WeITec联合学院,青岛黄海学院)
GTPBD-MM: A Global Terraced Parcel and Boundary Dataset with Multi-Modality
Sun Yat-sen University(中山大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);China Agricultural University(中国农业大学);Southwest Jiaotong University(西南交通大学);Northeastern University(东北大学);National Supercomputing Center in Shenzhen(深圳国家超算中心)
Fusing Perceptual Vision Experts with Multimodal LLMs for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation
Cornell University(康奈尔大学);University of the Peloponnese(伯罗奔尼撒大学);Agricultural University of Athens(雅典农业大学)
Boosting Crop Classification by Hierarchically Fusing Satellite, Rotational, and Contextual Data
Centro Nacional de Inteligencia Artificial (CENIA)(国家人工智能中心);European Commission, Joint Research Centre (JRC)(欧盟委员会联合研究中心);Technical University of Munich(慕尼黑工业大学)
INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurance
School of Computer Science Fudan University(复旦大学计算机科学学院);Department of Computer Science University of Rochester(罗切斯特大学计算机科学系);School of Economics Fudan University(复旦大学经济学院)
PestVL-Net: Enabling Multimodal Pest Learning via Fine-grained Vision-Language Interaction
Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences(智能机器研究所,合肥物理科学研究院,中国科学院);University of Science and Technology of China(中国科学技术大学);Zhongke Hefei Institute of Technology Innovation Engineering(中科合肥技术创新工程研究院)
AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuning
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Georgia Institute of Technology(佐治亚理工学院);Johns Hopkins University(约翰斯·霍普金斯大学)
LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
School of Electrical Engineering, Korea University(韩国大学电气工程学院);Department of Integrative Biology, The University of Texas at Austin(德克萨斯大学奥斯汀分校整合生物学系);Department of Software Engineering, FPT University(FPT大学软件工程系)
Pest-Thinker: Learning to Think and Reason like Entomologists via Reinforcement Learning
Institute of Intelligent Machines, Hefei Institute of Physical Science, Chinese Academy of Sciences(智能机器研究所、合肥物理科学研究所、中国科学院);University of Science and Technology of China(中国科学技术大学);Zhongke Hefei Institute of Technology Innovation Engineering(中科创新合肥科技研究院);Hefei University of Technology(合肥工业大学)
RSHallu: Dual-Mode Hallucination Evaluation for Remote-Sensing Multimodal Large Language Models with Domain-Tailored Mitigation
College of Computer Science, Chongqing University(重庆大学计算机科学学院);Heavy Rainfall Research Center of China(中国强降水研究中心);CMA Key Open Laboratory of Transforming Climate Resources to Economy, Chongqing Institute of Meteorological Sciences(中国气象局气候资源转化经济重点开放实验室、重庆气象科学研究院);Chongqing Metropolitan College of Science(重庆科学理工学院);School of Intelligence Science(智能科学学院);College of Artificial Intelligence, Harbin Institute of Technology(人工智能学院、哈尔滨工业大学);BNU-UIC Institute of Artificial Intelligence(北京师范大学-国际学院人工智能与未来网络研究院);Future Networks, Beijing Normal University at Zhuhai(未来网络、北京师范大学珠海分校)
Large Language Models and Foundation Models in Smart Agriculture: Basics, Opportunities, and Challenges
Michigan State University(密歇根州立大学);Jeonbuk National University(国立全北大学);North Carolina State University(北卡罗来纳州立大学);Southeast University(东南大学);Nanyang Technological University(南洋理工大学)