arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.01655eess.IVcs.AIcs.LG
收藏

UniCrop: 一个通用、多源数据工程流水线,用于可扩展的作物产量预测

UniCrop: A Universal, Multi-Source Data Engineering Pipeline for Scalable Crop Yield Prediction

Cardiff University, School of Mathematics, CF24 4AG UK.;Cardiff University, School of Computer Science \& Informatics, CF24 4AG UK

Emiliya Khidirova, Oktay Karakuş

AI总结:

UniCrop通过自动化多源环境数据处理,提供了一种通用的数据工程框架,用于提高作物产量预测的可扩展性和准确性。

摘要:

准确的作物产量预测依赖于多种数据流,包括卫星、气象、土壤和地形信息。然而,尽管在机器学习领域取得了快速进展,现有的方法仍然局限于特定作物或地区,并且需要数据工程工作。这限制了可扩展性、可重复性和操作部署。本研究引入了UniCrop,一个通用且可重用的数据流水线,旨在自动化多源环境数据的获取、清洗、协调和工程化,以用于作物产量预测。对于任何给定的位置、作物类型和时间窗口,UniCrop会自动获取、协调和工程化超过200个环境变量(Sentinel-1/2、MODIS、ERA5-Land、NASA POWER、SoilGrids和SRTM),将其缩减为一个紧凑的、可用于分析的特征集,利用结构化特征减少工作流程,最小冗余最大相关性(mRMR)。为了验证,UniCrop被应用于一个包含557个田间观测的水稻产量数据集。仅使用所选的15个特征,四个基线机器学习模型(LightGBM、随机森林、支持向量回归和弹性网络)被训练。LightGBM在单模型性能上表现最好(RMSE = 465.1 kg/ha,$R^2 = 0.6576$),而一个约束的基线集合进一步提高了准确性(RMSE = 463.2 kg/ha,$R^2 = 0.6604$)。UniCrop提供了一个可扩展且透明的数据工程框架,解决了操作作物产量建模中的主要瓶颈:一致且协调的多源数据准备。通过将数据规范与实现分离,并通过简单的配置更新支持任何作物、地区和时间框架,UniCrop提供了一个可扩展农业分析的实用基础。代码和实现文档在https://github.com/CoDIS-Lab/UniCrop共享。

英文摘要:

Accurate crop yield prediction relies on diverse data streams, including satellite, meteorological, soil, and topographic information. However, despite rapid advances in machine learning, existing approaches remain crop- or region-specific and require data engineering efforts. This limits scalability, reproducibility, and operational deployment. This study introduces UniCrop, a universal and reusable data pipeline designed to automate the acquisition, cleaning, harmonisation, and engineering of multi-source environmental data for crop yield prediction. For any given location, crop type, and temporal window, UniCrop automatically retrieves, harmonises, and engineers over 200 environmental variables (Sentinel-1/2, MODIS, ERA5-Land, NASA POWER, SoilGrids, and SRTM), reducing them to a compact, analysis-ready feature set utilising a structured feature reduction workflow with minimum redundancy maximum relevance (mRMR). To validate, UniCrop was applied to a rice yield dataset comprising 557 field observations. Using only the selected 15 features, four baseline machine learning models (LightGBM, Random Forest, Support Vector Regression, and Elastic Net) were trained. LightGBM achieved the best single-model performance (RMSE = 465.1 kg/ha, $R^2 = 0.6576$), while a constrained ensemble of all baselines further improved accuracy (RMSE = 463.2 kg/ha, $R^2 = 0.6604$). UniCrop contributes a scalable and transparent data-engineering framework that addresses the primary bottleneck in operational crop yield modelling: the preparation of consistent and harmonised multi-source data. By decoupling data specification from implementation and supporting any crop, region, and time frame through simple configuration updates, UniCrop provides a practical foundation for scalable agricultural analytics. The code and implementation documentation are shared in https://github.com/CoDIS-Lab/UniCrop.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑