作物大数据集成的数据仓库与决策支持
Data Warehouse and Decision Support on Integrated Crop Big Data
摘要:
近年来,精准农业正变得越来越流行。采用现代信息和通信技术收集和处理农业数据,使农业生产发生了革命性变化。这已经开始了一段时间前(20世纪初),它是由收集有关一切的数据的低成本驱动的;从种子,土壤,肥料,害虫等领域的信息到天气数据,无人机和卫星图像。特别是今天的农业数据采掘,无论从数量、种类、速度还是准确性上都被认为是大数据应用。因此,它导致了处理大量复杂多样的信息以为农民、农学家和其他企业提取有用知识的挑战。它是建立作物智能平台的关键基础,这将使高效的资源管理和高质量的农艺决策和建议成为可能。本文设计并实现了一个大陆级农业数据仓库(ADW)。ADW的特点是(1)灵活的模式;(2)来自真实农业多数据集的数据集成;(3)数据科学和业务智能支持;(4)高性能;(5)高存储;(6)安全性;(7)治理和监控;(8)一致性,可用性和分区容忍;(9)云兼容性。我们还评估了ADW的性能,并提出了一些复杂的查询,以提取和返回有关作物管理的必要知识。
英文摘要:
In recent years, precision agriculture is becoming very popular. The introduction of modern information and communication technologies for collecting and processing Agricultural data revolutionise the agriculture practises. This has started a while ago (early 20th century) and it is driven by the low cost of collecting data about everything; from information on fields such as seed, soil, fertiliser, pest, to weather data, drones and satellites images. Specially, the agricultural data mining today is considered as Big Data application in terms of volume, variety, velocity and veracity. Hence it leads to challenges in processing vast amounts of complex and diverse information to extract useful knowledge for the farmer, agronomist, and other businesses. It is a key foundation to establishing a crop intelligence platform, which will enable efficient resource management and high quality agronomy decision making and recommendations. In this paper, we designed and implemented a continental level agricultural data warehouse (ADW). ADW is characterised by its (1) flexible schema; (2) data integration from real agricultural multi datasets; (3) data science and business intelligent support; (4) high performance; (5) high storage; (6) security; (7) governance and monitoring; (8) consistency, availability and partition tolerant; (9) cloud compatibility. We also evaluate the performance of ADW and present some complex queries to extract and return necessary knowledge about crop management.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。