基于Hadoop的农产品安全监控平台的设计

The Design of the Platform of Safety Monitoring of Agricultural Products Based on Hadoop

摘要:

针对当前传统数据库已经不能满足海量农产品安全监控信息的存取及处理需求，借鉴Hadoop平台的分布式文件系统和Map/Reduce并行计算方法设计了农产品安全监控平台的框架，在此基础上，提出了一种用于监测农产品各项指标的Map/Reduce算法；最后通过Linux集群技术，搭建了一个基于Hadoop的农产品安全监控数据存储处理实验性平台，该平台能够有效地对海量农产品数据进行及时存储与处理。实验最终结果表明，相比传统的数据库，该平台能够大幅提升海量农产品数据的吞吐率及数据处理性能，由此验证了平台的合理及有效性。

Abstract:

Facing the problem that the traditional database can not meet the demand of storing and accessing the information in safety monitoring of agricultural products, this paper put forward a solution of using distributed technology to solve the problem.By using Linux cluster technology,the paper designs a platform based on Hadoop which can store and process the big data.The experiment and the results show that the solution have advantage over those traditional methods in storing and accessing the massive information in safety monitoring of agricultural products and it provides some support for the construction of the safety monitoring and early warning system for agricultural products.