摘要
为实现生态环境综合决策科学化,利用大数据技术及传统数据库的结合,设计一种混合存储结构。既利用Hbase在大规模环境质量监测数据的高可拓展性、高可靠性的数据存储能力,又利用关系型数据库My SQL提供的强大SQL查询语言以及数据多维分析能力,实时统计分析与多维展示最近一段时间内环境质量监测数据。实验结果表明,所用方法与传统的手工记录查询方式及单一数据库查询方式相比,有效提高了数据存储规模及数据查询速度。
To realize the comprehensive scientific decision-making of the ecological environment,a hybrid storage structure based on a combination of big data technology and traditional database is designed. First,Hbase has high expansibility and reliability of data storage capacity for in large environmental monitoring data. Second,relational database My Sql provided powerful SQL query language and data analysis capabilities,which could make a real time statistical analysis and multi-dimensional display of environmental quality monitoring data in recent time. Experimental results show that our method can effectively improve the data storage size and query speed,compared with the traditional method.
出处
《计算机应用与软件》
2017年第9期64-67,113,共5页
Computer Applications and Software
基金
国家自然科学基金项目(61503171)
山东省自然科学基金项目(ZR2015FL021)
关键词
环保大数据
混合存储
数据导入
Environmental big data
Hybrid storage
Data import
