期刊文献+

基于Hadoop的土地时空大数据集成框架设计研究 被引量:4

Design and Implementation of the Integration Framework for Spatiotemporal Land Data Based on Hadoop Platform
在线阅读 下载PDF
导出
摘要 本文提出了基于Hadoop集群计算的土地时空大数据集成平台框架,并初步实现了原型系统,对关键技术进行了验证。实例验证结果显示,利用本研究提出的技术路线和框架,可以极大地提升海量土地时空数据的管理水平、处理能力和服务效率。 The paper proposed a novel framework for integration of national scale spatio-temporal land data based onHadoop platform. A prototype system has been implemented and the key technologies have been verified. Testing resultsshow that with the proposed system framework and technical approach, the capability and performance of the massive landdata management, processing and service could be improved significantly.
出处 《国土资源信息化》 2016年第2期3-8,共6页 Land and Resources Informatization
基金 "十二五"国土资源调查评价土地基础数据整合集成与共享平台建设(DCPJ121707-01)项目资助
关键词 时空数据 HADOOP集群 全要素网格 大数据 数据集成 Spatial-temporal data Hadoop Cluster All Factor Data Grid Big Data Data Integration
  • 相关文献

参考文献9

  • 1Ghemawat S, Gobioff H, Leung S T. The Google file system[C]//ACMSIGOPS Operating Systems Review. ACM, 2003, 37(5): 29-43.
  • 2Chang F, Dean J, Ghemawat S, et al. Bigtable: A distributed storagesystem for structured data[J]. ACM Transactions on Computer Systems(TOCS), 2008, 26(2): 4.
  • 3Melnik S, Gubarev A, Long J J, et al. Dremel: interactive analysis ofweb-scale datasets[J]. Proceedings of the VLDB Endowment, 2010,3(1-2): 330-339.
  • 4Beaver, Doug, et al. "Finding a Needle in Haystack: Facebook's PhotoStorage." OSDI. Vol. 2010. 2010.
  • 5DeCandia, Giuseppe, et al. "Dynamo: amazon's highly available keyvaluestore." ACM SIGOPS Operating Systems Review. Vol. 41. No. 6.ACM, 2007.
  • 6Isard M, Budiu M, Yu Y, et al. "Dryad: distributed data-parallelprograms from sequential building blocks". ACM SIGOPS OperatingSystems Review, 2007, 41(3): 59-72.
  • 7Shvachko, Konstantin, et al. "The hadoop distributed file system."Mass Storage Systems and Technologies (MSST), 2010 IEEE 26thSymposium on. IEEE, 2010.
  • 8贾文珏,安琼.基于“分治网格”的空间大数据快速分析方法[J].计算机工程与设计,2015,36(8):2317-2320. 被引量:6
  • 9吕雪锋,程承旗,席福彪.地理空间大数据存储管理的地理网络地址研究[J].地理与地理信息科学,2015,31(1):1-5. 被引量:7

二级参考文献19

  • 1程承旗,任伏虎,濮国梁,等.空间信息剖分组织导论[M].北京:科学出版社,2012.
  • 2LECLERC Y, REDDY M, IVERSON L, et al. The GeoWeb-A New Paradigm for Finding Data on the Web[C]. Proceedings of the International Cartographic Conference (ICC2001), Bei- jing, 2001.
  • 3LECLERC Y,REDDY M, ERIKSEN M,et al. SRI's Digital Earth Project[R]. Technical Report No. 560, Artificial Intelligence Center, SRI International, Menlo Park, CA. 1,2002.
  • 4Tong D, Murray AT. Spatial optimization in geography [J]. Annals o{ the Association of American Geographers, 2012, 10g (6): 1290- 1309.
  • 5Ghemawat S, Gobioff H, Leung SI\ The Google file system [J]. ACM SIGOPS Operating Systems Review, g003, 37 (5) : 29-43.
  • 6Chang F, Dean J, Ghemawat S, et al. Bigtable: A distribu- ted storage system for structured data [J]. A('M Transactions on Computer Systems, 2008, 26 (2): 4-5.
  • 7Melnik S, Gubarev A, I.ong JJ, et al. I)remel: Interactive analysis of web-scale datasets [J]. Proceedings of the VI.DB Endowment, 2010, 3 (1-2).. 330-339.
  • 8Isard M, Budiu M, Yu Y, et al. Dryad: Distributed data- parallel programs from sequential building blocks J]. ACM SIGOPS Operating Systems Review, 2007, 41 (3): 59-72.
  • 9Beaver Doug. Finding a needle in haystack: Facebook's Photo Storage [C] //OSDI, 2010.
  • 10DeCandia Giuseppe. Dynamo: Amazon's highly available key value store [J]. ACM SIGOPS Operating Systems Review, 2007, 41 (6): 205 220.

共引文献11

同被引文献28

引证文献4

二级引证文献38

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部