期刊文献+

基于Hadoop的大数据查询系统简述 被引量:5

A Brief Introduction Hadoop-based Big Data Query System
在线阅读 下载PDF
导出
摘要 近年来,随着计算机技术的迅猛发展,其领域迎来了大数据时代。随着大数据的出现,传统的关系型数据库已经不能满足高储存量的要求,此时成本低廉、有着良好并行性和伸缩性的云数据库应运而生,它采用键值对数据模型和分布式的计算环境。但是海量数据在Key-value数据库中的查询效率低下、实时性差等问题又普遍存在。为了解决查询效率低下这一问题,将多维数据模型和索引技术应用于Key-value数据库,将事实数据以多维的形式进行存储并在多维模型上建立索引以加快查询速度。论文将系统地描述多维数据模型的建立和索引技术的实现,最后简单地和主流Key-value数据库进行优缺点对比。 In recent years, with the rapid development of computer technology, its area ushers in the era of big data. With the emer- gence of big data, the traditional relational database connot meet the needs of high storage capacity when the low cost cloud database with good parallelism and scalability comes into being at the historic moment. It uses a Key-value data model and the distributed computing envi- ronment. But the problem that query of huge amounts of data in the Key-value database lacks efficiency and has bad real-time performance is universal. To solve low efficiency in query, this system applies multidimensional data model and the indexing technology to the Key-value da- tabase, storing fact data in forms of multidimensional data and indexing on the multidimensional model in order to speed up the query. The establishment of multidimensional data model and the implementation of indexing technology is systematically described. Finally the thesis briefly compares it to the mainstream Key-value database in terms of advantages and disadvantages.
出处 《计算机与数字工程》 2013年第12期1939-1942,共4页 Computer & Digital Engineering
关键词 大数据 Key-value数据库 多维模型 Z-ordering K—d TREE big data, Key-value database, multidimensional data model, Z-ordering, K-d tree
  • 相关文献

参考文献10

  • 1李奕.计算革命与数据价值[J].中国计算机报,2012(10).
  • 2王海波.云计算中数据库的关键问题研究与实现[D].吉林大学,2011.
  • 3Yongqiang He, Rubao Lee, Yin Huai. RCFile: A fast and space-efficient data placement structure in MapReduce~based warehouse systems. ICDE,2011:1199-1208.
  • 4Dhruba Borthakur. The Hac/oop Distributed File System[J]. Architecture and Design.
  • 5宋杰,侯泓颖,李丹程.MQM:一种用于Web服务查找的多维QoS模型[J].小型微型计算机系统,2011(3):1000-1220.
  • 6Apache HBase, a distributed, versioned, column-oriented da tabase built on top of Apache Hadoop and Apache ZooKeeper. Chapter 5. 5.
  • 7Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Bigtable: A Dis trihuted Storage System for Structured Data[J]. ACM Trans. Comput. Syst. (TOCS),2008,26(2).
  • 8Foley, James, Andries van Dam, Steven Feiner, John Hughes. Computer Graphics= Principle and Practice. Massa- chusetts : Addison-Wesley Publishing Company, 1987 : 870-871.
  • 9Andrew W. Moore. An introductory tutorial on kd-trees. Computer Laboratory[D]. London: University of Cambridge, 1991.
  • 10Shoji Nishimura, Sudipto Das, Divyakant Agrawal, et al. MDHBase: A Scalable Multi dimensional Data Infrastruc- ture for Location Aware Services [C]//IEEE International Conference on Mobile Data Management, 2011 (12).

共引文献1

同被引文献25

引证文献5

二级引证文献42

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部