登录 | 注册 | 退出 | 公司首页 | 繁体中文 | 满意度调查
综合馆
云计算环境下支持复杂查询的多维数据索引机制
  • 摘要

    针对云计算环境下分布式存储系统的数据索引不支持复杂查询的问题,提出了一种多维数据索引机制M-Index,采用金字塔技术(pyramid-technique)将数据的多维元数据描述成一维索引,在此基础上首次提出前缀二叉树(prefix binary tree,PBT)的概念,通过提取一维索引和PBT有效节点的前缀作为数据在存储系统中的主键.数据根据主键和一致性Hash机制发布到存储节点组成的覆盖网络.设计了基于M-Index的数据查询算法,将复杂查询请求转换成一维查询键值,有效支持多维查询和区间查询等复杂查询模式.理论分析和实验表明,M-Index在复杂查询模式下具有良好的查询效率和负载均衡.

  • 作者

    朱夏  罗军舟  宋爱波  东方  Zhu Xia  Luo Junzhou  Song Aibo  Dong Fang 

  • 作者单位

    东南大学计算机科学与工程学院 南京211189

  • 刊期

    2013年8期 ISTIC EI PKU

  • 关键词

    云计算  数据索引  多维查询  区间查询  一致性Hash  cloud computing  data indexing  multi-dimensional query  range query  consistent Hashing 

参考文献
  • [1] 王鹏,孟丹,詹剑锋,涂碧波. 数据密集型计算编程模型研究进展. 计算机研究与发展, 2010,11
  • [2] FAY CHANG;JEFFREY DEAN;SANJAY GHEMAWAT;WILSON C. HSIEH;DEBORAH A. WALLACH;MIKE BURROWS;TUSHAR CHANDRA;ANDREW FIKES;ROBERT E. GRUBER. Bigtable: A Distributed Storage System for Structured Data. ACM transactions on computer systems, 2008,2
  • [3] Mell P;Grance T. The NIST definition of cloud computing,SP800-145. Gaithersburg:National Institute of Standards and Technology, 2011
  • [4] Apache. HBase. http://hbase.apache.org/, 2011-12-20
  • [5] Cooper B;Ramakrishnan R;Srivastava U. PNUTS:Yahoo! 's hosted data serving platform. Proceedings of the VLDB Endowment, 2008,02
  • [6] Stoica I;Morris R;Karger D. Chord:A scalable peer-to-peer lookup service for Internet applications. New York:ACM, 2001
  • [7] Ratnasamy S;Francis P;Handley M. A scalable content addressable network. New York:ACM, 2001
  • [8] Zhao B;Kubiatowicz J;Joseph A. Tapestry:An infrastructure for fault-tolerant wide-area location and routing,CSD-01-1141. Berkeley:University of California at Berkeley, 2001
  • [9] Rowstron A;Druschel P. Pastry:Scalable,decentralized object location and routing for large-scale peer-to-peer systems. Beilin:Springer-Verlag, 2001
  • [10] Wang Jinbao;Wu Sai;Gao Hong. Indexing multidimensional data in a cloud system. New York:ACM, 2010
  • [11] Berchtold S;B(o)hm C;Kriegal H. The pyramid-technique:Towards breaking the curse of dimensionality. New York:ACM, 1998
  • [12] Stonebraker M. The case for shared nothing. IEEE Database Engineering Bulletin, 1986,01
  • [13] Ghemawat S;Gobioff H;Leung S. The google file system. New York:ACM, 2003
  • [14] Apache. Hadoop. http://hadoop.apache.org/, 2011-12-20
  • [15] DeCandia G;Hastorun D;Jampani M. Dynamo:Amazon's highly available key-value store. New York:ACM, 2007
  • [16] Lakshman A;Malik P. Cassandra:A decentralized structured storage system. ACM SIGOPS Operating Systems Review, 2010,02
  • [17] Karger D;Lehman E;Leighton T. Consistent hashing and random trees:distributed caching protocols for relieving hot spots on the World Wide Web. New York:ACM, 1997
查看更多︾
相似文献 查看更多>>
18.232.188.251