Big Data and OLAP Systems

Xiaoyong Du; Yueguo Chen; Xiongpai Qin

doi:10.11959/j.issn.2096-0271.2015.01.005

您当前的位置：

首页 >

文章列表页 >

Big Data and OLAP Systems

Topic:Key technologies of big data | 更新时间：2024-06-03

- Big Data and OLAP Systems
- BIG DATA RESEARCH Vol. 1, Issue 1, Pages: 46-58(2015)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-0271.2015.01.005
  CLC：
- Online First：2015-05，
  
  Published：20 May 2015
- 稿件说明：
移动端阅览
Xiaoyong Du, Yueguo Chen, Xiongpai Qin. Big Data and OLAP Systems[J]. BIG DATA RESEARCH, 2015, 1(1): 46-58.
DOI：

Xiaoyong Du, Yueguo Chen, Xiongpai Qin. Big Data and OLAP Systems[J]. BIG DATA RESEARCH, 2015, 1(1): 46-58. DOI： 10.11959/j.issn.2096-0271.2015.01.005.

摘要

OLAP（online analytical processing，在线联机分析处理）是关系数据基础上实现商业智能的核心技术。在大数据时代，人们迫切希望在由普通机器组成的大规模集群上能实现高性能的OLAP，然而系统性能的挑战巨大。可喜的是，近年来进展迅速，涌现了很多以Hadoop上的数据进行OLAP的所谓SQL on Hadoop系统，并且系统性能不断提升。在综述OLAP技术发展的基础上，重点对几个有代表性的SQL on Hadoop系统进行了测试分析，并展示了这类系统的性能特点。可以预见，未来在低成本的大数据OLAP市场，这类系统会占有重要位置。

Abstract

OLAP (online analytical processing) is a key technology of business intelligence based on relational data. In big data era

people want to achieve high performance OLAP using a large cluster of ordinary nodes. However

the performance of such systems is a big challenge. Recently

many SQL on Hadoop systems have been proposed to address this challenge. We have seen a significant performance improvement of such systems. A survey of technology development of OLAP technologies was first provided. Then

a study of the performance of three representatives SQL on Hadoop systems was focused on. Based on the results

it is expected that such systems will play an very important role in the market of low cost OLAP analysis.

关键词

Keywords

references

Codd E F , Codd S B , Salley C T . Providing OLAP (online analytical processing) to user-analysts: an IT mandate . E f codd &Associates , 1998

Thomsen E . OLAP Solutions: Building Multidimensional Information Systems2nd Edition . Hoboken: John Wiley & Sons , 2002

Daniel M S , Abadi D J , Batkin A , et al . C-store: a column-oriented DBMS . Proceedings of the 31st Very Large Data Bases (VLDB) Conference 2005 553 ～ 564 .

Kaufmann M , Manjili A A , Vagenas P , et al . Timeline index: a unified data structure for processing queries on temporal data in SAP HANA . Proceedings of Acm Special Interest Group on Management of Data (SIGMOD) International Conference on Management of Data ， New York, USA 2013 : 1173 ～ 1184 .

Dean J , Ghemawat S , Vagenas P , et al . MapReduce:simplified data processing on large clusters . Proceedings of Operating Systems Design and Implementation (OSDI) ， San Francisco, CA, USA 2004 137 ～ 150 .

Pavlo A , Paulson E , Rasin A , et al . A comparison of approaches to large-scale data analysis . Proceedings of the ACM Special Interest Group on Management of Data (SIGMOD) International Conference on Management of Data , Providence, USA , 2009 165 - 178 .

Chen Y G , Qin X P , Bian H Q , et al . A study of SQL-on-hadoop systems . Lecture Notes in Computer Science , 2014 ,( 8807 ): 154 - 166 .

Hive cost based optimization . https://cwiki.apache.org/confluence/display/Hive/Cost-based+optimization+in+Hive https://cwiki.apache.org/confluence/display/Hive/Cost-based+optimization+in+Hive 2015

Ion Stoica . http://ampcamp.berkeley.edu/wp-content/uploads/2013/02/Berkeley-Data-Analytics-Stack-BDAS-Overview-Ion-Stoica-Strata-2013.pdf http://ampcamp.berkeley.edu/wp-content/uploads/2013/02/Berkeley-Data-Analytics-Stack-BDAS-Overview-Ion-Stoica-Strata-2013.pdf 2013

Views

730

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

A scalable parallel sorting algorithm by regular sampling for big data

Gansu smart tourism system based on big data

Big data and computing models

Analysis and research on the strategy and problems of “Channel Computing Resources from the East to the West”

Digital transformation in higher education:a systematic review

Related Author

Ying WANG

Zhiguang CHEN

Yutong LU

Liang GUO

Yi YANG

Bingfeng QIN

Jianwen CAO

Min LI

Related Institution

School of Information Science and Engineering, Lanzhou University

Key Laboratory of Tourism Information Fusion Processing and Data Ownership Protection, Ministry of Culture and Tourism, Lanzhou University

Technology Information Department, Gansu Provincial Department of Culture and Tourism

School of Computer and Artificial Intelligence, Lanzhou Polytechnical College

Key Laboratory of Artificial Intelligence and Computing Power Technology

Postal code：100079
Tel：（010）53879208、53859533 Email：bdr@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：273651 Visits Today：557

⁰