Multisource heterogeneous big data processing architecture in smart city

Yan LIU; Hua WANG; Yeyang QIN; Xingjie ZHU

doi:10.11959/j.issn.2096-0271.2017007

您当前的位置：

首页 >

文章列表页 >

Multisource heterogeneous big data processing architecture in smart city

STUDY | 更新时间：2024-06-03

- Multisource heterogeneous big data processing architecture in smart city
- Big data research Vol. 3, Issue 1, Pages: 2017007(2017)
- 作者机构：
  
  1. 泰康保险集团股份有限公司数据信息中心，北京 102206
  2. 中国人民大学，北京 100872
  3. 北京大学，北京 100871
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-0271.2017007
  CLC： TP391
- Online First：2017-01，
  
  Published：20 January 2017
- 稿件说明：
移动端阅览
Yan LIU, Hua WANG, Yeyang QIN, et al. Multisource heterogeneous big data processing architecture in smart city[J]. Big data research, 2017, 3(1): 2017007.
DOI：

Yan LIU, Hua WANG, Yeyang QIN, et al. Multisource heterogeneous big data processing architecture in smart city[J]. Big data research, 2017, 3(1): 2017007. DOI： 10.11959/j.issn.2096-0271.2017007.

摘要

智慧城市建设的重心已由传统IT系统和信息资源共享建设，转变为数据的深度挖掘利用和数据资产的运营流通。大数据中心是数据资产管理和利用的实体基础，其核心驱动引擎是大数据平台及各类数据挖掘与分析系统。讨论了智慧城市大数据中心建设的功能架构，围绕城市多源异构数据处理的实际需要，对数据中心大数据平台的架构进行了拆分讲解，并以视频大数据处理为例，阐述了数据中心中大数据平台的运转流程。

Abstract

The focus of smart city construction has been transferred from the tradition IT systems and sharing of information resources construction into the data mining operations and the flow of data assets.Big data center is the physical infrastructure of data assets management and utilization.Its core driver includes big data platform and kinds of data mining and analysis systems.The functional architecture of big data center in smart cities was discussed.And around the actual needs of urban multisource heterogeneous data processing

the structure of the big data platform used by parts was explained.Then taking the video processing as an example

the working flow of big data platform in the big data center was described.

关键词

Keywords

references

程学旗 , 靳小龙 , 王元卓 , 等 . 大数据系统和分析技术综述 [J ] . 软件学报 , 2014 , 25 ( 9 ): 1889 - 1908 .

CHENG X Q , JIN X L , WANG Y Z , et al . Survey on big data system and analytic technology [J ] . Journal of Software , 2014 , 25 ( 9 ): 1889 - 1908 .

石宇 , 詹明 , 尹璐 , 等 . 面向对象的多源异构数据关联组织与分析 [J ] . 测绘通报 , 2015 ( 1 ): 102 - 104 .

SHI Y , ZHAN M , YIN L , et al . Research on associated orgabization and analysis of target-oriented multi-source heterogeneous data [J ] . Bulletin of Surveying and Mapping , 2015 ( 1 ): 102 - 104 .

GHEMAWAT S , GOBIOFF H , LEUNG S . File and storage systems:the Google file system [J ] . ACM Sigops Operating Systems Review , 2003 , 37 ( 5 ): 29 - 43 .

HE H , DU Z , ZHANG W , et al . Optimization strategy of Hadoop small file storage for big data in healthcare [J ] . Journal of Supercomputing , 2015 , 72 ( 10 ): 1 - 12 .

DEAN J , GHEMAWAT S . MapReduce:simplified data processing on large clusters [J ] . Communications of the ACM , 2008 , 51 ( 1 ): 107 - 113 .

孙大为 , 张广艳 , 郑纬民 . 大数据流式计算:关键技术及系统分析 [J ] . 软件学报 , 2014 , 25 ( 4 ): 839 - 862 .

SUN D L , ZHANG G Y , ZHENG W M . Big data stream computing:technologies and instances [J ] . Journal of Software , 2014 , 25 ( 4 ): 839 - 862 .

齐开元 , 赵卓峰 . 针对高速数据流的大规模数据实时处理方法 [J ] . 计算机学报 , 2012 , 35 ( 3 ): 477 - 490 .

QI K Y , ZHAO Z F . Real-time processing for high speed data stream over large scale data [J ] . Chinese Journal of Computers , 2012 , 35 ( 3 ): 477 - 490 .

DING S H , LI G , LI Y , et al . SurvSurf:human retrieval on large surveillance video data [J ] . Multimedia Tools ＆ Applications , 2016 ( 1 ): 1 - 29 .

ZHU H D , SHEN Z , SHANG L , et al . Parallel image texture feature extraction under Hadoop cloud platform [J ] . Springer International Publishing , 2014 ( 8588 ): 459 - 465 .

Views

2039

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Opportunities and challenges of geo-spatial information science from the perspective of big data

Big data open platform and industrial ecology construction for smart city

Big data analysis and knowledge discovery for smart city development enhancement

Driving reforms of smart city by big data as the core

A scalable parallel sorting algorithm by regular sampling for big data

Related Author

Deren LI

Guo ZHANG

Yonghua JIANG

Xin SHEN

Weiling LIU

Aobing SUN

Tongkai JI

Cong CHEN

Related Institution

School of Remote Sensing and Information Engineering, Wuhan University

State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University

The Cloud Computing Center,Chinese Academy of Sciences

Cloud Science and Technology Limited Company,Dongguan

Department of Civil Engineering,University of New Mexico,,New Mexico

Postal code：100079
Tel：（010）53879208、53859533 Email：bdr@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：273427 Visits Today：333

⁰