大数据价值期望探讨

王崇骏

doi:10.11959/j.issn.2096-0271.2017045

您当前的位置：

首页 >

文章列表页 >

大数据价值期望探讨

论坛 | 更新时间：2024-06-03

- 大数据价值期望探讨
- Discussions of the value expectations of big data
- 大数据 2017年3卷第4期页码：91-103
- 作者机构：
- 作者简介：
  
  [ "王崇骏（1975-），男，博士，南京大学计算机科学与技术系及软件新技术国家重点实验室教授、博士生导师，主要研究方向为自主Agent及多Agent系统、复杂网络理论及应用、大数据分析及智能系统。截至2016年底，主持和参与包括“973”项目、国家发展和改革委员会专项、工业和信息化部产业化基金、国家自然科学基金、国家社会科学基金、省自然科学基金及支撑计划在内的国家及省部级基金与企事业资助项目50余项。在教育医疗类惠民行业、优政兴业类政府领域、互联网新经济领域有30余项科研成果获得产品化和商品化推广。" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61375069);国家自然科学基金资助项目;The National Natural Science Foundation of China(61403156);科技部重点研发基金资助项目;The National Key Research and Development Program of China(2016YFB1001102)
- DOI：10.11959/j.issn.2096-0271.2017045
  中图分类号： TP391
- 网络首发：2017-07，
  
  纸质出版：2017-07-20
- 稿件说明：
移动端阅览
王崇骏. 大数据价值期望探讨[J]. 大数据, 2017,3(4):91-103.

Chongjun WANG. Discussions of the value expectations of big data[J]. Big data research, 2017, 3(4): 91-103.
王崇骏. 大数据价值期望探讨[J]. 大数据, 2017,3(4):91-103. DOI： 10.11959/j.issn.2096-0271.2017045.

Chongjun WANG. Discussions of the value expectations of big data[J]. Big data research, 2017, 3(4): 91-103. DOI： 10.11959/j.issn.2096-0271.2017045.

摘要

各边利益主体对大数据价值的共同期盼，引发了社会各界对大数据的普遍关注。不同利益主体的自有利益使然，各边的价值期望是不同的，但这些迥异的价值期望恰恰都是大数据价值实现的目标。尝试从大数据的多边定义和理解出发，梳理不同研究视角的相关研究以及不同利益角色的价值期望，介绍了相关研究及产业化现状，并给出了实践可行的方法、思路和策略。

Abstract

People from all social circles are concerned about the big data

because all of them think that big data is valuable.However

different people have different value expectation

all of which are the goals when implementing big data project.Multiple kinds of definitions and understandings of big data were attempted to indicate

and then different research perspectives and different value expectations from different people were introduced.Furthermore

some practical and feasible methods

ideas and strategies were given after briefly expressing the relevant research status and industrialization status.

关键词

Keywords

references

王崇骏 . 大数据思维与应用攻略 [M ] . 北京 : 机械工业出版社 , 2016 .

WANG C J . Big data thinking and application raiders [M ] . Beijing : China Machine Press , 2016 .

SCARDAMALIA M , BEREITE C . Computer support for knowledge-building communities [J ] . Journal of the Learning Sciences , 1994 , 3 ( 3 ): 265 - 283 .

李国杰 , 程学旗 . 大数据研究:未来科技及经济社会发展的重大战略领域 [J ] . 中国科学院院刊 , 2012 ( 6 ): 647 - 657 .

LI G J , CHENG X Q . Research status and scientific thinking of big data [J ] . Bulletin of the Chinese Academy of Sciences , 2012 ( 6 ): 647 - 657 .

维克托·迈尔·舍恩伯 , 肯尼思·库克耶 . 大数据时代:生活、工作与思维的大变革 [M ] . 盛杨燕 , 周涛 ,译. 杭州 : 浙江人民出版社 , 2013 .

MAYER-SCHÖNBERGER V , CUKIER K . Big data:a revolution that will transform how we live,work and think [M ] . Translated by SHENG Y Y,ZHOU T . Hangzhou : Zhejiang People’s Publishing House , 2013 .

郭华东 , 王力哲 , 陈方 , 等 . 科学大数据与数字地球 [J ] . 科学通报 , 2014 ( 12 ): 1047 - 1054 .

GUO H D , WANG L Z , CHEN F , et al . Scientific big data and digital earth [J ] . Chinese Science Bulletin , 2014 ( 12 ): 1047 - 1054 .

陈刚 . 科学研究大数据挑战 [J ] . 科学通报 , 2015 ( 5 ): 439 - 444 .

CHEN G . Challenges of big data in science researches [J ] . Chinese Science Bulletin , 2015 ( 5 ): 439 - 444 .

刘言 , 蔡文生 , 邵学广 . 大数据与化学数据挖掘 [J ] . 科学通报 , 2015 ( 8 ): 694 - 703 .

LIU Y , CAI W S , SHAO X G . Big data and chemical data mining [J ] . Chinese Science Bulletin , 2015 ( 8 ): 694 - 703 .

KAISLER S , ARMOUR F , ESPINOSA J A , et al . Big data:issues and challenges moving forward [C ] // 46th Hawaii International Conference on System Sciences (HICSS),Jan 7-10,2013,Wailea,Maui,HI,USA . New Jersey:IEEE Press , 2013 : 995 - 1004 .

JIN X , WAH B W , CHENG X , et al . Significance and challenges of big data research [J ] . Big Data Research , 2015 , 2 ( 2 ): 59 - 64 .

WANG H , XU Z , FUJITA H , et al . Towards felicitous decision making:an overview on challenges and trends of big data [J ] . Information Sciences , 2016 ( s367 ): 747 - 765 .

李学龙 , 龚海刚 . 大数据系统综述 [J ] . 中国科学:信息科学 , 2015 , 45 ( 1 ): 1 - 44 .

LI X L , GONG H G . Summary on big data system [J ] . SCIENTIA SINICA Informationis , 2015 , 45 ( 1 ): 1 - 44 .

程学旗 , 靳小龙 , 王元卓 , 等 . 大数据系统和分析技术综述 [J ] . 软件学报 , 2014 , 25 ( 9 ): 1889 - 1908 .

CHENG X Q , JIN X L , WANG Y Z , et al . Survey on big data system and analytic technology [J ] . Journal of Software , 2014 , 25 ( 9 ): 1889 - 1908 .

HUANG S J , CHEN S , ZHOU Z H . Multilabel active learning:query type matters [C ] // 24th International Conference on Artificial Intelligence,July 25-31,2015,Buenos Aires,Argentina . New York:ACM Press , 2015 : 946 - 952 .

ZHU Y , GAO W , ZHOU Z H . Onepass multi-view learning [C ] // 7th Asian Conference on Machine Learning,November 20-22,2015,Hong Kong,China . New York:ACM Press , 2015 : 407 - 422 .

HUANG S J , CHEN S , ZHOU Z H . Multi-label active learning:query type matters [C ] // 24th International Conference on Artificial Intelligence,July 25-31,2015,Kyoto,Japan . New York:ACM Press , 2015 : 946 - 952 .

ZHOU Z H . Ensemble learning [M ] . Beijing : Tsinghua University Press , 2015 : 411 - 416 .

ZHANG M L , ZHOU Z H . A review on multi-label learning algorithms [J ] . IEEE Transactions on Knowledge and Data Engineering , 2014 , 26 ( 8 ): 1819 - 1837 .

NGUYEN C T , WANG X L , LIU J , et al . Labeling complicated objects:multi-view multi-instance multi-label learning [C ] // 28th AAAI Conference on Artificial Intelligence,July 27-31,2014,Québec City,Québec,Canada . New York:ACM Press , 2014 : 2013 - 2019 .

WEI X S , WU J , ZHOU Z H . Scalable algorithms for multi-instance learning [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2017 , 28 ( 4 ): 975 - 987 .

ZHU Y , TING K M , ZHOU Z H . Discover multiple novel labels in multi-instance multi-label learning [C ] // 31st AAAI Conference on Artificial Intelligence,February 4-9,2017,San Francisco,USA .[S.l.:s.n. ] , 2017 : 2977 - 2984

WEI X S , WU J , ZHOU Z H . Scalable multi-instance learning [C ] // IEEE International Conference on Data Mining,Dec 14-17,2014,Québec,Canada . New Jersey:IEEE Press , 2014 : 1037 - 1042 .

STEWART R , ERMON S . Label-free supervision of neural networks with physics and domain knowledge [C ] // 31st AAAI Conference on Artificial Intelligence,February 4-9,2017,San Francisco,USA .[S.l.:s.n. ] , 2017 : 2576 - 2582 .

JOUPPI N P , YOUNG C , PATIL N , et al . In-datacenter performance analysis of a tensor processing unit [C ] // 44th Annual International Symposium on Computer Architecture,June 24 - 28,2017,Toronto,Canada . New York:ACM Press , 2017 : 1 - 12 .

SAYAR A . Hadoop optimization for massive image processing:case study face detection [J ] . International Journal of Computers Communications ＆ Control , 2014 , 9 ( 6 ): 664 - 671 .

GU R , WANG S , WANG F , et al . Cichlid:efficient large scale RDFS/OWL reasoning with spark [C ] // 2015 IEEE International Parallel and Distributed Processing Symposium,May 25-29,2015,Orlando,USA . Washington,DC:IEEE Computer Society , 2015 : 700 - 709 .

GU R , YANG X , YAN J , et al . SHadoop:improving MapReduce performance by optimizing job execution mechanism in Hadoop clusters [J ] . Journal of Parallel and Distributed Computing , 2014 , 74 ( 3 ): 2166 - 2179 .

顾荣 , 严金双 , 杨晓亮 , 等 . Hadoop MapReduce短作业执行性能优化 [J ] . 计算机研究与发展 , 2014 , 51 ( 6 ): 1270 - 1280 .

GU R , YAN J S , YANG X L , et al . Performance optimization for short job execution in Hadoop MapReduce [J ] . Journal of Computer Research and Development , 2014 , 51 ( 6 ): 1270 - 1280 .

YANG M , MA R T B . Smooth task migration in Apache storm [C ] // 2015 ACM SIGMOD International Conference on Management of Data,May 31-June 4,2015,Melbourne,Australia . New York:ACM Press , 2015 : 2067 - 2068 .

ARMBRUST M , DAS T , DAVIDSON A , et al . Scaling spark in the real world:performance and usability [J ] . Proceedings of the VLDB Endowment , 2015 , 8 ( 12 ): 1840 - 1843 .

ARMBRUST M , XIN R S , LIAN C , et al . Spark sql:relational data processing in spark [C ] // 2015 ACM SIGMOD International Conference on Management of Data,May 31-June 4,2015,Melbourne,Australia . New York:ACM Press , 2015 : 1383 - 1394 .

VAN DER VEEN J S , VAN DER WAAIJ B , LAZOVIK E , et al . Dynamically scaling apache storm for the analysis of streaming data [C ] // 1st International Conference on Big Data Computing Service and Applications,March 30-April 2,2015,San Francisco,USA . New Jersey:IEEE Press , 2015 : 154 - 161 .

SCHAEFER C , MANOJ P M . Enabling privacy mechanisms in apache storm [C ] // 1st International Conference on Big Data Computing Service and Applications,March 30-April 2,2015,San Francisco,USA . New Jersey:IEEE Press , 2015 : 102 - 109 .

BOSAGH ZADEH R , MENG X , ULANOV A , et al . Matrix computations and optimization in apache spark [C ] // 2016 ACM SIGKDD Knowledge Discovery and Data Mining (SIGKDD-16),August 13-17,2016,San Francisco,USA . New York:ACM Press , 2016 : 31 - 38 .

ARMBRUST M , XIN R S , LIAN C , et al . Spark sql:Relational data processing in spark [C ] // 2015 ACM SIGMOD International Conference on Management of Data,May 31-June 4,2015,Melbourne,Australia . New York:ACM Press , 2015 : 1383 - 1394 .

ZHAO S Y , XIANG R , SHI Y H , et al . SCOPE:scalable composite optimization for learning on spark [C ] // 31st AAAI Conference on Artificial Intelligence(AAAI-17),February 4-9,2017,San Francisco,USA .[S.l.:s.n. ] , 2017 : 2928 - 2934 .

中国电子信息产业发展研究院 . 2016中国大数据产业生态地图 [D ] . 北京:中国电子信息产业发展研究院 , 2016 .

China Center for Information Industry Development . 2016 Chinese big data industrial ecology map [D ] . Beijing:China Center for Information Industry Development , 2016 .

王叁寿 . 大数据商业应用场景 [M ] . 北京 : 机械工业出版社 , 2016 .

WANG S S . Big data commercial application scenarios [M ] . Beijing : China Machine PressPress , 2016 .

DEAN J , GHEMAWAT S . MapReduce:simplified data processing on large clusters [J ] . Communications , 2008 , 51 ( 1 ): 107 - 113 .

GHEMAWAT S , GOBIOFF H , LEUNG S T . The Google file system [C ] // 19th ACM Symposium on Operating Systems Principles(SOSP-03),October 19-22,2003,Bolton Landing,USA . New York:ACM Press , 2003 , 37 ( 5 ): 29 - 43 .

CHANG F , DEAN J , GHEMAWAT S , et al . Bigtable:a distributed storage system for structured data [J ] . Transactions on Computer Systems , 2006 , 26 ( 2 ): 4 .

SHVACHKO K , KUANG H , RADIA S , et al . The Hadoop distributed file system [C ] // IEEE 26th Symposium on Mass Storage Systems and Technologies(MSST-10),May 3-7,2010,Nevada,USA . New Jersey:IEEE Press , 2010 : 1 - 10 .

BORTHAKUR D . The Hadoop distributed file system:architecture and design [J ] . Hadoop Project Website , 2007 , 11 ( 11 ): 1 - 10 .

雷军 , 叶航军 , 武泽胜 , 等 . 基于开源生态系统的大数据平台研究 [J ] . 计算机研究与发展 , 2017 , 54 ( 1 ): 80 - 93 .

LEI J , YE H J , WU Z S , et al . Big data platform based on open source ecosystem [J ] . Journal of Computer Research and Development , 2017 , 54 ( 1 ): 80 - 93 .

唐斯斯 , 刘叶婷 . 我国大数据交易亟待突破 [J ] . 中国发展观察 , 2016 ( 13 ): 19 - 21 .

TANG S S , LIU Y T . Chinese big data transactions need to break through [J ] . China Development Observation , 2016 ( 13 ): 19 - 21 .

GOLDBERG A V , HARTLINE J D , WRIGHT A . Competitive auctions and digital goods [C ] // ACM-SIAM Symposium on Discrete Algorithms(SODA-10),January 17-19,2010,Austin,USA .[S.l.:s.n. ] , 2001 : 735 - 744 .

GOLDBERG A V , HARTLINE J D , KARLIN A R , et al . Competitive auctions [J ] . Games and Economic Behavior , 2006 , 55 ( 2 ): 242 - 269 .

CHEN N , GRAVIN N , LU P . Optimal competitive auctions [C ] // 46th Annual ACM Symposium on Theory of Computing(STOC-14),May 31-June 3,2014,New York,USA .[S.l.:s.n. ] , 2014 : 253 - 262 .

LAVI R , NISAN N . Competitive analysis of incentive compatible on-line auctions [J ] . Theoretical Computer Science , 2000 , 310 ( 1 ): 159 - 180 .

LAVI R , NISAN N . Online ascending auctions for gradually expiring items [C ] // 6th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA-05),January 23-25,2005,Vancouver,Canada . Philadelphia:Society for Industrial and Applied Mathematics , 2005 : 1146 - 1155 .

FRIEDMAN E J , PARKES D C . Pricing wifi at starbucks:issues in online mechanism design [C ] // 4th ACM Conference on Electronic Commerce(EC-03),June 9 - 12,2003,San Diego,CA,USA . New York:ACM Press , 2003 : 240 - 241 .

MASHAYEKHY L , NEJAD M M , GROSU D , et al . An online mechanism for resource allocation and pricing in clouds [J ] . IEEE Transactions on Computers , 2016 , 65 ( 4 ): 1172 - 1184 .

MYERSON R B . Optimal auction design [J ] . Mathematics of Operations Research , 1981 , 6 ( 1 ): 58 - 73 .

唐平中 . 计算经济学与最优机制设计问题 [J ] . 中国计算机学会通讯 , 2013 , 9 ( 10 ): 18 - 23 .

TANG P Z . Computational economics and optimal mechanism design [J ] . Communications of the CCF , 2013 , 9 ( 10 ): 18 - 23 .

SUN J , QU H , CHAKRABARTI D , et al . Neighborhood formation and anomaly detection in bipartite graphs [C ] // 5th IEEE International Conference on Data Mining(ICDM-05),Nov 27-30,2005,Houston,TX,USA . New Jersey:IEEE Press , 2005 : 1 - 8 .

RAZ O , KOOPMAN P , SHAW M . Semantic anomaly detection in online data sources [C ] // 24rd International Conference on Software Engineering(ICSE-02),May 25,2002,Orlando,USA . New Jersey:IEEE Press , 2002 : 302 - 312 .

汤琪 . 大数据交易中的产权问题研究 [J ] . 图书与情报 , 2016 ( 4 ): 38 - 45 .

TANG Q . Study on the property right issues in big data trade [J ] . Library and Information , 2016 ( 4 ): 38 - 45 .

REICHMAN J H , SAMUELSON P . Intellectual property rights in data [J ] . Vanderbilt Law Review , 1997 , 50 ( 4 ): 337 - 348 .

浏览量

583

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

“数据科学”课程群与“数据科学导论”课程建设初探

大数据的若干基础研究方向

数据科学人才的需求与培养

大数据时代的数据科学家培养

面向大数据的可扩展正则采样并行排序算法