大数据时代的数据传输网

孙卫强; ，胡卫生

doi:10.11959/j.issn.2096-0271.2015019

您当前的位置：

首页 >

文章列表页 >

大数据时代的数据传输网

研究 | 更新时间：2024-06-05

- 大数据时代的数据传输网
- Networking Challenges in the Big Data Era
- 大数据 2015年1卷第2期页码：2015019
- 作者机构：
- 作者简介：
  
  [ "孙卫强，男，博士，上海交通大学教授、博士生导师，主要研究方向为大数据网络、信息通信网、网络优化、网络性能评估等。" ]
  [ "胡卫生，男，博士，上海交通大学教授、博士生导师，国家杰出青年基金获得者，主要研究方向为下一代光接入网、光交换、光网络等。" ]
- 基金信息：
- DOI：10.11959/j.issn.2096-0271.2015019
  中图分类号：
- 网络首发：2015-07，
  
  纸质出版：2015-07-20
- 稿件说明：
移动端阅览
孙卫强, ，胡卫生. 大数据时代的数据传输网[J]. 大数据, 2015,1(2):2015019.

Weiqiang Sun, Weisheng Hu. Networking Challenges in the Big Data Era[J]. BIG DATA RESEARCH, 2015, 1(2): 2015019.
孙卫强, ，胡卫生. 大数据时代的数据传输网[J]. 大数据, 2015,1(2):2015019. DOI： 10.11959/j.issn.2096-0271.2015019.

Weiqiang Sun, Weisheng Hu. Networking Challenges in the Big Data Era[J]. BIG DATA RESEARCH, 2015, 1(2): 2015019. DOI： 10.11959/j.issn.2096-0271.2015019.

摘要

大数据时代数据传输需求呈爆炸式增长，如何充分利用数据流的新特征，发挥不同交换方式的优势，是解决未来大数据传输的必由之路。为此，介绍了大数据传输在容量和能耗方面的挑战，并结合数据流的新特征，分析网络技术发展的新机遇。然后，回顾了近几年相关领域的研究进展，并简要介绍了笔者在混合交换和存储转发等方面正在开展的研究工作。

Abstract

Explosive growth of traffic demand both inside and between data centers has resulted in a new wave of cutting edge research in the networking community.Inter-and Intra-data center research problems were identified and various solutions aiming to reduce networking cost or increase energy efficiency have been investigated.The growth in traffic demand in the big data era was accompanied by distinct characteristics in flow size distribution and delay tolerance.Data volume was dominated by large flows that are very few in number

and such flows are typically delay tolerant.How these characteristics may be used to tackle the challenge was discussed

followed by our recent work in big data transmission.The BLOC (blocking loss curve) framework aims to provide a framework with which hybrid switching systems combining packet and circuit switching can be studied.The time-shifted multi-layer graph is a generic tool that can be used to analyze the performance of circuit switched networks with bulk storage.

关键词

Keywords

references

邬贺铨 . 大数据时代的机遇与挑战 . 求是 , 2013 ( 4 )

Wu H Q . Opportunities and challenges in the era of big data . Qiushi , 2013 ( 4 )

Robinson S , Ferguson R . The storage and transfer challenges of big data . MIT SloanManagement Review , 7 June , 2012

Greenberg A , Hamilton J , Maltz D A , et al . The cost of a cloud:research problems in data center networks . ACM SIGCOMM Computer Communication Review , 2009 , 39 ( 1 ): 68 ～ 73

李国杰程学旗 . 大数据研究:未来科技及经济发展的重大战略领域 . 中国科学院院刊 , 2012 , 27 ( 6 ): 647 ～ 657

Li G J , Cheng X Q . Research status and scientific thinking of big data . Bulletin of Chinese Academy of Sciences , 2012 , 27 ( 6 ): 647 ～ 657

Pollack A . DNA sequencing caught in deluge of data . The New York Times , 12 August , 2011

Heller B , Seetharaman S , Mahadevan P , et al . ElasticTree:saving energy in data center networks . Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation (NSDI) , San Jose,USA , 2010

Koomey J . Growth in Data Center Electricity Use 2005 to 2010 . Oakland : Analytics Press , 2011

Davis A , Jouppi N P , Mclaren M , et al . The role of photonics in future datacenter networks . Optical Interconnects for Future Data Center Networks , 2013 : 67 ～ 93

Chen Y , Jain S , Adhikari V K , et al . A first look at inter-data center traffic characteristics via yahoo! datasets . Proceedings of IEEE INFOCOM , Shanghai,China , 2011 : 1620 ～ 1628

Briscoe B . A fairer,faster internet . IEEE Spectrum , 2008 , 45 ( 12 ): 42 ～ 47

Laoutaris N , Smaragdakis G , Stanojevic R , et al . Delay-tolerant bulk data transfers on the Internet . IEEE/ACM Transactions on Networking , 2013 , 21 ( 6 ): 1852 ～ 1865

Laoutaris N , Sirivianos M , Yang X , et al . Inter-datacenter bulk transfers with netstitcher . ACM SIGCOMM Computer Communication Review , 2011 , 41 ( 4 ): 74 ～ 85

Mahimkar A , Chiu A , Doverspike , et al . Bandwidth on demand for inter-data center communication . Proceedings of the 10th ACM Workshop on Hot Topics in Networks (Hotnets 2011) , New York,NY,USA , 2011

Feng Y , Li B , Li B . Postcard:minimizing costs on inter-datacenter traffic with store-and-forward . Proceedings of the 32nd International Conference on Distributed Computing Systems Workshops (ICDCSW) , Macau,China , 2012

Handley M . Network neutrality and the IETF . Plenary Presentation on IETF , 2009 : 3 ～ 4

Liou C . Next-generation inter-data center networking,special symposia 2:next generation data centres - paving the way for the Zettabyte era . Proceedings of European Conference and Exhibition on Optical Communication (ECOC) , London,UK , 2013

Fernández-Palacios J P , Perez L , Rodriguez J , et al . IP off-loading over multi-granular photonic switching technologies . Proceedings of European Conference and Exhibition on Optical Communication (ECOC)2010 , Torino,Italy , 2010

Xin C S , Qiao C M , Ye Y H . A hybrid optical switching approach . Proceedings of Global Telecommunications Conference , San Francisco,USA , 2003 : 3808 ～ 3812

Lee G M , Wydrowski B , Zukerman M , et al . Performance evaluation of an optical hybrid switching system . Proceedings of Global Telecommunications Conference , San Francisco,USA , 2003 : 2508 ～ 2512

Vu H L , Zalesky A , Wong E W M , et al . Scalable performance evaluation of a hybrid optical switch . IEEE/OSA Journal of Lightwave Technology , 2005 , 23 ( 10 ): 2961 ～ 2973

De Leenheer M , Develder C , Vermeir J , et al . Performance analysis of a hybrid optical switch . Proceedings of International Conference on Optical Network Design and Modeling,Vilanova i la Geltru ， Spain , 2008

Veisllari R , Bjornstad S , Bozorgebrahimi K . Integrated packet/circuit hybrid network field-trial , Proceedings of Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference (OFC/NFOEC) , Anaheim,CA,USA , 2013

Wang G , Andersen D G , Kaminsky M , et al . c-Through:part-time optics in data centers . Proceedings of the ACM SIGCOMM , New Delhi,India , 2010

Singla A , Singh A , Ramachandran K , et al . Proteus:a topology malleable data center network . Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks , Monterey,CA , 2010

Farrington N , Porter G , Radhakrishnan S , et al . Helios:a hybrid electrical/optical switch architecture for modular data centers . ACM SIGCOMM Computer Communication Review , 2011 , 41 ( 4 ): 339 ～ 350

Bazzaz H , Tewari M , Wang G , et al . Switching the optical divide:fundamental challenges for hybrid electrical/optical datacenter networks . Proceedings of the 2nd ACM Symposium on Cloud Computing , New York,NY,USA , 2011

Kachris C , Tomkos I . A survey on optical interconnects for data centers . IEEE Communications Surveys ＆ Tutorials , 2012 , 14 ( 4 ): 1021 ～ 1036

Sun W Q , Li P Q , Li C . Seamlessly transformable hybrid packet and circuit switching for efficient optical networks . Chinese Optics Letters , 2013 , 11 ( 1 )

Miyazawa T , Furukawa H , Fujikawa K , et al . Development of an autonomous distributed control system for optical packet and circuit integrated networks . Journal of Optical Communications and Networking , 2012 , 4 ( 1 )

Vadrevu C S K , Tornatore M , Guok C P , et al . Vertical and horizontal circuit/packet integration techniques for the future optical internet . IEEE Network , 2013 , 27 ( 1 ): 52 ～ 58

Milton M , Hadi A . Deep packet inspection and bandwidth management:battles over BitTorrent in Canada and the United States . Telecommunications Policy , 2012 , 36 ( 6 ): 462 ～ 475

Breitgand D , Raz D , Shavitt Y . The traveling miser problem . IEEE/ACM Transactions on Networking , 2006 , 14 ( 4 ): 711 ～ 724

Chen B B , Primet P . Scheduling deadline-constrained bulk data transfers to minimize network congestion . Proceedings of IEEE/ACM International Symposium on Cluster,Cloud,and Grid Cpmputing , Rio,Brazil , 2007

Agapi A , Soudan S , Pasin M , et al . Optimizing deadline-driven bulk data transfers in overlay networks . Proceedings of the 18th Internatonal Conference on Computer Communications and Networks , San Francisco,CA,USA , 2009

Li R , Eryilmaz A . Scheduling for end-to-end deadline-constrained traffic with reliability requirements in multihop networks . IEEE/ACM Transactions on Networking , 2012 , 20 ( 5 ): 1649 ～ 1662

Miyagi H , Hayashitani M , Ishii D , et al . Advanced wavelength reservation method based on deadline-aware scheduling for lambda grid networks . IEEE/OSA Journal of Lightwave Technology , 2007 , 25 ( 10 ): 2904 ～ 2910

Andrei D , Tornatore M , Batayneh M , et al . Provisioning of deadline-driven requests with flexible transmission rates in WDM mesh networks . IEEE/ACM Transactions on Networking , 2010 , 18 ( 2 ): 353 ～ 366

Morell J A . Adaptive resizing of deadline-driven requests for provisioning traffic in elastic optical networks (master dissertation) . Miami University , 2013

Sara R , Agarwal A . SDN approach to largescale global data centers . Proceedings of Open Networking Summit , Santa Clara,California,USA , 2012

Mckeown N , Anderson T , Balakrishnan H , et al . OpenFlow:enabling innovation in campus networks . ACM SIGCOMM Computer Communication Review , 2008 , 38 ( 2 ): 69 ～ 74

Das S , Parulkar G , Mckeown N , et al . Packet and circuit network convergence with OpenFlow . Proceedings of Optical Fiber Communication,Collocated National Fiber Optic Engineers Conference , San Diego,CA,USA , 2010

Yang H , Zhao Y L , Zhang J , et al . Multi-stratum resource integration for OpenFlow-based data center interconnect . IEEE/OSA Journal of Optical Communications and Networking , 2013 , 5 ( 10 ): A240 ～ A248

浏览量

713

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

长短期记忆网络在虚拟电厂数据中心的应用

“东数西算”背景下数据中心碳减排效益分析

SKA数据中心云平台方案的概念性研究