Programming frameworks for deep learning algorithms

Bingrui WANG; Huiying LAN; Yunji CHEN

doi:10.11959/j.issn.2096-0271.2018040

您当前的位置：

首页 >

文章列表页 >

Programming frameworks for deep learning algorithms

TOPIC：SYSTEM ARCHITECTURE FOR BIG DATA-DRIVEN INTELLIGENT | 更新时间：2024-06-03

- Programming frameworks for deep learning algorithms
- Big Data Research Vol. 4, Issue 4, Pages: 2018040(2018)
- 作者机构：
  
  1. 中国科学技术大学，安徽合肥 230026
  2. 中国科学院计算技术研究所，北京 100190
  3. 中国科学院大学，北京 100049
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-0271.2018040
  CLC： F830
- Online First：2018-07，
  
  Published：15 July 2018
- 稿件说明：
移动端阅览
Bingrui WANG, Huiying LAN, Yunji CHEN. Programming frameworks for deep learning algorithms[J]. Big Data Research, 2018, 4(4): 2018040.
DOI：

Bingrui WANG, Huiying LAN, Yunji CHEN. Programming frameworks for deep learning algorithms[J]. Big Data Research, 2018, 4(4): 2018040. DOI： 10.11959/j.issn.2096-0271.2018040.

摘要

近年来，深度学习算法日益流行，在各种领域的应用都取得了出色的效果，受到工业界和学术界的广泛关注。越来越多的研究者开始利用深度学习算法解决实际问题（如图像分类、图像识别、语音识别、自然语言处理等）。人们提出了各种各样的深度学习编程框架，便于研究者们开发新的深度学习算法。这些深度学习库的设计原则、抽象层次各有不同。对常见的深度学习编程框架进行了分类介绍，针对深度学习编程框架设计中的关键问题进行了分析，并且对未来深度学习编程框架的发展方向做了展望，为以后深度学习编程框架的设计提供了设计思路和方向。

Abstract

In recent years

deep learning algorithms became increasingly pervasive.It has drew extensive attentions from both researchers and industries

as it achieves very promising results on many applications of various fields.More and more researchers began to use deep learning algorithms to solve practical problems (e.g.

image classification

image recognition

speech recognition

and natural language processing).Many deep learning frameworks and libraries were proposed so that researchers can develop new deep learning algorithms in a more convenient fashion.These frameworks and libraries were different in many aspects (e.g.

design principles and abstraction).Firstly

several pervasive deep learning frameworks were introduced

and then the critical issue of designing such frameworks was analyzed.At last

the future challenges of designing deep learning frameworks were discussed.The study provides ideas and directions for future design.

关键词

Keywords

references

HE K , ZHANG X , REN S , et al . Deep residual learning for image recognition [C ] // 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),June 26-July 1,2016,Las Vegas,USA . Piscataway:IEEE Press , 2016 : 770 - 778 .

ABADI M , BARHAM P , CHEN J , et al . TensorFlow:a system for large-scale machine learning [C ] // The 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI ’16),November 2-4,2016,Savannah,USA . Berkeley:USENIX Association , 2016 : 265 - 284 .

JOUPPI N P , YOUNG C , PATIL N , et al . In-datacenter performance analysis of a tensor processing unit [C ] // The 44th Annual International Symposium on Computer Architecture,June 24-28,2017,Toronto,Canada . New York:ACM Press , 2017 : 1 - 12 .

ZHANG M , ZHOU Z . ML-KNN :a lazy learning approach to multi-label learning [J ] . Pattern Recognition , 2007 , 40 ( 7 ): 2038 - 2048 .

YANG S L , LI Y S , HU X X , et al . Optimization study on k value of kmeans algorithm [J ] . Systems EngineeringTheory ＆ Practice , 2006 , 26 ( 2 ): 97 - 101 .

MADIGAN D , YORK J . Bayesian graphical models for discrete data [J ] . International Statistical Review , 1995 , 63 ( 2 ): 215 - 232 .

OSUNA E , FREUND R , GIROSI F . Training svm:an application to face detection [R ] . 1997 .

LECUN Y , KAVUKCUOGLU K , FARABET C . Convolutional networks and applications in vision [C ] // International Symposium on Circuits and Systems,May 30-June 2,2010,Paris,France . Piscataway:IEEE Press , 2010 : 253 - 256 .

KRIZHEVSKY A , SUTSKEVER I , HINTON G E . ImageNet classification with deep convolutional neural networks [C ] // The 25th International Conference on Neural Information Processing Systems,December 3-6,2012,Lake Tahoe,Nevada.New York:Curran Associates Inc . , 2012 : 1 - 9 .

SIMONYAN K , ZISSERMAN A . Very deep convolutional networks for large-scale image recognition [J ] . Computer Science , 2014 :arXiv:1409.1556.

CHEN T , LI M , LI Y , et al . MXNet :a flexible and efficient machine learning library for heterogeneous distributed systems [J ] . Statistics , 2015 :arXiv:1512.01274.

TEAM T D , ALRFOU R , ALAIN G , et al . Theano:a Python framework for fast computation of mathematical expressions [J ] . Computer Science , 2016 :arXiv:1605.02688.

COLLOBERT R , KAVUKCUOGLU K , FARABET C . Torch7:a matlab-like environment for machine learning [C ] // The 25th Annual Conference on Neural Information Processing Systems,December 12-14,2011,Granada,Spain.[S.l.:s.n] . 2011 : 1 - 6 .

JIA Y , SHELHAMER E , DONAHUE J , et al . Caffe:convolutional architecture for fast feature embedding [J ] . Computer Science , 2014 :arXiv:1408.5093.

CHEN T , DU Z , SUN N , et al . DianNao:a small-footprint high-throughput accelerator for ubiquitous machinelearning [C ] // The 19th International Conference on Architectural Support for Programming Languages and Operating Systems,March 1-5,2014,Salt Lake City,USA . New York:ACM Press , 2014 : 269 - 284 .

CHEN Y , LUO T , LIU S , et al . DaDianNao:a machine-learning supercomputer [C ] // The 47th Annual IEEE/ACM International Symposium on Microarchitecture,December 13-17,2014,Cambridge,UK . Washington DC:IEEE Computer Society , 2014 : 609 - 622 .

DU Z , FASTHUBER R , CHEN T , et al . ShiDianNao [C ] // The 42nd Annual International Symposium on Computer Architecture,June 13-17,2015,Portland,USA.[S.l.:s.n] . 2015 : 92 - 104 .

LIU D , CHEN T , LIU S , et al . PuDianNao:a polyvalent machine learning accelerator [C ] // The 20th International Conference on Architectural Support for Programming Languages and Operating Systems,March 14-18,2015,Istanbul,Turkey . New York:ACM Press , 2015 : 369 - 381 .

ZHANG S , DU Z , ZHANG L , et al . Cambricon-X:an accelerator for sparse neural networks [C ] // The 49th Annual IEEE/ACM International Symposium on Microarchitecture,October 15-19,2016,Taipei,China . Piscataway:IEEE Press , 2016 : 1 - 12 .

LIU S , DU Z , TAO J , et al . Cambricon:an instruction set architecture for neural networks [C ] // The 43rd International Symposium on Computer Architecture,June 18-22,2016,Seoul,Korea . New York:ACM Press , 2016 : 393 - 405 .

WEI R , SCHWARTZ L , ADVE V . DLVM:a modern compiler infrastructure for deep learning systems [J ] . Computer Science , 2017 :arXiv:1711.03016.

CHEN T , MOREAU T , JIANG Z , et al . TVM:end-to-end optimization stack for deep learning [J ] . Computer Science , 2018 :arXiv:1802.04799v1.

Views

1009

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

A Model of Pre-Warning Based on the Big Data Technology for P2P Lending Platform

Research Progress on Big Data Machine Learning System

A scalable parallel sorting algorithm by regular sampling for big data

Data expansion method for genetic engineering of special materials with small sample data

Gansu smart tourism system based on big data

Related Author

Chunyu Lin

Chonggang Li

Fangyuan Xu

Huiquan Xu

Lei Shi

Xianghu Lu

Yihua Huang

Ying WANG

Related Institution

Beijing JinXinWangYin Financial Information Service Co., Ltd.

State Grid Energy Research Institute

Shenzhen Koron Soft Co., Ltd.

GD Holdings Pearl River Delta Water Supply Co., Ltd.

South China Academy of Advanced Optoelectronics, South China Normal University

Postal code：100079
Tel：（010）53879208、53859533 Email：bdr@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：273380 Visits Today：286

⁰