深度學習的分布和並行處理系統
深度學習出來以後，大家發現它和以前機器學習的演算法運行系統不一樣，這就有了GPU的「輝煌歲月」：）。大神Jeff Dean也曾為此抓狂過的，這才有了Tensorflow。
自動駕駛的深度學習任務也很大，建立強大的深度學習平台是非常必要的。
。。。。。。
1 「Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis」， 9， 2018
2. "Using Distributed TensorFlow with Cloud ML Engine and Cloud Datalab"
3 「Distributed training of deep learning models on Azure」
4 Peer-to-Peer Framework
5 DistBelief: Distributed Deep Nets at Google
6 Project Adam @MSR
7 Petuum: Iterative-Convergent Distributed ML
8 SINGA: A Distributed Deep Learning Platform
9 Minerva: A Scalable and Highly Efficient Training Platform
10 Mariana: Deep Learning Platform at Tencent
11 MXNET: Distributed Deep Learning
12 TensorFlow: Large-Scale Heterogeneous Distributed ML
13 Caffe on Spark at Yahoo
14 DMTK: Distributed Machine Learning Toolkit @ MSR
15 Computational Network Toolkit (CNTK) at MSR
16 BigDL: A Distributed Deep Learning Framework for Big Data
。。。待續
推薦閱讀：
