ReNom User Group #11 Part1

1. I N F R A S T R U C T U R E + L I F E + I N N O V A T I O N
RNUG #11
Copyright © 2019GRID Al l Rights Reserved.

2. App: WordCard
インストール数: 56
Copyright © 2019GRID Al l Rights Reserved.

3. 32019/5/7Copyright © 2019GRID Al l Rights Reserved.

4. 42019/5/7Copyright © 2019GRID Al l Rights Reserved.

5. F
52019/5/7
L D R
D
D => & N
Copyright © 2019GRID Al l Rights Reserved.

6. 62019/5/7Copyright © 2019GRID Al l Rights Reserved.

7. 72019/5/7
,
D ,N
DLフレームワーク共通の課題
Copyright © 2019GRID Al l Rights Reserved.

8. 82019/5/7
,
Copyright © 2019GRID Al l Rights Reserved.

9. 92019/5/7
for N :
2. <= GPU (X, Y)
1. X, Y <=
3.
,
Copyright © 2019GRID Al l Rights Reserved.

10. 102019/5/7
CPU
GPU
Copyright © 2019GRID Al l Rights Reserved.

11. 112019/5/7
CPU
GPU
Copyright © 2019GRID Al l Rights Reserved.

12. 122019/5/7
CPU
GPU
CPU
GPU
Copyright © 2019GRID Al l Rights Reserved.

13. 132019/5/7
CPU
GPU
,
, .
Copyright © 2019GRID Al l Rights Reserved.

14. CPU
GPU
142019/5/7
,
Copyright © 2019GRID Al l Rights Reserved.

15. CPU
GPU
152019/5/7Copyright © 2019GRID Al l Rights Reserved.

16. 162019/5/7
CPU
GPU
CPU
GPU
Copyright © 2019GRID Al l Rights Reserved.

17. / O
172019/5/7
O
• ) D N
• PAC
• / IA
• ( ,
• ,
• N / U
•
Copyright © 2019GRID Al l Rights Reserved.

18. U/
182019/5/7
• ) O C P C O N A C
• h O
• /I
• ( , O C P C
• ,
• D/ n
•
ReNom DL v3
/ O
.
Copyright © 2019GRID Al l Rights Reserved.

19. NN
Copyright © 2019GRID Al l Rights Reserved.

20. =>
=>
,
Copyright © 2019GRID Al l Rights Reserved.

21. Copyright © 2019GRID Al l Rights Reserved.

22. Executor ?
1.
2.
3. (Gemm, Convlution)
4. CPU, GPU
5. GPU , CPU
6.
Copyright © 2019GRID Al l Rights Reserved.

23. dL
dw
dw
dw
dwdw
dw
dO
w
w
w
w
w
w
232019/5/7
Executor
Out1
Out2
In
In
w
w
w
w
Out
w
w
Loss
Target
dO
dO
1.枝刈り
Copyright © 2019GRID Al l Rights Reserved.

24. dL
dw
dw
dw
dwdw
dw
dO
w
w
w
w
w
w
242019/5/7
Executor
Out1
Out2
In
In
w
w
w
w
Out
w
w
Loss
Target
2. 並列実行
, ,
,
Copyright © 2019GRID Al l Rights Reserved.

25. dL
dw
dw
dw
dwdw
dw
dO
w
w
w
w
w
w
252019/5/7
Executor
Out1
Out2
In
In
w
w
w
w
Out
w
w
Loss
Target
2. 並列実行
,
Copyright © 2019GRID Al l Rights Reserved.

26. Copyright © 2019GRID Al l Rights Reserved.

27. Executor ?
1.
2.
3. (Gemm, Convlution)
4. CPU, GPU
5. GPU , CPU
6.
version 3.0.0 beta
.
Copyright © 2019GRID Al l Rights Reserved.

28. Executor ?
1.
2.
3. (Gemm, Convlution)
4. CPU, GPU
5. GPU , CPU
6.
version 3.0.0 beta
.
Copyright © 2019GRID Al l Rights Reserved.

29. Executorモードは
マルチGPU環境でも使用可能
Executor , Python ,
.
Copyright © 2019GRID Al l Rights Reserved.

30. Executor , Python ,
.
VGG16 CNN
DataParallel
multi_gpu_model
Iteration: 5 * 280 = 1400
Batch size: 32
Input tensor size: (3, 224, 224)
Num GPUs: 1, 2, 3, 4
Copyright © 2019GRID Al l Rights Reserved.