HPC: AWS for High Performance Computing

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Mv – Marcus Vinicius Ferreira
Sr. Solutions Architect, Public Sector, Amazon Web Services
Diretor TI, CVC Corp
CMP201
HPC: High Performance Computing
AWS
Flavio Ayra

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
 Infraestrutura Global
 HPC Grids
 Performance: CPU
 Performance: Rede
 Performance: Storage
 Automação
 Gráficos e Imagens
… e ESCALA

AWS: Infraestrutura Global
Amazon Global
Network
• Rede: 100-GbE network
• Rede Privada
• Rede em redundância

Grids: Escala Global
CERN Large Hadron Collider (LHC)

Grids: Escala Global
Spot: usando diferentes tipos de instâncias, múltiplas AZs e Regiões

HPC Grids

Defining HPC: Casos de uso
Data Light
Simple
performance
storage
Data Heavy
High-
performance
storage
Dinâmica de Fluidos
Simulações Meteorológicas
Stress de Materiais
Simulações de Acidentes
Simulações de Risco
Simulações Financeiras
Modelagem Molecular
Animação VFX
Processamento de Imagem
GIS
Genoma
Geologia
Astro-Física
Deep learning
Cluster HPC
Distributed/Grid HPC

Cluster HPC
HPC Tradicional
“Scale-Up”
“Tightly coupled,
latency-sensitive”
Grid HPC
Mais Escalável
“Scale-Out”
“Loosely coupled,
pleasingly parallel”
Grids of clusters
Jobs em Paralelo
Jobs Heteregêneos
Cluster HPC / Grid HPC

Grid computing
(Scale -ou t)

Cl emson Uni versi ty: NL P (Natural L anguage Processi ng)
AWS Blog
https://aws.amazon.com/blogs/aws/natural-language-processing-at-clemson-university-1-1-million-vcpus-
ec2-spot-instances/

Cl emson Uni versi ty: NL P (Natural L anguage Processi ng)

Cluster computing
(Scale -u p )

HPC Tradicional: Meteorologia

HPC Tradicional: Simulação Estrutural
0
20
40
60
80
100
120
140
160
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
20000
0 50 100 150 200 250 300 350
ScaleUp
Time(s)
Cores
c4.8xlarge Time c4.8xlarge Scaleup

Dinâmica de Fluidos: Ansys Fluent
 C4.8xlarge
 140 Million cells
 Formula 1: benchmark

HPC: Componentes

AWS: Instâncias HPC
M5
General
purpose
Compute
optimized
Storage and I/O
optimized
GPU, FPGA
accelerated
Memory
optimized
X1 F1
P3
I3 D2
R4
C5
C4
P2

EC2 C5 - Intel XEON Scalable Processor
 Intel Skylake @ 3.0
GHz (turbo to 3.5 GHz)
 AVX512
 C-state
 Nitro System:
dedicated hardware,
lightweight hypervisor
 25-Gbps network
AVX 512
72 vCPUs
“Skylake”
144-GiB memory
C5
12 Gbps to EBS
2X vCPUs
3X throughput
2.4X memory
C4
36 vCPUs
“Haswell”
4 Gbps to EBS
60-GiB memory

Xilinx
UltraScale+
FPGANVIDIA GPU
EC2 P2/P3: GPU
 “Parallel”
 “1000s of cores”
 APIs: CUDA, OpenACC, OpenCL
 Open-source frameworks
EC2 F1: FPGA
 “Massively parallel”
 “Millions of parallel system logic cells”
 “Flexible – no fixed instruction set”
 Programável
EC2: GPUs, FPGAs

GPU: Deep learning
MXNet: Usando EC2 P2
 Inception v3: análise de imagens
 Escalabilidade de 85%
 https://www.kaggle.com/google-
brain/inception-v3

FPGA: Genoma
F1

Hypervisor
Management,
Security, and
Monitoring
Storage
Customer
Instances
Network
EC2: Arquitetura Original - Virtualização
 Virtualização
 Foco:
• Segurança
SERVER

Hypervisor
Management,
Security, and
Monitoring
Storage
Customer
Instances
Network
EC2 C5
 Hardware
Dedicado
 Foco:
• Segurança
• Performance
SERVER
NITRO

Performance: Rede
Amazon EC2 para Amazon S3
 EC2 para Amazon S3 com tráfego de até 25 Gbps de banda
Enhanced Networking
 > Performance: 1 Million PPS (packets per second)
 < Latência
AWS Proprietary Network, 10 Gbps & 25 Gbps
 “Full bisection bandwidth in Placement Groups”
 “No network oversubscription”
 “No jitter”
 “Consistent network performance”

Linux Driver: Amazon ENA Module Info
description: Elastic Network Adapter (ENA)
author: Amazon.com, Inc. or its affiliates

Performance
H P C w o r k l o a d s
SO
 Amazon Linux or an
 Recent 3.10+ kernel–4.0
Processor states
 P-states, C-states
Instâncias
 C5, C4, M4, R4
 Latest is best
Hyper-threading
 Hyper-Threading (HT)
 HT: on /off
 Mais performance: HT off

Performance
C P U P e r f o r m a n c e
Disable Hyper-Threading
 https://aws.amazon.com/blogs/compute/disabling-intel-hyper-
threading-technology-on-amazon-linux/
 https://aws.amazon.com/blogs/compute/disabling-intel-hyper-
threading-technology-on-amazon-ec2-windows-instances/
Optimizing CPU
 https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-
optimize-cpu.html

Performance
C P U P e r f o r m a n c e
Optimizing CPU
 https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-
optimize-cpu.html

Amazon EFS
File
Amazon EBS
Amazon EC2
Instance Store
Block
Amazon
S3 / S3-IA
Amazon Glacier
Object
Data Transfer
AWS Direct
Connect
ISV
Connectors
Amazon
Kinesis Data
Firehose
AWS Storage
Gateway
S3 Transfer
Acceleration
AWS Storage
AWS
Snowball
Amazon
CloudFront
Internet/
VPN

AWS Storage: HPC Data
Corporate data center
Amazon
Glacier
Amazon S3
AWS Direct
Connect
ISV
Connectors
Storage
Gateway
AWS
Snowball
Internet/VPN
Ingress
Egress
Lifecycle
EC2 Instance
EBS
Instance
Store
Kinesis Data
Firehose
S3 Transfer
Acceleration
Amazon
CloudFront
Other Shared File
System
EFS

Block Storage
Duas opções possíveis: Amazon EBS and Instance Store
EC2 Instance
/dev/xvda
/dev/xvdb
/dev/xvdc
Block Device Mapping Instance Store
ephemeral0
ephemeral1
vol-xxxxxxxx
vol-xxxxxxxx
/dev/xvdd
EBS Volumes

AWS File Systems
 Amazon Elastic File System (Amazon EFS)
 Simples de usar, Simples de gerenciar
 Distribuído em Multi-AZs
 Petabyte-scale
 Custom file systems
 Lustre, GPFS, GlusterFS
 Custom NFS
 Usando discos Ephemeral
 Usando discos Amazon EBS

High-performance NFS
 EC2+EBS:
mais performance: tradicional HPC
 NFS, CIFS:
custom filesystem
 Fileserver performance:
até 25 Gb/s, por instância

Amazon S3: Automatizando com “Lifecycles”
Standard
• Active data
• Primary data
• Big data / analytics
• Archive data
• Tape backup replacement
• Logs
• Enterprise backup
Standard - Infrequent Access Amazon Glacier

Automação

Arquitetura HPC
Shared File Storage
Cloud-based, auto-scaling HPC cluster
License managers and cluster
head nodes with job schedulers
3D graphics virtual workstation
AWS Direct Connect
On-Premises HPC
Resources
Thin or Zero Client
- No local data -
Storage CacheAmazon S3
and Amazon
Glacier
AWS Snowball
AWS Batch

AWS CfnCluster
CfnCluster
https://aws.amazon.com/getting-started/projects/deploy-elastic-hpc-cluster/

CfnCluster: AWS CloudFormation
Corporate data center
Availability Zone
Auto Scaling group
Parallel
FS
Local
NFS
S3
Data
ingress/egress
Amazon
EFS
 File systems:
Amazon EFS, Local NFS, and
Parallel FS
 Schedulers:
Torque, Slurm, SGE
 Auto Scaling:
Spot Instances
Master instance
$ qsub job.sh
EBS

CfnCluster: Monitoração
CfnCluster
https://aws.amazon.com/getting-started/projects/deploy-elastic-hpc-cluster/

HPC: Job Schedulers
HPC Tradicional
 OpenMPI: Slurm, Torque, Sun Grid Engine
 IBM Platform LSF
 Univa Grid Engine
 Altair PBS Pro
HPC em AWS
 AWS Batch
 AWS Lambda

HPC: Schedulers, Jobs, Queues
Queues
• Capacidade definida, limitada
• Jobs múltiplos: devem esperar na FILA!
?

AWS como Escala: Múltiplos clusters
CfnCluster
CfnCluster
CfnCluster

Dedicated HPC
Your Data Center
Project A
Genoma

Dedicated HPC
Your Data Center
AWS VPC
Geologia
C++/Fortran
Biologia
Perl
Aerodinâmica
Python
Fluidos
Ansys
… usando clusters dedicados

HPC: Arquiteturas Híbridas
A m a z o n
E C 2 S y s t e m s M a n a g e r
Capabilities
Run
Command
State
Manager
Inventory Maintenance
Window
Patch
Manager
Automation Parameter
Store
Documents
AWS Cloud
corporate data
center
Controle de acesso: role-based
 Windows / Linux nodes
 On-premises / Amazon VPC
 Auditoria

HPC Gráficos e Imagens

AppStream 2.0
 Preços: “Always-On” ou “On-Demand”
 Suporte a OpenGL, DirectX, OpenCL, CUDA

Desktop streaming
Amazon AppStream 2.0
Stream de aplicações desktop para
qualquer browser
Preço Flexível Escala
Segurançaweb browser

Caso de Cliente

A CVC Corp
Maior Grupo de Turismo LATAM
6 unidades de negócio
B2b b2c b2b2c
~11bi de vendas 2017

O Desafio
• Otimizar recursos na API
($$$$$$$$$)
• Escalar com velocidade
• ~3000 rpm em velocidade cruzeiro
• API sem cache (de cias aéreas)
Print Screen do sistema
(se possível)

“De 3:00 para 1:20 pela metade do preço com C5”
www.cvc.com.br
Auto Scaling group
ELB
ElastiCache
CloudFront
API Gatewqy
RDS
Auto Scaling group
nginx
Cias
Aéreas
C5

Resumo
 HPC: High-Performance Computer
 High Performance: CPU, GPU, FPGA
 High Performance: Rede
 High Performance: Storage
 High Performance: Escala
 High Performance: Automação

Obrigado!!!
aws.amazon.com/hpc

Feedback
1. Tap the Schedule icon. 2. Select the session
you attended.
3. Tap Session Evaluation
to submit your feedback.

HPC: AWS for High Performance Computing

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie HPC: AWS for High Performance Computing

Ähnlich wie HPC: AWS for High Performance Computing (20)

Mehr von Amazon Web Services

Mehr von Amazon Web Services (20)

HPC: AWS for High Performance Computing