HPC DAY 2017 - http://www.hpcday.eu/ FlyElephant Solutions for Data Science and HPC Dmitry Spodarets | CEO at FlyElephant

1. FlyElephant Solutions for
Data Science and HPC
Dmitry Spodarets
HPC DAY 2017

2. SolutionCompany overview
2014
FOUNDED
8 employees worldwide
Locations
Odessa (Ukraine)
Dnipro (Ukraine)
Passau (Germany)
Biel (Switzerland)
Partners
The main focus of business:
● Data Science
● BigData
● High Performance Computing
The Best Cloud Startup

3. Our computing infrastructures
(60 data centers)

4. Data Science + HPC

5. Healthcare
Financial
Retail
Life Sciences Manufacturing
Automotive Oil & Gas
Aerospace

6. Process
Training
model
Deployed
Model
Live
Data
Historical
Data
Result
Creating
model

7. Process
Training
model
Deployed
Model
Live
Data
Historical
Data
Result
Creating
model

8. Hardware & Software for
Data Science
Various hardware
Various software

9. Hardware & Software for
HPC
Various hardware
Various software

10. Hybrid Infrastructure

11. Containers
Docker Singularity

12. Containers

13. Docker (Dockerfile)
FROM gcr.io/tensorflow/tensorflow
MAINTAINER Dmitry Spodarets <d.spodarets@flyelephant.net>
RUN apt update && apt -y upgrade && apt -y install git curl wget
CMD /run_jupyter.sh

14. Docker Hub

15. Docker Store

16. Docker
● docker images
● docker run -it --cpus="2" --name mycont registry.flyelephant.net/tensorflow
● docker exec -i -t mycont bash
● docker ps
● docker stats
● docker stop CONTAINER ID
● docker start CONTAINER ID
● docker rm CONTAINER ID

17. Docker Machine
•Amazon Web Services
•Digital Ocean
•Exoscale
•Generic
•Google Compute Engine
•IBM Softlayer
•Microsoft Azure
•Microsoft Hyper-V
•OpenStack
•Oracle
•VirtualBox
•Rackspace
•VMware Fusion
•VMware v
•Cloud Air
•VMware vSphere
docker-machine create --driver azure --azure-subscription-id subscription-id --azure-resource-group
resourcename --azure-ssh-user user --azure-size machine-name
docker-machine ssh machine-name

18. nvidia-docker
https://github.com/NVIDIA/nvidia-docker

19. What about containers
for HPC?

20. Singularity

21. Singularity
•First public release in April 2016, followed by a massive uptake
•HPC Wire Editor’s choice: Top Technologies to Watch for 2017
•Simple integration with resource managers, InfiniBand, GPUs, MPI, file systems,
and supports multiple architectures (x86_64, PPC, ARM, etc..)
•Limits user’s privileges (inside user == outside user)
•No root owned container daemon
•Network images are supported via URIs and all require local caching:
○ docker:// - This will pull a container from Docker Hub
○ http://, https:// - This will pull an image or tarball from the URL, cache
and run it
○ shub:// - Pull an image from the Singularity Hub
http://singularity.lbl.gov/

22. Singularity - Usage Examples
$ python ./hello.py
Hello World: The Python version is 2.7.5
$ sudo singularity exec --writable /tmp/debian.img
apt-get install python
…
$ singularity exec /tmp/debian.img python ./hello.py
Hello World: The Python version is 2.7.12
Webinar "Introduction to Singularity"
https://youtu.be/h5rDnCA3NJA

23. Singularity HUB
https://singularity-hub.org

24. Contributors to Singularity

25. How our company helps businesses use
containers and HPC technologies ?

26. ALL-IN-ONE AUTOMATED WORKFLOW PLATFORM

27. FlyElephant helps to prototype, run and scale
data science models and engineering simulations
on-premise or in the cloud
to deliver the best results faster.

28. ● Computing Resources
● Ready Environments
● Process Automation
● Collaboration
FlyElephant Features
● File Management
● API & CLI
● Marketplace
● Security

29. Computing Resources
60 data centers

30. Computing Resources
NVIDIA TESLA V100
● 2 x PCI Tesla V100
● 2 x Intel Xeon E5-2630v4
● 2.2 GHz, 128 GB RAM
● 960 GB SSD, 40 Gbps Port
Will be available for tests from October 30th.
For more details, please contact us.

31. Ready Environments
● Images Repository With Custom Software.
● Web Applications.
● Full SSH access.
● Remote Desktops.
Get your ready environment in < 30 sec!

32. Ready Environments
Jupyter Notebook

33. Ready Environments
Supported Software
We can easily add software you need!

34. Ready Environments
Remote Desktop

35. Ready Environments
FlowVision Case

36. Process Automation
● Deploying the infrastructure.
● Running Jobs.
● Sequences of Jobs.
● Scaling.
● Publishing Jobs as REST APIs.
Process automation helps to go 10X faster.

42. Collaboration
● Public and private projects
● Sharing jobs and their result
● Team Management
● Expert Community
Increase team’s productivity through rapid
exchange of knowledge between members and
expert support from community.

43. What our customers say about us

44. Hybrid Infrastructure

45. Core capabilities:
● Ready for using your local computing infrastructure.
● All platform functionalities available.
● Easy to get an extra our computing resources.
● Customer responsive support team.

46. Use Case 1
Connect computing resources to online
FlyElephant Platform

47. Use Case 2
Full local infrastructure and extra computing resources
through FlyElephant Platform.

48. Use Case 3
Full local infrastructure and special computing resources
through FlyElephant Platform.

49. Thank you!
Please contact me for a live demo or
partnership.
Dmitry Spodarets
d.spodarets@flyelephant.net
www.flyelephant.net