1.
PTL
Sergey Lukjanov
Data Processing Update
OpenStack Sahara

2.
To provide a scalable data processing stack
and associated management interfaces Sahara
● provisions & operates data proc. clusters
● schedules & operates data proc. jobs /
workloads

3.
Elastic Data Processing (EDP) is Sahara’s take
on data processing workflow management.

4.
Kilo release overview
● 720+ code commits from 50 people
● 52 blueprints implemented
● ~7000 code reviews
● ~239 bugs fixed
details: https://launchpad.net/sahara/kilo

5.
New and updated plugins
Vanilla Apache Hadoop 2.6.0
extended CDH 5
MapR
Apache Storm
Kilo

6.
Sahara UI improvements (in Horizon)
Guided cluster creation and job exec
Filtering for all objects search
Kilo

7.
Indirect VM access (gateway)
Kilo

8.
Event log
Kilo

9.
Default templates CLI
Kilo

10.
Liberty plans

11.
CDH 5.4.X w/ HA
HDP 2.2 w/ HA
Spark 1.3.X
Liberty

12.
Data Sources placeholders / templates
Liberty

13.
Objects editing
Liberty

14.
Separated sahara-tests scenarios test tool
Liberty

15.
Overall provisioning reliability
Only Heat engine
Liberty