Scala eXchange 2017

1. Tour of Apache PredictionIO
in 10 Minutes
Scala eXchange Dec 14th, 2017

2. Web Developer
We'd like to give users
recommendations.

3. App
Give us items, please.
Web Developer
Here you are.

4. Give us items, please.
Web Developer
Here you are.
App
It's easy for you to say.

5. Prediction
query
result
App

6. Training Data
Prediction
query
result
collect some events
App

7. Training Data
Predictive Model
Prediction
train
query
result
App
collect some events

8. Training Data
Predictive Model
Prediction
train
deploy
query
result
App
collect some events

9. Training Data
query
result
App
collect some events
PredictionIO

10. Overview
● Open source machine learning framework
○ Building an end-to-end machine learning platform
● Built-in storage facilities
○ Training data: (e.g.: Elasticsearch, HBase)
○ Models: (e.g.: HDFS, S3)

11. Apply Governance
● Involve personal efforts
○ Inconsistent architectures
● Apply governance using PIO
○ Improve efficiency and productivity

12. Training Data
Predictive Model
Prediction
train
deploy
query
result
App
collect some events

13. Training Data
Predictive Model
Prediction
deploy
query
result
App
collect some events
predict
train

15. Templates
● All kinds of machine learning tasks
○ Template gallery offers templates in advance
○ Use by downloading a template
● Customizable

16. Process

17. Process
git clone
choose a template
collect some events
Ap

18. Process
git clone
collect some events
pio build
choose a template

19. Process
git clone
collect some events
pio build
pio train
store model
choose a template

20. Process
git clone
collect some events
pio build
pio train
pio deploy
store model
choose a template

21. Process
git clone
collect some events
pio build
pio train
pio deploy
App
query
store model
choose a template

22. Process
git clone
collect some events
pio build
pio train
pio deploy
App
query
result
store model
choose a template
Note that some steps are left out for brevity.

23. Algorithm
def train(sc: SparkContext, data: PreparedData): Model = {
// Returns a trained model
}
def predict(model: Model, query: Query): PredictedResult = {
// Returns a prediction
}

24. Algorithm
def train(sc: SparkContext, data: PreparedData): Model = {
// Returns a trained model
}
def predict(model: Model, query: Query): PredictedResult = {
// Returns a prediction
}
Produce a model from prepared data

25. Algorithm
def train(sc: SparkContext, data: PreparedData): Model = {
// Returns a trained model
}
def predict(model: Model, query: Query): PredictedResult = {
// Returns a prediction
}
Produce a prediction from a query and
trained model

26. Community
● Support : user@predictionio.apache.org
● https://predictionio.apache.org