Leveraging open source analytics for making game changing decisions

1. IBM Spark Technology Center
Apache Big Data NA 2016
Leveraging Open Source Analytics for
making game changing decisions
Luciano Resende
IBM | Spark Technology Center

2. IBM Spark Technology Center 2
Apache Big Data Evolution
http://pepperdata.com/2014/06/the-10-hottest-words-at-hadoop-summit-2014/

3. IBM Spark Technology Center 3
Apache Big Data Evolution

4. IBM Spark Technology Center 4
Apache Big Data Evolution

5. IBM Spark Technology Center 5
The
Analytics
Operating System

6. IBM Spark Technology Center
Enhance it! Offer it!
Leverage it!
Spark Technology
Center @ SF
Shipping with
BigInsights /
Spark as a Service
Inside our products
At IBM, We Love Spark!
Open sourced
Apache
SystemML
Open sourced
Apache Quarks

7. IBM Spark Technology Center
IBM is Building on Apache Spark
IBM Analytics
IBM Commerce
IBM Watson
IBM Research
IBM Cloud
Image source: http://zdnet2.cbsistatic.com/hub/i/r/2015/06/15/1a23c9cd-74bc-4c8b-9e83-da45e977d97d/thumbnail/770x578/4a70eb03e79c794393d1d7d26bb34687/ibm-apache-spark.gif

8. IBM Spark Technology Center 8
How our customers
are leveraging
open source analytics

9. IBM Spark Technology Center
The Weather Company
Data volumes from weather are growing !
– ~30 billion API requests per day
– ~120 million active mobile users
- #3 most active mobile user base
– ~360 PB of traffic daily
– Billions of events per day (~1.3 M per sec)
– Keep data forever
The use case
– Efficient batch + streaming analysis
– Self-service data science
– BI / Visualization tool support

10. IBM Spark Technology Center
Healthcare Enterprise
Health Care Data Lakes
– Improve how health care is delivered
– Collect and combine data from dozens of sources
– Clinical, Operational, Financial
– Inside and outside your enterprise
Benefits
– Better medical outcomes for patients
– Control cost and improve quality
SystemML on Spark
– Predictive Risk Modeling
– Right patient intervention relating to adverse heath events
10

11. IBM Spark Technology Center
Spark maps Customer Experience “journey”
The Challenge
– Improve Customer satisfaction rates
– Multiple channels for customer iteractions
– Very large volumes of data
The need
– Create a 360 degree view of a customer
– Stich all interactions across channels –
“Customer Experience Journey”
– Classify interaction sentiment and take necessary actions
PUB / SUB
MQTT / WebSockets / Flume / Kafka
` ` `
Journey
Dashboards
Interaction & Journey Data
Voice &
Text Data

12. IBM Spark Technology Center
12Image source: http://az616578.vo.msecnd.net/files/2016/03/21/6359412499310138501557867529_thank-you-1400x800-c-default.gif