SlideShare a Scribd company logo
1 of 17
Download to read offline
Applying the R Language in Streaming
Applications and Business Intelligence
Lou Bajuk-Yorgan
Sr. Dir., Product Management
TIBCO Spotfire
lbajuk@tibco.com
@loubajuk
© Copyright 2000-2014 TIBCO Software Inc.
1
R in Streaming Applications and Business Intelligence
• TIBCO’s History with S+ and R
• Challenges of R for Enterprise applications
• TIBCO Enterprise Runtime for R (TERR)
• Applications of R/TERR for BI and Streaming
• Learn more and try it yourself
- 2
TIBCO’s Unique History with R/S
• John Chambers developed the S language at Bell Labs
– Starting in the mid 70’s
• Insightful founded (as StatSci) to commercialize S as S+ in 1987
– The “plus”: statistical libraries, documentation, and support
– Focused on commercial users, ease of use, server integration
• R: development begun by Ross Ihaka and Robert Gentleman at University of Auckland in
mid 90’s
• Insightful joined TIBCO in 2008
– Spotfire (for Data Discovery and Visualization) joined in 2007
• Focus on applying Advanced Analytics in Spotfire & TIBCO real-time applications
– Embraced R language as part of a broader Advanced Analytic Ecosystem
• Ongoing commitment to the R Community
– useR sponsor for 7 years running
– Founding member of the R Consortium
Embracing R
• Spotfire Statistics Server
– Integration of R & S+ into Spotfire
applications
• Later SAS® & MATLAB®
– Leverage the interactive visualizations,
data access and application development
of Spotfire
• Well received—but our Enterprise
customers needed more
– Clear customer-feedback on the Open
Source R engine’s shortcomings for
Enterprise usage
- 4
Challenges with R in the Enterprise
• R provides tremendous benefits to statisticians
– Enterprises are challenged to leverage that value
• Enterprises need:
– R’s expansive flexibility to develop the most powerful and relevant predictive models
– Enterprise-friendly R
 Better performance than open source R  faster, more memory efficient, greater scalability
 Fully supported R environment
 Tightly integrated into enterprise applications
– Agility to use R through the entire prototyping-to-production process
• Vendors & application developers need:
– An embeddable R engine that is not open-source GPL licensed
– Alternative to loose integrations, manual configuration and poor user experience
TIBCO Enterprise Runtime for R (TERR)
• Unique, enterprise-grade statistics engine,
architected from the ground up by TIBCO
– Based on TIBCO’s long history and expertise with S+
– Better performance and memory management than open
source R
• Designed for R language compatibility
– Wide range of built-in analytic methods
– Extensible through R community packages
• Designed for commercial embeddability
– TIBCO licensed & supported product
– Not GPL, not a repackaging of the Open source R engine
• TERR extends the reach of R in the enterprise
– Develop code in open source R
– Deploy on a commercially-supported and robust platform
– Without the delay and cost of rewriting your code
Example 1: Embedded TERR in Spotfire
• Spotfire: Data Discovery and Visualization platform for Business Users and Analysts
– Separate analytics platform, independent of TERR/R
• Easily enhance Spotfire analyses and applications with R language scripts
– Extend the impact of the Data Scientist/R by making their analytic insights available to a wider audience
Write R code directly in Spotfire;
TERR executes locally or on server
Manage TERR analytics locally or
in Server to reuse across
community
Deploy TERR-powered
applications to the web
Illustrating the power of embedded Advanced Analytics
See the live demo at the TIBCO Booth
Advanced Analytic Applications in Spotfire
Customer Churn:
• Retain your most profitable customers
• Increase upsell, decrease churn
Fraud Detection:
• Reduce losses due to fraudulent
transactions
Supply Chain Optimization:
• Anticipate peaks and lulls
• Optimize distribution centers
HR Planning:
• Predict employee attrition and optimize
retention
• TERR powers real-time advanced analytics in TIBCO “Fast Data”
– When an event is identified, the CEP application applies a predictive model, and then can
trigger an automated business process
– E.g., extend a mobile offer to a customer; stop a fraudulent transaction in process
Example 2: TERR in TIBCO’s Complex Event Processing
Model
Develop model
Deploy via TERR in
TIBCO Streambase
or Business Events
Act
Automatically monitor
real-time transactions
Automatically trigger
action
Analyze
Analyze data in Spotfire
Uncover patterns,
trends & correlations
• Port Congestion Detection
– Real time system triggers TERR
– Analyzes port congestion
– Recommends reduction of speed if
no berths available
• Maritime Abnormality Detection
– Based on Automatic Identification
System info, TERR calculates
likelihood of deviation from normal
sailing routes
– Alerts carrier & operator
Logistics Optimization
• Oil & Gas Extraction
– Maintenance Downtime and Equipment failures
are costly
– Engineers track sensor data to find leading
indicators
• Temperature, vibration, etc.
• Engineers usually use ad hoc rules on leading
indicators
– R/TERR used to develop predictive models for
preventative maintenance
– Deployed in real-time systems, alert when
maintenance recommended
Predictive Maintenance for Oil & Gas
© Copyright 2000-2013 TIBCO Software Inc.
TERR for individual R users
• Empower R users
– Enterprise platform for the deployment and
integration of your work—without having to rewrite
it!
• TERR Developer Edition
– Full version of TERR engine for testing code prior
to deployment
• Compatible with RStudio & ESS Emacs
– Free for non-production use
– Supported through Community site
– Available at Tap.tibco.com
-
Summary
• TIBCO makes the power of R available across the enterprise
– Ad-hoc Predictive Analytics for Data Scientists
 Spotfire & TERR
– Guided Analytic Applications
 Spotfire & Statistics Services predictive ecosystem, starring TERR
– Event-driven, real-time analytics
 Spotfire Event Analytics, TIBCO CEP & TERR
• TERR is R for the Enterprise
– Enables customers to develop code in open source R, then deploy their R code on
commercially-supported and robust platforms—without recoding, saving time &
money
– Enables TIBCO, partners & customers products to tightly & efficiently embed R
language functionality
• TERR Community at TIBCOmmunity.com
– Resources, Documentation, FAQs, Forums
– More info at spotfire.tibco.com/terr
• TERR Developer Edition
– Full version of TERR engine for testing code prior to deployment
– Supported through TIBCOmmunity, download via tap.tibco.com
• Spotfire Free Trial: http://spotfire.tibco.com/trial
• Presentations: http://www.slideshare.net/loubajukyorgan/presentations
– Will post slides to twitter @loubajuk #useR2015
• Stop by our booth
• R Consortium Founding Member www.r-consortium.org
Learn more and Try it yourself
© Copyright 2000-2013 TIBCO Software Inc.
Supplemental Slides
Broadening TERR Partner Ecosystem
• Lavastorm Analytics
– Visual workflow tool for data management
and analysis
– Embedding TERR for R scripting and
predictive tools
• RStudio IDE
– Free, open source IDE widely used by the
R Community
– Fully compatible with TERR Developer
Edition
• KNIME
– Free, open source workflow tool for data
management and analysis
– TERR fully compatible with KNIME
Interactive R Statistics Integration nodes

More Related Content

What's hot

DeployR: Revolution R Enterprise with Business Intelligence Applications
DeployR: Revolution R Enterprise with Business Intelligence ApplicationsDeployR: Revolution R Enterprise with Business Intelligence Applications
DeployR: Revolution R Enterprise with Business Intelligence ApplicationsRevolution Analytics
 
Streaming analytics overview for R
Streaming analytics overview for RStreaming analytics overview for R
Streaming analytics overview for RLou Bajuk
 
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...InfluxData
 
Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...
Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...
Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...Project Controls Expo
 
Big Data Adoption Status
Big Data Adoption Status Big Data Adoption Status
Big Data Adoption Status Xpand IT
 
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSBIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSTIBCO Spotfire
 
Munich Re: Driving a Big Data Transformation
Munich Re: Driving a Big Data TransformationMunich Re: Driving a Big Data Transformation
Munich Re: Driving a Big Data TransformationDataWorks Summit
 
Bosch Splunk Roundtable: Bosch atmo Performance Center
Bosch Splunk Roundtable: Bosch atmo Performance CenterBosch Splunk Roundtable: Bosch atmo Performance Center
Bosch Splunk Roundtable: Bosch atmo Performance CenterSplunk
 
Cloudera Customer Success Story
Cloudera Customer Success StoryCloudera Customer Success Story
Cloudera Customer Success StoryXpand IT
 
Cloud Foundry Summit 2015: Cloud Foundry and IoT Protocol Support
Cloud Foundry Summit 2015: Cloud Foundry and IoT Protocol SupportCloud Foundry Summit 2015: Cloud Foundry and IoT Protocol Support
Cloud Foundry Summit 2015: Cloud Foundry and IoT Protocol SupportVMware Tanzu
 
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...InfluxData
 
Mo.Le nec-midih_presentation_oc2
Mo.Le nec-midih_presentation_oc2Mo.Le nec-midih_presentation_oc2
Mo.Le nec-midih_presentation_oc2MIDIH_EU
 
Mamoc dmc smart systems-midih_oc2_demoday
Mamoc dmc smart systems-midih_oc2_demodayMamoc dmc smart systems-midih_oc2_demoday
Mamoc dmc smart systems-midih_oc2_demodayMIDIH_EU
 
HiTech Manufacturing Use Cases/Examples
HiTech Manufacturing Use Cases/ExamplesHiTech Manufacturing Use Cases/Examples
HiTech Manufacturing Use Cases/ExamplesTIBCO Spotfire
 
The Single Most Important Formula for Business Success
The Single Most Important Formula for Business SuccessThe Single Most Important Formula for Business Success
The Single Most Important Formula for Business SuccessDataWorks Summit
 
Splunk at Lloyds Banking Group
Splunk at Lloyds Banking GroupSplunk at Lloyds Banking Group
Splunk at Lloyds Banking GroupSplunk
 
Heimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11bHeimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11bDean Heimmerman
 
Saving Human Lives with the IoT
Saving Human Lives with the IoTSaving Human Lives with the IoT
Saving Human Lives with the IoTDat Tran
 

What's hot (19)

DeployR: Revolution R Enterprise with Business Intelligence Applications
DeployR: Revolution R Enterprise with Business Intelligence ApplicationsDeployR: Revolution R Enterprise with Business Intelligence Applications
DeployR: Revolution R Enterprise with Business Intelligence Applications
 
Streaming analytics overview for R
Streaming analytics overview for RStreaming analytics overview for R
Streaming analytics overview for R
 
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...
How to Improve Data Labels and Feedback Loops Through High-Frequency Sensor A...
 
Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...
Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...
Project Controls Expo, 13th Nov 2013 - "Loading Cost and Activity data into P...
 
Big Data Adoption Status
Big Data Adoption Status Big Data Adoption Status
Big Data Adoption Status
 
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSBIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
 
Munich Re: Driving a Big Data Transformation
Munich Re: Driving a Big Data TransformationMunich Re: Driving a Big Data Transformation
Munich Re: Driving a Big Data Transformation
 
Bosch Splunk Roundtable: Bosch atmo Performance Center
Bosch Splunk Roundtable: Bosch atmo Performance CenterBosch Splunk Roundtable: Bosch atmo Performance Center
Bosch Splunk Roundtable: Bosch atmo Performance Center
 
Cloudera Customer Success Story
Cloudera Customer Success StoryCloudera Customer Success Story
Cloudera Customer Success Story
 
Cloud Foundry Summit 2015: Cloud Foundry and IoT Protocol Support
Cloud Foundry Summit 2015: Cloud Foundry and IoT Protocol SupportCloud Foundry Summit 2015: Cloud Foundry and IoT Protocol Support
Cloud Foundry Summit 2015: Cloud Foundry and IoT Protocol Support
 
I'm being followed by drones
I'm being followed by dronesI'm being followed by drones
I'm being followed by drones
 
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...
Worldsensing: A Real World Use Case for Flux by Albert Zaragoza, CTO & Head o...
 
Mo.Le nec-midih_presentation_oc2
Mo.Le nec-midih_presentation_oc2Mo.Le nec-midih_presentation_oc2
Mo.Le nec-midih_presentation_oc2
 
Mamoc dmc smart systems-midih_oc2_demoday
Mamoc dmc smart systems-midih_oc2_demodayMamoc dmc smart systems-midih_oc2_demoday
Mamoc dmc smart systems-midih_oc2_demoday
 
HiTech Manufacturing Use Cases/Examples
HiTech Manufacturing Use Cases/ExamplesHiTech Manufacturing Use Cases/Examples
HiTech Manufacturing Use Cases/Examples
 
The Single Most Important Formula for Business Success
The Single Most Important Formula for Business SuccessThe Single Most Important Formula for Business Success
The Single Most Important Formula for Business Success
 
Splunk at Lloyds Banking Group
Splunk at Lloyds Banking GroupSplunk at Lloyds Banking Group
Splunk at Lloyds Banking Group
 
Heimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11bHeimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11b
 
Saving Human Lives with the IoT
Saving Human Lives with the IoTSaving Human Lives with the IoT
Saving Human Lives with the IoT
 

Similar to Using the R Language in BI and Real Time Applications (useR 2015)

Extending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and SpotfireExtending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and SpotfireLou Bajuk
 
Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015Lou Bajuk
 
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Data Con LA
 
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...Chief Analytics Officer Forum
 
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025Nicola Sandoli
 
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...Databricks
 
Engineering Effectiveness
Engineering EffectivenessEngineering Effectiveness
Engineering EffectivenessMarcio Sete
 
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Matt Stubbs
 
Houston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO SlidesHouston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO SlidesJennifer Walsh
 
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsAhead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsInside Analysis
 
Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...
Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...
Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...Senturus
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Spark Summit
 
Framework and Product Comparison for Big Data Log Analytics and ITOA
Framework and Product Comparison for Big Data Log Analytics and ITOA Framework and Product Comparison for Big Data Log Analytics and ITOA
Framework and Product Comparison for Big Data Log Analytics and ITOA Kai Wähner
 
RTBkit Introduction & Best Practices
RTBkit Introduction & Best PracticesRTBkit Introduction & Best Practices
RTBkit Introduction & Best PracticesDatacratic
 
apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...
apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...
apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...apidays
 
MMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptx
MMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptxMMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptx
MMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptxFIAT/IFTA
 
Telco Business & Technology
Telco Business & TechnologyTelco Business & Technology
Telco Business & TechnologySARCCOM
 

Similar to Using the R Language in BI and Real Time Applications (useR 2015) (20)

Extending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and SpotfireExtending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and Spotfire
 
Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015
 
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
 
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
 
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
 
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
 
Engineering Effectiveness
Engineering EffectivenessEngineering Effectiveness
Engineering Effectiveness
 
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
 
Houston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO SlidesHouston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO Slides
 
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsAhead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time Analytics
 
Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...
Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...
Advanced Analytics in Tableau: Use the Force!, Built-In Functions and 3rd Par...
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
 
Framework and Product Comparison for Big Data Log Analytics and ITOA
Framework and Product Comparison for Big Data Log Analytics and ITOA Framework and Product Comparison for Big Data Log Analytics and ITOA
Framework and Product Comparison for Big Data Log Analytics and ITOA
 
RTBkit Introduction & Best Practices
RTBkit Introduction & Best PracticesRTBkit Introduction & Best Practices
RTBkit Introduction & Best Practices
 
II-SDV 2016 GRIDLOGICS
II-SDV 2016 GRIDLOGICSII-SDV 2016 GRIDLOGICS
II-SDV 2016 GRIDLOGICS
 
Rpa consulting service in cognic
Rpa consulting service in cognicRpa consulting service in cognic
Rpa consulting service in cognic
 
apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...
apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...
apidays LIVE Australia - The Evolution of APIs: Events and the AsyncAPI speci...
 
MMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptx
MMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptxMMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptx
MMC Seminar May 2015 Jonas Engstrom (Mayam) Keynote pptx
 
Telco Business & Technology
Telco Business & TechnologyTelco Business & Technology
Telco Business & Technology
 
Airtel-BML
Airtel-BMLAirtel-BML
Airtel-BML
 

More from Lou Bajuk

R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017Lou Bajuk
 
Reusing and Managing R models in an Enterprise
Reusing and Managing  R models in an EnterpriseReusing and Managing  R models in an Enterprise
Reusing and Managing R models in an EnterpriseLou Bajuk
 
R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017Lou Bajuk
 
Making Data Science accessible to a wider audience
Making Data Science accessible to a wider audienceMaking Data Science accessible to a wider audience
Making Data Science accessible to a wider audienceLou Bajuk
 
R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017Lou Bajuk
 
Tibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmapTibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmapLou Bajuk
 
Embracing data science for smarter analytics apps
Embracing data science for smarter analytics appsEmbracing data science for smarter analytics apps
Embracing data science for smarter analytics appsLou Bajuk
 
EARL Sept 2016 R consortium
EARL Sept 2016 R consortiumEARL Sept 2016 R consortium
EARL Sept 2016 R consortiumLou Bajuk
 
The Importance of an Analytics Platform
The Importance of an Analytics PlatformThe Importance of an Analytics Platform
The Importance of an Analytics PlatformLou Bajuk
 
Software Testing and the R language
Software Testing and the R languageSoftware Testing and the R language
Software Testing and the R languageLou Bajuk
 
The Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERRThe Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERRLou Bajuk
 

More from Lou Bajuk (11)

R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017
 
Reusing and Managing R models in an Enterprise
Reusing and Managing  R models in an EnterpriseReusing and Managing  R models in an Enterprise
Reusing and Managing R models in an Enterprise
 
R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017
 
Making Data Science accessible to a wider audience
Making Data Science accessible to a wider audienceMaking Data Science accessible to a wider audience
Making Data Science accessible to a wider audience
 
R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017
 
Tibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmapTibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmap
 
Embracing data science for smarter analytics apps
Embracing data science for smarter analytics appsEmbracing data science for smarter analytics apps
Embracing data science for smarter analytics apps
 
EARL Sept 2016 R consortium
EARL Sept 2016 R consortiumEARL Sept 2016 R consortium
EARL Sept 2016 R consortium
 
The Importance of an Analytics Platform
The Importance of an Analytics PlatformThe Importance of an Analytics Platform
The Importance of an Analytics Platform
 
Software Testing and the R language
Software Testing and the R languageSoftware Testing and the R language
Software Testing and the R language
 
The Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERRThe Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERR
 

Recently uploaded

Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesŁukasz Chruściel
 
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Matt Ray
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringHironori Washizaki
 
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdfExploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdfkalichargn70th171
 
PREDICTING RIVER WATER QUALITY ppt presentation
PREDICTING  RIVER  WATER QUALITY  ppt presentationPREDICTING  RIVER  WATER QUALITY  ppt presentation
PREDICTING RIVER WATER QUALITY ppt presentationvaddepallysandeep122
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...
Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...
Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...Angel Borroy López
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 
cpct NetworkING BASICS AND NETWORK TOOL.ppt
cpct NetworkING BASICS AND NETWORK TOOL.pptcpct NetworkING BASICS AND NETWORK TOOL.ppt
cpct NetworkING BASICS AND NETWORK TOOL.pptrcbcrtm
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
How to submit a standout Adobe Champion Application
How to submit a standout Adobe Champion ApplicationHow to submit a standout Adobe Champion Application
How to submit a standout Adobe Champion ApplicationBradBedford3
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceBrainSell Technologies
 
Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Mater
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanyChristoph Pohl
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsChristian Birchler
 
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Natan Silnitsky
 
Odoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 EnterpriseOdoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 Enterprisepreethippts
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalLionel Briand
 

Recently uploaded (20)

Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New Features
 
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their Engineering
 
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdfExploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
 
PREDICTING RIVER WATER QUALITY ppt presentation
PREDICTING  RIVER  WATER QUALITY  ppt presentationPREDICTING  RIVER  WATER QUALITY  ppt presentation
PREDICTING RIVER WATER QUALITY ppt presentation
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...
Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...
Alfresco TTL#157 - Troubleshooting Made Easy: Deciphering Alfresco mTLS Confi...
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 
cpct NetworkING BASICS AND NETWORK TOOL.ppt
cpct NetworkING BASICS AND NETWORK TOOL.pptcpct NetworkING BASICS AND NETWORK TOOL.ppt
cpct NetworkING BASICS AND NETWORK TOOL.ppt
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
How to submit a standout Adobe Champion Application
How to submit a standout Adobe Champion ApplicationHow to submit a standout Adobe Champion Application
How to submit a standout Adobe Champion Application
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. Salesforce
 
Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
 
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort ServiceHot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
 
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
 
Odoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 EnterpriseOdoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 Enterprise
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive Goal
 

Using the R Language in BI and Real Time Applications (useR 2015)

  • 1. Applying the R Language in Streaming Applications and Business Intelligence Lou Bajuk-Yorgan Sr. Dir., Product Management TIBCO Spotfire lbajuk@tibco.com @loubajuk © Copyright 2000-2014 TIBCO Software Inc. 1
  • 2. R in Streaming Applications and Business Intelligence • TIBCO’s History with S+ and R • Challenges of R for Enterprise applications • TIBCO Enterprise Runtime for R (TERR) • Applications of R/TERR for BI and Streaming • Learn more and try it yourself - 2
  • 3. TIBCO’s Unique History with R/S • John Chambers developed the S language at Bell Labs – Starting in the mid 70’s • Insightful founded (as StatSci) to commercialize S as S+ in 1987 – The “plus”: statistical libraries, documentation, and support – Focused on commercial users, ease of use, server integration • R: development begun by Ross Ihaka and Robert Gentleman at University of Auckland in mid 90’s • Insightful joined TIBCO in 2008 – Spotfire (for Data Discovery and Visualization) joined in 2007 • Focus on applying Advanced Analytics in Spotfire & TIBCO real-time applications – Embraced R language as part of a broader Advanced Analytic Ecosystem • Ongoing commitment to the R Community – useR sponsor for 7 years running – Founding member of the R Consortium
  • 4. Embracing R • Spotfire Statistics Server – Integration of R & S+ into Spotfire applications • Later SAS® & MATLAB® – Leverage the interactive visualizations, data access and application development of Spotfire • Well received—but our Enterprise customers needed more – Clear customer-feedback on the Open Source R engine’s shortcomings for Enterprise usage - 4
  • 5. Challenges with R in the Enterprise • R provides tremendous benefits to statisticians – Enterprises are challenged to leverage that value • Enterprises need: – R’s expansive flexibility to develop the most powerful and relevant predictive models – Enterprise-friendly R  Better performance than open source R  faster, more memory efficient, greater scalability  Fully supported R environment  Tightly integrated into enterprise applications – Agility to use R through the entire prototyping-to-production process • Vendors & application developers need: – An embeddable R engine that is not open-source GPL licensed – Alternative to loose integrations, manual configuration and poor user experience
  • 6. TIBCO Enterprise Runtime for R (TERR) • Unique, enterprise-grade statistics engine, architected from the ground up by TIBCO – Based on TIBCO’s long history and expertise with S+ – Better performance and memory management than open source R • Designed for R language compatibility – Wide range of built-in analytic methods – Extensible through R community packages • Designed for commercial embeddability – TIBCO licensed & supported product – Not GPL, not a repackaging of the Open source R engine • TERR extends the reach of R in the enterprise – Develop code in open source R – Deploy on a commercially-supported and robust platform – Without the delay and cost of rewriting your code
  • 7. Example 1: Embedded TERR in Spotfire • Spotfire: Data Discovery and Visualization platform for Business Users and Analysts – Separate analytics platform, independent of TERR/R • Easily enhance Spotfire analyses and applications with R language scripts – Extend the impact of the Data Scientist/R by making their analytic insights available to a wider audience Write R code directly in Spotfire; TERR executes locally or on server Manage TERR analytics locally or in Server to reuse across community Deploy TERR-powered applications to the web
  • 8. Illustrating the power of embedded Advanced Analytics See the live demo at the TIBCO Booth
  • 9. Advanced Analytic Applications in Spotfire Customer Churn: • Retain your most profitable customers • Increase upsell, decrease churn Fraud Detection: • Reduce losses due to fraudulent transactions Supply Chain Optimization: • Anticipate peaks and lulls • Optimize distribution centers HR Planning: • Predict employee attrition and optimize retention
  • 10. • TERR powers real-time advanced analytics in TIBCO “Fast Data” – When an event is identified, the CEP application applies a predictive model, and then can trigger an automated business process – E.g., extend a mobile offer to a customer; stop a fraudulent transaction in process Example 2: TERR in TIBCO’s Complex Event Processing Model Develop model Deploy via TERR in TIBCO Streambase or Business Events Act Automatically monitor real-time transactions Automatically trigger action Analyze Analyze data in Spotfire Uncover patterns, trends & correlations
  • 11. • Port Congestion Detection – Real time system triggers TERR – Analyzes port congestion – Recommends reduction of speed if no berths available • Maritime Abnormality Detection – Based on Automatic Identification System info, TERR calculates likelihood of deviation from normal sailing routes – Alerts carrier & operator Logistics Optimization
  • 12. • Oil & Gas Extraction – Maintenance Downtime and Equipment failures are costly – Engineers track sensor data to find leading indicators • Temperature, vibration, etc. • Engineers usually use ad hoc rules on leading indicators – R/TERR used to develop predictive models for preventative maintenance – Deployed in real-time systems, alert when maintenance recommended Predictive Maintenance for Oil & Gas © Copyright 2000-2013 TIBCO Software Inc.
  • 13. TERR for individual R users • Empower R users – Enterprise platform for the deployment and integration of your work—without having to rewrite it! • TERR Developer Edition – Full version of TERR engine for testing code prior to deployment • Compatible with RStudio & ESS Emacs – Free for non-production use – Supported through Community site – Available at Tap.tibco.com -
  • 14. Summary • TIBCO makes the power of R available across the enterprise – Ad-hoc Predictive Analytics for Data Scientists  Spotfire & TERR – Guided Analytic Applications  Spotfire & Statistics Services predictive ecosystem, starring TERR – Event-driven, real-time analytics  Spotfire Event Analytics, TIBCO CEP & TERR • TERR is R for the Enterprise – Enables customers to develop code in open source R, then deploy their R code on commercially-supported and robust platforms—without recoding, saving time & money – Enables TIBCO, partners & customers products to tightly & efficiently embed R language functionality
  • 15. • TERR Community at TIBCOmmunity.com – Resources, Documentation, FAQs, Forums – More info at spotfire.tibco.com/terr • TERR Developer Edition – Full version of TERR engine for testing code prior to deployment – Supported through TIBCOmmunity, download via tap.tibco.com • Spotfire Free Trial: http://spotfire.tibco.com/trial • Presentations: http://www.slideshare.net/loubajukyorgan/presentations – Will post slides to twitter @loubajuk #useR2015 • Stop by our booth • R Consortium Founding Member www.r-consortium.org Learn more and Try it yourself
  • 16. © Copyright 2000-2013 TIBCO Software Inc. Supplemental Slides
  • 17. Broadening TERR Partner Ecosystem • Lavastorm Analytics – Visual workflow tool for data management and analysis – Embedding TERR for R scripting and predictive tools • RStudio IDE – Free, open source IDE widely used by the R Community – Fully compatible with TERR Developer Edition • KNIME – Free, open source workflow tool for data management and analysis – TERR fully compatible with KNIME Interactive R Statistics Integration nodes