SlideShare a Scribd company logo
1 of 20
Delivering Instant Self-Service
Analytics with Tableau on Big Data
Saikat Basu
2020.4
© Kyligence Inc. 2019, Confidential.
Agenda
Trends in Big Data Analytics
Challenges Faced by Traditional
BI
Kyligence + Tableau Solutions
Case Study
Demo
Who We Are
© Kyligence Inc. 2019, Confidential.
Business Use Case
• Storm season was almost over when a very late forecast came - within a few days a massive cyclone would hit
• Would impact 8 states in the South and South-East
• Largest retailer in the country stocked a ton of appropriate inventory in 100s of stores
• Most of these items sold out
• On the day of the storm, retail management struggled to make discount decisions on the storm inventory
• Their goal was to sell out to avoid carrying the cost later
© Kyligence Inc. 2019, Confidential.
Apache Kylin
Top Level Apache Project
 The only open source OLAP on
big data platform
Best Open Source Big Data Tool
 InfoWorld’s Bossies (Best of Open Source
Software Awards) in 2015 & 2016
Sub-Second Interactive Query
 Large scale, high concurrency, sub-second
query latency, multi-dimension
1,000+ Organizations
 Adopted by thousands of organizations
globally
© Kyligence Inc. 2019, Confidential.
Kyligence = Kylin + Intelligence
• Founded in 2016 by the creators of Apache Kylin
• Built around Kylin, with augmented AI and enhanced to deliver
unprecedented enterprise analytic performance
• CRN Top-10 big data startups in 2018
• Global Presence: San Jose, Seattle, New York, Shanghai, Beijing
• VCs: Fidelity International, Shunwei Capital, Broadband Capital,
Redpoint, Cisco, Coatue
Accelerate Critical Business Decisions with AI-Augmented Data Management and Analytics
2016
Founded Pre-
A
Redpoint
Cisco
2017
Series A
CBC
Shunwei
2018
Series B
8Roads
2019
Series C
Coatue
© Kyligence Inc. 2019, Confidential.
Trends in Enterprise Analytics in the Big Data Era
#1
More
Requirements
Static Reports
Multi-Dimensional Analysis
Ad-Hoc Queries
Detail Queries
• Reporting
• Dashboard
• OLAP
• Detail Query
• Ad-hoc
• Self-Analysis
• Data mining
• Real Time
• AI / ML
Gartner Analytics Ascendancy Model
© Kyligence Inc. 2019, Confidential.
#2
Data Analysts
More Users
More Artificial Intelligence
More Automation
Partners/Clients
Business Users
Analysts Satisfied Users
Only 20% of
requirements
are served
Mgmt.
Data Users and Their Behavior
1 Management
2 Data Analysts
3 Business Users
4 Partners/Clients
 Reports  Dashboard
s
 Self-
Service
 Data
Mining
 Self-
Service
 Real-Time
 Reports Self-
Service
Ever Increasing Demands From User Groups
© Kyligence Inc. 2019, Confidential.
#3
Augmented
Analytics
Gartner’s 2019 Top 10
Strategic Technology Trends
Evolution of Analysis Technologies
© Kyligence Inc. 2019, Confidential.
Challenges Faced by Traditional BI in the Big Data
Era
$$$
• Cost is hard to control
• Not enough budget for growth
• Very high TCO
• Old, hard-to-expand architecture
• Limited concurrency
• No elasticity and cloud storage
• Does not support interactive
analysis
• Difficult to get values from data
• Slow query performance
• Long development cycle
COMPUTE
STORE
© Kyligence Inc. 2019, Confidential.
Industry Is Waiting for a New Disruptive Solution
Data Analysis
360 Degree Single Source of
Truth
Interactive Dashboards
with Drill-Down Capabilities
Self-Service
Interactive Analysis
Multi-Dimensional Analysis
AI-Augmented OLAP
Sub-Second Response
Hybrid Cloud Model
Optimized Pay-Per-Use Price
State-of-the-Art Technology
(SPARK)
Enterprise-Scale Data Lake
Business AnalyticsIT Infrastructure
© Kyligence Inc. 2019, Confidential.
Kyligence’s Flexible & Scalable Architecture
Fault tolerant, cost-optimized infrastructure
High concurrency, high performance, sub-second
response
Easy to deploy, automated cluster formation on the
cloud
Single
Bootstrap
Node
Secured, isolated multi-tenancy platform
Load Balanced
Cluster
Read-Write
Separation
Multi-Tenancy
© Kyligence Inc. 2019, Confidential.
Kyligence + Tableau Self-Service Analytics Solution
Fast Query Response Time
Tableau Live mode for sub-second response
on PB scale data, with high concurrency
AI-Augmented Modeling
Automates model design and cube building
with the Kyligence algorithm
Self-Service Analysis
For business users and data analysts
Universal Semantic Layer
Model is synchronized with Tableau
with the click of a button
© Kyligence Inc. 2019, Confidential.
Kyligence + Tableau – Combined Ecosystem
Data Prep ETL Scheduling
Developer
s
Deposits
TopN
Wealth
Mgmt. Cube
Asset Mgmt.
Cube
Analysts
 Data Preparation
 Model Design
 Model Publish
 Self-Service Analysis
Business
Modeler
s
Model
Desig
n
Resource
Mgmt.
Kyligence
Self-
Service
Analysis
Tableau Server Tableau Desktop
Enterprise
Account
Cube
Risk Cube
User
Analysis
Self-Service AnalysisAsset
Analysis
Publish
Self-Service Dashboard Subscription/Share Enhancements
tds tdsSQL SQL
© Kyligence Inc. 2019, Confidential.
TDS
Kyligence + Tableau: 3 Steps to Self-Service Analysis
Create Model / Cube Export TDS File
Open TDS with
Tableau
Download
in one click
• Synchronizes model and semantic definitions with Tableau with the click of a button
• Supports Tableau generated queries
• Reduces time and resource needed to develop BI reports and dashboards
TDS
Use Case
© Kyligence Inc. 2019, Confidential.
Tableau
Analysis
Platform
Analysis/Repor
t
Legacy DB
Dashboard
Retail
CRM
B2B
Analysis
OLAP Cube
Hadoop
Migration - Architectural Changes for a Retailer
 Architecture Evolution
 From Legacy RDBMS + Traditional BI to
Hadoop + open standard analytic platform
 Benefits
 Saved cost significantly
 Fast query response time
 Agile development environment
 Quick and informed business decision
One Stop Info
Mgmt.
Analysis for Retail
Customers
Analysis for
Business
Customers
Data Layer: Migrated from DB to Hadoop
OLAP Layer: From Cognos Cubes to
Kyligence
Presentation: From Cognos to Tableau
Migratio
n
Traditional BI
Platform
© Kyligence Inc. 2019, Confidential.
Tableau
Analysis
Platform
Cognos
Analysis/Repor
t
DB2
Dashboard
Retail
CRM
B2B
Analysis
Cognos Cube
Hadoop
Migration - Architectural Changes for a Bank
 Architecture Evolution
 From DB2 + Cognos Cubes to Hadoop +
Kyligence
 Benefits
 90%+ of queries finish in < 2 seconds
 More time-based analysis options (Daily -> Hourly)
 Seamless integration with Tableau
 Improved efficiency with Kyligence’s auto-
modeling
 Improved efficiency building cubes on Hadoop
One Stop Info
Mgmt.
Analysis for Retail
Customers
Analysis for
Business
Customers
Data Layer: Migrated from DB to Hadoop
OLAP Layer: From Cognos Cubes to
Kyligence
Presentation: From Cognos to Tableau
Migratio
n
Analysis
Platform
© Kyligence Inc. 2019, Confidential.
Traditional BI Platform vs. Self-Service BI Platform
Cognos + DB2 Tableau + Kyligence + Hadoop
Cluster Size 11 Cognos Servers + 9 DB2 Servers 40 Hadoop Nodes
HW/SW Cost $Millions $100,000s
OLAP Performance Minutes ~ Hours Seconds
Self-Service
Analysis
Not Supported Supported
Detailed Queries Not Supported Supported
Daily Delta Load
Time
10 Hours 1.5 Hours
Concurrency < 10 100s ~ 1,000s
150 million daily new records, 160+ dimensions
Demo
Thank You!
#kyligence
@kyligence
Connect with us on
LinkedIn,
Twitter & Facebook
Try Kyligence @ https://kyligence.io/download-free-
trial/
www.kyligence.io

More Related Content

More from Tyler Wishnoff

Augmented OLAP Analytics for Big Data
Augmented OLAP Analytics for Big DataAugmented OLAP Analytics for Big Data
Augmented OLAP Analytics for Big DataTyler Wishnoff
 
Simplify Data Analytics Over the Cloud
Simplify Data Analytics Over the CloudSimplify Data Analytics Over the Cloud
Simplify Data Analytics Over the CloudTyler Wishnoff
 
Apache Kylin Meetup: Berlin - With OLX Group
Apache Kylin Meetup: Berlin - With OLX GroupApache Kylin Meetup: Berlin - With OLX Group
Apache Kylin Meetup: Berlin - With OLX GroupTyler Wishnoff
 
Apache Kylin Data Summit 2019: Kyligence Presentation
Apache Kylin Data Summit 2019: Kyligence PresentationApache Kylin Data Summit 2019: Kyligence Presentation
Apache Kylin Data Summit 2019: Kyligence PresentationTyler Wishnoff
 
Augmented OLAP for Big Data Analytics
Augmented OLAP for Big Data AnalyticsAugmented OLAP for Big Data Analytics
Augmented OLAP for Big Data AnalyticsTyler Wishnoff
 
Take the Bias out of Big Data Insights With Augmented Analytics
Take the Bias out of Big Data Insights With Augmented AnalyticsTake the Bias out of Big Data Insights With Augmented Analytics
Take the Bias out of Big Data Insights With Augmented AnalyticsTyler Wishnoff
 
How Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
How Analytics Teams Using SSAS Can Embrace Big Data and the CloudHow Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
How Analytics Teams Using SSAS Can Embrace Big Data and the CloudTyler Wishnoff
 
Accelerating Big Data Analytics with Apache Kylin
Accelerating Big Data Analytics with Apache KylinAccelerating Big Data Analytics with Apache Kylin
Accelerating Big Data Analytics with Apache KylinTyler Wishnoff
 

More from Tyler Wishnoff (8)

Augmented OLAP Analytics for Big Data
Augmented OLAP Analytics for Big DataAugmented OLAP Analytics for Big Data
Augmented OLAP Analytics for Big Data
 
Simplify Data Analytics Over the Cloud
Simplify Data Analytics Over the CloudSimplify Data Analytics Over the Cloud
Simplify Data Analytics Over the Cloud
 
Apache Kylin Meetup: Berlin - With OLX Group
Apache Kylin Meetup: Berlin - With OLX GroupApache Kylin Meetup: Berlin - With OLX Group
Apache Kylin Meetup: Berlin - With OLX Group
 
Apache Kylin Data Summit 2019: Kyligence Presentation
Apache Kylin Data Summit 2019: Kyligence PresentationApache Kylin Data Summit 2019: Kyligence Presentation
Apache Kylin Data Summit 2019: Kyligence Presentation
 
Augmented OLAP for Big Data Analytics
Augmented OLAP for Big Data AnalyticsAugmented OLAP for Big Data Analytics
Augmented OLAP for Big Data Analytics
 
Take the Bias out of Big Data Insights With Augmented Analytics
Take the Bias out of Big Data Insights With Augmented AnalyticsTake the Bias out of Big Data Insights With Augmented Analytics
Take the Bias out of Big Data Insights With Augmented Analytics
 
How Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
How Analytics Teams Using SSAS Can Embrace Big Data and the CloudHow Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
How Analytics Teams Using SSAS Can Embrace Big Data and the Cloud
 
Accelerating Big Data Analytics with Apache Kylin
Accelerating Big Data Analytics with Apache KylinAccelerating Big Data Analytics with Apache Kylin
Accelerating Big Data Analytics with Apache Kylin
 

Recently uploaded

Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一fhwihughh
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)jennyeacort
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...dajasot375
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhijennyeacort
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]📊 Markus Baersch
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfchwongval
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Cantervoginip
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queensdataanalyticsqueen03
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 217djon017
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort servicejennyeacort
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 

Recently uploaded (20)

Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝DelhiRS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
RS 9000 Call In girls Dwarka Mor (DELHI)⇛9711147426🔝Delhi
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]
 
Multiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdfMultiple time frame trading analysis -brianshannon.pdf
Multiple time frame trading analysis -brianshannon.pdf
 
ASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel CanterASML's Taxonomy Adventure by Daniel Canter
ASML's Taxonomy Adventure by Daniel Canter
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queens
 
Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2Easter Eggs From Star Wars and in cars 1 and 2
Easter Eggs From Star Wars and in cars 1 and 2
 
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
9711147426✨Call In girls Gurgaon Sector 31. SCO 25 escort service
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 

Deliver Instant Self-Service Analytics with Tableau on Big Data

  • 1. Delivering Instant Self-Service Analytics with Tableau on Big Data Saikat Basu 2020.4
  • 2. © Kyligence Inc. 2019, Confidential. Agenda Trends in Big Data Analytics Challenges Faced by Traditional BI Kyligence + Tableau Solutions Case Study Demo Who We Are
  • 3. © Kyligence Inc. 2019, Confidential. Business Use Case • Storm season was almost over when a very late forecast came - within a few days a massive cyclone would hit • Would impact 8 states in the South and South-East • Largest retailer in the country stocked a ton of appropriate inventory in 100s of stores • Most of these items sold out • On the day of the storm, retail management struggled to make discount decisions on the storm inventory • Their goal was to sell out to avoid carrying the cost later
  • 4. © Kyligence Inc. 2019, Confidential. Apache Kylin Top Level Apache Project  The only open source OLAP on big data platform Best Open Source Big Data Tool  InfoWorld’s Bossies (Best of Open Source Software Awards) in 2015 & 2016 Sub-Second Interactive Query  Large scale, high concurrency, sub-second query latency, multi-dimension 1,000+ Organizations  Adopted by thousands of organizations globally
  • 5. © Kyligence Inc. 2019, Confidential. Kyligence = Kylin + Intelligence • Founded in 2016 by the creators of Apache Kylin • Built around Kylin, with augmented AI and enhanced to deliver unprecedented enterprise analytic performance • CRN Top-10 big data startups in 2018 • Global Presence: San Jose, Seattle, New York, Shanghai, Beijing • VCs: Fidelity International, Shunwei Capital, Broadband Capital, Redpoint, Cisco, Coatue Accelerate Critical Business Decisions with AI-Augmented Data Management and Analytics 2016 Founded Pre- A Redpoint Cisco 2017 Series A CBC Shunwei 2018 Series B 8Roads 2019 Series C Coatue
  • 6. © Kyligence Inc. 2019, Confidential. Trends in Enterprise Analytics in the Big Data Era #1 More Requirements Static Reports Multi-Dimensional Analysis Ad-Hoc Queries Detail Queries • Reporting • Dashboard • OLAP • Detail Query • Ad-hoc • Self-Analysis • Data mining • Real Time • AI / ML Gartner Analytics Ascendancy Model
  • 7. © Kyligence Inc. 2019, Confidential. #2 Data Analysts More Users More Artificial Intelligence More Automation Partners/Clients Business Users Analysts Satisfied Users Only 20% of requirements are served Mgmt. Data Users and Their Behavior 1 Management 2 Data Analysts 3 Business Users 4 Partners/Clients  Reports  Dashboard s  Self- Service  Data Mining  Self- Service  Real-Time  Reports Self- Service Ever Increasing Demands From User Groups
  • 8. © Kyligence Inc. 2019, Confidential. #3 Augmented Analytics Gartner’s 2019 Top 10 Strategic Technology Trends Evolution of Analysis Technologies
  • 9. © Kyligence Inc. 2019, Confidential. Challenges Faced by Traditional BI in the Big Data Era $$$ • Cost is hard to control • Not enough budget for growth • Very high TCO • Old, hard-to-expand architecture • Limited concurrency • No elasticity and cloud storage • Does not support interactive analysis • Difficult to get values from data • Slow query performance • Long development cycle COMPUTE STORE
  • 10. © Kyligence Inc. 2019, Confidential. Industry Is Waiting for a New Disruptive Solution Data Analysis 360 Degree Single Source of Truth Interactive Dashboards with Drill-Down Capabilities Self-Service Interactive Analysis Multi-Dimensional Analysis AI-Augmented OLAP Sub-Second Response Hybrid Cloud Model Optimized Pay-Per-Use Price State-of-the-Art Technology (SPARK) Enterprise-Scale Data Lake Business AnalyticsIT Infrastructure
  • 11. © Kyligence Inc. 2019, Confidential. Kyligence’s Flexible & Scalable Architecture Fault tolerant, cost-optimized infrastructure High concurrency, high performance, sub-second response Easy to deploy, automated cluster formation on the cloud Single Bootstrap Node Secured, isolated multi-tenancy platform Load Balanced Cluster Read-Write Separation Multi-Tenancy
  • 12. © Kyligence Inc. 2019, Confidential. Kyligence + Tableau Self-Service Analytics Solution Fast Query Response Time Tableau Live mode for sub-second response on PB scale data, with high concurrency AI-Augmented Modeling Automates model design and cube building with the Kyligence algorithm Self-Service Analysis For business users and data analysts Universal Semantic Layer Model is synchronized with Tableau with the click of a button
  • 13. © Kyligence Inc. 2019, Confidential. Kyligence + Tableau – Combined Ecosystem Data Prep ETL Scheduling Developer s Deposits TopN Wealth Mgmt. Cube Asset Mgmt. Cube Analysts  Data Preparation  Model Design  Model Publish  Self-Service Analysis Business Modeler s Model Desig n Resource Mgmt. Kyligence Self- Service Analysis Tableau Server Tableau Desktop Enterprise Account Cube Risk Cube User Analysis Self-Service AnalysisAsset Analysis Publish Self-Service Dashboard Subscription/Share Enhancements tds tdsSQL SQL
  • 14. © Kyligence Inc. 2019, Confidential. TDS Kyligence + Tableau: 3 Steps to Self-Service Analysis Create Model / Cube Export TDS File Open TDS with Tableau Download in one click • Synchronizes model and semantic definitions with Tableau with the click of a button • Supports Tableau generated queries • Reduces time and resource needed to develop BI reports and dashboards TDS
  • 16. © Kyligence Inc. 2019, Confidential. Tableau Analysis Platform Analysis/Repor t Legacy DB Dashboard Retail CRM B2B Analysis OLAP Cube Hadoop Migration - Architectural Changes for a Retailer  Architecture Evolution  From Legacy RDBMS + Traditional BI to Hadoop + open standard analytic platform  Benefits  Saved cost significantly  Fast query response time  Agile development environment  Quick and informed business decision One Stop Info Mgmt. Analysis for Retail Customers Analysis for Business Customers Data Layer: Migrated from DB to Hadoop OLAP Layer: From Cognos Cubes to Kyligence Presentation: From Cognos to Tableau Migratio n Traditional BI Platform
  • 17. © Kyligence Inc. 2019, Confidential. Tableau Analysis Platform Cognos Analysis/Repor t DB2 Dashboard Retail CRM B2B Analysis Cognos Cube Hadoop Migration - Architectural Changes for a Bank  Architecture Evolution  From DB2 + Cognos Cubes to Hadoop + Kyligence  Benefits  90%+ of queries finish in < 2 seconds  More time-based analysis options (Daily -> Hourly)  Seamless integration with Tableau  Improved efficiency with Kyligence’s auto- modeling  Improved efficiency building cubes on Hadoop One Stop Info Mgmt. Analysis for Retail Customers Analysis for Business Customers Data Layer: Migrated from DB to Hadoop OLAP Layer: From Cognos Cubes to Kyligence Presentation: From Cognos to Tableau Migratio n Analysis Platform
  • 18. © Kyligence Inc. 2019, Confidential. Traditional BI Platform vs. Self-Service BI Platform Cognos + DB2 Tableau + Kyligence + Hadoop Cluster Size 11 Cognos Servers + 9 DB2 Servers 40 Hadoop Nodes HW/SW Cost $Millions $100,000s OLAP Performance Minutes ~ Hours Seconds Self-Service Analysis Not Supported Supported Detailed Queries Not Supported Supported Daily Delta Load Time 10 Hours 1.5 Hours Concurrency < 10 100s ~ 1,000s 150 million daily new records, 160+ dimensions
  • 19. Demo
  • 20. Thank You! #kyligence @kyligence Connect with us on LinkedIn, Twitter & Facebook Try Kyligence @ https://kyligence.io/download-free- trial/ www.kyligence.io