Weitere ähnliche Inhalte Ähnlich wie RWDG Webinar: Big Data & BI Analytics Require Data Governance (20) Mehr von DATAVERSITY (20) Kürzlich hochgeladen (20) RWDG Webinar: Big Data & BI Analytics Require Data Governance1. 1
1
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
Real-World Data Governance
Big Data & BI Analytics Require Data Governance
Monthly Webinar Series Hosted by Dataversity
Robert S. Seiner – KIK Consulting / TDAN.com
July 16, 2015 – 2:00 p.m. EST
Robert S. Seiner
KIK Consulting & Educational Services, LLC - KIKconsulting.com
The Data Administration Newsletter, LLC - TDAN.com
2. 2
2
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Real-World Data Governance – Monthly Webinar Series
– August 20 – Data Governance & Data Steward Certification
– September 17 – Data Modeling is Data Governance *
– October 15 – Govern Metadata: Vocabulary, Dictionaries and Data
– November 19 – Agile Data Governance: How to Apply Governance to Agile
– December 17 – Data Governance and the Internet of Thing
– Third Thursday at 2 pm EST
– Register On-Line at DATAVERSITY.net
– or TDAN.com or KIKConsulting.com
* with David C. Hay
Big Data & BI Analytics Require Data Governance
Upcoming Webinars
3. 3
3
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• The Data Administration Newsletter (TDAN.com):
Published Since 1997
Partnership with DATAVERSITY
Re-Launched July 1, 2015
Embracing Social Media – @TDAN_com
RSS Data News Feed
Authors & Practitioners for …
Articles, Columns, Features, Blogs
Welcome Back & Please Register
Big Data & BI Analytics Require Data Governance
Current Events
4. 4
4
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Non-Invasive Data Governance:
The Path of Least Resistance and Greatest Success
ISBN 9781935504856 / Technics Publishing – September 2014
• KIKConsulting.com
Home of Non-Invasive Data Governance™
Refurbished in 2014
• DATAVERSITY Events
Data Governance Financial Services 2015 Conference
With DEBtech International – September 28-29 – Jersey City, NJ
Considerations for Starting or Enhancing
Financial Data Governance Program
Enterprise DATAVERSITY 2015 Conference
November 2-5 – Chicago, IL
A Strategic Data Framework Based on
Governance Best Practices
5. 5
5
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• This webinar will cover:
– Existing Governance Applications for BI
– Future of Big Data & BI Data
– Relationship between Big Data, BI and Governance
– Articulating Value
– True Intelligence Derived from Governed Data
Big Data & BI Analytics Require Data Governance
Abstract
6. 6
6
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Data Governance is the execution and enforcement of authority
over the management of data and data-related assets.
• Data Stewardship is the formalization of accountability for the
management of data and data-related assets.
Big Data & BI Analytics Require Data Governance
Definitions
7. 7
7
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Non-Invasive Data Governance™
– The practice of:
• applying formal accountability & behavior
• through a non-invasive framework of roles & responsibilities
• to existing and / or new processes
• to assure that the definition, production & usage of data
• improves regulatory compliance, security, privacy & protection.
– Non-Invasive describes how governance is applied to assure
non-threatening management of valuable data assets.
– The goal is to be
» Transparent
» Supportive
» Collaborative.
Big Data & BI Analytics Require Data Governance
Definitions
8. 8
8
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Big Data
– Broad term for data sets so large or complex that traditional data
processing applications are inadequate.
– Challenges include, but are not limited to:
• Analysis
• Capture
• Curation
• Search
• Sharing
– Data Governance must be applied to all of these challenges.
• Storage
• Transfer
• Visualization
• Information Privacy
Big Data & BI Analytics Require Data Governance
Applications of Data Governance
Wikipedia
9. 9
9
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Business Intelligence
– Set of techniques and tools for the transformation of raw data into
meaningful and useful information for business analysis purposes.
– Common functions include, but are not limited to:
• Reporting
• Online Analytical Processing
• Process Mining
• Complex Event Processing
– Data Governance must be applied to all of these functions.
• Business Performance Management
• Benchmarking
• Predictive Analytics
• Prescriptive Analytics
Wikipedia
Big Data & BI Analytics Require Data Governance
Applications of Data Governance
10. 10
10
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• As companies generate increasingly more content (read big data),
they are coming to recognize that [big data] analytics is a
nonnegotiable.
• Gleaning business insight from [big data] analytics is still in the
early-adopter and well-hyped phase, but companies are beginning
to see results emerge in terms of smoother workflows, improved
search and better compliance [read governance] practices.
http://searchcontentmanagement.techtarget.com/tip/Content-analytics-becomes-an-enterprise-must-have
Big Data & BI Analytics Require Data Governance
Applications of Data Governance
11. 11
11
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• [Big Data] analytics is a business practice that analyzes and derives
insight from data about the amount of content being created, the
nature of that content and how it is used.
• [Big Data] analytics can help companies manage their information
lifecycle management chains by creating relevant cost and
consumption metrics.
• With business metrics in place, companies can identify which digital
content [big data] is most valuable and adjust investments in
storage and future analytics as needed.
http://searchcontentmanagement.techtarget.com/tip/Content-analytics-becomes-an-enterprise-must-have
Big Data & BI Analytics Require Data Governance
Applications of Data Governance
12. 12
12
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• How Much Data is Big?
– Bytes (8 bits)
– Kilobyte (1000 bytes)
– Megabyte (1 000 000 bytes)
– Gigabyte (1 000 000 000 bytes)
– Terabyte (1 000 000 000 000 bytes)
– Petabyte (1 000 000 000 000 000 bytes)
– Exabyte (1 000 000 000 000 000 000 bytes)
– Zetabyte (1 000 000 000 000 000 000 000 bytes)
– 2.7 Zetabytes of data existed in the digital universe as of 2012 – 35 Zetabytes to be created annually by 2020
– Yottabyte (1 000 000 000 000 000 000 000 000 bytes)
– Xenottabyte (1 000 000 000 000 000 000 000 000 000 bytes)
– Shilentnobyte (1 000 000 000 000 000 000 000 000 000 000 bytes)
– Domegemegrottebyte (1 000 000 000 000 000 000 000 000 000 000 000 bytes)
Big Data & BI Analytics Require Data Governance
More Data Then We Can Count
13. 13
13
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Why does Big Data require Data Governance?
– Big Data as an Asset
– Formalized Accountability
– Following the Rules
– Consistency in Big Data Application
– Metadata to Improve Value & Understanding
– Management of Big Data Definition
– Management of Big Data Production
– Management of Big Data Usage
Big Data & BI Analytics Require Data Governance
Why?
14. 14
14
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Why do BI Analytics require Data Governance?
– Data Drives Analytics
– Formalized Accountability
– Following the Rules
– Consistency in Analytical Application
– Metadata to Improve Value & Understanding
– Management of BI Data Definition
– Management of BI Data Production
– Management of BI Data Usage
Big Data & BI Analytics Require Data Governance
Why?
15. 15
15
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Metadata Past and Future
– Metadata in the past was limited to :
• Names
• Definitions
• Labels
– Metadata now encompasses
• Relationships between the
– Data
– People
– Processes
– Use of Big Data
Big Data & BI Analytics Require Data Governance
Metadata Lies at the Core
16. 16
16
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Metadata Required
– Metadata Continues to Evolve
• From a Data Management Asset
• To a Business Intelligence / Data Warehousing Asset
• To a Data Governance Asset
• To a Privacy and Confidentiality Asset
• To a Big Data & Analytical Asset
Big Data & BI Analytics Require Data Governance
Metadata Lies at the Core
17. 17
17
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Data Governance required for:
– Structured data
– Unstructured data
– Content
– Record
– Logs
– Social Media
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
18. 18
18
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Data Governance required for:
– Big Data
– Small Data
– Data Warehouse Data
– Master Data
– Metadata
– Analytical Data
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
19. 19
19
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Governing Perspectives for Big Data or Analytical Data
– Accountability Perspective
– Process Perspective
– Rules Perspective
– Inventory Perspective
– Decision Making Perspective
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
20. 20
20
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Governing Perspectives for Big Data or Analytical Data
– Accountability Perspective
• Definition
• Production
• Use
• Protection
• Understanding
• Retention / Elimination
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
21. 21
21
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Governing Perspectives for Big Data or Analytical Data
– Process Perspective
• Bill of “Rights”
• Ownership
• Participation
• Input
• Output / Outcomes
• Throughput
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
22. 22
22
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Governing Perspectives for Big Data or Analytical Data
– Rules Perspective
• Business Rules
• Compliance Rules
• Protection Rules
• Standard Rules
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
23. 23
23
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Governing Perspectives for Big Data or Analytical Data
– Inventory Perspective
• Quantitative
• Qualitative
• Ownership
• Usage
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
24. 24
24
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Governing Perspectives for Big Data or Analytical Data
– Decision Making Perspective
• Who makes the decision
• How they make the decision
• When they make the decision
• Who is impacted by the decision
• How they track decisions
Big Data & BI Analytics Require Data Governance
Governance Lies at the Core
25. 25
25
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• To look at the future … Let’s start by looking at the past …
– Business Intelligence Strategies have evolved from …
• Hierarchical Design
• Relational Design
• Dimensional Design
• Enterprise Data Warehouses
• Data Marts / Cubes / Distributed Databases
• Data Lakes – object-based storage repository that holds data
in its native format until it is needed.
• Unstructured Data & Big Data
Big Data & BI Analytics Require Data Governance
Future of Big Data & BI
26. 26
26
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• OK … Now let’s look to the future …
– Business Intelligence Strategies have evolved to …
• Data Mining – looking for a needle in the haystack
• Big Data Analytics – looking at the whole haystack
Big Data & BI Analytics Require Data Governance
Future of Big Data & BI
27. 27
27
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Three Vs of Big Data
– Volume
– Velocity
– Variety
– You saw the chart – Growing exponentially
– Present state handling of the Three Vs
Big Data & BI Analytics Require Data Governance
Future of Big Data & BI
28. 28
28
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• What are we going to do with all this data?
– We need to be able to make sense of the data.
– We need to be able to understand and trust the data.
– We need to be able to protect the data.
– We need to know where the data comes from.
– We need to be able to access the data.
– We need to be able to analyze the data.
Big Data & BI Analytics Require Data Governance
Future of Big Data & BI
29. 29
29
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• To achieve these goals:
– We need to be able to make sense of the data.
– We need to be able to understand and trust the data.
– We need to be able to protect the data.
– We need to know where the data comes from.
– We need to be able to access the data.
– We need to be able to analyze the data.
• What do we need? Data & Process & Technology
And we need all these things to be governed.
Some call this Information Governance.
Big Data & BI Analytics Require Data Governance
Future of Big Data & BI
30. 30
30
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Value of Data Governance to Big Data
– We just spoke about this so let’s reverse it!
• Value of Data Governance to BI Analytical Data
– We just spoke about this so let’s reverse it!
» What is the value of Big Data to Data Governance?
» What is the value of BI Analytics to Data Governance?
Big Data & BI Analytics Require Data Governance
Value of Governance
31. 31
31
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• What is the value of Big Data to Data Governance?
• What is the value of BI Analytics to Data Governance?
• Organizations need to use these things as their crutch to
– justify the investment in …
– maximize use of resources when doing …
– provide trustable data from …
– make better decisions using …
Big Data & BI Analytics Require Data Governance
Value to Governance
32. 32
32
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Bold Statement 1:
– Organizations that govern their data effectively get more value
from their Big Data and BI Analytics effort.
Big Data & BI Analytics Require Data Governance
Value to Governance
33. 33
33
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Bold Statement 2:
– Organizations that do not govern their data effectively either:
• Do not embark on these activities
• Get less value from their data-driven activities
Big Data & BI Analytics Require Data Governance
Value to Governance
34. 34
34
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Deriving Intelligence from Governed Data requires:
– Quality
– Understanding
– Protection
– Availability
– Accountability
Big Data & BI Analytics Require Data Governance
True Intelligence
35. 35
35
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Deriving Intelligence from Governed Data requires:
– Quality
• Data Standards
• Followed Process
• Escalation Paths
• Decision Rights
• Certification
Big Data & BI Analytics Require Data Governance
True Intelligence
36. 36
36
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Deriving Intelligence from Governed Data requires:
– Understanding
• Glossary
• Dictionary
• Mapping
• Validation
• Education
Big Data & BI Analytics Require Data Governance
True Intelligence
37. 37
37
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Deriving Intelligence from Governed Data requires:
– Protection
• Classification
• Security
• Auditability
• Process / Education
• Enforcement / Compliance
Big Data & BI Analytics Require Data Governance
True Intelligence
38. 38
38
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Deriving Intelligence from Governed Data requires:
– Availability
• Access
• Storage
• Timeliness
• Completeness
Big Data & BI Analytics Require Data Governance
True Intelligence
39. 39
39
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Deriving Intelligence from Governed Data requires:
– Accountability
• Formalization
• Stewardship
• Communications
• Execution – Enforcement of Authority
Big Data & BI Analytics Require Data Governance
True Intelligence
40. 40
40
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Main Points Covered:
– Existing Governance Applications for BI
– Future of Big Data & BI Data
– Relationship between Big Data, BI and Governance
– Articulating Value
– True Intelligence Derived from Governed Data
Big Data & BI Analytics Require Data Governance
Summary
41. 41
41
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Real-World Data Governance – Monthly Webinar Series
– August 20 – Data Governance & Data Steward Certification
Real-World Data Governance
Upcoming Webinar
42. 42
42
Copyright © 2015 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG
@RSeiner
• Robert S. Seiner
KIK Consulting & Educational Services – KIKconsulting.com
The Data Administration Newsletter – TDAN.com
Post Office Box 112571, Upper St. Clair, Pennsylvania 15241
412.220.9643, 412.220.9644 (Fax)
rseiner@kikconsulting.com
rseiner@tdan.com
@RSeiner
#RWDG
Real-World Data Governance
Contact Information