SlideShare ist ein Scribd-Unternehmen logo
1 von 58
Downloaden Sie, um offline zu lesen
DW Part 2 The Twins:  Data Quality & Business Intelligence Denise Jeffries [email_address] [email_address] 205.747.3301
Star Schema (facts and dimensions) ,[object Object],[object Object],[object Object],[object Object],[object Object]
Star Schema example (Sales db)
SnowFlake Schema ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Snowflake Schema example (Sales db)
Comparison of SQL Star vs SnowFlake ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Account, Customer & Address Relationships Account Contact Party Address link Account Party link Address Account Party Account Information loaded from  ALL Source Systems ETL process builds the relationship between Accounts and Customers (Party)  based on the  relationship file from CUSTOMER CRM SYSTEM
EDW Process State Staging Area EDW Metadata  |  Data Governance  |  Data Management DM CPS MANTAS CRDB MKTG FIN SALES EDW Data cleansing Data profiling Sync & Sort BI Source System Cleanse / Pre-process IMP RM OEC ALS AFS ST RE DFP SBA AFS V-PR
Explosion in innovation ,[object Object],[object Object],[object Object],[object Object],[object Object]
Change in Business ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Single definition of a data element needed for BI ,[object Object],[object Object],[object Object]
Business view of data ,[object Object],[object Object],[object Object]
Example of conforming data for business view: http://www.sserve.com/ftp/dwintro.doc
Business use of DW ,[object Object],[object Object],[object Object]
EDW Development Project Cycle (New Source to EDW)
DW - Roadmap Management Architecture (Metadata, Data Security, Systems Management)
SECTION 3 ,[object Object],[object Object],[object Object],[object Object]
Data Quality ,[object Object],[object Object],[object Object],[object Object],[object Object]
Roadmap to DQ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Profiling ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Profiling Example
Data Quality is measured as the degree of superiority, or excellence, of the various data that we use to create information products. ,[object Object]
Data Quality Tools  (Gartner Magic Quadrant)
Dimensions of Quality Informatica.com
Data Quality Measures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Definition ,[object Object],[object Object],[object Object],[object Object]
Accuracy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Completeness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Measures of  Completeness  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Coverage ,[object Object],[object Object]
Timeliness ,[object Object],[object Object],[object Object],[object Object],[object Object]
Validity ,[object Object],[object Object]
Data Quality Measures ,[object Object],[object Object],[object Object]
Measurement Informatica.com
Exercise: Changing the Data  (1 of 2) ,[object Object],[object Object],[object Object],[object Object]
Brainstorming Group Exercise  (2 of 2)  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
MDM Master Data Management ,[object Object],[object Object]
MDM ,[object Object]
What Is Master Data Management? ,[object Object]
5 Types of Data for MDM ,[object Object],[object Object],[object Object],[object Object]
5 types of data cont’d  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Exercise: ,[object Object],[object Object],[object Object]
SECTION 4 ,[object Object],[object Object],[object Object],[object Object]
SECTION 4 ,[object Object],[object Object],[object Object],[object Object],[object Object]
What is business intelligence ,[object Object],[object Object]
What is BI ,[object Object],[object Object]
BI solutions examples by industry ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
BI term coined Sept 1996 by  Gartner Group in a report ,[object Object]
Magic Quadrant for BI (Gartner)
BI ,[object Object],[object Object]
What kinds of companies use BI ,[object Object],[object Object]
When are you doing BI? ,[object Object],[object Object],[object Object]
How do you know if you are really doing BI? ,[object Object],[object Object],[object Object],[object Object]
BI Tools  &  What they do ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
BICC ,[object Object],[object Object],[object Object]
BICC ,[object Object],[object Object],[object Object],[object Object],[object Object]
Jobs in Business Intelligence ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
References ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Weitere ähnliche Inhalte

Was ist angesagt?

Reference master data management
Reference master data managementReference master data management
Reference master data managementDr. Hamdan Al-Sabri
 
Data Quality: A Raising Data Warehousing Concern
Data Quality: A Raising Data Warehousing ConcernData Quality: A Raising Data Warehousing Concern
Data Quality: A Raising Data Warehousing ConcernAmin Chowdhury
 
Data quality and data profiling
Data quality and data profilingData quality and data profiling
Data quality and data profilingShailja Khurana
 
Data Architecture for Data Governance
Data Architecture for Data GovernanceData Architecture for Data Governance
Data Architecture for Data GovernanceDATAVERSITY
 
Collibra - Forrester Presentation : Data Governance 2.0
Collibra - Forrester Presentation : Data Governance 2.0Collibra - Forrester Presentation : Data Governance 2.0
Collibra - Forrester Presentation : Data Governance 2.0Guillaume LE GALIARD
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best PracticesDATAVERSITY
 
Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)DATAVERSITY
 
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...DATAVERSITY
 
Activate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogActivate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogDATAVERSITY
 
The data quality challenge
The data quality challengeThe data quality challenge
The data quality challengeLenia Miltiadous
 
Data Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and GovernanceData Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and GovernanceDenodo
 
Date warehousing concepts
Date warehousing conceptsDate warehousing concepts
Date warehousing conceptspcherukumalla
 
Data Governance and Metadata Management
Data Governance and Metadata ManagementData Governance and Metadata Management
Data Governance and Metadata Management DATAVERSITY
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at ScaleDATAVERSITY
 
Data quality architecture
Data quality architectureData quality architecture
Data quality architectureanicewick
 
Building a Data Governance Strategy
Building a Data Governance StrategyBuilding a Data Governance Strategy
Building a Data Governance StrategyAnalytics8
 
Glossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data GovernanceGlossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data GovernanceDATAVERSITY
 
MDM Strategy & Roadmap
MDM Strategy & RoadmapMDM Strategy & Roadmap
MDM Strategy & Roadmapvictorlbrown
 
Big Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity ModelBig Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity ModelRoss Collins
 
Data Quality Dashboards
Data Quality DashboardsData Quality Dashboards
Data Quality DashboardsWilliam Sharp
 

Was ist angesagt? (20)

Reference master data management
Reference master data managementReference master data management
Reference master data management
 
Data Quality: A Raising Data Warehousing Concern
Data Quality: A Raising Data Warehousing ConcernData Quality: A Raising Data Warehousing Concern
Data Quality: A Raising Data Warehousing Concern
 
Data quality and data profiling
Data quality and data profilingData quality and data profiling
Data quality and data profiling
 
Data Architecture for Data Governance
Data Architecture for Data GovernanceData Architecture for Data Governance
Data Architecture for Data Governance
 
Collibra - Forrester Presentation : Data Governance 2.0
Collibra - Forrester Presentation : Data Governance 2.0Collibra - Forrester Presentation : Data Governance 2.0
Collibra - Forrester Presentation : Data Governance 2.0
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
 
Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)
 
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
Lessons in Data Modeling: Why a Data Model is an Important Part of Your Data ...
 
Activate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogActivate Data Governance Using the Data Catalog
Activate Data Governance Using the Data Catalog
 
The data quality challenge
The data quality challengeThe data quality challenge
The data quality challenge
 
Data Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and GovernanceData Catalog for Better Data Discovery and Governance
Data Catalog for Better Data Discovery and Governance
 
Date warehousing concepts
Date warehousing conceptsDate warehousing concepts
Date warehousing concepts
 
Data Governance and Metadata Management
Data Governance and Metadata ManagementData Governance and Metadata Management
Data Governance and Metadata Management
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Data quality architecture
Data quality architectureData quality architecture
Data quality architecture
 
Building a Data Governance Strategy
Building a Data Governance StrategyBuilding a Data Governance Strategy
Building a Data Governance Strategy
 
Glossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data GovernanceGlossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data Governance
 
MDM Strategy & Roadmap
MDM Strategy & RoadmapMDM Strategy & Roadmap
MDM Strategy & Roadmap
 
Big Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity ModelBig Data Fabric Capability Maturity Model
Big Data Fabric Capability Maturity Model
 
Data Quality Dashboards
Data Quality DashboardsData Quality Dashboards
Data Quality Dashboards
 

Andere mochten auch

Quality dimension assignment1 subham
Quality dimension assignment1 subhamQuality dimension assignment1 subham
Quality dimension assignment1 subhamSubham Das
 
Dimension of quality in Cloud Database Services
Dimension of quality in Cloud Database ServicesDimension of quality in Cloud Database Services
Dimension of quality in Cloud Database ServicesImran Khan
 
Quality management ppt
Quality management pptQuality management ppt
Quality management pptAakriti .
 
Тестирование данных с помощью Data Quality Services (MS SQL 12)
Тестирование данных с помощью Data Quality Services (MS SQL 12)Тестирование данных с помощью Data Quality Services (MS SQL 12)
Тестирование данных с помощью Data Quality Services (MS SQL 12)SQALab
 
Assessing M&E Systems For Data Quality
Assessing M&E Systems For Data QualityAssessing M&E Systems For Data Quality
Assessing M&E Systems For Data QualityMEASURE Evaluation
 
Chp 3 the business of product management
Chp 3 the business of product managementChp 3 the business of product management
Chp 3 the business of product managementcheqala5626
 
Tqm and transformational leadership in private schools
Tqm and transformational leadership in private schoolsTqm and transformational leadership in private schools
Tqm and transformational leadership in private schoolsjunabundo
 
Designing Scalable Data Warehouse Using MySQL
Designing Scalable Data Warehouse Using MySQLDesigning Scalable Data Warehouse Using MySQL
Designing Scalable Data Warehouse Using MySQLVenu Anuganti
 
8 Dimensions Of Quality
8 Dimensions Of Quality8 Dimensions Of Quality
8 Dimensions Of QualityKenHeitritter
 
Building A Bi Strategy
Building A Bi StrategyBuilding A Bi Strategy
Building A Bi Strategylarryzagata
 
Business Intelligence Presentation (1/2)
Business Intelligence Presentation (1/2)Business Intelligence Presentation (1/2)
Business Intelligence Presentation (1/2)Bernardo Najlis
 
Introduction to Business Intelligence
Introduction to Business IntelligenceIntroduction to Business Intelligence
Introduction to Business IntelligenceAlmog Ramrajkar
 
Business intelligence ppt
Business intelligence pptBusiness intelligence ppt
Business intelligence pptsujithkylm007
 

Andere mochten auch (14)

Quality dimension assignment1 subham
Quality dimension assignment1 subhamQuality dimension assignment1 subham
Quality dimension assignment1 subham
 
Dimension of quality in Cloud Database Services
Dimension of quality in Cloud Database ServicesDimension of quality in Cloud Database Services
Dimension of quality in Cloud Database Services
 
Quality management ppt
Quality management pptQuality management ppt
Quality management ppt
 
Тестирование данных с помощью Data Quality Services (MS SQL 12)
Тестирование данных с помощью Data Quality Services (MS SQL 12)Тестирование данных с помощью Data Quality Services (MS SQL 12)
Тестирование данных с помощью Data Quality Services (MS SQL 12)
 
Assessing M&E Systems For Data Quality
Assessing M&E Systems For Data QualityAssessing M&E Systems For Data Quality
Assessing M&E Systems For Data Quality
 
What is quality
What is qualityWhat is quality
What is quality
 
Chp 3 the business of product management
Chp 3 the business of product managementChp 3 the business of product management
Chp 3 the business of product management
 
Tqm and transformational leadership in private schools
Tqm and transformational leadership in private schoolsTqm and transformational leadership in private schools
Tqm and transformational leadership in private schools
 
Designing Scalable Data Warehouse Using MySQL
Designing Scalable Data Warehouse Using MySQLDesigning Scalable Data Warehouse Using MySQL
Designing Scalable Data Warehouse Using MySQL
 
8 Dimensions Of Quality
8 Dimensions Of Quality8 Dimensions Of Quality
8 Dimensions Of Quality
 
Building A Bi Strategy
Building A Bi StrategyBuilding A Bi Strategy
Building A Bi Strategy
 
Business Intelligence Presentation (1/2)
Business Intelligence Presentation (1/2)Business Intelligence Presentation (1/2)
Business Intelligence Presentation (1/2)
 
Introduction to Business Intelligence
Introduction to Business IntelligenceIntroduction to Business Intelligence
Introduction to Business Intelligence
 
Business intelligence ppt
Business intelligence pptBusiness intelligence ppt
Business intelligence ppt
 

Ähnlich wie Data quality and bi

Overview of business intelligence
Overview of business intelligenceOverview of business intelligence
Overview of business intelligenceAhsan Kabir
 
FirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdf
FirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdfFirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdf
FirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdfarifulislam946965
 
Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-AshishGuleria
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
06. Transformation Logic Template (Source to Target)
06. Transformation Logic Template (Source to Target)06. Transformation Logic Template (Source to Target)
06. Transformation Logic Template (Source to Target)Alan D. Duncan
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overviewashok kumar
 
Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...Chain Sys Corporation
 
Data Provisioning & Optimization
Data Provisioning & OptimizationData Provisioning & Optimization
Data Provisioning & OptimizationAmbareesh Kulkarni
 
Data Collection Process And Integrity
Data Collection Process And IntegrityData Collection Process And Integrity
Data Collection Process And IntegrityGerrit Klaschke, CSM
 
The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.Richard Vermillion
 
Data quality testing – a quick checklist to measure and improve data quality
Data quality testing – a quick checklist to measure and improve data qualityData quality testing – a quick checklist to measure and improve data quality
Data quality testing – a quick checklist to measure and improve data qualityJaveriaGauhar
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingwork
 
Databases
DatabasesDatabases
DatabasesUMaine
 

Ähnlich wie Data quality and bi (20)

Overview of business intelligence
Overview of business intelligenceOverview of business intelligence
Overview of business intelligence
 
Kaizentric Presentation
Kaizentric PresentationKaizentric Presentation
Kaizentric Presentation
 
FirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdf
FirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdfFirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdf
FirstEigen-White-Paper_Autonomous-Data-Trust-Score-for-Data-Catalogs.pdf
 
Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
06. Transformation Logic Template (Source to Target)
06. Transformation Logic Template (Source to Target)06. Transformation Logic Template (Source to Target)
06. Transformation Logic Template (Source to Target)
 
Data quality
Data qualityData quality
Data quality
 
Data quality
Data qualityData quality
Data quality
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overview
 
Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...
 
Lecture 01 mis
Lecture 01 misLecture 01 mis
Lecture 01 mis
 
Data Provisioning & Optimization
Data Provisioning & OptimizationData Provisioning & Optimization
Data Provisioning & Optimization
 
Data Collection Process And Integrity
Data Collection Process And IntegrityData Collection Process And Integrity
Data Collection Process And Integrity
 
End User Informatics
End User InformaticsEnd User Informatics
End User Informatics
 
The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.
 
IT Ready - DW: 1st Day
IT Ready - DW: 1st Day IT Ready - DW: 1st Day
IT Ready - DW: 1st Day
 
Data quality testing – a quick checklist to measure and improve data quality
Data quality testing – a quick checklist to measure and improve data qualityData quality testing – a quick checklist to measure and improve data quality
Data quality testing – a quick checklist to measure and improve data quality
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
Databases
DatabasesDatabases
Databases
 

Kürzlich hochgeladen

CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...Nguyen Thanh Tu Collection
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
Department of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdfDepartment of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdfMohonDas
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.raviapr7
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxraviapr7
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfYu Kanazawa / Osaka University
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17Celine George
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlDr. Bruce A. Johnson
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17Celine George
 
How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17Celine George
 
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxSlides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxCapitolTechU
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxDr. Asif Anas
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxraviapr7
 

Kürzlich hochgeladen (20)

CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
Department of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdfDepartment of Health Compounder Question ‍Solution 2022.pdf
Department of Health Compounder Question ‍Solution 2022.pdf
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
March 2024 Directors Meeting, Division of Student Affairs and Academic Support
March 2024 Directors Meeting, Division of Student Affairs and Academic SupportMarch 2024 Directors Meeting, Division of Student Affairs and Academic Support
March 2024 Directors Meeting, Division of Student Affairs and Academic Support
 
Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptx
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting Bl
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17
 
How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17
 
Finals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quizFinals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quiz
 
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxSlides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptx
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptx
 

Data quality and bi

  • 1. DW Part 2 The Twins: Data Quality & Business Intelligence Denise Jeffries [email_address] [email_address] 205.747.3301
  • 2.
  • 3. Star Schema example (Sales db)
  • 4.
  • 6.
  • 7. Account, Customer & Address Relationships Account Contact Party Address link Account Party link Address Account Party Account Information loaded from ALL Source Systems ETL process builds the relationship between Accounts and Customers (Party) based on the relationship file from CUSTOMER CRM SYSTEM
  • 8. EDW Process State Staging Area EDW Metadata | Data Governance | Data Management DM CPS MANTAS CRDB MKTG FIN SALES EDW Data cleansing Data profiling Sync & Sort BI Source System Cleanse / Pre-process IMP RM OEC ALS AFS ST RE DFP SBA AFS V-PR
  • 9.
  • 10.
  • 11.
  • 12.
  • 13. Example of conforming data for business view: http://www.sserve.com/ftp/dwintro.doc
  • 14.
  • 15. EDW Development Project Cycle (New Source to EDW)
  • 16. DW - Roadmap Management Architecture (Metadata, Data Security, Systems Management)
  • 17.
  • 18.
  • 19.
  • 20.
  • 22.
  • 23. Data Quality Tools (Gartner Magic Quadrant)
  • 24. Dimensions of Quality Informatica.com
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48.
  • 49. Magic Quadrant for BI (Gartner)
  • 50.
  • 51.
  • 52.
  • 53.
  • 54.
  • 55.
  • 56.
  • 57.
  • 58.

Hinweis der Redaktion

  1. Dims have a simple PRIMARY KEY Facts have FOREIGN KEYS (which make up a compound primary key often used as a natural key in ETL coding DIMS are 2 nd normal form FACTS are 3 rd normal form
  2. Fact.Sales is the fact table and there are three dimension tables Dim.Date, Dim.Store and Dim.Product. Each dimension table has a primary key on its PK column, relating to one of the columns (viewed as rows in the example schema) of the Fact.Sales table's three-column (compound) primary key (Date_FK, Store_FK, Product_FK). The non-primary key [Units Sold] column of the fact table in this example represents a measure or metric that can be used in calculations and analysis. The non-primary key columns of the dimension tables represent additional attributes of the dimensions (such as the Year of the Dim.Date dimension). Using schema descriptors with dot-notation, combined with simple suffix decorations for column differentiation, makes it easier to write the SQL for Star Schema queries. This is because fewer underscores are required and table aliasing is minimized. Most SQL database engines allow schemata descriptors, and also permit decoration suffixes on surrogate keys columns. Using square brackets, which are physically easier to type on the keyboard (no shift key needed) are not intrusive and make the code easier to read. For example, the following query extracts how many TV sets have been sold, for each brand and country, in 1997: SELECT Brand, Country, SUM ([Units Sold]) FROM Fact.Sales JOIN Dim.Date ON Date_FK = Date_PK JOIN Dim.Store ON Store_FK = Store_PK JOIN Dim.Product ON Product_FK = Product_PK WHERE [Year] = 1997 AND [Product Category] = 'tv' GROUP BY Brand, Country http://en.wikipedia.org/wiki/Star_schema
  3. http://en.wikipedia.org/wiki/Snowflake_schema
  4. DIMS connect out to be more 3 rd normal form
  5. The skyrocketing power of hardware and software, along with the availability of affordable and easy-to-use reporting and analysis tools have played the most important role in evolution of data warehouses.
  6. Another factor that is fast becoming an important variable in data warehousing equations is the emergence of vendors with popular business application suites. Led by wildly popular German software vendor SAP AG, flexible business software suites adapted to the particulars of a business have become a very popular way to move to a sophisticated multi-tier architecture. Other vendors such as Baan, PeopleSoft, and Oracle have likewise come out with suites of software that provide different strengths but have comparable functionality. The emergence of these application suites has a direct bearing on the increased use of data warehousing in that they are increasingly able to provide standard applications that are replacing existing custom developed legacy applications. In the near future, almost every data warehouse is likely to derive data from one of these application sources rather than the customized extraction from legacy systems. Further, there are significant initiatives at these vendors to make transaction data easily available to data warehousing systems. To the extent that these standard applications have extensive customization features, data acquisition from these applications can be much simpler than from the mainframe systems
  7. Provides consistent use of data element (entity attributes) values – ie M, F vs 1,2 for gender
  8. Yes, we can come up with more – but we’ll pay attention to these
  9. “A challenge that organizations face as they attempt to define data quality key performance indicators is that completeness, validity and integrity may be relatively easy to measure, but measuring consistency, accuracy and timeliness is a whole other story. “ Information Mgmt
  10. Hardware Software licenses ETL Testing Promotion to production
  11. For the purpose of this analysis, Ability to Execute is a function of a vendor's score of five measures that Gartner believes customers care about most in vendor selection. It does not equate to revenue, revenue growth or market share. Completeness of Vision is based on the scoring of six key measures, including, but not exclusive to, "Offering (Product) Strategy." It is important to understand these criteria while judging vendors' positions on the Magic Quadrant. These evaluation criteria are detailed in the Evaluation Criteria section of this document.
  12. With an analytical approach, the Patriots managed to win the Super Bowl three times in four years. The team uses data and analytical models extensively, both on and off the field. In-depth analytics help the team select players and stay below the NFL salary cap. Patriots coaches and players are renowned for their extensive study of game film and statistics, and Coach Bill Belichick reads articles by academic economists on statistical probabilities of football outcomes. Off the field, the team uses detailed analytics to assess and improve the "total fan experience." At every home game, for example, 20 to 25 people have specific assignments to make quantitative measurements of the stadium food, parking, personnel, bathroom cleanliness and other factors. In retail, Wal-Mart uses vast amounts of data and category analysis to dominate the industry. Harrah’s has changed the basis of competition in gaming from building megacasinos to analytics around customer loyalty and service. Amazon and Yahoo aren't just e-commerce sites; they are extremely analytical and follow a "test and learn" approach to business changes. Capital One runs more than 30,000 experiments a year to identify desirable customers and price credit card offers.
  13. Mainly 2 tools: Multidimensional OLAP and Relationship OLAP HOLAP is a hybrid of the two
  14. BI Engineer job posting: Responsibilities: Act as a point person for statistical analyses, data deep dives, and general reporting. Deep dive into massive data sets to answer key business questions using MS Excel, Oracle, SQL, SAS, Perl, and other data manipulation languages.  Interact with key stakeholders to understand business issues and recommend approaches to insure business questions are properly answered.  Manage large scale requests and projects to define requirements, manage timelines, and coordinate activities with other involved team members.  Use experimental design and statistics to assist in the design and measurement of marketing tests.  Report on key business metrics.  Participate in the design and development of analytics and reporting data mart.  Using data mining techniques, statistics, and SAS, build predictive models and segmentation schemes for the purposes of cross sell, retention, acquisition, and lifetime value. Qualifications : Master’s degree or foreign equivalent in Mathematics, Statistics, Analytics, Operations Research, or a related field plus one year of progressively responsible experience in the job offered or as a Business Analyst, Data Engineer, or another related occupation. Employer will accept a Bachelor’s degree in Mathematics, Statistics, Analytics, Operations Research, or a related field plus five years of experience in the specialty as equivalent to a Master’s degree and one year of progressively responsible experience. Experience in the job offered or related occupation must involve performing data modeling, database development, and statistical testing and analysis of large-scale datasets using Oracle SQL, Perl, MS Excel, and SAS.