More Related Content
Similar to EDW: Enterprise Data Warehouse - Architecture and Process (20)
More from Pier Giuseppe De Meo (9)
EDW: Enterprise Data Warehouse - Architecture and Process
- 1. EDW Architecture
and Process
Setting-up an Enterprise Data Warehouse
Enterprise Data Warehouse (EDW) by Pier Giuseppe De Meo is licensed under CC BY 4.0
©2020 De Meo Pier Giuseppe | Data Warehouse and Business Intelligence Consultant | Enterprise Data Warehouse Specialist
- 2. PRE-STAGING
Data Catalog
and Matadata
STAGING
Cross Reference
INTEGRATION
Classification
Mapping
SOURCES DATAMART
Aggregation
Mapping
ANALYTICS
RECONCILED
Master Data
Management
Enterprise Data Warehouse - Architecture
ETL/ELT
cross-Area
ETL/ELT
in-Area
Data Quality
Alarm
Automatic
Configuration
User
Configuration
2
- 3. Enterprise Data Warehouse - Process
Acquire
Download raw Data from
Sources and load into
PRE-STAGING Area:
● FLOW: automatic or
manual / scheduled or
on-demand
● TRANSFORM: no
transform
● MODEL: relational
(physical)
● QUALITY: Timeliness
Load
Load raw Data from
PRE-STAGING into
STAGING Area:
● FLOW: automatic /
scheduled
● TRANSFORM: basic
transform / cross
reference decode
● MODEL: relational
(physical)
● QUALITY: Validity,
Uniqueness
Reconcile
Load prepared Data from
STAGING into
RECONCILED Area:
● FLOW: automatic /
scheduled
● TRANSFORM: complex
transform / golden
record and enterprise
keys
● MODEL: relational
(physical)
● QUALITY: Accuracy,
Completeness,
Consistency
Distribute
Load specialized Data from
INTEGRATION into
DATAMART Area:
● FLOW: automatic /
scheduled
● TRANSFORM:
aggregation mapping /
calculated column /
custom aggregation
● MODEL:
multidimensional
(physical or virtual)
● QUALITY: Quantitative,
Qualitative and Trend
check
Integrate
Load certified Data from
RECONCILED into
INTEGRATION Area:
● FLOW: automatic /
scheduled
● TRANSFORM:
classification mapping /
calculated column /
custom aggregation
● MODEL:
multidimensional
(physical)
● QUALITY: Quantitative,
Qualitative and Trend
check
3