2. Meeting Agenda
Quality Gates – A Brief Overview
BI Data quality
Demo
2 4/6/2011
3. Vision.bi Quality Gates - overview
Vision.bi Quality Gates ™ is a centralized solution for data quality.
The solutions helps organizations to constantly and efficiently improve
the quality of information and trust in organizational information systems
by defining various types of quality gates.
Quality gates can be used for integration and BI projects (QA) or for
monitoring data quality in production (On going…)
3 4/6/2011
5. QA in BI Environment
Quality Gates
OLAP
Front
SCD
On Going QA RI
Source Changes ColumnsTable Mapping
Quality Gates
Undated sources Data Loaded
Centralize management
Bugs in the sources Calculations
Auto execution Roles
Referential Integrity Cubes
History Vision.bi Create Reports *
Regression tests
Various sources
Methodology
Load Metadata Design Your Model Create DWH Create ETL QA
6. Centered Management
Manage QA organization tree
Cartelize Solution
Unique QA dashboard
Intuitive drill to the tests result
6 4/6/2011
7. Various test types
QA best practices
Unique test types for BI and integration
User friendly definition
Best practices
Check sum - Compare between source
Compare tables – Detailed compare
Execution flow – Tests parallelism and
dependencies
Referential integrity – Complete dimension
missing value
Free SQL – Custom tests
7 4/6/2011
8. #1 – Data consistency
Test goal
Identify changes in data trend
Identify missing sources
How
Compare amount between current period to previous
Compare to average
Test type: Check Sum
When
End of the ETL cycle
Before cube process
8 4/6/2011
9. #2 – Data Availability
Test goal
Verify updated data availability
Inform users for updated data
How
Query for rows on the last period
If missing inform the IT team else inform the user
Test type: Custom test
When
End of the ETL cycle
Every hour
9 4/6/2011
10. #3 – RI Completeness
Test goal
Check and complete dimension missing keys with default values
Insure data integrity for join between fact tables and dimensions
How
Find distinct values from fact where not exists in the dimension
Test type: Referential integrity
When
After loading fact tables
10 4/6/2011
11. #4 – Cube correctness
Test goal
Verify cube data Vs. Data warehouse
How
Compare last period in cube Vs Dwhsources queries
Test type: Check Sum
When
End of the ETL cycle
11 4/6/2011
12. #5 – Execution Flow
Test goal
Tests dependencies
Execute in parallel
Drill to the row level
How
Add your tests to the execution flow test and define the dependencies
Test type: Execution flow and all other objects
When
End of the ETL cycle
12 4/6/2011
13. And more…
Compare values – changes over time
Tests history & versions
Advanced mail alerts
Environments (Test -> Production)
…
13 4/6/2011
14. BI clients (Partial List)
A global company (NYSE: DOX) with revenue of $3.0 billion in fiscal 2010, Amdocs is the
market leader in customer experience systems innovation with over 19,000
employees delivering the most advanced business support systems (BSS), operational
support systems (OSS) and service delivery to innovative service providers in more than
60 countries around the world.
NICE Systems (NASDAQ: NICE), is the worldwide leader of intent-based solutions
that capture and analyze interactions and transactions, realize intent, and extract
and leverage insights to deliver impact in real time.
Harel Group is the third largest insurance group in Israel. It is the second largest in
general insurance; the market leader in health insurance, and from the perspective of
premium volume, it is the third largest in life insurance.
Eden Springs Ltd is the IL market leader in the Water Cooler Industry and forms part
of Eden Springs Europe, which has a presence in 13 other European countries.
013 NetVision is the leading company in the Israeli communication sector with a
market share of 36% in International Telephony services. In addition, the company
offers its customers a domestic calls service (VOIP).
14
15. Summary
Start using Vision.bi Quality gates and get
Business alerts
Data integrity
Inform on data inconsistency
Cube validation
15 4/6/2011
16. Thank You!
For demo please contact
Ram Yonish Yifat Vector
M - ryonish@tact.co.il M - yifatva@matrix.co.il
P – 052-2424314 P – 052-8651729
&
16 4/7/2011