One of the key stepping stones to turn the theoretical Data Governance concept to reality is the implementation of data issue management and resolution (IMR) process which includes tools, processes, governance and most importantly persistence to get to the bottom of the each data quality issue.
This presentation lays down the basic components of IMR process and tries to guide practitioners. This process was applied along with an in-house configured SharePoint management tool with workflows.
Data Quality Management - Data Issue Management & Resolutionn / Practical Approach
1. Burak S. Arikan | 382 Webster Avenue, Jersey City NJ | +1 (201) 356-7058 | burak@burakarikan.com
Data Quality Management
Data Issue Management and Resolution (IMR) – Practical Approach
Burak S. Arikan
April 2016
2. Burak S. Arikan | 382 Webster Avenue, Jersey City NJ | +1 (201) 356-7058 | burak@burakarikan.com 2
Data Issue Management and Resolution
Holistic Process Overview
Data Warehouse currently has data issues which cause reports (e.g. holding values) to be inaccurate. Initial analysis identify multiple different manifested symptoms . The goal of this working
group is to detect the root cause of each symptom and identify the steps to remediate. If a remediation is deemed to be feasible and necessary, a separate project will be created to implement
the resolution.
Data Issue Analysis Project Life Cycle
Detect
Record
Prioritize
Analyze
Root Cause
Finalization by CDO
Root Cause
Sign-off by
Stakeholders
Solution
Design
Solution Sign-off
by
Stakeholders/CDO
Remediate?
STOP
Common
tool
Issue Specific Remediation Project
FRD
FRD Sign-off
Construction
Testing
Support Model
Monitoring
& Alerting
Data Ownership
Implementation
Post
Implementation
New Process
Flow by Owner
New Process
Sign-off
New Process
Globalization
New Process
Implementation
New Process
Monitoring by
Data Warehouse
TECHNOLOGY
SOLUTION
OPERATIONS
SOLUTION
NO
YES
3. Burak S. Arikan | 382 Webster Avenue, Jersey City NJ | +1 (201) 356-7058 | burak@burakarikan.com 3
Data Issue Management and Resolution
Detailed Analysis Process
The following list the methodology to manage issues and report on them.
BusinessAnalystREQUESTER
1. Submit Data
Issue
DataQualityAnalysis
ProjectWorkingGroup
2. Review
Request
Request
Approved?
3. Assign it to a
DQ Analyst to
investigate
No
Yes
4. Collect the
existing
information on
the issue
10 . Initiate a
kick of call to
agree on the
problem
5. Prepare
initial problem
statement
6. Identify all
key players
Identified
all key
player?
7. Escalate to
Working Group
for assistance
8. Identify the
further needed
players
9. Source the
players to the
BA
11. Identify root
cause
C. Report Progress into Working Group and update details on the SharePoint
C. Perform weekly status calls to track development
12. Obtain the
agreement on
the root cause
13. Initiate
Solutioning
conversations
Root Cause
Approved?
No
Yes
Solution
agreed and
approved?
No
Yes
No
Yes
14. Present the
solution Design
to Present to
Working Group
15. Assess the
required
resources,
budget for
securitization
18. Inform the
requester about
the outcomes
Big effort
project?
17. Initiate a
project through
proper channel
16. Resolve it
as a minor fix
Yes
No
19. Requestor
is updated
4. Burak S. Arikan | 382 Webster Avenue, Jersey City NJ | +1 (201) 356-7058 | burak@burakarikan.com 4
Data Issue Management and Resolution
Governance
Project Sponsor Data Quality (DQ) Council
Sets policies & ultimate project decision
making body
Enterprise CDO
CDO DQ Analysis Program
Oversight of the entire program
Reporting, Consulting & StrategyGovernance Implementation
Business & Ops
Responsible for supporting
analysis of issues and sharing
business expertise and bring key
players.
Data Warehouse
Technology
Responsible for leading the
analysis of data issues that
manifest themselves through
Data Warehouse.
Data Quality Analysis Project Working Group
Super User Group
Business Users of Data within Data
Warehouse . Reports data issues, support
analysis and resolution
CustodySystem
1
TradeCapture
System
FundAccounting
System
CustodyProd
FINCON
Business
Intelligence
Business
Analyst
Business
Analyst
Technology
Meets weekly in order to:
•Set expectations & targets
• Prioritize existing and newly identified
data issues
•Resolves issues escalated by BAs
• Holds a weekly meeting for:
Status update
Issue & Risk
A proper governance structure is needed in order to ensure that appropriate parties are engaged .
Technology Manager
Core Systems
Responsible for supporting the
analysis that are undertaken by
data analyst , and designing and
implementing the resolution.
5. Burak S. Arikan | 382 Webster Avenue, Jersey City NJ | +1 (201) 356-7058 | burak@burakarikan.com 5
Data Issue Management and Resolution
Communication Plan
Each issue is managed by the assigned Data Quality Analyst (DQA). It is DQA’s sole responsibility to understand and document an approved root cause and ensure that a solution to address
the root cause is devised. “Data Quality Analysis Project Working Group” meetings are set to review the results of BA’s work, escalation and resolution.
Day-to-dayIssue
Calls
GenEmail
Distribution
WeeklyIssue
AnalysisStatusCall
Bi-weeklyCouncil
Meeting
DataCouncil
Roles
Data Quality Analyst X X X X -
Data Warehouse Technology Resources AN AN - - -
Source System Technology Experts AN AN AN - -
Source System Operations AN AN - - -
Source System Product Experts AN AN AN - -
Data Issue Requester AN AN X - -
Data Analysis Program Members - X X X X
AN: As Needed. This means that the party will be included if it is a stakeholder for the issue.