Semantic Media Wiki Approach To Metadata

Semantic MediaWiki
Approach to Metadata

Scott E. Thompson
Manager - Data Architecture
Ontario Teachers’ Pension Plan

2
Agenda
1. Why? 2. SMW? 3. The PoC 4. The Unexpected 5. Wrap Up

Why?
Mashup of slides I’ve used before…
– What is Semantic MediaWiki?
– Proof of Concept
– The Unexpected
Wrap Up
Questions

3
pinterest.com/thompland777

SELECT ?Person
WHERE { ?Person :hasExperience :Semantic Technologies .
?Person :hasExperience :Meta Data.
?Person :hasExperience :Capital Markets }

4
Ontario Teachers’ Pension Plan

Fixed Income
Public Equities
Private Capital
Real Estate
Infrastructure
Foreign Currency
Commodities
Hedge Funds

5
The Challenge: Metadata

6
Current: Low Confidence

42? ETL Correct
Trade

IT Data Warehouse
Reload

Reload
Data
Rerun
Report

7
Future: Nirvana

8
Business Requirements

Findability of Data
Ownership of Data
Data Quality
Consistent Business Terminology

Added later…
Ownership of Metadata
Metadata Quality

9
Business Requirements

Value of Meta Data & Meta Data Tool
• Allows business users / end users to gain the required insight into what the data
and reports they are looking at means

• Makes data available and visible to others

• Creates a searchable set of information about the firm’s data. This allows data
developers and users to search for existing data and avoid data duplication.

• Provides a platform for sharing and publicizing data. This reduces the workload
of developers (interfaces, reports, etc.) and users and increases efficiency.

• Quality control, data restrictions and uses can be applied to the entire data set.

• Metadata documentation transcends people and time. Staff turnover and
balancing of multiple projects can be mitigated with metadata, providing data
permanence and the documentation of institutional knowledge.

10
MDM?

MDM could stand for Master Data Management
or Meta Data Management… coincidence?
“Lets go get all the key pieces of data and put
them in one place, which is really more of an
enterprise data warehouse but master data
management then says… it’s almost a map…
here is what each of those data fields are,
here is how you can find them, here is what
they mean, here is where they came from.”
Blake Johnson
Consulting Professor
Stanford University
“The Truth and Power of Master Data Management” (Teradata)
http://www.youtube.com/watch?feature=player_embedded&v=p6VHpIlDfu4#!

11
One Truth?

Pre-Trade Post-trade
Investment Portfolio Trade &
Strategy & Research & Deal Securities Collateral &Cash Portfolio
Planning Analytics Management Operations Management Accounting

V = f(trade, market context, model, business context)
Trades Reconciliation Trades

Market Context Market Context

Model Model
Trades
Business Context Business Context
Market Context

Model

Business Context

Total Fund Reporting
Market Credit & Counterparty Liquidity
Risk Risk Risk Performance Compliance
Management Management Management

12
What is a Wiki?

Hawaiian for “quick”
Allows large numbers of people to
create and edit the same content
Effective for reaching a credible
consensus from a large group
Wikipedia is the world’s largest
collaboratively edited source of
encyclopedic knowledge

13
What is the Semantic Web?

14
MediaWiki (Web 2.0)

15
Semantic MediaWiki (Web 3.0)

16
Future Opportunities

Simple search algorithms would
suffice to provide a precise answer
to the question…

17
Faceted Search

18
Graphs (relate/infer)

otpp:Index-Linked Bond subClassOf otpp:Debt

f
As eO
same ubt
yp
p:s
otp
dbpedia:
otpp:Fixed-Rate Bond subClassOf otpp:Debt
Inflation-Linked Bond

otpp:Amortizing
subClassOf otpp:Index-Linked Bond
Index-Linked Bond

otpp:Index-Linked <sameAs> dbpedia:Inflation
Bond Linked Bond

19
Who Needs Consistency?

20
Linked Open Data Graph (OLD)

21


FIBO

22
Proof of Concept

Build a knowledgebase about:
Our structured data (schemas, tables,
columns)
Our business terminology (business
process, products, attributes)

Prove that the technology could:
• Automatically load technical metadata
and relate it with business metadata
• Customize workflow to collect and
govern the manual business input

23
Data Architecture Ontology

Schema Group
BelongsToA
Instances:
TOOLKIT
CORE
PRODUCT
Schema FUNCTIONAL
BUAD
IsPartOfA
Instances:
ACCT
MREF
MKT
FIQR
Table

Instances:
Table1
Table2
View1
View2

24


25
Data Management Ontology

Table

sA
ha hasDataOwner

ha
sD
at
aS
A tew
ha s
ar
d

Organizational
Quality State
Group

Instances: Instances:
User Investment Division – Asset Mix & Risk
Authoratative Finance Division – Data Management
SLA

Instances:
SLA1
SLA2

26


27


28


29


30
Workflow

31


32
Product Attribute Ontology

CallsA

ReferencesA
Product Group Stored Procedure

belongsToA
Table

ha
hasA

sD
M
Q
Product

ua
l it
yT
Quality Test

es
t
Instances :
Missing
Stale
Null Value Column
m
Comparative
Fr o
ata
ha

Tolerance
sD
ge t
sAtt

Changed
ribu
e t

Focus on this data entry form
Product Attribute
Metadata to be curated by DM

Metadata to be curated by AM &R

33
% Sourced from Core Schemas?

{{#sparql: SELECT DISTINCT ?Product ?Product_attribute ?Column ?Schema
WHERE { ?Product property:HasAttribute ?Product_Attribute . ?Product_attribute
property:GetsDataFrom ?Column . ?Column MDM:belongsToSchema ?Schema . }
|merge=true|link=all}}

34
Data Management Indexes

35


36
It’s a New Kind of Database!

37
SMW+ in a nutshell

Semantic
MediaWiki MediaWiki

WYSIWYG extension
Enhanced Retrieval Extension
Deployment Framework
Web Server

“The smartest organizations are not
those with the smartest people but
those with the quickest access to their
collective knowledge”

- Rod Collins (wiki-management.com)

Semantic Media Wiki Approach To Metadata

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie Semantic Media Wiki Approach To Metadata

Ähnlich wie Semantic Media Wiki Approach To Metadata (20)

Semantic Media Wiki Approach To Metadata