SlideShare ist ein Scribd-Unternehmen logo
1 von 33
Role of Metadata
Why Metadata
 Before touches the keyboard by the
prominent(superlative) users.
 Several questions come to their mind.
What are various data in the data
warehouse?
Is there information about unit sale and
costs by product?
How old is the data in the warehouse.
When was the last time fresh data was
brought in?
Are there any summaries by month and
product?
Why Meta data contd.,
 These questions and several more
information are very valid and pertinent.
 What are answers? Where are the
answers? Can ur user see the answers?
How easy to get the answers?
What is Meta data?
 Metadata in a data warehouse contains
the answer to questions about the data
in the data warehouse.
 Keep the answer in a place called the
metadata repository.
Different definitions for
metadata
 Data about the data.
 Table of contents for the data.
 Catalog for the data.
 Data warehouse roadmap.
 Data warehouse directory.
 Tongs to handle the data.
 The nerve center.
So, what exactly is metadata
 It tells u more.
 It gives more than the explanation of the
semantics and the syntax.
 Describes all the pertinent(relevant)
aspect of the data in the data
warehouse.
 Pertinent to whom?
 The answer is – primarily to the user
and also developer and even project
team.
Meta data
Why it is important?
 Metadata is necessary for using,
building and administering your data
warehouse.
For using the data warehouse
 Without the metadata support, user
cannot get an information every time
they needed(user create their own ad
hoc report).
 Today data warehouses are much larger
in size, wide in scope.
 User critically need metadata.
For building the data
warehouse(extraction team)
 Need to know the structure and data
content in the data warehouse.
 Mapping and data transformations.
 Logical structure of data warehouse
database.
For administering the data
warehouse
 Impossible to administer the data
warehouse(size)
 Large no of questions and queries.
 Cannot administer without answers for
these questions.
 Metadata must address these issues.
List of questions relating to
data warehouse
Who needs metadata?
 Without metadata, Datawarehouse is
like such a filling cabinet without
information.
 Go through the image column(it address
the our question)
Like a nerve center
 Metadata placed in a key position and
enables communication among various
processes.
Why metadata is essential for
IT
 Development and deployment of data
warehouse is joint effort between users
and IT staff.
 Technical issue-IT primarily responsible
design and ongoing administration.
 Metadata essential for IT
 beginning with the data extraction and
ending with information delivery.
 It drives and record the each processes.
Summary list of process in which
metadata is significant for IT
 Data extraction
 Data transformation
 Data scrubbing
 Data staging
 Data refreshment
 Database design
 Query report and design
Automation of DWH tasks
Types by Functional Area
 Classify and group in various way-some
by usage and who use it
 Administrative/End-user/Optimization
 Technical/Business
 Development/usage
 In the data mart/At the workstation
 Bank room/front room
 Internal/External
Functional Areas
 Data Acquisition
 Data stroage
 Information delivery
Data Acquisition
 DWH process related to following
functions.
Data extraction
Data transformation
Data cleaning
Data integration
Data staging
Data aquisition
Data stroage
 Data loading
 Data archiving
 Data management
 Use metadata in this area for full data
refresh and load.
Information Delivery
 Report generating
 Query processing
 Complex analysis
Mostly this are meant for end-user.
Metadata recorded in processes of other
two areas.
It also record OLAP-the developer and
administrators are involved in this
processes.
Business METADATA
 It connect business with DWH.
 Business users need more than other
users.
 Business metadata is like a roadmap.
 Tout guide-managers and analysis.
 Must describe the contents in plain
language giving information in business
teerms.
 Example
The name of data tables (or) individual
element must not be cryptic.
The data item name-calc_pr_sle.
You need to rename this as calculated-prior-
month-sale
Business metadata Contd.,
 Much less structured than technical
metadata.
 Textual documents, spreadsheets, and
even business rules and policies not
written down completely.
Examples of Business
Metadata who Benefits?
 Primarily benefits end-users.
Managers
Business analysis
Power users
Regular users
Casual users
Senior managers/ junior managers
Technical Metadata
 IT staff- Development and
Administration of the data warehouse.
 Who Benefits?
Project manager
Data warehouse administrator
Metadata manager
Database administrator
Business analyst
Data quality analyst

Weitere ähnliche Inhalte

Was ist angesagt?

Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingJason S
 
Introduction to metadata management
Introduction to metadata managementIntroduction to metadata management
Introduction to metadata managementOpen Data Support
 
Introduction to Data Warehouse
Introduction to Data WarehouseIntroduction to Data Warehouse
Introduction to Data WarehouseShanthi Mukkavilli
 
Multidimensional schema of data warehouse
Multidimensional schema of data warehouseMultidimensional schema of data warehouse
Multidimensional schema of data warehousekunjan shah
 
Dimensional Modeling
Dimensional ModelingDimensional Modeling
Dimensional Modelingaksrauf
 
Data Warehouse Architectures
Data Warehouse ArchitecturesData Warehouse Architectures
Data Warehouse ArchitecturesTheju Paul
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSSDeepali Raut
 
Distributed Query Processing
Distributed Query ProcessingDistributed Query Processing
Distributed Query ProcessingMythili Kannan
 
Warehousing dimension star-snowflake_schemas
Warehousing dimension star-snowflake_schemasWarehousing dimension star-snowflake_schemas
Warehousing dimension star-snowflake_schemasEric Matthews
 
Data Warehouse Modeling
Data Warehouse ModelingData Warehouse Modeling
Data Warehouse Modelingvivekjv
 
Building a Big Data Solution
Building a Big Data SolutionBuilding a Big Data Solution
Building a Big Data SolutionJames Serra
 
3 tier data warehouse
3 tier data warehouse3 tier data warehouse
3 tier data warehouseJ M
 
Etl process in data warehouse
Etl process in data warehouseEtl process in data warehouse
Etl process in data warehouseKomal Choudhary
 

Was ist angesagt? (20)

Data mart
Data martData mart
Data mart
 
Introduction to ETL and Data Integration
Introduction to ETL and Data IntegrationIntroduction to ETL and Data Integration
Introduction to ETL and Data Integration
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
ETL Process
ETL ProcessETL Process
ETL Process
 
Introduction to metadata management
Introduction to metadata managementIntroduction to metadata management
Introduction to metadata management
 
Introduction to Data Warehouse
Introduction to Data WarehouseIntroduction to Data Warehouse
Introduction to Data Warehouse
 
Multidimensional schema of data warehouse
Multidimensional schema of data warehouseMultidimensional schema of data warehouse
Multidimensional schema of data warehouse
 
Dimensional Modeling
Dimensional ModelingDimensional Modeling
Dimensional Modeling
 
Data Warehouse Architectures
Data Warehouse ArchitecturesData Warehouse Architectures
Data Warehouse Architectures
 
Data Mining
Data MiningData Mining
Data Mining
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Distributed Query Processing
Distributed Query ProcessingDistributed Query Processing
Distributed Query Processing
 
Warehousing dimension star-snowflake_schemas
Warehousing dimension star-snowflake_schemasWarehousing dimension star-snowflake_schemas
Warehousing dimension star-snowflake_schemas
 
Data Warehouse Modeling
Data Warehouse ModelingData Warehouse Modeling
Data Warehouse Modeling
 
Building a Big Data Solution
Building a Big Data SolutionBuilding a Big Data Solution
Building a Big Data Solution
 
Ppt
PptPpt
Ppt
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouse
 
3 tier data warehouse
3 tier data warehouse3 tier data warehouse
3 tier data warehouse
 
Etl process in data warehouse
Etl process in data warehouseEtl process in data warehouse
Etl process in data warehouse
 

Ähnlich wie Metadata in data warehouse

Dataware housing
Dataware housingDataware housing
Dataware housingwork
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptDougSchoemaker
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptSumathiG8
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptPalaniKumarR2
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingwork
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousingsumit621
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSINGKing Julian
 
Report for internship
Report for internshipReport for internship
Report for internshipSalman Khan
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.pptSamPrem3
 
Data warehouse
Data warehouseData warehouse
Data warehouseMR Z
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
Data warehousing
Data warehousingData warehousing
Data warehousingkeeyre
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Health Informatics New Zealand
 
Data warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-designData warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-designSarita Kataria
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overviewashok kumar
 
BI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business businessBI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business businessJawaherAlbaddawi
 

Ähnlich wie Metadata in data warehouse (20)

Metadata
MetadataMetadata
Metadata
 
Dataware housing
Dataware housingDataware housing
Dataware housing
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
E05WAREH1.PPT
E05WAREH1.PPTE05WAREH1.PPT
E05WAREH1.PPT
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 
Report for internship
Report for internshipReport for internship
Report for internship
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Presentation
PresentationPresentation
Presentation
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...
 
Data warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-designData warehouse-dimensional-modeling-and-design
Data warehouse-dimensional-modeling-and-design
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overview
 
BI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business businessBI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business business
 

Mehr von Siddique Ibrahim (20)

List in Python
List in PythonList in Python
List in Python
 
Python Control structures
Python Control structuresPython Control structures
Python Control structures
 
Python programming introduction
Python programming introductionPython programming introduction
Python programming introduction
 
Data mining basic fundamentals
Data mining basic fundamentalsData mining basic fundamentals
Data mining basic fundamentals
 
Basic networking
Basic networkingBasic networking
Basic networking
 
Virtualization Concepts
Virtualization ConceptsVirtualization Concepts
Virtualization Concepts
 
Networking devices(siddique)
Networking devices(siddique)Networking devices(siddique)
Networking devices(siddique)
 
Osi model 7 Layers
Osi model 7 LayersOsi model 7 Layers
Osi model 7 Layers
 
Mysql grand
Mysql grandMysql grand
Mysql grand
 
Getting started into mySQL
Getting started into mySQLGetting started into mySQL
Getting started into mySQL
 
pipelining
pipeliningpipelining
pipelining
 
Micro programmed control
Micro programmed controlMicro programmed control
Micro programmed control
 
Hardwired control
Hardwired controlHardwired control
Hardwired control
 
interface
interfaceinterface
interface
 
Interrupt
InterruptInterrupt
Interrupt
 
Interrupt
InterruptInterrupt
Interrupt
 
DMA
DMADMA
DMA
 
Io devies
Io deviesIo devies
Io devies
 
Stack & queue
Stack & queueStack & queue
Stack & queue
 
Data extraction, transformation, and loading
Data extraction, transformation, and loadingData extraction, transformation, and loading
Data extraction, transformation, and loading
 

Kürzlich hochgeladen

CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 

Kürzlich hochgeladen (20)

CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 

Metadata in data warehouse

  • 2. Why Metadata  Before touches the keyboard by the prominent(superlative) users.  Several questions come to their mind. What are various data in the data warehouse? Is there information about unit sale and costs by product? How old is the data in the warehouse. When was the last time fresh data was brought in? Are there any summaries by month and product?
  • 3. Why Meta data contd.,  These questions and several more information are very valid and pertinent.  What are answers? Where are the answers? Can ur user see the answers? How easy to get the answers?
  • 4. What is Meta data?  Metadata in a data warehouse contains the answer to questions about the data in the data warehouse.  Keep the answer in a place called the metadata repository.
  • 5. Different definitions for metadata  Data about the data.  Table of contents for the data.  Catalog for the data.  Data warehouse roadmap.  Data warehouse directory.  Tongs to handle the data.  The nerve center.
  • 6. So, what exactly is metadata  It tells u more.  It gives more than the explanation of the semantics and the syntax.  Describes all the pertinent(relevant) aspect of the data in the data warehouse.  Pertinent to whom?  The answer is – primarily to the user and also developer and even project team.
  • 8. Why it is important?  Metadata is necessary for using, building and administering your data warehouse.
  • 9. For using the data warehouse  Without the metadata support, user cannot get an information every time they needed(user create their own ad hoc report).  Today data warehouses are much larger in size, wide in scope.  User critically need metadata.
  • 10. For building the data warehouse(extraction team)  Need to know the structure and data content in the data warehouse.  Mapping and data transformations.  Logical structure of data warehouse database.
  • 11. For administering the data warehouse  Impossible to administer the data warehouse(size)  Large no of questions and queries.  Cannot administer without answers for these questions.  Metadata must address these issues.
  • 12. List of questions relating to data warehouse
  • 13. Who needs metadata?  Without metadata, Datawarehouse is like such a filling cabinet without information.  Go through the image column(it address the our question)
  • 14.
  • 15. Like a nerve center  Metadata placed in a key position and enables communication among various processes.
  • 16.
  • 17. Why metadata is essential for IT  Development and deployment of data warehouse is joint effort between users and IT staff.  Technical issue-IT primarily responsible design and ongoing administration.  Metadata essential for IT  beginning with the data extraction and ending with information delivery.  It drives and record the each processes.
  • 18.
  • 19. Summary list of process in which metadata is significant for IT  Data extraction  Data transformation  Data scrubbing  Data staging  Data refreshment  Database design  Query report and design
  • 21. Types by Functional Area  Classify and group in various way-some by usage and who use it  Administrative/End-user/Optimization  Technical/Business  Development/usage  In the data mart/At the workstation  Bank room/front room  Internal/External
  • 22. Functional Areas  Data Acquisition  Data stroage  Information delivery
  • 23. Data Acquisition  DWH process related to following functions. Data extraction Data transformation Data cleaning Data integration Data staging
  • 25. Data stroage  Data loading  Data archiving  Data management  Use metadata in this area for full data refresh and load.
  • 26.
  • 27. Information Delivery  Report generating  Query processing  Complex analysis Mostly this are meant for end-user. Metadata recorded in processes of other two areas. It also record OLAP-the developer and administrators are involved in this processes.
  • 28.
  • 29. Business METADATA  It connect business with DWH.  Business users need more than other users.  Business metadata is like a roadmap.  Tout guide-managers and analysis.
  • 30.  Must describe the contents in plain language giving information in business teerms.  Example The name of data tables (or) individual element must not be cryptic. The data item name-calc_pr_sle. You need to rename this as calculated-prior- month-sale
  • 31. Business metadata Contd.,  Much less structured than technical metadata.  Textual documents, spreadsheets, and even business rules and policies not written down completely.
  • 32. Examples of Business Metadata who Benefits?  Primarily benefits end-users. Managers Business analysis Power users Regular users Casual users Senior managers/ junior managers
  • 33. Technical Metadata  IT staff- Development and Administration of the data warehouse.  Who Benefits? Project manager Data warehouse administrator Metadata manager Database administrator Business analyst Data quality analyst