Biml Academy 2 - Lesson 5: Importing source metadata into Biml
1. Biml Academy 2
Importing, Staging, and Loading Data with Biml
Andy Leonard · Scott Currie · Cathrine Wilhelmsen
2. Biml Academy 2
Lesson 5: Importing source metadata into Biml (Cathrine)
Lesson 6: Staging data with Biml (Andy)
Lesson 7: Metadata-driven staging pattern with Biml (Andy)
Lesson 8: BimlFlex for Data Vault data warehouses (Scott)
Lesson 9: Biml Q&A with several BimlHeroes!
6. Methods for importing metadata
ImportTableNodes
Import tables and views in one schema
Filter tables using LIKE % wildcard syntax
7. Methods for importing metadata
ImportDB
Import all schemas, tables and views
Filter using LIKE % wildcard syntax
8. Methods for importing metadata
GetDatabaseSchema
Import all schemas, tables and views
Filter using collections
9. Why ImportDB and GetDatabaseSchema?
ImportDB / ImportTableNodes
• SELECT * on each imported table
• SELECT to get defaults, indexes etc.
• Using SchemaOnly mode
• Doesn't actually run the query, but
returns schema for the result set
GetDatabaseSchema
• Figures out target database type
(SQL Server, Oracle, Teradata, DB2,
PostgreSQL, Ingres, OpenEdge etc.)
• Queries the relevant information
schema for that database type
A few queries for the entire importMultiple queries per table
10. But why keep both if one is faster?
Support for legacy scripts :)
They can return different results – where both are valid/correct
Different data type mapping defaults in different systems
(Bulk Copy, SSIS and Excel are all different)
Biml supports the two most commonly used approaches
21. Biml Academy 2
Lesson 5: Importing source metadata into Biml (Cathrine)
Lesson 6: Staging data with Biml (Andy)
Lesson 7: Metadata-driven staging pattern with Biml (Andy)
Lesson 8: BimlFlex for delivering Data Vault data warehouses (Scott)
Lesson 9: Biml Q&A with several BimlHeroes!