1. The document discusses the evolution of data integration infrastructures from pre-data warehouse systems using custom reporting and local data collections to traditional data warehouses using on-premise databases and ETL processes to modern cloud-based architectures.
2. It describes an airline company's move from an on-premise data warehouse to a new cloud-based data architecture on Azure using services like Azure Data Factory and data virtualization to provide a more scalable, flexible, and agile solution.
3. The key takeaways are that a new era of data usage has begun, solutions should be proven in parts to show business value, and an agile approach using pay-per-
4. Evolution of data integration infrastructures
Custom reporting
solutions Local data
collections
Physical
distribution
1.0 Pre Data Warehouse
Infrastucture
On-premise
RDBMS
ETL
Physical layers
Physical
distribution
2.0 Traditional Data Warehouse
infrastructure
IaaS cloud
implementation
A new era has already begun
Storage
Compute
Data persistence
Cloud
Data Virtualization
Reuse of data
Manage logic,
not data
3.0 Modern Data
Integration infrastructure
5. • Scalable
• Flexible
• Supports Agile way of working
• Shorter Time to Market
• Uncoupling data and logic
9. Former architecture
Data Warehouse
Data Sources Data ConsumersOracle DWH
IBM Netezza (MPP) DWH
Different workloads
Different timelines
Different data structures
Different use of data
10. Evolve
• Discover your goals
- One platform as one starting point for all
- Not just one tool for everybody
- Standardization
- Total cost of ownership, ‘On when needed’
- Replace on-prem MPP solution
• Proving by doing
- Draw the complete concept
- Proof the parts needed
- Every month results with business value
- Innovation sprinting
• Use pay per use services
- Scalable
- Low maintenance
Agile solutioning
11. A New architecture
Cloud Platform
Data Sources
Data Preparation
Data Consumers
Data Scientists
Data Storage Publish Data
13. Takeaways
1. A new era has already begun
2. Data usage mixed
3. Find your sweet spots
4. Proof your solutioning
5. Agile approach
6. Have fun!
Why not start today?