Mainframes continue to perform mission-critical transaction processing and contain massive amounts of core business data. But digital transformation initiatives and cloud computing have created both opportunities and challenges for unlocking and utilizing this data. Qlik and AWS will share some of the proven strategies from successful customer deployments across a range of different mainframe to cloud use cases, including legacy application modernization, data analytics, and data migrations.
In this presentation, you will learn how to:
• Replicate very large volumes of mainframe data in real-time to the cloud
• Automate the creation of analytics-ready data lakes and data warehouses
• Achieve a 30% reduction in cost of compute
13. 13
Use Case 1: Mainframe Data Analytics on AWS
Relational Hierarchical Data files
Transaction Manager
Mainframe
Amazon Redshift
data warehouse
Analysis Dashboards
Amazon S3
data lake
Amazon EMR
analytics
Amazon
QuickSight
Legacy
requests
Amazon
Aurora
Replicate
14. 14
Use Case 2: Mainframe Data-Driven Augmentation
Relational Hierarchical Data files
Transaction Manager
Mainframe
Amazon Kinesis
Streams
Amazon
Aurora
Amazon ECS
containers
Amazon API
Gateway
Amazon Lambda
microservices
Amazon
Machine Learning
Alexa Skill
Mobile Voice
Legacy
requests
Amazon
Redshift
Replicate
15. 15
Use Case 3: Mainframe Data Workload Offload
Relational Hierarchical Data files
Transaction Manager
Mainframe
Amazon Kinesis
Streams
Amazon
Aurora
Amazon ECS
containers
Amazon API
Gateway
Amazon Lambda
microservices
Offloaded
workload 1
Offloaded
workload 2
Legacy
requests
Elastic Load
Balancing
Amazon EC2
instances
Amazon
RDS
Replicate
16. 16
meets or exceeds mainframe workloads requirements
High Security AWS top priority – Encryption everywhere – AWS Key Management Service – AWS CloudHSM – AWS VPN – AWS Direct
Connect – AWS IAM central access control – AWS CloudTrail central auditing – Virtual Private Cloud (VPC) – VPC Flow Logs
– Security Groups – Network Access Control Lists – AWS Config – Organizations Service Control Policies – Amazon
Inspector – Amazon GuardDuty – AWS Web Application Firewall – Automated reasoning technology – And more
High Availability Redundancy across Availability Zones (AZ) – Replication across Regions – Inter-AZ and inter-regions load-balancing –
Health-checks and automatic restart – Managed data synchronization and replication – Amazon Aurora 6 data copies across
3 AZ – Aurora Multi-Master – Aurora Global Database – Smaller blast radius with horizontal redundancy
Scalability and
Elasticity
Horizontal scalability with virtually unlimited capacity – Dynamic elasticity with Auto Scaling Groups – Vertical scalability with
EC2 instance type wide selection – Vertical scalability up to 224 physical CPU cores – Scalability across AZ and Regions –
Caching with Amazon ElastiCache or CloudFront – Right tool for the right job with many database types (no-SQL, graph,
document…)
System Management Amazon CloudWatch monitoring – CloudWatch Logs – Compliance with AWS Config – AWS Control Tower – AWS
Organizations – AWS Systems Manager – AWS Service Catalog – AWS OpsWorks – AWS trusted Advisor – AWS Backup –
Cost Allocation Tags – AWS License Manager – AWS Budgets – AWS Marketplace – AWS X-Ray – Reduced administration
with fully managed services
Cost Optimization Optimized pricing with Spot Instances, Reserved Instances, Savings Plans – Pay-as-you-go with Per Second Billing – Right-
sizing with EC2 type wide selection – Dynamic allocation with Auto Scaling Groups – AWS Cost and Usage Report – Cost
Explorer
Agility Continuous Integration and Continuous Deployment with AWS Code* – Infrastructure-as-code – AWS CloudFormation
automation – AWS Cloud Development Kit – Amazon Machine Image (AMI) – Microservices on containers or serverless
computing – Cloud speed with managed services – Large choice of services and frameworks – Rapid growth of AWS
innovations
19. 19
Replicate Task
Source Endpoint
Replicate Task: High Level Logical Overview
Source DB Target
Transaction Logs
Source Tables Target Tables
Change Data
Capture
Source
Unload
In-Memory Processing Target Endpoint
Stream
Apply
Target
Load
Filter
and
Transform
20. 20
Mainframe Customer Examples
“Qlik Replicate enables us to build agile
applications and analytics in the AWS
Cloud, dealing efficiently with the volume
and velocity of our mainframe data.”
- Donovan Stockton, Platform Owner, Cloud Data as a
Service, Vanguard
Challenge:
To have efficient and real-time access data from
large mainframe systems to cloud
Solution:
Near real-time mainframe data into AWS with
Qlik Replicate
Results:
20 million rows of data moved per hour, on avg
Over 60 million rows of data per hour during
peak demand.
200% Increased cloud adoption year-on-year
30% Reduced compute & build costs