Moving your commercial databases to Amazon RDS

1. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Peter Chan Solutions Architect Amazon Web Services Move your Commercial Databases to Amazon Relational Database Service Calvin Lam Assistant Manager of Cloud Services New World Development Co. Ltd.

2. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Agenda  Overview of Amazon RDS  Options for Deploying SQL Server on AWS  Managed experience of SQL Server on Amazon RDS – High Availability – Security – Performance / Scaling – Backup / Config / Monitoring  SQL Server BI Services on Amazon RDS **NEW!  Migrating data to / from Amazon RDS  Case Sharing from New World Development Co. Ltd.  Q/A

3. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon Relational Database Service (RDS) Managed relational database service with a choice of six popular database engines Easy to administer Available and durable Highly scalable Fast and secure No need for infrastructure provisioning, installing, and maintaining DB software Automatic Multi-AZ data replication; automated backup, snapshots, failover Scale database compute and storage with a few clicks with no app downtime SSD storage and guaranteed provisioned I/O; data encryption at rest and in transit

4. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon RDS for SQL Server SQL Server on Amazon EC2 Customer managedAWS managed Power, HVAC, net OS Install/Maintenance OS Patching DBMS Install/Maintenance DBMS Patching Database Backups High Availability Scaling Power, HVAC, net OS Install/Maintenance OS Patching DBMS Install/Maintenance DBMS Patching Database Backups High Availability Scaling • Consider RDS first • Focus on business value tasks • High-level tuning asks • Schema optimization • No in-house database expertise • Need full control over DB instance • Self managed Backups • Replication • Clustering • Options that are not available in RDS Options for Deploying SQL Server on AWS

5. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark SQL Server Features at a Glance 2012, 2014, 2016, 2017Versions Supported: Editions Supported: High Availability: Encryption: Authentication: Backups: Maintenance: Express, Web, Standard, Enterprise All** including 2019 All** AWS-managed Encrypted Storage using AWS KMS (all editions); TDE support Self-managed; AlwaysOn, Mirroring… Windows & SQL Authentication Managed Automated Backups Maintenance Plans & 3rd Party Tools Automated Software Patching Self-managed Amazon RDS Amazon EC2 Licensing: License-included License-included, BYOL

8. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. HA of SQL Server on Amazon RDS (Multi-AZ) • Fully managed secondary in-region • Distinct EC2/EBS resources • Synchronous storage replication • Failover in 1-2 minutes • Crash recovery • CNAME propagation • 99.95% monthly uptime SLA Region Availability zone A Availability zone B DB Instance DB instance standby Volume Volume RDS monitoring and automation DB instance standby DB Instance

9. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Implementations of Multi-AZ SQL Server on RDS Database Mirroring • SQL Server 2012 Standard and Enterprise • SQL Server 2014 Standard and Enterprise • SQL Server 2016 Standard • SQL Server 2017 Standard • SQL Server 2016 Enterprise • SQL Server 2017 Enterprise AlwaysOn Availability Group

10. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark RDS for SQL Server high availability (Database Mirroring) AMAZON RDS FOR SQL SERVER MULTI-AZ DEPLOYMENT • Fully managed and automated HA solution in an AWS region • Principal and secondary DB nodes in different AZs • Witness in a third AZ • Leverages SQL Server DB mirroring • DNS endpoint provided for app connectivity

11. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark RDS for SQL Server high availability (AlwaysOn) AMAZON RDS FOR SQL SERVER MULTI-AZ DEPLOYMENT • SQL Server 2016 and 2017 Enterprise Only • Fully managed and automated HA solution in an AWS region • Principal and secondary DB nodes in different AZs • Leverages AlwaysOn (non-domain joined) • Secondary node is completely passive • DNS endpoint and AlwaysOn AG listener provided for app connectivity

12. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark AlwaysOn availability group spans across two AZs • Synchronized replication • Active / passive • AAG listener endpoint • Automatic failover

13. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Availability: Failover Times *Crash recovery times not included **MultiSubnetFailover = True Failover reason Time to reconnect* (seconds) Mirroring Primary DNS Always On Primary DNS Always On Listener Manual failover 60-70 30-40 5-7 Primary SQL Server crash 30-40 30-40 6-9 Primary server network disconnect 80-110 80-110 30-35

14. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Securing SQL Server on AWS: data Protect data at rest • Encrypted DB instances using EBS encryption with AWS KMS • Encrypted databases using TDE (Enterprise version only) Secure data in transit Encrypted connections via SSL, forced SSL supported 1 2 3 Both in-transit and on-disk Always Encrypted

15. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark M5 Family • General Purpose Instances • M5.Xlarge (4 vCPU/16 GiB ) • M5.24Xlarge (96 vCPU/384 GiB ) • High performance networking • Good for running CPU intensive workloads (e.g. WordPress) R5 Family • Memory Optimized • R5.Xlarge (4 vCPU/32 GiB ) • R5.24Xlarge (96 vCPU/768 GiB ) • High performance networking • Good for query intensive workloads or high connection counts Available Instance Types X1E • Optimized for large-scale, enterprise-class and in-memory applications, and offer one of the lowest price per GiB of RAM among Amazon EC2 instance type • x1e.Xlarge (4 vCPU/122 GiB ) • x1e.8Xlarge (32 vCPU/976 GiB ) z1d Family • CPU Optimized, 4GHz • Memory Optimized • z1d.Xlarge (4 vCPU/32 GiB ) • z1d.12Xlarge (48 vCPU/384 GiB)

16. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Optimizing costs and performance with Windows, Intel and AWS • Over 57% of all Windows deployments in the cloud run on AWS, almost 2X over the closest provider • AWS has over 10 years of experience running Windows applications • AWS offers the broadest family of instances • General purpose, compute and memory optimized • Packaged, custom AMI’s • Multiple pricing models • Maximum performance with optimized instances • High memory – Largest SAP certified in-memory instances • Z1d – fastest compute with Intel Xeon Scalable processor for design automation

17. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Why Microsoft SQL Server on Intel Xeon Scalable processors Industry Leading Performance – Processing workloads for all types at breakthrough speeds, in memory OLTP, in-memory column store, runs Linux and Docker Containers, in- database advanced analytics, end-to-end mobile BI, AI built-in Consistent Experience – Most consistent on premises to cloud, Intel® Xeon® Scalable processors available in AWS , easy migration to cloud Better Security – Microsoft* TDE and Intel® AES-NI accelerate encryption¹, Microsoft SQL Server* named least vulnerable database for 7 years²

18. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon EBS Volume Types Volume Type General Purpose: GP2 Provisioned IOPS: PIOPS/IO1 Technology: SSD SSD Sizes: 1 GiB – 16 TiB 4 GiB – 16 TiB Max. IOPS: 16,000** 64,000* Max. IOPS/Instance 80,000 80,000 Max. Throughput: 250 MiB/sec** 1000 MiB/sec* Properties: 3 IOPS/1 GB, burstable up to 3000 IOPS for up to 1 TiB volumes, 99% performance Consistent provisioned performance, 99.9%

19. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Compute and Storage Scaling Scale Compute to Handle Increased Load Up to 96 vCPUs (R5.24XL) 976 GiB of RAM (x1e.8XL) Scale Storage for Larger Data Sets Scalable EBS storage up to 16TiB Scale Down to Control Costs As little as 1 vCPU and 1 GiB of RAM

21. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark • 2016+ Enterprise Edition • Leveraging AlwaysOn Availability Group feature • Up to 5 asynchronous in-region read replicas • Manual promotion of read replica to principal Read replica of SQL Server on Amazon RDS **NEW!

22. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark • Source instance must be multi-AZ deployment with AlwaysOn AG • Source instance type has at least 4 vCPU • Separate listener endpoint for EACH read replica Distributed AG for Read Replica

23. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Centralized DB engine configuration PARAMETER GROUPS OPTION GROUPS • Centralized management of DB engine parameters • Ability to consistently apply configurations to DB instances • Auditability of configuration • Sensible defaults work for most use cases • Ability to create custom parameter groups • Read only vs. changeable parameters • Applied immediately vs. requiring reboot • Used for enabling additional features • Ability to create custom option groups • Supported options: • Transparent data encryption (TDE) in enterprise edition only • Amazon Simple Storage Service (Amazon S3) backup & restore • SSIS, SSAS, SSRS Exercise caution—Change at your own risk! Follow Microsoft and documented best practices

24. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Automated Backups Point-in-time recovery for your DB instance • Scheduled daily volume backup of entire instance • Archive database change logs • 35–day maximum retention • Minimal impact on database performance Every day during your backup window, RDS creates a storage volume snapshot of your instance Every five minutes, RDS backs up the transaction logs of your database

26. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Native Backups • Backup and restore directly to and from S3 bucket • Supports Compression • Only full & diff backups (no t-log) • Full, diff & t-log restores • Multi-file backup/restore Amazon RDS SQL Server Amazon S3 IAM SQL Server *.bak

27. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Integrate with Amazon Directory Service • Cloud-based Active Directory deployment using AWS Directory Services Microsoft AD • Managed directory • Credentials stored and managed in the directory • RDS DB instance joined to the directory operated domain • Add SQL Server logins for domain users, and authenticate using Windows Authentication virtual private cloud RDS SQL Server Enabled for Windows Authentication Amazon Directory Service

28. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Windows Authentication Using On-Prem AD 1. Setup SQL Server RDS 2. Setup Managed AD 3. Enable Windows Integrated Authentication to use Managed AD directory 4. Create a Trust with On- Premises Domain 5. Assign privileges to On- Premises for access to RDS

29. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Monitoring RDS SQL Server performance Monitor performance using Amazon CloudWatch Enhanced Monitoring Performance Insights 1 2 3 4 SQL Server Logs (error logs, agent logs, trace and dump files) 4 3rd Party Tools

30. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Cloud Watch metrics Amazon CloudWatch metrics • CPU Utilization • DB Connections • Free Storage Space • Freeable memory • Write / Read IOPS • Queue Depth • Write / Read Throughput • Swap usage • Write / Read Latency • Network Receive Throughput • Network Transmit Throughput

31. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon RDS Enhanced Monitoring Overview: • OS Level Monitoring Metrics – 26 system and per process metrics • Metrics delivered to CloudWatch Logs • Up to 1 second granularity Compared to CloudWatch Metrics: • Agent based metrics collections • There can be differences with CloudWatch metrics due to collection source (hypervisor vs. agent) – eg. CPU

33. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Rethinking Standard Edition High availability with RDS Multi-AZ • Synchronous replication and automated failover  99.95% uptime SLA • Independent infrastructure RDS Storage encryption with Amazon KMS • AES-256 encryption at rest • Bring your own keys Tuning with RDS Enhanced Monitoring and Performance Insights • Per-process host metrics, granularity down to 1 second • Analyze database load and active sessions

39. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Migrating Data to & from Amazon RDS .BAK File Save & Restore Leverages SQL Server’s native backup functionality AWS Database Migration Service Minimize downtime during migrations, migrate between different DB platforms, Schema Conversion Tool AWS Marketplace Third-party data import and export tools and solutions 1 3 4 Microsoft SQL Server Database Publishing Wizard, Import/Export Export to T-SQL files, load using sqlcmd 2 SQL Server Replication Push subscriptions to transactional replication 5

41. About New World • Founded in 1970 • Our core business areas include: - Investment in property and property development - Investment in and/or operation of roads - Commercial aircraft leasing - Construction - Insurance - Hotels - Other strategic businesses

42. Originally, all of New World Development’s operations were hosted in a colocation data center. But by 2013, the Hong Kong government introduced new regulations requiring property listings to be updated and available online 24/7. This prompted us to migrate the company’s property website and mobile app to the AWS Cloud. When selecting a cloud provider, reliability was the key factor. “Prior to AWS, we tried other cloud providers, but AWS is much more reliable in terms of service availability.” Why AWS?

43. Challenges before using RDS Corporate data center Traditional server Challenges

44. Challenges before using RDS Corporate data center Traditional server Challenges Solutions

45. Challenges before using RDS Corporate data center Traditional server Challenges Solutions

46. What RDS services are used? Corporate data center Traditional server Challenges Solutions AWS Cloud Region B AWS Backup Snapshot Auto Snapshot Region A Availability Zone A Availability Zone B Security group Security group CloudWatch Recommendation s Primary Standby Corporate Data center S3 Import/Export Traditional server

47. Benefits after using RDS

48. Migration experience – Native SQL backup restore 1. Create the S3 Bucket 2. Create an option group that will allow us to perform the native backup from SQL Studio Management. 3. Select your option group and click on the “add option” button 4. Make sure the SQLSERVER_BACKUP_RESTORE is selected and then create a new IAM role. 5. Select the S3 bucket created and then select “Apply immediately – YES”. 6. You can see that the option was added to the option group: 7. Then you have to modify your instance and assign the new option group: 8. Choose “Apply immediately” option: 9. On the details of your instance, you will see the option group created. 10. Backup and Restore

49. Lesson learnt - Cross region backup 1. To start, open the AWS Backup service. 2. Click on Backup plans and then Create Backup plan. 3. After naming your plan, you will configure the backup rule—or, more specifically, a schedule that will be followed for creating backups. 4. After you’re done and your plan is created, it is time to assign resources to it. 5. Resources can be assigned by using tags or by adding them based on the Resource ID. 6. With the plan created and the resources assigned, your AWS Backup is ready.

Moving your commercial databases to Amazon RDS

Du liest eine Vorschau.

Hier ansehen

Moving your commercial databases to Amazon RDS

Weitere Verwandte Inhalte

Diashows für Sie (20)

Ähnlich wie Moving your commercial databases to Amazon RDS (20)

Weitere von Amazon Web Services (20)