Deep Dive on Amazon Elastic Block Storage (Amazon EBS) (STG310-R1) - AWS re:Invent 2018

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep Dive on Amazon Elastic Block
Store
Marc Olson
Principal Engineer
Elastic Block Store
@molson
S T G 3 1 0 R
Ashish Palekar
Director, Product Management
Elastic Block Store
@logicalblock

Complete set of data building blocks
Data movement
OnlineOffline
Data security
and management
Amazon
EFS
Amazon
EBS
AWS Snow family
AWS Storage Gateway
Family
AWS Direct Connect
Amazon EFS File Sync
Amazon S3
Transfer Acceleration
Storage Partners
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
Amazon
S3
Amazon
Glacier
AWS KMS
AWS IAM
Amazon CloudWatch
AWS CloudTrail
AWS CloudFormation
AWS Lambda
Amazon Macie
Amazon QuickSight

AWS block storage offerings
EC2 instance
store
sc1st1
io1gp2
EBS
SSD-backed
volumes
EBS
HDD-backed
volumes
HDDSSD

What is Amazon EC2 instance store?
• Local to instance
• Non-persistent data store
• Data not replicated (by default)
• No snapshot support
• SSD or HDD
EC2 instances
Physical Host
Instance Store
or

What is Amazon EBS?
• Block storage as a service
• Create, attach volumes through an API
• Service accessed over the network
EC2
instance
EBS
volume

What is Amazon EBS?
• Block storage as a service
• Create, attach volumes through an API
• Service accessed over the network
EC2
instance
!=
EBS
volume

What is Amazon EBS?
EC2
instance
EBS
volume

What is Amazon EBS?
• Volumes persist independent of EC2
• Select storage and compute based on
your workload
• Detach and attach between instances
within the same Availability Zone
EC2
instance
EC2
instance
Availability Zone
AWS Region
EBS
volume

What is Amazon EBS?
• Volumes attach to one instance
• Many volumes can attach to an instance
• Separate boot and data volumes
EC2
instance
EBS
volume
(boot)
EBS
volume
(data)
EBS
volume
(data)
Availability Zone
AWS Region

Amazon EBS volume types
Hard disk drives (HDD)Solid-state drives (SSD)

Amazon EBS volume types
HDDSSD
Provisioned IOPS
SSD
io1
General Purpose
SSD
gp2
Throughput Optimized HDD
st1 sc1
Cold HDD

Amazon EBS use cases
HDDSSD
Relational Databases
MySQL, SQL Server,
PostgreSQL, SAP,
Oracle
NoSQL Databases
Cassandra, MongoDB,
CouchDB
Big Data , Analytics
Kafka, Splunk,
Hadoop, Data
Warehousing
File / Media
CIFS/NFS, Transcoding,
Encoding, Rendering

Choosing an Amazon EBS volume type
or
What is more important to your workload?
IOPS Throughput?

gp2
Latency?
< 1 ms Single-digit ms
Which is more important?
Cost Performance
IOPS
≤ 80,000> 80,000
is more important

Amazon EBS volume types: General Purpose SSD
gp2
Throughput: Up to 160 MiB/s
Latency: Single-digit ms
Capacity: 1 GiB to 16 TiB
Baseline: 100 to 10,000 IOPS; 3 IOPS per GiB
Burst: 3,000 IOPS (for volumes up to 1,000 GiB)
Great for boot volumes, low-latency applications, and bursty databases
General Purpose SSD

Amazon EBS volume types: General Purpose SSD
gp2
General Purpose SSD

gp2
Latency?
Cost Performance
IOPS
≤ 80,000> 80,000
is more important
io1

Amazon EBS volume types: Provisioned IOPS
io1
Baseline: 100–32,000 IOPS
Ideal for critical applications and databases with sustained IOPS
Provisioned IOPS

Scaling Provisioned IOPS SSD (io1)
IOPS
0 2 16
1,000
5,000
10,000
32,000
6 90.64
Volume Size (TiB)
Max Provisioned IOPS
(Maximum IOPS:GB ratio of 50:1)
Available Provisioned IOPS
640 GiB
15,000

Double performance for Provisioned IOPS (io1) SSD
Volumes
Reduce operational complexity
of multiple volumes and use a
single io1 volume to meet high
performance needs
Available in all commercial
regions worldwide on Nitro-
based EC2 instances
Up to 64,000 IOPS and
1,000 MiB/s of throughput
per volume
2x performance for EBS io1 SSD volume types, making it even
easier to run mission-critical applications requiring high
performance storage

Scaling Provisioned IOPS SSD (io1)
IOPS
0 2 16
10,000
20,000
30,000
40,000
64,000
6 91.28
Volume Size (TiB)
Max Provisioned IOPS
(Maximum IOPS:GB ratio of 50:1)
Available Provisioned IOPS
1280 GiB
50,000

Amazon EBS volume types: Provisioned IOPS
io1
Baseline: 100–64,000 IOPS
Throughput: Up to 1,000 MiB/s
Ideal for critical applications and databases with sustained IOPS
Provisioned IOPS

gp2
Latency?
Cost Performance
IOPS
≤ 80,000> 80,000
is more important
io1
Throughput?

gp2
Latency?
Cost Performance
IOPS
≤ 80,000> 80,000
is more important
io1
Throughput
is more important
Small, random I/O Large, sequential I/O
st1
d2
≤ 1,750 MiB/s
Aggregate throughput?
> 1,750 MiB/s
Cost Performance

Amazon EBS volume types: Throughput Provisioned
st1
Baseline: 40 MiB/s per TiB up to 500 MiB/s
Burst: 250 MiB/s per TiB up to 500 MiB/s
Ideal for large-block, high-throughput sequential workloads
Throughput Optimized HDD

gp2
Latency?
Cost Performance
IOPS
≤ 80,000> 80,000
is more important
io1
Throughput
is more important
Small, random I/O Large, sequential I/O
st1
d2
≤ 1,750 MiB/s
Aggregate throughput?
> 1,750 MiB/s
Cost Performance
sc1

Amazon EBS volume types: Throughput Provisioned
sc1
Cold HDD
Baseline: 12 MiB/s per TB up to 192 MiB/s
Burst: 80 MiB/s per TB up to 250 MiB/s
Ideal for sequential throughput workloads, such as logging and backup

Don’t know
your workload
yet?

EBS volume types: General Purpose SSD
gp2
General Purpose SSD

Hybrid volume use cases
https://aws.amazon.com/solutions/case-studies/zendesk/
We have a more flexible way to manage our
logging solution using multiple types of Amazon
EBS volumes, and that has helped us save more
than 60% of the overall costs of running the
solution.
- David Bernstein, Director, Operations Services
Management, Zendesk

I/O Provisioned Volumes Throughput Provisioned Volumes
sc1st1io1gp2
$0.10 per GiB $0.125 per GiB
$0.065 per PIOPS
* All prices are per month, prorated to the second, and from the us-west-2 Region as of April 2018
$0.045 per GiB $0.025 per GiB
Snapshot storage for all volume types is $0.05 per GiB per month

Elastic Volumes: Features
Increase volume size
Increase/decrease provisioned IOPS
Change volume type
standard gp2

Elastic Volumes: Overview
Production
database instance
Network link
IO IO IO IO IO IO IO IOIO
EBS volume

How to modify
1. Snapshot volume
2. Modify volume
3. Monitor modification
4. Extend filesystem (if necessary)

Step 1: Snapshot volume
aws ec2 create-snapshot
--volume-id vol-00077cd243d4af642
--description ”data before resize”

Step 2: Modify volume
aws ec2 modify-volume
--size 5000
--volume-type io1
--iops 32000
Type: gp2
IOPS: 3000
Size: 1 TiB
Original volume:
Type: io1
IOPS: 32000
Size: 5 TiB
Modified volume:

Step 3: Monitor volume
aws ec2 describe-volumes-modifications
{
"VolumesModifications": [
{
"TargetSize": 5000,
"TargetVolumeType": "io1",
"ModificationState": "optimizing",
"VolumeId": "vol-00077cd243d4af642",
"TargetIops": 32000,
"StartTime": "2018-03-30T17:09:18.486Z",
"Progress": 99,
"OriginalVolumeType": "gp2",
"OriginalIops": 3000,
"OriginalSize": 1000
}
]
}
Type: gp2
IOPS: 3000
Size: 1 TiB
Original volume:
Type: io1
IOPS: 32000
Size: 5 TiB
Modified volume:

Step 3: Monitor volume (EC2 console)

Step 4: Extending the filesystem (Linux)
• Determine your file system
• Compare block device size to file
system disk usage
• Extend the file system (if needed)
Note: if the drive is partitioned,
first grow the partitions
[ec2-user ~]$ sudo file –s /dev/xvd*
/dev/xvda1: Linux rev 1.0 ext4 filesystem data ...
/dev/xvdf: SGI XFS filesystem data ...
[ec2-user ~]$ lsblk
[ec2-user ~]$ df –h
EXT:
[ec2-user ~]$ sudo resize2fs device_name
XFS:
[ec2-user ~]$ sudo xfs_growfs –d mount_point
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/recognize-expanded-volume-linux.html

Step 4: Extending the filesystem (Windows)

Step 4: Extending the filesystem (Windows)
Resize partition with PowerShell:
https://docs.microsoft.com/en-us/powershell/module/storage/resize-partition?view=win10-ps

Volume modification tips
• Modification must fit within volume specs (1 GiB gp2 != 1 GiB st1)
• Can modify volumes once every 6 hours
• Current generation instances do not need a stop/start or
attach/detach
• Volumes created before 11/1/2016 require a stop/start or
attach/detach

Elastic Volumes: Automation ideas
Amazon CloudWatchElastic Volumes AWS Lambda

Elastic Volumes: Automation ideas
• Publish a “free space” metric to CloudWatch
and use Lambda + EC2 Systems Manager to
resize the volume and the file system
• Use a CloudWatch alarm to watch for a volume
that is running at or near its IOPS limit or
exhausting burst balance
• Initiate workflow to provision additional IOPS Amazon CloudWatch
Right-sizing:
https://github.com/awslabs/aws-elastic-volumes

Amazon EBS volume attachment
API
AttachVolume
CLI
aws ec2 attach-volume --instance-id i-0cda3bbe40c6ba495
--volume-id vol-01324f611e2463981 --device /dev/xvdf
Console

Amazon EBS volume attachment: Xen
[ec2-user@ip-10-0-22-96 ~]$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
xvda 202:0 0 8G 0 disk
└─xvda1 202:1 0 8G 0 part /
xvdf 202:80 0 1G 0 disk

EBS volume attachment: Nitro Hypervisor
[ec2-user@ip-10-0-12-183 ~]$ lsblk
nvme1n1 259:1 0 1G 0 disk
├─nvme0n1p1 259:2 0 8G 0 part /
└─nvme0n1p128 259:3 0 1M 0 part
[ec2-user@ip-10-0-12-183 ~]$ sudo nvme id-ctrl -v /dev/nvme1n1 | egrep "mn|sn|^00[01]0"
sn : vol01324f611e2463981
mn : Amazon Elastic Block Store
0000: 2f 64 65 76 2f 78 76 64 66 20 20 20 20 20 20 20 "/dev/xvdf......."
0010: 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 "................"

EBS volume attachment: Nitro Hypervisor
[ec2-user@ip-10-0-12-183 ~]$ lsblk
├─nvme0n1p1 259:2 0 8G 0 part /
└─nvme0n1p128 259:3 0 1M 0 part
With ec2-utils:
[ec2-user@ip-10-0-12-183 ~]$ sudo /sbin/ebsnvme-id /dev/nvme1n1
EBS Volume ID: vol-01324f611e2463981
Block device : /dev/xvdf
[ec2-user@ip-10-0-12-183 ~]$ ls -la /dev/xvdf
lrwxrwxrwx 1 root root 7 Oct 12 02:55 /dev/xvdf -> nvme1n1
[ec2-user@ip-10-0-12-183 ~]$ ls -la /dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol01324f611e2463981-ns-1
lrwxrwxrwx 1 root root 13 Oct 12 02:55 /dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol01324f611e2463981-
ns-1 -> ../../nvme1n1

Amazon EBS best practices
Security

Amazon EBS encryption:
Data volumes
Best practice: Encryption

Create a new AWS KMS master key for Amazon EBS
• Define key rotation policy
• Enable AWS CloudTrail auditing
• Control who can use key
• Control who can administer key
Best practice: Encryption

PREVIEW: EBS Encryption Enhancements
Launch Encrypted EBS Backed EC2 Instances from
unencrypted AMIs
Share custom CMK encrypted AMIs between
accounts
Launch Encrypted EBS Backed EC2 Instances from
shared AMIs
Contact us at: ebs-encryption-preview@amazon.com

Security
Reliability

99.999% service availability
0.1% to 0.2% annual failure rate (AFR)
Amazon EBS is designed for

• Point-in-time backup of modified volume
blocks
• Stored in Amazon S3, accessed via EBS APIs
• Subsequent snapshots are incremental
• Deleting snapshot only removes data
exclusive to that snapshot
• Crash consistent
EBS
volume
EBS
snapshot
How does an Amazon EBS snapshot work?

Tracking snapshots and costs (custom tagging)
• Tags provide the ability to assign key/value pairs to AWS
resources
• Snapshots support tags for identification and management
• Snapshot tags can be activated as “cost allocation” tags allowing
for greater visibility into snapshot storage costs
EBS
snapshots
Development
EBS volume
Key = usage
Value = dev
Key = usage
Value = dev
EBS
snapshots
Production
EBS volume
Key = usage
Value = backup
Key = usage
Value = backup

Amazon EBS snapshot tagging upon creation
aws ec2 create-snapshot
--volume-id vol-03f3c34ded2e3398f
--tag-specifications
'ResourceType=snapshot,
Tags=[{Key=CostCenter,Value=115},
{Key=IsProd,Value=Yes}]'

Amazon EBS snapshot tagging upon creation
Specify tags for Amazon EBS snapshots as part of the API call that creates the
resource or via the Amazon EC2 Console when creating an Amazon EBS snapshot.

Tracking snapshots and costs (Cost Explorer)
First, activate customer tag for cost allocation
Generate reports with …..
View usage and costs broken down by “usage” tag value
(example : metrics, dev, backup)

VSS support via EC2 SSM
• Use Policy Generator to create
IAM policy for AWS service, AWS
Systems Manager
• Actions: DescribeInstances,
CreateTags, and CreateSnapshot
• Create Amazon EC2 type IAM role
and attach to Windows instances
SSM VSS included in Microsoft Windows Server AMI version 2017.11.21 & up

Resource-level permissions
Ideas:
• Require use of specific tags
• Specify which users could take
snapshots for a given set of volumes
• Restrict access to DeleteSnapshot
IAM policies can mandate the use of specific tags when taking actions on
Amazon EBS snapshots.

Amazon Data Lifecycle Manager
• Use policies to enforce regular backup schedules
• Policies use tags to identify volumes to backup
• Retain backups for compliance/audit purposes
• Control snapshot costs by automatically deleting
old backups
• Use IAM to control policy access
• No cost to use
Simple, automated way to back up data stored on EBS volumes by
ensuring that EBS snapshots are created and deleted on a custom
schedule.

EBS
volume
Availability Zone
AWS Region
Amazon
S3
EBS snapshot
Availability Zone
EBS
volume
EC2
instance
EC2
instance
What can you do with a snapshot?

EBS
volume
Availability Zone
AWS Region
Amazon
S3
EBS snapshot
EBS
volume
Availability Zone
AWS Region
EBS snapshot
EC2
instance
EC2
instance
What can you do with a snapshot?

AWS Region
EBS
volume
EC2
instance
Availability Zone
What about EC2 instance failure?

AWS Region
EBS
volume
New EC2
instance
Availability Zone
What about EC2 instance failure?

RECOVER instance
Instance ID
Instance metadata
Private IP addresses
Elastic IP addresses
EBS volume attachments
Instance retains:
* Supported on C3, C4, C5, M3, M4, M5, R3, R4, T2, and X1 instance types within a VPC and with EBS-only storage
StatusCheckFailed_System
Amazon CloudWatch
per-instance metric alarm:
When alarm triggers?
Amazon EBS enables EC2 instance recovery

DeleteOnTermination = False
What about EC2 instance termination?
AWS Region
EBS
volume
EC2
instance
Availability Zone

DeleteOnTermination = True
AWS Region
EBS
volume
EC2
instance
Availability Zone
What about EC2 instance termination?

Security
Reliability
Performance

New EBS volume? New EBS volume from snapshot?
• Attach and it’s ready to go • Initialize for best performance
• Random read across volume
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-initialize.html
EBS volume initialization

$ sudo yum install –y fio
$ sudo fio --filename=/dev/xvdf --rw=randread --bs=128k --iodepth=32
--ioengine=libaio --direct=1 --name=volume-initialize
Fio-based example:
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-initialize.html
Best practice: EBS volume initialization

How do we count I/O?
When possible, we logically merge sequential I/Os
...To minimize I/O charges on io1,
and maximize burst on gp2, sc1, and st1
io1 and gp2: up to 256 KiB
st1 and sc1: up to 1 MiB

• Example 1: Random I/Os
• Example 2: Sequential I/O (SSD and HDD)
• Example 3: Large I/O
• Example 4: Mixed I/O

Example 1: Random I/Os
• 4 random I/Os (i.e., non-sequential I/Os)
• Each I/O 64 KiB
EC2
instance
Amazon EBS
Counted as 4 I/Os

Example 2: Sequential I/O
• 4 sequential I/Os
• Each I/O 64 KiB
Up to 256 KiB (SSD)
EC2
instance
Counted as 1 I/O
Amazon EBS

Example 2: Sequential I/O
• 4 sequential I/Os
• Each I/O 64 KiB
Up to 1024 KiB (HDD)
EC2
instance
Counted as 1 I/O
Amazon EBS

Example 3: Large I/O
• 1 I/O
• 1024 KiB
Up to 256 KiB
EC2
instance
Counted as 4 I/Os
How do we count I/Os for GP2 and IO1?
Amazon EBS

EC2
instance
Example 4: Mixed I/O
• 2 * 512 KB sequential I/Os
• 2 * 64 KB random I/Os
• 2 * 128 KB sequential I/Os
Up to 1024 KiB
Counted as 4 I/Os or 4 MiB/s of burst (but only ~ 1.4 MiB of data transferred)
How do we count I/Os for ST1 and SC1?
Amazon EBS

Max I/O credit per bucket is 5.4M
Burst performance:
You can spend up to
3,000 credits per second
Baseline performance:
Always accumulating
3 IOPS per GiB per second
gp2
Burst bucket: gp2

Burst and baseline: gp2
Baseline IOPS
(Baseline Linearly Scales at 3 IOPS/GiB)
Burstable to
3,000 IOPS
IOPS
0 1 16
1,000
2,000
3,000
8,000
16,000
3 90.5
Volume size (TiB)
5,334 GiB
100 IOPS
Minimum
300-GiB volume
6

0
150
300
450
600
750
0 100 200 300 400 500 600 700 800 900
MinutesofBurst
Volume size in GiB
43 min
300 GiB
1 hour
500 GiB
How long can I burst on gp2?
10 hours
950 GiB

One hour
How do I monitor my burst balance?

How do I monitor my burst balance?

Max I/O bucket credit is 1 TiB of
credit per TiB in volume
Burst performance:
Spend up to
st1: 500 MiB/s
sc1: 250 MiB/s
Baseline performance:
Always accumulating
st1: 40MiB/s per TiB
sc1: 12MiB/s per TiB
st1/sc1
Burst bucket: Throughput

0
125
250
375
500
0 2 4 6 8 10 12 14 16
ThroughputinMiB/s
Volume size in TiB
Series1
320
st1
Burst & baseline: st1

0
75
150
225
300
0 2 4 6 8 10 12 14 16
ThroughputinMiB/s
Volume size in TiB
Series1 Series2
192
sc1
Burst & baseline: sc1

4 TiB st1 Volume
5,400 GiB
87 GiB
0
1500
3000
4500
6000
1
3-Hour Data Transfer: Sequential vs. Random
Series1 Series2
1 MiB Sequential:
5.4 TiB transferred
16 KiB Random:
87 GiB transferred
Burst balance for st1 and sc1

2046 sectors x 512 bytes/sector = ~1024 KiB
$ iostat –xm
Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
xvdf 0.00 0.20 0.00 523.40 0.00 523.00 2046.44 3.99 7.62 1.61 100.00
iostat for Linux
Perfmon for Windows
Verify workload I/O patterns

Verify ST1 & SC1 workloads
128 KiB
Amazon
CloudWatch
Console

Verify ST1 & SC1 workloads
Amazon
CloudWatch
Console
Under 64
KiB?
Small or
random IOPS
likely

Increase read-ahead buffer:
• Recommended for high-throughput read workloads
• Per volume configuration
• Default is 128 KiB (256 sectors) for Amazon Linux
• Smaller or random I/O will degrade performance
Increase read-ahead:
$ sudo blockdev --setra 2048 /dev/<device>
Examine current value:
$ sudo blockdev --getra 2048 /dev/<device>
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSPerformance.html
Linux performance tuning: st1 & sc1

More details:
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSOptimized.html
• Dedicated network bandwidth for Amazon EBS I/O
• Enabled by default on all current generation instance types
• Can be enabled at instance launch or on a running instance
• Not an option on some 10-Gbps instance types
• (c3.8xlarge, r3.8xlarge, i2.8xlarge)
What is an EBS-optimized instance?

c4.large
Dedicated to EBS
500 Mbps ~ 62.5 MiB/s
2 TiB GP2 volume:
6,000 IOPS
250 MiB/s max throughput
4,000 16K IOPS
c4.2xlarge
Dedicated to EBS
1 Gbps ~ 125 MiB/s
8,000 16K IOPS
2 TiB GP2 volume:
6,000 IOPS
Performance: EBS-optimized

Performance: EBS-optimized burst
c5.large
Dedicated to EBS
525 Mbps ~ 64 MiB/s
8,000 16K IOPS
2 TiB GP2 volume:
6,000 IOPS
c5.large
Dedicated to EBS
2250 Mbps ~ 275 MiB/s
2 TiB GP2 volume:
6,000 IOPS
16,000 16K IOPS
30 minutes

When to RAID?
• Storage requirement >16 TiB
• Throughput requirement > 1,000 MiB/s
• IOPS requirement >64,000 @ 16K
Best practice: RAID
EBS EBS EBS

Avoid RAID for redundancy
• EBS data is already replicated
• RAID1 halves available EBS bandwidth
• RAID5/6 loses 20% to 30% of usable I/O to parity
Best practice: RAID
EBS EBS EBS

Use Metric Math to derive new monitoring insights
Convert count metrics to rate/throughput metrics
EBS Database read/write operations to IOPS or EFS TotalIOBytes to Throughput
metrics
Aggregated cluster or fleet-wide metrics
Total # of requests for a service distributed across multiple clusters or Average CPU
Utilization across multiple instances
Fill sparse metrics
Fill in default values for metrics that have empty values or are not collected at regular
intervals
Relative scale/percentage metrics
Error count to % Error Rate or availability metrics

Use encryption if you
need it
Take snapshots,
tag snapshots
Select the right
instance for your
workload
Select the right
volume for your
workload
Summary

Thank you!
Marc Olson
Ashish Palekar
Submit Session Feedback

Deep Dive on Amazon Elastic Block Storage (Amazon EBS) (STG310-R1) - AWS re:Invent 2018

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Deep Dive on Amazon Elastic Block Storage (Amazon EBS) (STG310-R1) - AWS re:Invent 2018

Ähnlich wie Deep Dive on Amazon Elastic Block Storage (Amazon EBS) (STG310-R1) - AWS re:Invent 2018 (20)

Mehr von Amazon Web Services

Mehr von Amazon Web Services (20)

Deep Dive on Amazon Elastic Block Storage (Amazon EBS) (STG310-R1) - AWS re:Invent 2018