As your data repository grows on AWS using the object storage services Amazon S3 and Amazon Glacier, it becomes increasingly helpful to use particular features to help protect and manage your objects. In this chalk talk, you have the opportunity to speak directly with the AWS engineering team that builds and maintains features like Cross-Region Replication, S3 Storage Class Analysis, S3 Inventory, S3 Lifecycle, Amazon Glacier Vault Lock, and others. Bring your feedback, questions, and expertise to discuss innovative ways to protect data from corruption or malicious and accidental deletion, managing the data lifecycle to reduce costs, identifying wasted storage, and much more.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Manage Amazon S3 & Amazon
Glacier Objects at Scale
S T G 3 1 6
Shawn Davis
Principal SW Dev Engineer, S3
Amazon Web Services
Saras Kaul
Senior Product Manager, S3
Amazon Web Services
Aiden Byrne
Director of SW Dev, S3
Amazon Web Services

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Amazon Simple Storage Service (Amazon S3) Storage Classes
Storage Management at Scale
Q&A
Object Tags
Bucket Versioning
Storage Class Analysis
Lifecycle Management
Cross-Region Replication
S3 Inventory
S3 Batch Operations

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Your choice of Amazon S3 storage classes
Access FrequencyFrequent Infrequent
• Active, frequently
accessed data
• Milliseconds access
• > 3 AZ
• From: $0.0210/GB
S3 Standard
• Infrequently accessed
data
• Milliseconds access
• > 3 AZ
• From: $0.0125/GB
• Retrieval fee per GB
• Min storage duration
• Min object size
S3 Standard-IA S3 One Zone-IA
• Re-creatable less
accessed data
• Milliseconds access
• 1 AZ
• From: $0.0100/GB
• Retrieval fee per GB
• Min storage duration
• Min object size
S3 Glacier
• Archive data
• Minutes to hours access
• > 3 AZ
• From: $0.0040/GB
• Retrieval fee per GB
• Min storage duration
• Min object size

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Object Tags help ID and take action on objects
Use S3 Object Tags to identify and categorize storage, and perform
object-level operations
Go more granular than bucket level operations!
• Create AWS Identity and Access
Management (IAM) policies
• Filter Lifecycle Policies
• Filter Storage Class Analysis
• Customize Amazon CloudWatch Metrics
• Filter Cross-Region Replication
Key = Image type
Value = Original
Key = Image type
Value = Original
Key = Image type
Value = Rendered

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Bucket versioning helps protect your data
Use versioning to preserve, retrieve, and restore every version of every
object stored in Amazon S3 buckets
Create a new version with every upload. Previous versions are retained.
• Protect against:
o Unintended user actions
o Application failures
• Manage versions:
o Lifecycle expirations
o S3 Inventory
• Versioning required for:
o Cross-Region Replication
o S3 Object Lock

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Bucket versioning helps protect your data
Use versioning to preserve, retrieve, and restore every version of every
object stored in Amazon S3 buckets
• Protect against:
o Unintended user actions
o Application failures
• Manage versions:
o Lifecycle expirations
o S3 Inventory
• Versioning required for:
o Cross-Region Replication
o S3 Object Lock

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S3 Storage Class Analysis helps optimize cost
• Identifies storage age groups that are less
frequently accessed
• Recommends which storage age groups
can be lifecycled from Standard to S-IA
• Analyzes retrievals against storage
• Great for predictable workloads (object
age indicates access frequency)
• Fine tune analysis by bucket, prefix, or
object tag

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S3 Lifecycle Policy helps tier and expire storage
• S3 Lifecycle Policy to tier to lower cost
storage classes and expire storage
• S3 Storage Class Analysis results help set
up a S3 Lifecycle Policy
• Policies are based on age of object and
set by bucket, prefix, or object tag
S3 Standard S3 S-IA S3 Glacier
Why use Lifecycle Management:
• Optimize storage cost by right-sizing
your storage classes
• Clean up expired Multipart uploads
• Clean up Lone Delete Markers

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Your choice of Amazon S3 storage classes
Access FrequencyFrequent Infrequent
• Active, frequently
accessed data
• Milliseconds access
• > 3 AZ
• $0.0210/GB
S3 Standard
• Infrequently accessed
data
• Milliseconds access
• > 3 AZ
• $0.0125/GB
• Retrieval fee per GB
• Min storage duration
• Min object size
S3 S-IA S3 Z-IA
• Re-creatable less
accessed data
• Milliseconds access
• 1 AZ
• $0.0100/GB
• Retrieval fee per GB
• Min storage duration
• Min object size
S3 Glacier
• Archive data
• Select minutes or
hours
• > 3 AZ
• $0.0040/GB
• Retrieval fee per GB
• Min storage duration
• Min object size
• Data with changing
access pattern
• Milliseconds access
• > 3 AZ
• $0.0210 to $0.0125/GB
• Monitoring fee per Obj.
• Min storage duration
S3 INT

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S3 Intelligent-Tiering automates cost savings

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cross-Region Replication helps create backups
CRR automatically copies your data to another AWS region, enhancing
resiliency and getting data closer to end users.
• Filter by bucket, prefix, or object
tag
• Replicate to any S3 storage class
including S3 Glacier
• Change ownership of replica
objects
Why u se CRR:
• C omp liance re qu ire me nts
• Minimize late ncy
• I ncre ase op e rational e fficiency
• Maintain ob je ct cop ie s u nde r
diffe re nt owne rship

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S3 Inventory provides scheduled LIST of buckets
Use S3 Inventory as a scheduled alternative to synchronous LIST API to
simplify and speed up business workflows and Big Data jobs
• Filter by bucket, or prefix
• Output as CSV, or ORC into your S3 bucket
• Easily query-able using Athena and Redshift
• Audit object encryption status and replication status
• Create manifests for S3 Batch Operations
Scheduled
Cost
Effective
Actionable

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1
Choose Objects:
CSV list
S3 Inventory Report
S3 Batch Operations
Use S3 Batch Operations to perform API operations across billions of
objects easily
2
Select an Operation:
COPY
Invoke Lambda functions
Replace object ACL
Replace object tags sets
Restore from Glacier
3
View Progress:
Job-level controls
Completion reports
Notifications
Available in PREVIEW

18. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.