Weitere ähnliche Inhalte Ähnlich wie Dissecting Media Asset Management Architecture and Media Archive TCO (MAE301) - AWS re:Invent 2018 (20) Mehr von Amazon Web Services (20) Dissecting Media Asset Management Architecture and Media Archive TCO (MAE301) - AWS re:Invent 20182. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Dissecting Media Asset Management
Architecture and Media Archive TCO
Mike Davis
Business Development Manager
AWS
M A E 3 0 1
Jack Wenzinger
Solutions Architect
AWS/Global M&E Partners
Ken Shek
Media Specialist
AWS/Global M&E
3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Media customers are migrating their catalogs to AWS
for multiple reasons
• AWS costs are on-par with tape-based archival
• Adjacent value in AWS services: Moving the archive is a prerequisite
to agility and insight aka Do new things with your data
• Elimination of tape challenges including supply chain risk
• The AWS brand is a low-risk choice
4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Economics and Risks Large-Scale Tape Archival
Economics of tape: core BOM
Big libraries: >$2 Million and the media to fill
them
Drives and robotics
Networking
Licenses for software, media servers, etc
Support contracts
Additional quantitative costs
2 or 3 copies of tapes for DR
Costs of media migration
(media, people, bandwidth...)
Cost of under-utilization
Costs for offsite vaulting
Administrators
Harder-to-quantify but very real
Long recovery times
Resource contention
Bit rot, mechanical failure, and “fell off the truck”
Secure source of supply and support
5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Components of On-Premises Tape Archival
Component Cost Type of cost Insights
Tape library (chassis, robotics,
drives, media servers)
$500K-$2MM Fixed, capital Life span 10-15 years
Library support (license, repairs,
ESA)
20% License & support Break-fix is unpredictable
Media (LTO tape) $25/$68/$160 Variable
Replace after 8 years
Add in DR copies
Archive manager software
$250-$400K/year
+ 22% support
Annual license
(per slot)
Can eliminate with AWS!
Power & cooling minor Opex Consumes no pwr at rest
Datacenter footprint >500 ft2 Opportunity cost Very real-estate impactful
Administration $130K per 20PB Opex Lots of non-quant costs
Risk – DR, theft, bit-rot... % Not included in TCO
6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
An Example AWS TCO model
10 PB archive
10% annual growth
50TB monthly IO (0.5%)
100GB files
50% Expedited Retrieval
Dual 10Gb DX included
4 months of AWS Snowball
List price w/ 0% decline $0
$100,000
$200,000
$300,000
$400,000
$500,000
$600,000
$700,000
$800,000
$900,000
$1,000,000
Year 1 Year 2 Year 3 Year 4 Year 5
5-Year AWS Cost Calculation
Capacity costs Migration Access costs
8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Archive ProxiesCapture
Proxies
Distribution
Proxies
Service Masters
Versions
Languages
Formats
Promo Material
MAM: So what’s the big deal?
Production
Proxies Digital Intermediates
Mastering
VFX
Foley
Promos
10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MAM CORE SERVICES
Enterprise Playout / Distribution
Marketing
Archive
COMMON MAM USE-CASE
SOURCES
Production Catalog
• Finished Shows
• Localized Versions
• Promos
Live TV
- Broadcast
- Broadcast Highlights
- Livestream
- Livestream Highlights
Electronic News
Gathering
User Generated Content
Production Content
- Dailies
- Digital Intermediates
- VFX
- Audio
ENDPOINTS
TV
OTT
VOD
PC
Tablet/Mobile Apps
Website
Sponsors
Footage Licensing
Social Media
• YouTube
• Facebook
• Twitter
• Instagram
Catalog / Archive
• Website
• Sponsors
• Footage Licensing
Ingest Search Asset Database User Access
User Interface Preview Manage Deliver
Media Asset Management Ecosystem
Live Event
Production / Post Production
File Storage Acquisition Transcode Localization
Block Storage File Transfer Captioning Archive
Archive Storage Preview Packaging Analytics
Metadata Tagging Editing QC Delivery
Network / CDN Change Control Rights Taxonomy
Workflow
Orchestration
Database
SQL/NoSQL
Resource
Management
Machine
Learning
MAM ENABLING TECHNOLOGIES
11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud-Enabled: “Cloud-Hybrid”
On-Premise AWS Cloud
Access
Admin
DB
Search
UX
Tools
Workflow
Reports
Transcode
API
MAM Application
Machine Learning
Amazon
Comprehend
Amazon
Rekognition
Amazon
Transcribe
Media Service Elasticity
LTO Tape
Archive
NLE
NLE
NLE
Disaster Recovery & Delivery
Amazon S3 Amazon Glacier
AWS Elemental
MediaConvert AWS Lambda
Common Hybrid Use-Cases
12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud-Enabled: “Lift and Shift”
On-Premise AWS Cloud
Access
Admin
DB
Search
UX
Tools
Workflow
Reports
Transcode
API
MAM Application
LTO Tape
Archive
NLE
NLE
NLE
Amazon S3 Amazon Glacier
Common Hybrid Use-Cases
Amazon
EC2
MediaConvert
13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud-Native: “Optimized”
On-Premise
AWS Cloud
User Experience
Media Tools
MAM Application
Cloud Based Media Production
Server
Amazon
EC2
AMI
Elasticity
AWS Application
Auto Scaling
NLE
AI Recognition Speech to Text Context Security
Amazon Rekognition Amazon Transcribe Amazon Comprehend Amazon Inspector
Amazon SNS AWS Step Functions AWS Lambda Amazon SQS
Amazon DynamoDB Amazon ES Amazon RDS Aurora Amazon CloudWatch
Amazon Glacier Amazon S3 MediaConvert Amazon Cognito
Notifications Workflow Event Trigger Queuing
Metadata DB Search Index SQL DB Monitoring
Archive Storage Transcode Authentication
Infrastructure Template
AWS CloudFormation
Cloud Services Infrastructure
Amazon Machine
Interface
14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud Benefits
✔ Avoid heavy lifting
✔ Pay as you go
✔ Stop guessing capacity
✔ Agility, speed, innovation
✔ Service breadth & depth
✔ Experience
✔ Ecosystem
✔ Security
✔ Pricing philosophy
✔ Global reach
Cloud-Based MAM Benefits
� Control Your Content
� Leverage AIML
� Move Content Less
� Tackle the Legacy Problem
� Jump on Opportunities
15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless means…
No Server Management Flexible Scaling
No Idle Capacity
$
High Availability
16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ingest
Dashboard
Example: Serverless Ingest MAM Architecture Components
Object
Storage
File
Transfer
Amazon S3
Archive
Storage
Amazon Glacier
Storage
Policy
Asset Registry
UUID Tag
Technical
Metadata
Checksum
Event Driven Functions
Workflow Orchestration
AWS Step Functions
Amazon
Lambda
Media AI Metadata
Face / Object
Amazon Rekognition
Transcript
Amazon Transcribe
Contextual
Amazon Comprehend
Amazon
Lambda
Notification
MAM Import
Proxy Creation
AWS MediaConvert
Amazon
SNS
Amazon
Lambda
AWS Partner: Levels Beyond
Master Asset +
Filename, Barcode
Internet
Standardized
Asset +
Metadata
Archived Content
Original Metadata
Technical Level
UUID/MD5
Transcript
Faces / Objects
Phrases
Syntax
Sentiment
AWS Direct
Connect
AWS
Snowball
17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI Generated Metadata
UUID, MD5, Technical
Transcription Contextual Metadata
Object & Face
Recognition
+
18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud Center of Excellence
Cloud Operations Expertise
Acquisition &
Rights
Media Center of Excellence
Production Subject Matter Expertise
Media Supply
Chain
Playout Analytics
Asset
Management
Distribution
Business
(Legal /Sales
/ Finance)
Existing State
Definition
Cost Analysis
Initiative
Prioritization
Business KPIs Partner Review
Design &
Innovation
Implementation &
Review
Media SMEs in your Cloud Center of Excellence
Project
Management
Office
Security Strategy Architecture DevOps Engineering Support
21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build with Well-Architected In Mind
Security Reliability Performance
Efficiency
Cost
Optimization
Operational
Excellence
Job #1.
Build for
failure
More with
less
Margin &
Bottom-line
Build, Run,
Monitor,
Scale
22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Client-side Data Encryption
Server-side Data
Encryption
Network Traffic Protection
Platform, Applications, Identity & Access Management
Operating System, Network & Firewall Configuration
Customer content
Customers are responsible for
their security and compliance IN
the Cloud
AWS is responsible for the
security OF
the Cloud
Customer
AWS Global Infrastructure
Compute, Storage, Database, Networking
Regions, Availability Zones, Edge Locations
AWS
Security: Shared Responsibility Model
23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWSWellArchitectedFramework
SharedResponsibilityModel
DataGovernance
Project Metrics
Target
Service
Design
Executive Metrics
KPI
Mapping
Use-Case&ServiceStandards
Cloud Based MAM Strategy
Implementation
VideoGovernance
Cloud MAM Transition Management
Comms
&
Risk
Plan
Key
Milestones
Metrics And User Feedback Review
Project Timeline
24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Purchased Production Content
Content
Delivered to
Ingest Server
Production
Company /
Studio
Purchase
Content
Playout
No
Yes
PASS?
CONTRACT
METADATA
Rights/ERP
System
Move to Working
Storage
Manual QC
Confirm Title
Technical
Move to Editorial
Editorial QC
Marketing
Promo Creation
Create
Delivery Formats
OTT
Scheduling /
PlayoutMETADATA
SOURCES
Manual
Move to Fix
Content Fix
Fixabl
e
Broadcast
OTT NOC
Move to Publish
Manual
Broadcast NOC
Time Estimate
File Movement
Receive HDD
Social
Media
Captioning
Low Res
Proxies
Process Map Existing Workflow
25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Purchased Content Cloud Service Validation
FILE
TRANSFE
R
Identify Service Building Blocks for Workflows
QC EDIT
TRANSCOD
E
PROXIES
Candidate Cloud Services for New Workflow
Candidate Services
Chosen Target Services
STORAGE MAM
Cloud Sandbox Proof of Concept Testing
FILE
TRANSFER
Service
QC Service EDIT Service
TRANSCODE
Service
STORAGE
Service
MAM Service
Workflow
26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Commonality of Services Supporting Media Use-Cases
Acquisition
MAM/DAM &
Archive
Digital Supply
Chain
Post Production
Over The Top
Analytics
Broadcast
Playout
Publishing
Target Service Catalog
Search
Object Storage
Edit
Transcode
QC
File Movement
Block Storage
Archive Storage
Ingest Portal
Reporting
File Storage
Analytics
Automation
Content Lake
Architecture
Data Lake
Architecture
AWS cloud
27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Iterate Workflows to Define Target Service Architecture
Media Use-cases
Live
Distribution
Broadcast
OTT
Sports
Web
Process Map Use-Case
Design To-Be Process
New requirement
Integrate into the Target Service Architecture
New service need
New partner
Target Service Architecture
New Use-case Variables
28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Road Ahead…
� Master Does Not Move
� ML Standard Metadata Utility
� ML for Duplicate/Related Assets
� ML for Intelligent Filter / Deletion
� More and More Serverless
� Content Lakes are Standard
29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related breakouts
Wednesday November 28
MAE203 Hollywood's Cloud-Based Content Lakes: Modernized Media Archives
1900-2000 | Aria East, Level 1, Joshua 6
Tuesday November 27
STG349 Cloud-based Media Archival, Media Asset Management, and Supply Chain Workflows
1600-1700 | Bellagio, level 1, Degas 2
30. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Mike Davis, mikdav@amazon.com
Ken Shek, kenshek@amazon.com
Jack Wenzinger, jwenzing@amazon.com
31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud MAM Architecture Components
Ingest
Content Movement
HDD Archive
Storage
Search Asset Database
User Database
Authentication
Workflow Orchestration
MAM Interface
Media Players
ManageProxy
Creation
Machine Learning
UUID Tag
Technical
Metadata
Checksum
Block
Storage
Transcode
Edit
QC
Internet
Private Link CDN
Object
Storage
Third Party
Process
File
Transfer
Storage
ETL
File
Storage
MediaConvert
Step Functions
AWS Elasticsearch AWS DynamoDB
Amazon Aurora
Amazon Cognito
AWS Glue
MediaConvert
Comprehend Rekognition Transcribe SQSLambdaSNS
Amazon S3 Elastic Block Storage Elastic File Storage Amazon Glacier
AWS Snowball
AWS DirectConnect Amazon CloudFront Amazon Storage Policies
32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.