SlideShare a Scribd company logo
1 of 7
Download to read offline
White Paper




BREAKING THE CPU BARRIER IN MEDIA
TRANSCODING PERFORMANCE
EMC Isilon and Elemental Server
    Scalable solutions for on-demand video conversion and content
      delivery




                  EMC Solutions Group

                  Abstract
                  EMC Isilon and Elemental provide best-in-class, massively scalable solutions
                  for IPTV transcoding and on-demand content delivery for broadcast media
                  workflows. The world’s top on-demand service providers rely on EMC Isilon
                  scale-out NAS and Elemental Server GPU-based video transcoding solutions to
                  simplify and accelerate their workflows.

                  April 2012
Copyright © 2012 EMC Corporation. All Rights Reserved.

EMC believes the information in this publication is accurate as of its
publication date. The information is subject to change without notice.

The information in this publication is provided “as is.” EMC Corporation makes
no representations or warranties of any kind with respect to the information in
this publication, and specifically disclaims implied warranties of
merchantability or fitness for a particular purpose.

Use, copying, and distribution of any EMC software described in this
publication requires an applicable software license.

For the most up-to-date listing of EMC product names, see EMC Corporation
Trademarks on EMC.com.
All trademarks used herein are the property of their respective owners.

Part Number H10644




                   Breaking the CPU barrier in media transcoding performance        2
                                                  EMC Isilon and Elemental Server
Table of contents


  Executive summary....................................................................................................................... 4
     Business case .......................................................................................................................... 4
     Solution overview ..................................................................................................................... 4
     Key results/recommendations ................................................................................................... 4

  Elemental Server Integration with EMC Isilon .................................................................................. 5
     Configuration ........................................................................................................................... 5
     Design considerations .............................................................................................................. 6




                                                              Breaking the CPU barrier in media transcoding performance                            3
                                                                                                       EMC Isilon and Elemental Server
Executive summary
Business case       Elemental™ and EMC® Isilon ® solutions help top service providers to convert media
                    content for on-demand viewing on PCs, tablets, and mobile devices. Solutions from
                    Elemental employ the massively parallel architecture of graphics processing units
                    (GPUs) to perform accelerated video processing and encoding. Elemental reduces the
                    number of systems needed to support the transcoding of thousands of hours of
                    content compared to CPU-only solutions.

                    Service providers are faced with a number of issues as the market shifts from
                    broadcast media content consumption to a widening array of on-demand viewing
                    options:
                         Content must be available anywhere, at any time, for any device.
                         Massive libraries of legacy feature films and broadcast content require
                          conversion.
                         Valuable content must be secured and managed.

                    Transcoding workflows must be highly parallelized in order to prepare fresh content
                    for on-demand delivery in a timely manner. Service providers responsible for driving
                    new revenue from broadcast content in on-demand markets must rely on efficiencies
                    of scale. Above all, the solutions for on-demand content creation must be cost-
                    effective.

Solution overview   Elemental Server is a scalable, GPU-based video processing system. Each node in an
                    Elemental Server array is capable of converting up to 12 unique high definition or 32
                    mobile video files into hundreds of output files simultaneously, at data rates faster
                    than real-time. Elemental delivers the highest quality encoding using codecs
                    designed specifically for the GPU. Elemental Server is a Linux–based system featuring
                    web-based administration, REST/XML APIs, and standardized SMB or NFS
                    connectivity to high-performance EMC Isilon scale-out NAS. EMC Isilon and Elemental
                    Server combine to provide a scalable, fault-tolerant infrastructure for media content
                    conversion and delivery to your content delivery network.

Key results/        The world’s top broadcast, streaming media, and production companies trust EMC
recommendations     Isilon to store content and drive performance-hungry media workflows. Elemental and
                    EMC Isilon have partnered to provide a state-of-the art compute layer for on-demand
                    transcoding workflows built on the EMC Isilon family of scale-out NAS products. Like
                    EMC Isilon, Elemental Server is built on a modular appliance platform that easily
                    scales to meet the demands of your business.
                         Deploy high-density, multiformat video conversion
                         Scale out network attached storage capacity and bandwidth through the simple
                          addition of EMC Isilon nodes
                         Scale parallel GPU-based video processing power through the simple addition
                          of Elemental Server systems




                                              Breaking the CPU barrier in media transcoding performance       4
                                                                            EMC Isilon and Elemental Server
Elemental Server Integration with EMC Isilon
Configuration   Elemental Server is typically deployed in a clustered configuration consisting of a
                management node and one or more worker nodes. The management node of the
                cluster acts as a gateway to balance new jobs from the REST/XML interface, watch
                folders, or web interface evenly across the cluster. The management node may also
                store an XML file to automate the configuration of new worker nodes as they are
                added to the Elemental Server cluster. Communication from the Elemental Server
                management node to the worker nodes is carried over a dedicated management
                network interface. The Elemental Server cluster connects to EMC Isilon NAS over a
                dedicated interface on the “data network” as shown below in figure 1. For optimum
                performance, the data network should be a 10 gigabit network configured for jumbo
                frames.




                Figure 1.   Elemental Server clustered network configuration

                Elemental Server uses standard SMB v1 and NFS v3 mounts when connecting to EMC
                Isilon NAS. To mount a share or NFS export on the Elemental Server cluster, simply
                enter the fully qualified domain name for the EMC Isilon SmartConnect™ zone and
                share name into the “mount point settings” page of the Elemental Server web
                interface. The EMC Isilon SmartConnect service automatically balances network
                connections from the Elemental Server cluster across to individual nodes in the EMC
                Isilon storage cluster. For the best performance and reliability, mount the EMC Isilon
                cluster from an NFS export using the SmartConnect Advanced application.
                SmartConnect Advanced allows for the dynamic allocation of IP addresses to different
                nodes in the NAS cluster. SmartConnect Advanced automatically initiates a failover of
                active NFS connections in the event of a hardware failure. SmartConnect Advanced
                also rebalances active NFS connections across the EMC Isilon cluster to ensure an
                even distribution of active Elemental Server client connections on each node. This
                NFS client rebalancing is possible without disconnecting the active client
                connections.

                The EMC Isilon OneFS® operating system allows SMB shares to be mounted as NFS
                exports simultaneously, allowing seamless integration of Windows and UNIX/Linux
                applications in your workflow. Contact your local EMC Isilon sales team to learn more
                about EMC Isilon account identity mapping and authentication features that enable
                concurrent integration of UNIX POSIX permissions and Windows access control list
                permissions.




                                          Breaking the CPU barrier in media transcoding performance        5
                                                                         EMC Isilon and Elemental Server
Those familiar with high-volume transcode workflows know that the storage
                 requirements for content grow out of hand very quickly. Broadcasters taking on the
                 challenge of converting entire libraries of content from an archival format such as
                 JPEG2000 to a constantly growing array of output formats know the pain points
                 surrounding traditional LUN-based SAN architectures. EMC Isilon eliminates the need
                 for teams of storage administrators and the time-consuming administrative tasks
                 associated with traditional SAN or LUN-based NAS management. The EMC Isilon
                 OneFS operating system automatically balances data evenly across each node in the
                 cluster for every file written and routinely rebalances the data for each file to ensure a
                 constant symmetry of capacity on each node. The revolutionary OneFS filesystem has
                 become a staple in the media-centric data center for this very reason. It is common
                 for tens or even hundreds of terabytes worth of media to rotate in and out of a
                 filesystem in a high-volume transcode workflow over the course of a single week. The
                 amount of file system “churn” associated with the rapid creation and deletion of files
                 in an automated media workflow can bring a traditional LUN-based infrastructure to
                 its knees.

Design           A single Elemental Server appliance with 1024 GPU cores can generate between 80–
considerations   200 megabytes per second of combined read/write traffic when running the standard
                 throughput benchmark test profile created by the default Elemental Server install. The
                 read/write throughput generated by each Elemental Server appliance is highly
                 variable. The read performance may peak up to 200 megabytes per second or higher
                 on an Elemental Server that is equipped with the optional 10 Gigabit Ethernet
                 network adapter while the source file is read into memory for decoding. The
                 bandwidth requirements for the Elemental Server are highly variable and “bursty” as
                 the appliance reads files into memory.

                 Due to the considerable storage requirements and moderate throughput demands of
                 the Elemental Server appliance, the EMC Isilon X200 storage node is an ideal match.
                 Testing at the EMC Isilon labs indicate that a single EMC Isilon X200 node equipped
                 with 10 Gigabit Ethernet can easily support 2 Elemental Server appliances equipped
                 with 10 Gigabit Ethernet. This 2:1 ratio implies that the minimum EMC Isilon cluster
                 size, a 3-node X200 cluster, can easily support the bandwidth requirements of a 6-
                 node Elemental Server installation. Individuals wishing to add additional video
                 processing compute power to their Elemental Server installation simply add one more
                 EMC Isilon X200 node to their cluster for every 2 Elemental Severs appliances added.
                 Adding additional bandwidth and capacity to an EMC Isilon cluster is as simple as
                 pushing a button. The OneFS operating system automatically balances data and new
                 client connections to the new node as soon as it is added to the cluster. No
                 administrative overhead or complicated management of the storage environment is
                 required. For more information about the benefits of the EMC Isilon OneFS operating
                 system, please visit the EMC Isilon website.




                                            Breaking the CPU barrier in media transcoding performance         6
                                                                           EMC Isilon and Elemental Server
Figure 2.   Elemental Server workflow

Benchmark results are highly dependent upon workload, specific application
requirements, and system design and implementation. Relative system performance
will vary as a result of these and other factors. Therefore, this workload should not be
used as a substitute for a specific customer application benchmark when critical
capacity planning and/or product evaluation decisions are contemplated. All
performance data contained in this report was obtained in a rigorously controlled
environment. Results obtained in other operating environments may vary
significantly. EMC Corporation does not warrant or represent that a user can or will
achieve similar performance expressed in transactions per minute .




                          Breaking the CPU barrier in media transcoding performance        7
                                                         EMC Isilon and Elemental Server

More Related Content

Viewers also liked

Formulario agenda telefonica
Formulario agenda telefonicaFormulario agenda telefonica
Formulario agenda telefonicaNathalia Sanchez
 
Estrategias%20docentes%20para un-aprendizaje-significativo
Estrategias%20docentes%20para un-aprendizaje-significativoEstrategias%20docentes%20para un-aprendizaje-significativo
Estrategias%20docentes%20para un-aprendizaje-significativoNeftaly Niño Villarreal
 
SBIC Enterprise Information Security Strategic Technologies
SBIC Enterprise Information Security Strategic TechnologiesSBIC Enterprise Information Security Strategic Technologies
SBIC Enterprise Information Security Strategic TechnologiesEMC
 
Virtualization 2.0: The Next Generation of Virtualization
Virtualization 2.0: The Next Generation of VirtualizationVirtualization 2.0: The Next Generation of Virtualization
Virtualization 2.0: The Next Generation of VirtualizationEMC
 
Topic 3 Double entry book keeping
Topic 3 Double entry book keepingTopic 3 Double entry book keeping
Topic 3 Double entry book keepingSrinivas Methuku
 
MDP on Financial Statement Analysis
MDP on  Financial Statement AnalysisMDP on  Financial Statement Analysis
MDP on Financial Statement Analysiskanagaraj300
 
Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...
Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...
Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...Amanda James
 
Benh tieu chay_o_cho
Benh tieu chay_o_choBenh tieu chay_o_cho
Benh tieu chay_o_chomachupilani
 
BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING EROTICISM, SPIRITUALITY...
BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING  EROTICISM, SPIRITUALITY...BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING  EROTICISM, SPIRITUALITY...
BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING EROTICISM, SPIRITUALITY...Dr. Raju M. Mathew
 
White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...
White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...
White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...EMC
 
White Paper: The Essential Guide to Exchange and the Private Cloud
White Paper: The Essential Guide to Exchange and the Private CloudWhite Paper: The Essential Guide to Exchange and the Private Cloud
White Paper: The Essential Guide to Exchange and the Private CloudEMC
 

Viewers also liked (15)

Formulario agenda telefonica
Formulario agenda telefonicaFormulario agenda telefonica
Formulario agenda telefonica
 
Estrategias%20docentes%20para un-aprendizaje-significativo
Estrategias%20docentes%20para un-aprendizaje-significativoEstrategias%20docentes%20para un-aprendizaje-significativo
Estrategias%20docentes%20para un-aprendizaje-significativo
 
SBIC Enterprise Information Security Strategic Technologies
SBIC Enterprise Information Security Strategic TechnologiesSBIC Enterprise Information Security Strategic Technologies
SBIC Enterprise Information Security Strategic Technologies
 
Portfolio
PortfolioPortfolio
Portfolio
 
Virtualization 2.0: The Next Generation of Virtualization
Virtualization 2.0: The Next Generation of VirtualizationVirtualization 2.0: The Next Generation of Virtualization
Virtualization 2.0: The Next Generation of Virtualization
 
Topic 3 Double entry book keeping
Topic 3 Double entry book keepingTopic 3 Double entry book keeping
Topic 3 Double entry book keeping
 
MDP on Financial Statement Analysis
MDP on  Financial Statement AnalysisMDP on  Financial Statement Analysis
MDP on Financial Statement Analysis
 
Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...
Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...
Wind_Energy_Law_2014_Amanda James _Avoiding Regulatory Missteps for Developer...
 
Benh tieu chay_o_cho
Benh tieu chay_o_choBenh tieu chay_o_cho
Benh tieu chay_o_cho
 
Contracts
ContractsContracts
Contracts
 
BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING EROTICISM, SPIRITUALITY...
BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING  EROTICISM, SPIRITUALITY...BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING  EROTICISM, SPIRITUALITY...
BELLY DANCES AND INDIAN CLASSICAL DANCES - EMBEDDING EROTICISM, SPIRITUALITY...
 
White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...
White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...
White Paper: Next-Generation Genome Sequencing Using EMC Isilon Scale-Out NAS...
 
Teamwork
TeamworkTeamwork
Teamwork
 
Glossary
GlossaryGlossary
Glossary
 
White Paper: The Essential Guide to Exchange and the Private Cloud
White Paper: The Essential Guide to Exchange and the Private CloudWhite Paper: The Essential Guide to Exchange and the Private Cloud
White Paper: The Essential Guide to Exchange and the Private Cloud
 

More from EMC

INDUSTRY-LEADING TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
INDUSTRY-LEADING  TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUDINDUSTRY-LEADING  TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
INDUSTRY-LEADING TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUDEMC
 
Cloud Foundry Summit Berlin Keynote
Cloud Foundry Summit Berlin Keynote Cloud Foundry Summit Berlin Keynote
Cloud Foundry Summit Berlin Keynote EMC
 
EMC GLOBAL DATA PROTECTION INDEX
EMC GLOBAL DATA PROTECTION INDEX EMC GLOBAL DATA PROTECTION INDEX
EMC GLOBAL DATA PROTECTION INDEX EMC
 
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIOTransforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIOEMC
 
Citrix ready-webinar-xtremio
Citrix ready-webinar-xtremioCitrix ready-webinar-xtremio
Citrix ready-webinar-xtremioEMC
 
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES EMC
 
EMC with Mirantis Openstack
EMC with Mirantis OpenstackEMC with Mirantis Openstack
EMC with Mirantis OpenstackEMC
 
Modern infrastructure for business data lake
Modern infrastructure for business data lakeModern infrastructure for business data lake
Modern infrastructure for business data lakeEMC
 
Force Cyber Criminals to Shop Elsewhere
Force Cyber Criminals to Shop ElsewhereForce Cyber Criminals to Shop Elsewhere
Force Cyber Criminals to Shop ElsewhereEMC
 
Pivotal : Moments in Container History
Pivotal : Moments in Container History Pivotal : Moments in Container History
Pivotal : Moments in Container History EMC
 
Data Lake Protection - A Technical Review
Data Lake Protection - A Technical ReviewData Lake Protection - A Technical Review
Data Lake Protection - A Technical ReviewEMC
 
Mobile E-commerce: Friend or Foe
Mobile E-commerce: Friend or FoeMobile E-commerce: Friend or Foe
Mobile E-commerce: Friend or FoeEMC
 
Virtualization Myths Infographic
Virtualization Myths Infographic Virtualization Myths Infographic
Virtualization Myths Infographic EMC
 
Intelligence-Driven GRC for Security
Intelligence-Driven GRC for SecurityIntelligence-Driven GRC for Security
Intelligence-Driven GRC for SecurityEMC
 
The Trust Paradox: Access Management and Trust in an Insecure Age
The Trust Paradox: Access Management and Trust in an Insecure AgeThe Trust Paradox: Access Management and Trust in an Insecure Age
The Trust Paradox: Access Management and Trust in an Insecure AgeEMC
 
EMC Technology Day - SRM University 2015
EMC Technology Day - SRM University 2015EMC Technology Day - SRM University 2015
EMC Technology Day - SRM University 2015EMC
 
EMC Academic Summit 2015
EMC Academic Summit 2015EMC Academic Summit 2015
EMC Academic Summit 2015EMC
 
Data Science and Big Data Analytics Book from EMC Education Services
Data Science and Big Data Analytics Book from EMC Education ServicesData Science and Big Data Analytics Book from EMC Education Services
Data Science and Big Data Analytics Book from EMC Education ServicesEMC
 
Using EMC Symmetrix Storage in VMware vSphere Environments
Using EMC Symmetrix Storage in VMware vSphere EnvironmentsUsing EMC Symmetrix Storage in VMware vSphere Environments
Using EMC Symmetrix Storage in VMware vSphere EnvironmentsEMC
 
Using EMC VNX storage with VMware vSphereTechBook
Using EMC VNX storage with VMware vSphereTechBookUsing EMC VNX storage with VMware vSphereTechBook
Using EMC VNX storage with VMware vSphereTechBookEMC
 

More from EMC (20)

INDUSTRY-LEADING TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
INDUSTRY-LEADING  TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUDINDUSTRY-LEADING  TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
INDUSTRY-LEADING TECHNOLOGY FOR LONG TERM RETENTION OF BACKUPS IN THE CLOUD
 
Cloud Foundry Summit Berlin Keynote
Cloud Foundry Summit Berlin Keynote Cloud Foundry Summit Berlin Keynote
Cloud Foundry Summit Berlin Keynote
 
EMC GLOBAL DATA PROTECTION INDEX
EMC GLOBAL DATA PROTECTION INDEX EMC GLOBAL DATA PROTECTION INDEX
EMC GLOBAL DATA PROTECTION INDEX
 
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIOTransforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
Transforming Desktop Virtualization with Citrix XenDesktop and EMC XtremIO
 
Citrix ready-webinar-xtremio
Citrix ready-webinar-xtremioCitrix ready-webinar-xtremio
Citrix ready-webinar-xtremio
 
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
EMC FORUM RESEARCH GLOBAL RESULTS - 10,451 RESPONSES ACROSS 33 COUNTRIES
 
EMC with Mirantis Openstack
EMC with Mirantis OpenstackEMC with Mirantis Openstack
EMC with Mirantis Openstack
 
Modern infrastructure for business data lake
Modern infrastructure for business data lakeModern infrastructure for business data lake
Modern infrastructure for business data lake
 
Force Cyber Criminals to Shop Elsewhere
Force Cyber Criminals to Shop ElsewhereForce Cyber Criminals to Shop Elsewhere
Force Cyber Criminals to Shop Elsewhere
 
Pivotal : Moments in Container History
Pivotal : Moments in Container History Pivotal : Moments in Container History
Pivotal : Moments in Container History
 
Data Lake Protection - A Technical Review
Data Lake Protection - A Technical ReviewData Lake Protection - A Technical Review
Data Lake Protection - A Technical Review
 
Mobile E-commerce: Friend or Foe
Mobile E-commerce: Friend or FoeMobile E-commerce: Friend or Foe
Mobile E-commerce: Friend or Foe
 
Virtualization Myths Infographic
Virtualization Myths Infographic Virtualization Myths Infographic
Virtualization Myths Infographic
 
Intelligence-Driven GRC for Security
Intelligence-Driven GRC for SecurityIntelligence-Driven GRC for Security
Intelligence-Driven GRC for Security
 
The Trust Paradox: Access Management and Trust in an Insecure Age
The Trust Paradox: Access Management and Trust in an Insecure AgeThe Trust Paradox: Access Management and Trust in an Insecure Age
The Trust Paradox: Access Management and Trust in an Insecure Age
 
EMC Technology Day - SRM University 2015
EMC Technology Day - SRM University 2015EMC Technology Day - SRM University 2015
EMC Technology Day - SRM University 2015
 
EMC Academic Summit 2015
EMC Academic Summit 2015EMC Academic Summit 2015
EMC Academic Summit 2015
 
Data Science and Big Data Analytics Book from EMC Education Services
Data Science and Big Data Analytics Book from EMC Education ServicesData Science and Big Data Analytics Book from EMC Education Services
Data Science and Big Data Analytics Book from EMC Education Services
 
Using EMC Symmetrix Storage in VMware vSphere Environments
Using EMC Symmetrix Storage in VMware vSphere EnvironmentsUsing EMC Symmetrix Storage in VMware vSphere Environments
Using EMC Symmetrix Storage in VMware vSphere Environments
 
Using EMC VNX storage with VMware vSphereTechBook
Using EMC VNX storage with VMware vSphereTechBookUsing EMC VNX storage with VMware vSphereTechBook
Using EMC VNX storage with VMware vSphereTechBook
 

Recently uploaded

Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 

Recently uploaded (20)

Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 

Breaking the CPU Barrier in Media Transcoding Performance

  • 1. White Paper BREAKING THE CPU BARRIER IN MEDIA TRANSCODING PERFORMANCE EMC Isilon and Elemental Server  Scalable solutions for on-demand video conversion and content delivery EMC Solutions Group Abstract EMC Isilon and Elemental provide best-in-class, massively scalable solutions for IPTV transcoding and on-demand content delivery for broadcast media workflows. The world’s top on-demand service providers rely on EMC Isilon scale-out NAS and Elemental Server GPU-based video transcoding solutions to simplify and accelerate their workflows. April 2012
  • 2. Copyright © 2012 EMC Corporation. All Rights Reserved. EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided “as is.” EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. All trademarks used herein are the property of their respective owners. Part Number H10644 Breaking the CPU barrier in media transcoding performance 2 EMC Isilon and Elemental Server
  • 3. Table of contents Executive summary....................................................................................................................... 4 Business case .......................................................................................................................... 4 Solution overview ..................................................................................................................... 4 Key results/recommendations ................................................................................................... 4 Elemental Server Integration with EMC Isilon .................................................................................. 5 Configuration ........................................................................................................................... 5 Design considerations .............................................................................................................. 6 Breaking the CPU barrier in media transcoding performance 3 EMC Isilon and Elemental Server
  • 4. Executive summary Business case Elemental™ and EMC® Isilon ® solutions help top service providers to convert media content for on-demand viewing on PCs, tablets, and mobile devices. Solutions from Elemental employ the massively parallel architecture of graphics processing units (GPUs) to perform accelerated video processing and encoding. Elemental reduces the number of systems needed to support the transcoding of thousands of hours of content compared to CPU-only solutions. Service providers are faced with a number of issues as the market shifts from broadcast media content consumption to a widening array of on-demand viewing options:  Content must be available anywhere, at any time, for any device.  Massive libraries of legacy feature films and broadcast content require conversion.  Valuable content must be secured and managed. Transcoding workflows must be highly parallelized in order to prepare fresh content for on-demand delivery in a timely manner. Service providers responsible for driving new revenue from broadcast content in on-demand markets must rely on efficiencies of scale. Above all, the solutions for on-demand content creation must be cost- effective. Solution overview Elemental Server is a scalable, GPU-based video processing system. Each node in an Elemental Server array is capable of converting up to 12 unique high definition or 32 mobile video files into hundreds of output files simultaneously, at data rates faster than real-time. Elemental delivers the highest quality encoding using codecs designed specifically for the GPU. Elemental Server is a Linux–based system featuring web-based administration, REST/XML APIs, and standardized SMB or NFS connectivity to high-performance EMC Isilon scale-out NAS. EMC Isilon and Elemental Server combine to provide a scalable, fault-tolerant infrastructure for media content conversion and delivery to your content delivery network. Key results/ The world’s top broadcast, streaming media, and production companies trust EMC recommendations Isilon to store content and drive performance-hungry media workflows. Elemental and EMC Isilon have partnered to provide a state-of-the art compute layer for on-demand transcoding workflows built on the EMC Isilon family of scale-out NAS products. Like EMC Isilon, Elemental Server is built on a modular appliance platform that easily scales to meet the demands of your business.  Deploy high-density, multiformat video conversion  Scale out network attached storage capacity and bandwidth through the simple addition of EMC Isilon nodes  Scale parallel GPU-based video processing power through the simple addition of Elemental Server systems Breaking the CPU barrier in media transcoding performance 4 EMC Isilon and Elemental Server
  • 5. Elemental Server Integration with EMC Isilon Configuration Elemental Server is typically deployed in a clustered configuration consisting of a management node and one or more worker nodes. The management node of the cluster acts as a gateway to balance new jobs from the REST/XML interface, watch folders, or web interface evenly across the cluster. The management node may also store an XML file to automate the configuration of new worker nodes as they are added to the Elemental Server cluster. Communication from the Elemental Server management node to the worker nodes is carried over a dedicated management network interface. The Elemental Server cluster connects to EMC Isilon NAS over a dedicated interface on the “data network” as shown below in figure 1. For optimum performance, the data network should be a 10 gigabit network configured for jumbo frames. Figure 1. Elemental Server clustered network configuration Elemental Server uses standard SMB v1 and NFS v3 mounts when connecting to EMC Isilon NAS. To mount a share or NFS export on the Elemental Server cluster, simply enter the fully qualified domain name for the EMC Isilon SmartConnect™ zone and share name into the “mount point settings” page of the Elemental Server web interface. The EMC Isilon SmartConnect service automatically balances network connections from the Elemental Server cluster across to individual nodes in the EMC Isilon storage cluster. For the best performance and reliability, mount the EMC Isilon cluster from an NFS export using the SmartConnect Advanced application. SmartConnect Advanced allows for the dynamic allocation of IP addresses to different nodes in the NAS cluster. SmartConnect Advanced automatically initiates a failover of active NFS connections in the event of a hardware failure. SmartConnect Advanced also rebalances active NFS connections across the EMC Isilon cluster to ensure an even distribution of active Elemental Server client connections on each node. This NFS client rebalancing is possible without disconnecting the active client connections. The EMC Isilon OneFS® operating system allows SMB shares to be mounted as NFS exports simultaneously, allowing seamless integration of Windows and UNIX/Linux applications in your workflow. Contact your local EMC Isilon sales team to learn more about EMC Isilon account identity mapping and authentication features that enable concurrent integration of UNIX POSIX permissions and Windows access control list permissions. Breaking the CPU barrier in media transcoding performance 5 EMC Isilon and Elemental Server
  • 6. Those familiar with high-volume transcode workflows know that the storage requirements for content grow out of hand very quickly. Broadcasters taking on the challenge of converting entire libraries of content from an archival format such as JPEG2000 to a constantly growing array of output formats know the pain points surrounding traditional LUN-based SAN architectures. EMC Isilon eliminates the need for teams of storage administrators and the time-consuming administrative tasks associated with traditional SAN or LUN-based NAS management. The EMC Isilon OneFS operating system automatically balances data evenly across each node in the cluster for every file written and routinely rebalances the data for each file to ensure a constant symmetry of capacity on each node. The revolutionary OneFS filesystem has become a staple in the media-centric data center for this very reason. It is common for tens or even hundreds of terabytes worth of media to rotate in and out of a filesystem in a high-volume transcode workflow over the course of a single week. The amount of file system “churn” associated with the rapid creation and deletion of files in an automated media workflow can bring a traditional LUN-based infrastructure to its knees. Design A single Elemental Server appliance with 1024 GPU cores can generate between 80– considerations 200 megabytes per second of combined read/write traffic when running the standard throughput benchmark test profile created by the default Elemental Server install. The read/write throughput generated by each Elemental Server appliance is highly variable. The read performance may peak up to 200 megabytes per second or higher on an Elemental Server that is equipped with the optional 10 Gigabit Ethernet network adapter while the source file is read into memory for decoding. The bandwidth requirements for the Elemental Server are highly variable and “bursty” as the appliance reads files into memory. Due to the considerable storage requirements and moderate throughput demands of the Elemental Server appliance, the EMC Isilon X200 storage node is an ideal match. Testing at the EMC Isilon labs indicate that a single EMC Isilon X200 node equipped with 10 Gigabit Ethernet can easily support 2 Elemental Server appliances equipped with 10 Gigabit Ethernet. This 2:1 ratio implies that the minimum EMC Isilon cluster size, a 3-node X200 cluster, can easily support the bandwidth requirements of a 6- node Elemental Server installation. Individuals wishing to add additional video processing compute power to their Elemental Server installation simply add one more EMC Isilon X200 node to their cluster for every 2 Elemental Severs appliances added. Adding additional bandwidth and capacity to an EMC Isilon cluster is as simple as pushing a button. The OneFS operating system automatically balances data and new client connections to the new node as soon as it is added to the cluster. No administrative overhead or complicated management of the storage environment is required. For more information about the benefits of the EMC Isilon OneFS operating system, please visit the EMC Isilon website. Breaking the CPU barrier in media transcoding performance 6 EMC Isilon and Elemental Server
  • 7. Figure 2. Elemental Server workflow Benchmark results are highly dependent upon workload, specific application requirements, and system design and implementation. Relative system performance will vary as a result of these and other factors. Therefore, this workload should not be used as a substitute for a specific customer application benchmark when critical capacity planning and/or product evaluation decisions are contemplated. All performance data contained in this report was obtained in a rigorously controlled environment. Results obtained in other operating environments may vary significantly. EMC Corporation does not warrant or represent that a user can or will achieve similar performance expressed in transactions per minute . Breaking the CPU barrier in media transcoding performance 7 EMC Isilon and Elemental Server