SlideShare ist ein Scribd-Unternehmen logo
1 von 2
Downloaden Sie, um offline zu lesen
Meeting the challenges of AI
workloads with the Dell AI portfolio
A comparison of the Dell AI portfolio
vs. similar offerings from HPE
AI adoption presents new challenges for businesses and their data center
IT staff, including:
• Addressing the existing skill gaps in their current
staff through training or external hiring
• Understanding the data preparation needs of AI, including the
quality, quantity, location, and current state of the business’s data
• Assessing business goals to determine which AI models
and implementations will provide benefits
• Assessing the computational, networking, and storage needs
of the planned AI systems and acquiring these systems
With AI-ready portfolios, infrastructure vendors such as Dell Technologies
and HPE offer integrated solutions that encompass the entire AI lifecycle. We
researched publicly available information about both the Dell and HPE AI
portfolios, and examined benchmark testing from MLPerf®
. We found that Dell
is poised to help businesses embrace AI with a portfolio comprising high-
performing server and storage options, validated solutions, and professional
services that guide the process from planning to production.
AI model benchmark performance: MLPerf result comparison
Publicly available MLPerf®
Benchmark testing shows that offerings in the Dell AI
portfolio offer consistent, strong performance for AI workloads. MLPerf®
tests
performance for both training and inferencing on several AI models. The data
referenced in this report is based on MLPerf®
v3.1 Inference Datacenter results
published on the MLCommons®
website from November 2023.1
We compared
both 8- and 4-GPU servers and include one result from each category in this
summary; to see them all, read the full report at https://facts.pt/zPmSx4c.
1. MLCommons, “MLPerf Inference: Datacenter Benchmark Suite Results,” accessed December
12, 2023, https://mlcommons.org/en/inference-datacenter-31/.
Executive summary
Our research
found Dell has:
Broadest Generative
AI portfolio*
Per MLPerf®
results, the
Dell PowerEdge XE8640
server with four NVIDIA
H100 SXM5 GPUs achieved
the highest AI throughput
among all four-GPU
submissions in nine
different categories
A broader portfolio of
professional services
tailored for AI *Based on Dell analysis, August 2023. Dell Technologies offers solutions engineered to support AI
workloads from Workstations PCs (mobile and fixed) to Servers for High-performance Computing, Data
Storage, Cloud Native Software-Defined Infrastructure, Networking Switches, Data Protection, HCI and
Services. Data from: “Robert McNeal, “Dell, VMware and NVIDIA Bring AI to Your Data,” accessed
January 17, 2024, https://www.dell.com/en-us/blog/dell-vmware-and-nvidia-bring-ai-to-your-data/.
Meeting the challenges of AI workloads with the Dell AI portfolio January 2024
A Principled Technologies report: Hands-on testing. Real-world results.
Comparing MLPerf performance for eight-GPU servers
In the MLPerf®
v3.1 results for eight-GPU servers, the Dell PowerEdge XE9680 with NVIDIA SXM5 H100 GPUs out-
performed the HPE ProLiant XL675d Gen10 Plus with NVIDIA SXM4 A100 GPUs by up to 4.25x (see Figure 1).
Normalized MLPerf®
results: Dell PowerEdge XE9680 with H100 SXM5 vs.
HPE ProLiant XL675d Gen10 Plus with A100 SXM4 (Larger is better)
0.00
1.00
2.00
3.00
4.00
Server Offline Server Offline Offline Offline Server Offline Server Offline
99 99 99 99.9 99 99.9
ResNet Retinanet 3D-UNet BERT
Dell PowerEdge XE9680 HPE ProLiant XL675d Gen10 Plus
Accuracy
Model
2.03 2.07 2.22 2.14
1.67 1.67
2.25
2.47
3.99
4.25
1 1 1 1 1 1 1 1 1 1
Comparing MLPerf performance for four-GPU servers
The Dell PowerEdge XE8640 server with four NVIDIA H100 SXM5 GPUs achieved the highest AI throughput among all
four-GPU submissions in nine different categories. As Figure 2 shows, compared to the HPE ProLiant DL380a server, it
scored up to 2.07 times as high on the MLPerf®
benchmark.
In brief: Additional contributors to AI success
AI models require more than high performance servers for success. You must also consider storage for unstructured data
and professional services to plan, prepare, deploy, and manage your AI solution. The Dell portfolio offers storage for AI
datasets with the PowerScale series for file storage and Elastic Cloud Storage or ObjectScale storage for object storage.
Organizations can reap the advantages of Dell’s professional
and consulting services for AI, which offers some services
that HPE does not, such as data preparation. The Dell
portfolio also includes Validated Designs for AI, which takes
the guesswork out of designing and deploying AI.
*Verified MLPerf. score of v3.1 Inference Closed. Retrieved from https://ml-
commons.org/benchmarks/inference-datacenter/ 5 December 2023, entries
3.1-0069, 3.1-0085, 3.1-0067, and 3.1-0084. The MLPerf. name and logo are
registered and unregistered trademarks of MLCommons. Association in the
United States and other countries. All rights reserved. Unauthorized use strictly
prohibited. See www.mlcommons.org for more information.
Figure 1: Published MLPerf®
results for the Dell PowerEdge XE9680 and HPE ProLiant XL675d Gen10 Plus as of 11/29/23. The Dell system uses the
NVIDIA H100 GPU, while the GPUs in the HPE system are one generation older. Source: Principled Technologies using data from MLCommons®
.*
Normalized MLPerf®
results: Dell PowerEdge XE8640 with H100 SXM5 vs.
HPE ProLiant DL380a Gen 11 with H100 PCIe (Larger is better)
Dell PowerEdge XE8640 HPE ProLiant DL380a Gen11
0.00
1.00
2.00
Accuracy
Model
99 99 99 99.9 99 99.9
ResNet Retinanet 3D-UNet BERT
Server Offline Server Offline Offline Offline Server Offline Server Offline
1.65 1.56 1.68 1.52 1.34 1.34
2.07
1.54
1.82
1.55
1 1 1 1 1 1 1 1 1 1
Figure 2: Published MLPerf®
results for the Dell PowerEdge XE8640 and HPE ProLiant DL380a Gen11 as of 11/29/23. The Dell system uses the NVIDIA
H100 SXM form factor, while the HPE system uses the less powerful PCIe form factor. Source: Principled Technologies using data
from MLCommons®
.*
Principled Technologies is a registered trademark of Principled Technologies, Inc.
All other product names are the trademarks of their respective owners.
For additional information, review the report.
Principled
Technologies®
Facts matter.®
Principled
Technologies®
Facts matter.®
Read the report at https://facts.pt/zPmSx4c
Meeting the challenges of AI workloads with the Dell AI portfolio January 2024 | 2

Weitere ähnliche Inhalte

Ähnlich wie Meeting the challenges of AI workloads with the Dell AI portfolio - Summary

Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Principled Technologies
 
Dell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheetDell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheet
IndrawanIT
 
Cloudwatt pioneers big_data
Cloudwatt pioneers big_dataCloudwatt pioneers big_data
Cloudwatt pioneers big_data
xband
 

Ähnlich wie Meeting the challenges of AI workloads with the Dell AI portfolio - Summary (20)

Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
Investing in GenAI: Cost‑benefit analysis of Dell on‑premises deployments vs....
 
A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...
A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...
A single-socket Dell EMC PowerEdge R7515 solution delivered better value on a...
 
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
 
Streamline End-to-End AI Pipelines with Intel, Databricks, and OmniSci
Streamline End-to-End AI Pipelines with Intel, Databricks, and OmniSciStreamline End-to-End AI Pipelines with Intel, Databricks, and OmniSci
Streamline End-to-End AI Pipelines with Intel, Databricks, and OmniSci
 
Dell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdf
Dell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdfDell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdf
Dell_R730xd_RedHat_Ceph_Performance_SizingGuide_WhitePaper.pdf
 
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
Converged architecture advantages: Dell PowerEdge FX2s and FC830 servers vs. ...
 
Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...
Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...
Upgrade to Dell EMC PowerEdge R6515 servers and gain better OLTP and VDI perf...
 
Dell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheetDell poweredge-r730-spec-sheet
Dell poweredge-r730-spec-sheet
 
Performance advantages of Hadoop ETL offload with the Intel processor-powered...
Performance advantages of Hadoop ETL offload with the Intel processor-powered...Performance advantages of Hadoop ETL offload with the Intel processor-powered...
Performance advantages of Hadoop ETL offload with the Intel processor-powered...
 
Dell EMC Ready Solutions for Big Data
Dell EMC Ready Solutions for Big DataDell EMC Ready Solutions for Big Data
Dell EMC Ready Solutions for Big Data
 
Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Mic...
 
Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...
Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...
Dell PowerEdge M820 blades: Balancing performance, density, and high availabi...
 
Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...
Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...
Improve AI inference performance with HPE ProLiant DL380 Gen11 servers, power...
 
Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013Inside story on Intel Data Center @ IDF 2013
Inside story on Intel Data Center @ IDF 2013
 
Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...
Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...
Get stronger SQL Server performance for less with Dell EMC PowerEdge R6515 cl...
 
Cloudwatt pioneers big_data
Cloudwatt pioneers big_dataCloudwatt pioneers big_data
Cloudwatt pioneers big_data
 
Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...Give Your Organization Better, Faster Insights & Answers with High Performanc...
Give Your Organization Better, Faster Insights & Answers with High Performanc...
 
Run more applications without expanding your datacenter
Run more applications without expanding your datacenterRun more applications without expanding your datacenter
Run more applications without expanding your datacenter
 
VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...
VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...
VxRail Appliance - Modernize your infrastructure and accelerate IT transforma...
 
Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...
Dell PowerEdge M820 blade storage solution: Software cost advantages with Ora...
 

Mehr von Principled Technologies

Improving energy efficiency in the data center: Endure higher temperatures wi...
Improving energy efficiency in the data center: Endure higher temperatures wi...Improving energy efficiency in the data center: Endure higher temperatures wi...
Improving energy efficiency in the data center: Endure higher temperatures wi...
Principled Technologies
 
Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...
Principled Technologies
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
Principled Technologies
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
Principled Technologies
 

Mehr von Principled Technologies (20)

Enable security features with no impact to OLTP performance with Dell PowerEd...
Enable security features with no impact to OLTP performance with Dell PowerEd...Enable security features with no impact to OLTP performance with Dell PowerEd...
Enable security features with no impact to OLTP performance with Dell PowerEd...
 
Improving energy efficiency in the data center: Endure higher temperatures wi...
Improving energy efficiency in the data center: Endure higher temperatures wi...Improving energy efficiency in the data center: Endure higher temperatures wi...
Improving energy efficiency in the data center: Endure higher temperatures wi...
 
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
 
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
Dell APEX Cloud Platform for Red Hat OpenShift: An easily deployable and powe...
 
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
 
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
 
Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...
Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...
Realize 2.1X the performance with 20% less power with AMD EPYC processor-back...
 
Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...Improve performance and gain room to grow by easily migrating to a modern Ope...
Improve performance and gain room to grow by easily migrating to a modern Ope...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
Upgrade your cloud infrastructure with Dell PowerEdge R760 servers and VMware...
 
A comparison of security features in Dell, HP, and Lenovo PC systems
A comparison of security features in Dell, HP, and Lenovo PC systemsA comparison of security features in Dell, HP, and Lenovo PC systems
A comparison of security features in Dell, HP, and Lenovo PC systems
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
 
Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...Increase security, sustainability, and efficiency with robust Dell server man...
Increase security, sustainability, and efficiency with robust Dell server man...
 
Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...
Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...
Scale up your storage with higher-performing Dell APEX Block Storage for AWS ...
 
Scale up your storage with higher-performing Dell APEX Block Storage for AWS
Scale up your storage with higher-performing Dell APEX Block Storage for AWSScale up your storage with higher-performing Dell APEX Block Storage for AWS
Scale up your storage with higher-performing Dell APEX Block Storage for AWS
 
Get in and stay in the productivity zone with the HP Z2 G9 Tower Workstation
Get in and stay in the productivity zone with the HP Z2 G9 Tower WorkstationGet in and stay in the productivity zone with the HP Z2 G9 Tower Workstation
Get in and stay in the productivity zone with the HP Z2 G9 Tower Workstation
 
Open up new possibilities with higher transactional database performance from...
Open up new possibilities with higher transactional database performance from...Open up new possibilities with higher transactional database performance from...
Open up new possibilities with higher transactional database performance from...
 
Improving database performance and value with an easy migration to Azure Data...
Improving database performance and value with an easy migration to Azure Data...Improving database performance and value with an easy migration to Azure Data...
Improving database performance and value with an easy migration to Azure Data...
 
Realize better value and performance migrating from Azure Database for Postgr...
Realize better value and performance migrating from Azure Database for Postgr...Realize better value and performance migrating from Azure Database for Postgr...
Realize better value and performance migrating from Azure Database for Postgr...
 

Kürzlich hochgeladen

Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial IntelligenceRevolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
Precisely
 

Kürzlich hochgeladen (20)

Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cf
 
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial IntelligenceRevolutionizing SAP® Processes with Automation and Artificial Intelligence
Revolutionizing SAP® Processes with Automation and Artificial Intelligence
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 

Meeting the challenges of AI workloads with the Dell AI portfolio - Summary

  • 1. Meeting the challenges of AI workloads with the Dell AI portfolio A comparison of the Dell AI portfolio vs. similar offerings from HPE AI adoption presents new challenges for businesses and their data center IT staff, including: • Addressing the existing skill gaps in their current staff through training or external hiring • Understanding the data preparation needs of AI, including the quality, quantity, location, and current state of the business’s data • Assessing business goals to determine which AI models and implementations will provide benefits • Assessing the computational, networking, and storage needs of the planned AI systems and acquiring these systems With AI-ready portfolios, infrastructure vendors such as Dell Technologies and HPE offer integrated solutions that encompass the entire AI lifecycle. We researched publicly available information about both the Dell and HPE AI portfolios, and examined benchmark testing from MLPerf® . We found that Dell is poised to help businesses embrace AI with a portfolio comprising high- performing server and storage options, validated solutions, and professional services that guide the process from planning to production. AI model benchmark performance: MLPerf result comparison Publicly available MLPerf® Benchmark testing shows that offerings in the Dell AI portfolio offer consistent, strong performance for AI workloads. MLPerf® tests performance for both training and inferencing on several AI models. The data referenced in this report is based on MLPerf® v3.1 Inference Datacenter results published on the MLCommons® website from November 2023.1 We compared both 8- and 4-GPU servers and include one result from each category in this summary; to see them all, read the full report at https://facts.pt/zPmSx4c. 1. MLCommons, “MLPerf Inference: Datacenter Benchmark Suite Results,” accessed December 12, 2023, https://mlcommons.org/en/inference-datacenter-31/. Executive summary Our research found Dell has: Broadest Generative AI portfolio* Per MLPerf® results, the Dell PowerEdge XE8640 server with four NVIDIA H100 SXM5 GPUs achieved the highest AI throughput among all four-GPU submissions in nine different categories A broader portfolio of professional services tailored for AI *Based on Dell analysis, August 2023. Dell Technologies offers solutions engineered to support AI workloads from Workstations PCs (mobile and fixed) to Servers for High-performance Computing, Data Storage, Cloud Native Software-Defined Infrastructure, Networking Switches, Data Protection, HCI and Services. Data from: “Robert McNeal, “Dell, VMware and NVIDIA Bring AI to Your Data,” accessed January 17, 2024, https://www.dell.com/en-us/blog/dell-vmware-and-nvidia-bring-ai-to-your-data/. Meeting the challenges of AI workloads with the Dell AI portfolio January 2024 A Principled Technologies report: Hands-on testing. Real-world results.
  • 2. Comparing MLPerf performance for eight-GPU servers In the MLPerf® v3.1 results for eight-GPU servers, the Dell PowerEdge XE9680 with NVIDIA SXM5 H100 GPUs out- performed the HPE ProLiant XL675d Gen10 Plus with NVIDIA SXM4 A100 GPUs by up to 4.25x (see Figure 1). Normalized MLPerf® results: Dell PowerEdge XE9680 with H100 SXM5 vs. HPE ProLiant XL675d Gen10 Plus with A100 SXM4 (Larger is better) 0.00 1.00 2.00 3.00 4.00 Server Offline Server Offline Offline Offline Server Offline Server Offline 99 99 99 99.9 99 99.9 ResNet Retinanet 3D-UNet BERT Dell PowerEdge XE9680 HPE ProLiant XL675d Gen10 Plus Accuracy Model 2.03 2.07 2.22 2.14 1.67 1.67 2.25 2.47 3.99 4.25 1 1 1 1 1 1 1 1 1 1 Comparing MLPerf performance for four-GPU servers The Dell PowerEdge XE8640 server with four NVIDIA H100 SXM5 GPUs achieved the highest AI throughput among all four-GPU submissions in nine different categories. As Figure 2 shows, compared to the HPE ProLiant DL380a server, it scored up to 2.07 times as high on the MLPerf® benchmark. In brief: Additional contributors to AI success AI models require more than high performance servers for success. You must also consider storage for unstructured data and professional services to plan, prepare, deploy, and manage your AI solution. The Dell portfolio offers storage for AI datasets with the PowerScale series for file storage and Elastic Cloud Storage or ObjectScale storage for object storage. Organizations can reap the advantages of Dell’s professional and consulting services for AI, which offers some services that HPE does not, such as data preparation. The Dell portfolio also includes Validated Designs for AI, which takes the guesswork out of designing and deploying AI. *Verified MLPerf. score of v3.1 Inference Closed. Retrieved from https://ml- commons.org/benchmarks/inference-datacenter/ 5 December 2023, entries 3.1-0069, 3.1-0085, 3.1-0067, and 3.1-0084. The MLPerf. name and logo are registered and unregistered trademarks of MLCommons. Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information. Figure 1: Published MLPerf® results for the Dell PowerEdge XE9680 and HPE ProLiant XL675d Gen10 Plus as of 11/29/23. The Dell system uses the NVIDIA H100 GPU, while the GPUs in the HPE system are one generation older. Source: Principled Technologies using data from MLCommons® .* Normalized MLPerf® results: Dell PowerEdge XE8640 with H100 SXM5 vs. HPE ProLiant DL380a Gen 11 with H100 PCIe (Larger is better) Dell PowerEdge XE8640 HPE ProLiant DL380a Gen11 0.00 1.00 2.00 Accuracy Model 99 99 99 99.9 99 99.9 ResNet Retinanet 3D-UNet BERT Server Offline Server Offline Offline Offline Server Offline Server Offline 1.65 1.56 1.68 1.52 1.34 1.34 2.07 1.54 1.82 1.55 1 1 1 1 1 1 1 1 1 1 Figure 2: Published MLPerf® results for the Dell PowerEdge XE8640 and HPE ProLiant DL380a Gen11 as of 11/29/23. The Dell system uses the NVIDIA H100 SXM form factor, while the HPE system uses the less powerful PCIe form factor. Source: Principled Technologies using data from MLCommons® .* Principled Technologies is a registered trademark of Principled Technologies, Inc. All other product names are the trademarks of their respective owners. For additional information, review the report. Principled Technologies® Facts matter.® Principled Technologies® Facts matter.® Read the report at https://facts.pt/zPmSx4c Meeting the challenges of AI workloads with the Dell AI portfolio January 2024 | 2