SlideShare ist ein Scribd-Unternehmen logo
1 von 15
Paving the way to HPC as a Service
Heavy Duty Abaqus Structural Analysis Using HPC in the Cloud –
Challenges, Solutions, Lessons Learned, & Recommendations
Frank Ding
May 16, 2013
What is the UberCloud HPC Experiment?
 Started in mid-2012 as a voluntary effort
 Demonstrate the potential of HPC in the Cloud
 Uncover and overcome the obstacles
 Now with over 450 participants Round 3 is in progress
 Approaching 80 teams as of today
 Please submit your project ideas at the end of this webinar!
2
About the presenter
 Frank Ding, Engineering Analysis & Computing
Manager, Simpson Strong-Tie, HPC Experiment
Advocate,An early adopter of HPC for simulation-driven
design, a huge fan of Linux-based cluster computing
 Thanks to members of the HPC ExperimentTeam #47
 Matt Dunbar, SIMULIA 3DS
 Steve Hebert & Rob Sherrard, Nimbix
 Sharan Kalwani, DataSwing
 Antonio Arena & Cynthia Underwood, NICE Software
 Dennis Nagy, BeyondCAE
3
Simpson Strong-Tie
 A leader in structural systems research, testing and innovation
 Product Lines
 Connectors for light frame construction
 Fasteners and fastening systems
 Lateral systems
 Anchoring systems
 Fiber reinforcing materials
4
Realistic Simulation Requires HPC
 High-fidelity modeling
 Highly nonlinear materials
 Multi-physics
 Fracture and cracking
 Progressive damage and failure
5
Why HPC in the Cloud?
 Current HPC Cluster – 4-node 32 cores total
 Nehalem-based Xeon
 InfiniBand DDR
 HPC in the Cloud
 Lack of in-house HPC resources
 Capacity surge – large jobs speedup
 Capacity overflow jobs – large number of jobs
 Project tested in Round 2 HPC Experiment
 Concrete anchor bolt tension capacity
 1.9 millions of DOF’s
 11.5 hours runtime (32-core)
6
Cloud-Based HPCWorkflow
 ProjectWorkflow
 Pre-processing on the local workstation at the user end
 Abaqus input file loaded to the data staging point thru SFTP
 Abaqus job submitted to the compute cloud thru Nimbix web portal
 Job monitoring thru Nimbix dashboard plus email notification of job status
 Post-processing using remote visualization tool NICE DCV
7
Barriers and Challenges
 Data movement limited by internet bandwidth
 Use remote visualization for post-processing
 End user side internet bandwidth issue
 Team member time schedule (voluntary effort)
 Team member expertise gap
 Meet the project deadline
8
Benefits
 HPC in the Cloud solutions require multi-vendor support
 ISV – 3DS SIMULIA provided Abaqus license
 Cloud infrastructure and service provider – Nimbix HPC Cloud for CAE
 Remote visualization – NICE Desktop CloudVisualization(DCV)
 End-user applications
 HPC Experiment provides a collaboration platform
 Form a team based on end-user application requirement
 Basecamp.com to support team communication
 Third-party solution providers invited to the team if needed
9
Lessons Learned & Recommendations
 End point internet bandwidth variability is the top barrier
 Some workflow details have been identified to improve end user
experience
 Service provider is recommended to provide connection bandwidth
testing tool to the end users
 Remote visualization using NICE DCV is a good platform if a
stable/consistent internet bandwidth is available. Results accessible
anywhere when needed.
 HPC Experiment is a great platform to test your project on the Cloud
HPC
10
Ready for your project!
 Round 3 is in progress and will conclude at the end of June
 Anyone can create a project
 And it is not too late for Round 3 (and beyond)
 Please fill out the form at the end of this webinar
11
Q&A session notes
 What bandwidth is needed in your opinion?
 FD: Roughly a consistent bandwidth over 5Mbps is required
for a smooth response for dynamic 3D model manipulation.
 What is the largest memory node/core on the cloud
forAbaquspurposes?
 FD: I use 4GB/core for my local HPC, but I don’t know Nimbix
Compute Cloud’s configuration, but I would recommend the
same.
Q&A session notes
 Do you use .pbs to submit in batch?
 FD: No, I use Nimbix Compute Cloud job submission web portal,
which talks to theTorque load manager.
 What sort of interconnect types did you use / try?
 FD:We used GigE in the Round 1 and InfiniBand in Round 2.
InfiniBand performs better.
 Can you talk about the Memory required for your project?
 FD:The job was solved by Abaqus/Explicit, which does not have
intensive memory requirement like Abaqus/Standard does. Usually
I go with 4GB/core.
Q&A session notes
 You mentioned that Internet speed (or lack of) was a major
factor.What was the maximum internet speed available to
you for the project?
 FD:The maximum I ever tested was 10 Mbps on a 20 Mbps
pipe.
 Is the NICE visualization using a secure channel (encryption)?
 FD:Yes, encryption using the standard AES algorithm (128 or
256-bit)
ThankYou
http://www.hpcexperiment.com
http://www.cfdexperiment.com
http://www.compbioexperiment.com
http://www.bigdataexperiment.com

Weitere ähnliche Inhalte

Ähnlich wie HPC as a Service: Paving the Way with Heavy Duty Abaqus Analysis

UberCloud - From Project to Product
UberCloud - From Project to ProductUberCloud - From Project to Product
UberCloud - From Project to ProductThe UberCloud
 
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...Wolfgang Gentzsch
 
International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...Thomas Francis
 
UberCloud at ucc dresden
UberCloud at ucc dresdenUberCloud at ucc dresden
UberCloud at ucc dresdenThe UberCloud
 
Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013Wolfgang Gentzsch
 
Learn more about the tremendous value Open Data Plane brings to NFV
Learn more about the tremendous value Open Data Plane brings to NFVLearn more about the tremendous value Open Data Plane brings to NFV
Learn more about the tremendous value Open Data Plane brings to NFVGhodhbane Mohamed Amine
 
Irati goals and achievements - 3rd RINA Workshop
Irati goals and achievements - 3rd RINA WorkshopIrati goals and achievements - 3rd RINA Workshop
Irati goals and achievements - 3rd RINA WorkshopEleni Trouva
 
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...inside-BigData.com
 
Scaling Streaming - Concepts, Research, Goals
Scaling Streaming - Concepts, Research, GoalsScaling Streaming - Concepts, Research, Goals
Scaling Streaming - Concepts, Research, Goalskamaelian
 
Private Network Project for Colleges
Private Network Project for CollegesPrivate Network Project for Colleges
Private Network Project for CollegesAditya Jain
 
UberCloud HPC Experiment Introduction for Beginners
UberCloud HPC Experiment Introduction for BeginnersUberCloud HPC Experiment Introduction for Beginners
UberCloud HPC Experiment Introduction for Beginnershpcexperiment
 
Global Media Exchange: Work of the ETC By Christine Thomas of Dolby
Global Media Exchange: Work of the ETC By Christine Thomas of DolbyGlobal Media Exchange: Work of the ETC By Christine Thomas of Dolby
Global Media Exchange: Work of the ETC By Christine Thomas of DolbyETCenter
 
Busy Polling: Past, Present, Future
Busy Polling: Past,      Present, FutureBusy Polling: Past,      Present, Future
Busy Polling: Past, Present, FutureVenkatPulimi
 
Scalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC SystemsScalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC Systemsinside-BigData.com
 
NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .hpcexperiment
 
Accelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningAccelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningDataWorks Summit
 
ICEOTOPE & OCF: Performance for Manufacturing
ICEOTOPE & OCF: Performance for Manufacturing ICEOTOPE & OCF: Performance for Manufacturing
ICEOTOPE & OCF: Performance for Manufacturing IceotopePR
 
Research challenges in Reconfigurable Computing
Research challenges in Reconfigurable ComputingResearch challenges in Reconfigurable Computing
Research challenges in Reconfigurable ComputingSudhanshu Janwadkar
 

Ähnlich wie HPC as a Service: Paving the Way with Heavy Duty Abaqus Analysis (20)

UberCloud - From Project to Product
UberCloud - From Project to ProductUberCloud - From Project to Product
UberCloud - From Project to Product
 
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
The UberCloud - From Project to Product - From HPC Experiment to HPC Marketpl...
 
International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...International Conference on Utility and Cloud Computing December 9 – 12, Dres...
International Conference on Utility and Cloud Computing December 9 – 12, Dres...
 
UberCloud at ucc dresden
UberCloud at ucc dresdenUberCloud at ucc dresden
UberCloud at ucc dresden
 
Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013Uber cloud at ucc dresden dec 2013
Uber cloud at ucc dresden dec 2013
 
Learn more about the tremendous value Open Data Plane brings to NFV
Learn more about the tremendous value Open Data Plane brings to NFVLearn more about the tremendous value Open Data Plane brings to NFV
Learn more about the tremendous value Open Data Plane brings to NFV
 
Irati goals and achievements - 3rd RINA Workshop
Irati goals and achievements - 3rd RINA WorkshopIrati goals and achievements - 3rd RINA Workshop
Irati goals and achievements - 3rd RINA Workshop
 
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
 
Scaling Streaming - Concepts, Research, Goals
Scaling Streaming - Concepts, Research, GoalsScaling Streaming - Concepts, Research, Goals
Scaling Streaming - Concepts, Research, Goals
 
Private Network Project for Colleges
Private Network Project for CollegesPrivate Network Project for Colleges
Private Network Project for Colleges
 
UberCloud HPC Experiment Introduction for Beginners
UberCloud HPC Experiment Introduction for BeginnersUberCloud HPC Experiment Introduction for Beginners
UberCloud HPC Experiment Introduction for Beginners
 
Global Media Exchange: Work of the ETC By Christine Thomas of Dolby
Global Media Exchange: Work of the ETC By Christine Thomas of DolbyGlobal Media Exchange: Work of the ETC By Christine Thomas of Dolby
Global Media Exchange: Work of the ETC By Christine Thomas of Dolby
 
OFC 2014 Dinesh Dutt
OFC 2014 Dinesh DuttOFC 2014 Dinesh Dutt
OFC 2014 Dinesh Dutt
 
Busy Polling: Past, Present, Future
Busy Polling: Past,      Present, FutureBusy Polling: Past,      Present, Future
Busy Polling: Past, Present, Future
 
2017 dagstuhl-nfv-rothenberg
2017 dagstuhl-nfv-rothenberg2017 dagstuhl-nfv-rothenberg
2017 dagstuhl-nfv-rothenberg
 
Scalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC SystemsScalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC Systems
 
NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .NCMS UberCloud Experiment Webinar .
NCMS UberCloud Experiment Webinar .
 
Accelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learningAccelerating TensorFlow with RDMA for high-performance deep learning
Accelerating TensorFlow with RDMA for high-performance deep learning
 
ICEOTOPE & OCF: Performance for Manufacturing
ICEOTOPE & OCF: Performance for Manufacturing ICEOTOPE & OCF: Performance for Manufacturing
ICEOTOPE & OCF: Performance for Manufacturing
 
Research challenges in Reconfigurable Computing
Research challenges in Reconfigurable ComputingResearch challenges in Reconfigurable Computing
Research challenges in Reconfigurable Computing
 

Kürzlich hochgeladen

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 

Kürzlich hochgeladen (20)

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 

HPC as a Service: Paving the Way with Heavy Duty Abaqus Analysis

  • 1. Paving the way to HPC as a Service Heavy Duty Abaqus Structural Analysis Using HPC in the Cloud – Challenges, Solutions, Lessons Learned, & Recommendations Frank Ding May 16, 2013
  • 2. What is the UberCloud HPC Experiment?  Started in mid-2012 as a voluntary effort  Demonstrate the potential of HPC in the Cloud  Uncover and overcome the obstacles  Now with over 450 participants Round 3 is in progress  Approaching 80 teams as of today  Please submit your project ideas at the end of this webinar! 2
  • 3. About the presenter  Frank Ding, Engineering Analysis & Computing Manager, Simpson Strong-Tie, HPC Experiment Advocate,An early adopter of HPC for simulation-driven design, a huge fan of Linux-based cluster computing  Thanks to members of the HPC ExperimentTeam #47  Matt Dunbar, SIMULIA 3DS  Steve Hebert & Rob Sherrard, Nimbix  Sharan Kalwani, DataSwing  Antonio Arena & Cynthia Underwood, NICE Software  Dennis Nagy, BeyondCAE 3
  • 4. Simpson Strong-Tie  A leader in structural systems research, testing and innovation  Product Lines  Connectors for light frame construction  Fasteners and fastening systems  Lateral systems  Anchoring systems  Fiber reinforcing materials 4
  • 5. Realistic Simulation Requires HPC  High-fidelity modeling  Highly nonlinear materials  Multi-physics  Fracture and cracking  Progressive damage and failure 5
  • 6. Why HPC in the Cloud?  Current HPC Cluster – 4-node 32 cores total  Nehalem-based Xeon  InfiniBand DDR  HPC in the Cloud  Lack of in-house HPC resources  Capacity surge – large jobs speedup  Capacity overflow jobs – large number of jobs  Project tested in Round 2 HPC Experiment  Concrete anchor bolt tension capacity  1.9 millions of DOF’s  11.5 hours runtime (32-core) 6
  • 7. Cloud-Based HPCWorkflow  ProjectWorkflow  Pre-processing on the local workstation at the user end  Abaqus input file loaded to the data staging point thru SFTP  Abaqus job submitted to the compute cloud thru Nimbix web portal  Job monitoring thru Nimbix dashboard plus email notification of job status  Post-processing using remote visualization tool NICE DCV 7
  • 8. Barriers and Challenges  Data movement limited by internet bandwidth  Use remote visualization for post-processing  End user side internet bandwidth issue  Team member time schedule (voluntary effort)  Team member expertise gap  Meet the project deadline 8
  • 9. Benefits  HPC in the Cloud solutions require multi-vendor support  ISV – 3DS SIMULIA provided Abaqus license  Cloud infrastructure and service provider – Nimbix HPC Cloud for CAE  Remote visualization – NICE Desktop CloudVisualization(DCV)  End-user applications  HPC Experiment provides a collaboration platform  Form a team based on end-user application requirement  Basecamp.com to support team communication  Third-party solution providers invited to the team if needed 9
  • 10. Lessons Learned & Recommendations  End point internet bandwidth variability is the top barrier  Some workflow details have been identified to improve end user experience  Service provider is recommended to provide connection bandwidth testing tool to the end users  Remote visualization using NICE DCV is a good platform if a stable/consistent internet bandwidth is available. Results accessible anywhere when needed.  HPC Experiment is a great platform to test your project on the Cloud HPC 10
  • 11. Ready for your project!  Round 3 is in progress and will conclude at the end of June  Anyone can create a project  And it is not too late for Round 3 (and beyond)  Please fill out the form at the end of this webinar 11
  • 12. Q&A session notes  What bandwidth is needed in your opinion?  FD: Roughly a consistent bandwidth over 5Mbps is required for a smooth response for dynamic 3D model manipulation.  What is the largest memory node/core on the cloud forAbaquspurposes?  FD: I use 4GB/core for my local HPC, but I don’t know Nimbix Compute Cloud’s configuration, but I would recommend the same.
  • 13. Q&A session notes  Do you use .pbs to submit in batch?  FD: No, I use Nimbix Compute Cloud job submission web portal, which talks to theTorque load manager.  What sort of interconnect types did you use / try?  FD:We used GigE in the Round 1 and InfiniBand in Round 2. InfiniBand performs better.  Can you talk about the Memory required for your project?  FD:The job was solved by Abaqus/Explicit, which does not have intensive memory requirement like Abaqus/Standard does. Usually I go with 4GB/core.
  • 14. Q&A session notes  You mentioned that Internet speed (or lack of) was a major factor.What was the maximum internet speed available to you for the project?  FD:The maximum I ever tested was 10 Mbps on a 20 Mbps pipe.  Is the NICE visualization using a secure channel (encryption)?  FD:Yes, encryption using the standard AES algorithm (128 or 256-bit)