SlideShare ist ein Scribd-Unternehmen logo
1 von 11
CCFE is the fusion research arm of the United Kingdom Atomic Energy Authority.
This work was part-funded by the RCUK Energy Programme [grant number EP/I501045]
and the European Union’s Horizon 2020 research and innovation programme.
Small Scale HPC for Big Science
Shaun de Witt
shaun.de-witt@ukaea.uk
EOSC-Hub Public Day
Malaga, April 2018
• Background
• EOSCpilot Work and Preliminary Results
• EOSC-Hub Planned Work
• Conclusions
Agenda
• Making a Sun on Earth
– Fusing nuclei together
– Brings together compute intensive disciplines
• UQ, FEM, Radiative Transfer, Neutronics, spin lattice
dynamics,
• The Numbers – JET/ITER:
– Plasma Temperature: >100x106 (150x106) C
– Plasma Density: ~10-6 (10-5) atmospheric
– Duration of ‘shot’: 5-20 sec (350 sec)
– Input Power: 35 (50) MW
– Output Power: ~4.5 (500) MW
– Data Rate: 600 GB/day (2PB/day)
The Science
Data Scales in Fusion
1
10
100
1000
10000
100000
1000000
10000000
100000000
MAST JET 2007 JET 2017 ITER DEMO
VolumeofData(GB/Day)
Daily Data Volumes
Difference between LHC/SKA and ITER
Concept Design BuildModel Data
Science
Concept Design BuildModel Data Engine
ering
• Address part of the computing problem
– Scalability
• Cloud Bursting
– Running MPI and Open-MP applications
• In containers
– Makes use of a number of INDIGO components EGI FedCloud
Resources
• IM, Orchestrator, udocker,
– Tested with Geant-4 and Serpent
• Very Successful…
EOSCpilot
EOSCpilot Resource Usage
EOSCpilot Results
Image Courtesy of Andrew Lahiff, CCFE Image Courtesy of Jonathan Shimell, CCFE
• Combining Computing AND Data
– Increasing ITER Relevance
• DATA
– Data Federation and Distribution
• OneData, B2SAFE and Dynafed
• Data Readable and Writable using ITER middleware
• Computing
– Testing Cloud Deployment of IMAS
• Extending work of EOSCpilot
• AAI
– Integrating Proposed Fusion AAI into EOSC
EOSC-hub
• EOSCpilot has allowed us to successfully demonstrate the
usage of cloud computing for HPC work
– Both MPI and Open-MP
• EOSC-Hub will allow us to demonstrate
– ITER relevance of the work done on pilot
– Support EUROFusion Open Data policies
– Integrate Data Federation and Cloud Computing
Summary
• We would like to thank the following for use of cloud
resources in EOSCpilot:
– EGI Federation, CESGA, CESNET, IN2P3, ReCaS-Bari
• And the support provided by INDIGO-Datacloud in making the
demonstrator a success
Acknowledgements

Weitere ähnliche Inhalte

Mehr von EOSC-hub project

Mehr von EOSC-hub project (20)

EOSC working group on FAIR
EOSC working group on FAIREOSC working group on FAIR
EOSC working group on FAIR
 
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
 
Services to support FAIR data - Introduction
Services to support FAIR data - IntroductionServices to support FAIR data - Introduction
Services to support FAIR data - Introduction
 
EOSC-synergy
EOSC-synergyEOSC-synergy
EOSC-synergy
 
ExPaNDS
ExPaNDSExPaNDS
ExPaNDS
 
EOSC-Pillar
EOSC-PillarEOSC-Pillar
EOSC-Pillar
 
NI4OS-Europe
NI4OS-EuropeNI4OS-Europe
NI4OS-Europe
 
Excellerat CoE
Excellerat CoEExcellerat CoE
Excellerat CoE
 
Pathways for EOSC-hub and MaX collaboration
Pathways for EOSC-hub and MaX collaborationPathways for EOSC-hub and MaX collaboration
Pathways for EOSC-hub and MaX collaboration
 
Overview on the HPC CoEs panorama
Overview on the HPC CoEs panoramaOverview on the HPC CoEs panorama
Overview on the HPC CoEs panorama
 
Overview of the Onboarding and validation process and the Rules of Participat...
Overview of the Onboarding and validation process and the Rules of Participat...Overview of the Onboarding and validation process and the Rules of Participat...
Overview of the Onboarding and validation process and the Rules of Participat...
 
ELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hubELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hub
 
Data sharing in EOSC-hub: perspectives on “sensitive” data
Data sharing in EOSC-hub: perspectives on “sensitive” dataData sharing in EOSC-hub: perspectives on “sensitive” data
Data sharing in EOSC-hub: perspectives on “sensitive” data
 
Structural biology in the cloud powered by the WeNMR thematic services
Structural biology in the cloud powered by the WeNMR thematic servicesStructural biology in the cloud powered by the WeNMR thematic services
Structural biology in the cloud powered by the WeNMR thematic services
 
Use of EOSC to support Protected Area Management applications in the context ...
Use of EOSC to support Protected Area Management applications in the context ...Use of EOSC to support Protected Area Management applications in the context ...
Use of EOSC to support Protected Area Management applications in the context ...
 
ICOS Carbon Portal
ICOS Carbon PortalICOS Carbon Portal
ICOS Carbon Portal
 
OPENCoastS: An open-access service for producing on-demand coastal hydrodynam...
OPENCoastS: An open-access service for producing on-demand coastal hydrodynam...OPENCoastS: An open-access service for producing on-demand coastal hydrodynam...
OPENCoastS: An open-access service for producing on-demand coastal hydrodynam...
 
Eiscat 3D competence centre
Eiscat 3D competence centreEiscat 3D competence centre
Eiscat 3D competence centre
 
EOSC-hub Radioastronomy Competence Centre
EOSC-hub Radioastronomy Competence CentreEOSC-hub Radioastronomy Competence Centre
EOSC-hub Radioastronomy Competence Centre
 
My cloud, your cloud, our cloud: notes on governance alignment
My cloud, your cloud, our cloud: notes on governance alignmentMy cloud, your cloud, our cloud: notes on governance alignment
My cloud, your cloud, our cloud: notes on governance alignment
 

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 

Shaun de Witt: Example for an EOSC-hub Competence Centre example - Fusion

  • 1. CCFE is the fusion research arm of the United Kingdom Atomic Energy Authority. This work was part-funded by the RCUK Energy Programme [grant number EP/I501045] and the European Union’s Horizon 2020 research and innovation programme. Small Scale HPC for Big Science Shaun de Witt shaun.de-witt@ukaea.uk EOSC-Hub Public Day Malaga, April 2018
  • 2. • Background • EOSCpilot Work and Preliminary Results • EOSC-Hub Planned Work • Conclusions Agenda
  • 3. • Making a Sun on Earth – Fusing nuclei together – Brings together compute intensive disciplines • UQ, FEM, Radiative Transfer, Neutronics, spin lattice dynamics, • The Numbers – JET/ITER: – Plasma Temperature: >100x106 (150x106) C – Plasma Density: ~10-6 (10-5) atmospheric – Duration of ‘shot’: 5-20 sec (350 sec) – Input Power: 35 (50) MW – Output Power: ~4.5 (500) MW – Data Rate: 600 GB/day (2PB/day) The Science
  • 4. Data Scales in Fusion 1 10 100 1000 10000 100000 1000000 10000000 100000000 MAST JET 2007 JET 2017 ITER DEMO VolumeofData(GB/Day) Daily Data Volumes
  • 5. Difference between LHC/SKA and ITER Concept Design BuildModel Data Science Concept Design BuildModel Data Engine ering
  • 6. • Address part of the computing problem – Scalability • Cloud Bursting – Running MPI and Open-MP applications • In containers – Makes use of a number of INDIGO components EGI FedCloud Resources • IM, Orchestrator, udocker, – Tested with Geant-4 and Serpent • Very Successful… EOSCpilot
  • 8. EOSCpilot Results Image Courtesy of Andrew Lahiff, CCFE Image Courtesy of Jonathan Shimell, CCFE
  • 9. • Combining Computing AND Data – Increasing ITER Relevance • DATA – Data Federation and Distribution • OneData, B2SAFE and Dynafed • Data Readable and Writable using ITER middleware • Computing – Testing Cloud Deployment of IMAS • Extending work of EOSCpilot • AAI – Integrating Proposed Fusion AAI into EOSC EOSC-hub
  • 10. • EOSCpilot has allowed us to successfully demonstrate the usage of cloud computing for HPC work – Both MPI and Open-MP • EOSC-Hub will allow us to demonstrate – ITER relevance of the work done on pilot – Support EUROFusion Open Data policies – Integrate Data Federation and Cloud Computing Summary
  • 11. • We would like to thank the following for use of cloud resources in EOSCpilot: – EGI Federation, CESGA, CESNET, IN2P3, ReCaS-Bari • And the support provided by INDIGO-Datacloud in making the demonstrator a success Acknowledgements

Hinweis der Redaktion

  1. Atruistically – Make sure data is preserved and usable for future generations of scientists and engineers Legally – we want to be able to prove that our results are correct
  2. IMAS – the ITER Integrated Modelling and Analysis Suite