SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
Overview of GADGET-2
Hydrodynamic Galactic
Simulations
Bruce Becker | bbecker@csir.co.za
Coordinator, SAGrid
Meraka Institute, CSIR
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Outline
● What is GADGET and what does it do ?
● Application implementation and
dependencies
● Execution model
● Proposed development strategy
● Current situation
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
GADGET: what is it ?
http://www.mpa-garching.mpg.de/gadget/
● GAlaxies with Dark matter and Gas intEracT
● Cosmological N-body/Smoothed Particle Hydrodymanics
simulations (SPH)
● SPH:
●
Divides a fluid into discrete elements (particles)
● Have a typical length, over which properties of the
constituents are ”smothed”
● Smoothing length can be made adaptive, based on local
conditions
● particularly suited to astrophysics simulations at all scales.
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
GADGET: What is it good for ?
● Can be used for studies of isolated systems, or for simulations
that include the cosmological expansion of space, both with or
without periodic boundary conditions.
● In all these types of simulations, GADGET follows the evolution of
a self-gravitating collisionless N-body system, and allows gas
dynamics to be optionally included.
● Both the force computation and the time stepping of GADGET
are fully adaptive, with a dynamic range which is, in principle,
unlimited.
● Can be used to address a wide array of astrophysically interesting
problems, ranging from colliding and merging galaxies, to the
formation of large-scale structure in the Universe
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
GADGET: What is it good for ?
Galactic sphere
collissions
Cosmological galactic structure evolution
http://www.mpa-garching.mpg.de/galform/millennium
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
GADGET-2 : ”The Millenium Run”
”The Millennium Run used more than 10 billion particles to trace the
evolution of the matter distribution in a cubic region of the Universe
over 2 billion light-years on a side. It kept busy the principal
supercomputer at the Max Planck Society's Supercomputing
Centre in Garching, Germany for more than a month. By applying
sophisticated modelling techniques to the 25 TB of stored output,
Virgo scientists have been able to recreate evolutionary histories
both for the 20 million or so galaxies which populate this enormous
volume and for the supermassive black holes which occasionally
power quasars at their hearts. By comparing such simulated data to
large observational surveys, one can clarify the physical
processes underlying the buildup of real galaxies and black holes.”
- http://www.mpa-garching.mpg.de/galform/virgo/millennium/
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
GADGET – Research or Teaching ?
● GADGET is a very serious research
application, running on the most powerful
computers in the world.
● For serious research, run parameters need to
be properly validated...
● ...”But as a teaching tool I think this idea could
be great.”
- Prof. Romeel DavéSARChI Chair in
Cosmology, UWC/SAAO/AIMS
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Application implementation and
dependencies
● GADGET-2 is written in ANSI-C, with MPI-
bindings
● Inherently parallel, but can also be executed on
single CPU serially (good for testing)
● Requires:
● GNU Science Libraries
● FFTW
● (optional) HDF5 library for I/O
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Execution Model
● GADGET requires a set of initial conditions and a parameter
file to execute – mostly defined in Makefile
● Frequent recompilation necessary
● Typical workflow
1) Create initial condition file for specific problem with MUSIC*
2) Compile gadget for specific problem
3) Setup parameter input file
4) run the code and wait (monitor output log)
5) run analysis on the resulting data.
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Execution Model
Create initial conditions with MUSIC
Sim.conf → MUSIC → ics.dat
Research question -
”what would I measure
if the following scenario
happened”
Define simulation parameters
My­sim.param
Run the simulation
Gadget2 My­sim.param
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Portlet – Must Haves
● Required input:
● Makefile
● Parameters file
● Require two-step portlet
● Generate initial conditions
● Run Gadget Simulation
● GADGET recompilation happens on the fly
● All other dependencies deployed on the computing
infrastructure
● Can be obtained from Jenkins or CVMFS at the sites
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
Portlet – Nice to Haves
● Simple ”wizard” to generate IC and param files
● Parametric jobs (with certain parameter ranges)
● Snooping of output to see state of the job

Weitere ähnliche Inhalte

Ähnlich wie Gadget2 Science Gateway Development

Representing and Querying Geospatial Information in the Semantic Web
Representing and Querying Geospatial Information in the Semantic WebRepresenting and Querying Geospatial Information in the Semantic Web
Representing and Querying Geospatial Information in the Semantic Web
Kostis Kyzirakos
 
Handling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud ComputingHandling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud Computing
Abhishek Dey
 
M sc thesis of nicolo' savioli
M sc thesis of nicolo' savioliM sc thesis of nicolo' savioli
M sc thesis of nicolo' savioli
Nicolò Savioli
 

Ähnlich wie Gadget2 Science Gateway Development (20)

Parameter study bonn
Parameter study bonnParameter study bonn
Parameter study bonn
 
ePBCS Gridbuilder Deep Dive - Last Minute KScope Souvenirs
ePBCS Gridbuilder Deep Dive - Last Minute KScope SouvenirsePBCS Gridbuilder Deep Dive - Last Minute KScope Souvenirs
ePBCS Gridbuilder Deep Dive - Last Minute KScope Souvenirs
 
New Microsoft Word Document
New Microsoft Word DocumentNew Microsoft Word Document
New Microsoft Word Document
 
Current status of the project "Toward a unified view of the universe: from la...
Current status of the project "Toward a unified view of the universe: from la...Current status of the project "Toward a unified view of the universe: from la...
Current status of the project "Toward a unified view of the universe: from la...
 
Representing and Querying Geospatial Information in the Semantic Web
Representing and Querying Geospatial Information in the Semantic WebRepresenting and Querying Geospatial Information in the Semantic Web
Representing and Querying Geospatial Information in the Semantic Web
 
Handling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud ComputingHandling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud Computing
 
Distributed Development, Centralised Delivery - SAGrid Jenkins + CVMFS
Distributed Development, Centralised Delivery - SAGrid Jenkins + CVMFSDistributed Development, Centralised Delivery - SAGrid Jenkins + CVMFS
Distributed Development, Centralised Delivery - SAGrid Jenkins + CVMFS
 
Fulltext02
Fulltext02Fulltext02
Fulltext02
 
01-10 Exploring new high potential 2D materials - Angioni.pdf
01-10 Exploring new high potential 2D materials - Angioni.pdf01-10 Exploring new high potential 2D materials - Angioni.pdf
01-10 Exploring new high potential 2D materials - Angioni.pdf
 
Near Exascale Computing in the Cloud
Near Exascale Computing in the CloudNear Exascale Computing in the Cloud
Near Exascale Computing in the Cloud
 
Product & technology portfolio of gridworld
Product & technology portfolio of gridworldProduct & technology portfolio of gridworld
Product & technology portfolio of gridworld
 
Atomate: a tool for rapid high-throughput computing and materials discovery
Atomate: a tool for rapid high-throughput computing and materials discoveryAtomate: a tool for rapid high-throughput computing and materials discovery
Atomate: a tool for rapid high-throughput computing and materials discovery
 
Recent developments in HPX and Octo-Tiger
Recent developments in HPX and Octo-TigerRecent developments in HPX and Octo-Tiger
Recent developments in HPX and Octo-Tiger
 
GPU HistoPyramid Based Fluid Simulation and Rendering
GPU HistoPyramid Based Fluid Simulation and RenderingGPU HistoPyramid Based Fluid Simulation and Rendering
GPU HistoPyramid Based Fluid Simulation and Rendering
 
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
 NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic... NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
 
DuraMat CO1 Central Data Resource: How it started, how it’s going …
DuraMat CO1 Central Data Resource: How it started, how it’s going …DuraMat CO1 Central Data Resource: How it started, how it’s going …
DuraMat CO1 Central Data Resource: How it started, how it’s going …
 
Cycle Computing Record-breaking Petascale HPC Run
Cycle Computing Record-breaking Petascale HPC RunCycle Computing Record-breaking Petascale HPC Run
Cycle Computing Record-breaking Petascale HPC Run
 
M sc thesis of nicolo' savioli
M sc thesis of nicolo' savioliM sc thesis of nicolo' savioli
M sc thesis of nicolo' savioli
 
"Building and running the cloud GPU vacuum cleaner"
"Building and running the cloud GPU vacuum cleaner""Building and running the cloud GPU vacuum cleaner"
"Building and running the cloud GPU vacuum cleaner"
 
Burst data retrieval after 50k GPU Cloud run
Burst data retrieval after 50k GPU Cloud runBurst data retrieval after 50k GPU Cloud run
Burst data retrieval after 50k GPU Cloud run
 

Mehr von Bruce Becker

Sa grid application inventory 36
Sa grid application inventory 36Sa grid application inventory 36
Sa grid application inventory 36
Bruce Becker
 
Paerip chain-becker-10-11-2011
Paerip chain-becker-10-11-2011Paerip chain-becker-10-11-2011
Paerip chain-becker-10-11-2011
Bruce Becker
 

Mehr von Bruce Becker (9)

Trusted Configurations for e-Infrastructure Deployment
Trusted Configurations for e-Infrastructure DeploymentTrusted Configurations for e-Infrastructure Deployment
Trusted Configurations for e-Infrastructure Deployment
 
The Sci-GaIA project
The Sci-GaIA projectThe Sci-GaIA project
The Sci-GaIA project
 
NICIS: Stepping Stones to a Cyberinfrastructure Commons
NICIS: Stepping Stones to a Cyberinfrastructure CommonsNICIS: Stepping Stones to a Cyberinfrastructure Commons
NICIS: Stepping Stones to a Cyberinfrastructure Commons
 
Continuous Integration and Delivery of Research Applications
Continuous Integration and Delivery of Research ApplicationsContinuous Integration and Delivery of Research Applications
Continuous Integration and Delivery of Research Applications
 
Continuous Integration and Delivery of Research Applications
Continuous Integration and Delivery of Research ApplicationsContinuous Integration and Delivery of Research Applications
Continuous Integration and Delivery of Research Applications
 
Now you can cite APHRC's data sets (CHAIN-REDS)
Now you can cite APHRC's data sets (CHAIN-REDS)Now you can cite APHRC's data sets (CHAIN-REDS)
Now you can cite APHRC's data sets (CHAIN-REDS)
 
Continuous integration
Continuous integrationContinuous integration
Continuous integration
 
Sa grid application inventory 36
Sa grid application inventory 36Sa grid application inventory 36
Sa grid application inventory 36
 
Paerip chain-becker-10-11-2011
Paerip chain-becker-10-11-2011Paerip chain-becker-10-11-2011
Paerip chain-becker-10-11-2011
 

Kürzlich hochgeladen

Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.
Silpa
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
Silpa
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
Silpa
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
1301aanya
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Silpa
 

Kürzlich hochgeladen (20)

Genetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditionsGenetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditions
 
Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
 
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLGwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
 
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICEPATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.
 
300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx
 
Atp synthase , Atp synthase complex 1 to 4.
Atp synthase , Atp synthase complex 1 to 4.Atp synthase , Atp synthase complex 1 to 4.
Atp synthase , Atp synthase complex 1 to 4.
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdf
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
 
Use of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxUse of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptx
 
Site Acceptance Test .
Site Acceptance Test                    .Site Acceptance Test                    .
Site Acceptance Test .
 

Gadget2 Science Gateway Development

  • 1. Overview of GADGET-2 Hydrodynamic Galactic Simulations Bruce Becker | bbecker@csir.co.za Coordinator, SAGrid Meraka Institute, CSIR
  • 2. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za Outline ● What is GADGET and what does it do ? ● Application implementation and dependencies ● Execution model ● Proposed development strategy ● Current situation
  • 3. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za GADGET: what is it ? http://www.mpa-garching.mpg.de/gadget/ ● GAlaxies with Dark matter and Gas intEracT ● Cosmological N-body/Smoothed Particle Hydrodymanics simulations (SPH) ● SPH: ● Divides a fluid into discrete elements (particles) ● Have a typical length, over which properties of the constituents are ”smothed” ● Smoothing length can be made adaptive, based on local conditions ● particularly suited to astrophysics simulations at all scales.
  • 4. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za GADGET: What is it good for ? ● Can be used for studies of isolated systems, or for simulations that include the cosmological expansion of space, both with or without periodic boundary conditions. ● In all these types of simulations, GADGET follows the evolution of a self-gravitating collisionless N-body system, and allows gas dynamics to be optionally included. ● Both the force computation and the time stepping of GADGET are fully adaptive, with a dynamic range which is, in principle, unlimited. ● Can be used to address a wide array of astrophysically interesting problems, ranging from colliding and merging galaxies, to the formation of large-scale structure in the Universe
  • 5. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za GADGET: What is it good for ? Galactic sphere collissions Cosmological galactic structure evolution http://www.mpa-garching.mpg.de/galform/millennium
  • 6. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za GADGET-2 : ”The Millenium Run” ”The Millennium Run used more than 10 billion particles to trace the evolution of the matter distribution in a cubic region of the Universe over 2 billion light-years on a side. It kept busy the principal supercomputer at the Max Planck Society's Supercomputing Centre in Garching, Germany for more than a month. By applying sophisticated modelling techniques to the 25 TB of stored output, Virgo scientists have been able to recreate evolutionary histories both for the 20 million or so galaxies which populate this enormous volume and for the supermassive black holes which occasionally power quasars at their hearts. By comparing such simulated data to large observational surveys, one can clarify the physical processes underlying the buildup of real galaxies and black holes.” - http://www.mpa-garching.mpg.de/galform/virgo/millennium/
  • 7. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
  • 8. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za GADGET – Research or Teaching ? ● GADGET is a very serious research application, running on the most powerful computers in the world. ● For serious research, run parameters need to be properly validated... ● ...”But as a teaching tool I think this idea could be great.” - Prof. Romeel DavéSARChI Chair in Cosmology, UWC/SAAO/AIMS
  • 9. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za Application implementation and dependencies ● GADGET-2 is written in ANSI-C, with MPI- bindings ● Inherently parallel, but can also be executed on single CPU serially (good for testing) ● Requires: ● GNU Science Libraries ● FFTW ● (optional) HDF5 library for I/O
  • 10. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za Execution Model ● GADGET requires a set of initial conditions and a parameter file to execute – mostly defined in Makefile ● Frequent recompilation necessary ● Typical workflow 1) Create initial condition file for specific problem with MUSIC* 2) Compile gadget for specific problem 3) Setup parameter input file 4) run the code and wait (monitor output log) 5) run analysis on the resulting data.
  • 11. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za Execution Model Create initial conditions with MUSIC Sim.conf → MUSIC → ics.dat Research question - ”what would I measure if the following scenario happened” Define simulation parameters My­sim.param Run the simulation Gadget2 My­sim.param
  • 12. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za Portlet – Must Haves ● Required input: ● Makefile ● Parameters file ● Require two-step portlet ● Generate initial conditions ● Run Gadget Simulation ● GADGET recompilation happens on the fly ● All other dependencies deployed on the computing infrastructure ● Can be obtained from Jenkins or CVMFS at the sites
  • 13. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za
  • 14. Bruce Becker: Coordinator, SAGrid | bbecker@csir.co.za | http://www.sagrid.ac.za Portlet – Nice to Haves ● Simple ”wizard” to generate IC and param files ● Parametric jobs (with certain parameter ranges) ● Snooping of output to see state of the job