DevoxxFR 2024 Reproducible Builds with Apache Maven
Parametric studies for the AEC domain using InteliGrid platform
1. Interoperability of Virtual Organizations
on Complex Semantic Grid
www.InteliGrid.com
Parametric studies for the AEC
domain using InteliGrid platform
M. Dolenc and R. Klinc
matevz.dolenc@fgg.uni-lj.si
IST-2004-004664
University of Ljubljana
Faculty of Civil and Geodetic Engineering
Institute of Civil Engineering, Earthquake Engineering and Construction IT
Chair of Construction Informatics
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007
2. Content
www.InteliGrid.com
Overview of the InteliGrid project
High throughput computing (HTC)
Overview
DRM systems – products overview
Use case: parametric studies
Performance analysis / benefits
Conclusions and future work
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
3. About InteliGrid project
www.InteliGrid.com
September 2004 – April 2007 (32 months)
Effort 360 person months
EU funding 2.100.000 € (STREP)
Partners 9 (5 industries) / 6 countries
Research/academic
organisations
Infrastructure software
providers
Vertical software
providers and ASPs
Industrial associations
Characteristic user
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
4. InteliGrid context
www.InteliGrid.com
European large scale
engineering industries
... huge number of
experts
... wide a range of
software/hardware
resources
... dynamic virtual
organization (VO)
... sharing information
InteliGrid is building
information
infrastructure
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
10. InteliGrid computing components
www.InteliGrid.com
InteliGrid portal (GridSphere)
Authorization service (GAS)
Broker service (Condor, GRMS, OpenDSP)
Other:
Document management integration
Ontology service integration
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
11. Available computer resources
www.InteliGrid.com
UNIX® servers are actually quot;servingquot;
something less than 10 percent of the time.
Most PCs do nothing for 95 percent of a
typical day.
Imagine ...
... an airline with 90 percent of its fleet on the ground
... an auto maker with 40 percent of its assembly
plants idle
... a hotel chain with 95 percent of its rooms
unoccupied
Source:
http://www-128.ibm.com/developerworks/grid/newto/index.html
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
12. Available computer resources
www.InteliGrid.com
Almost every organization is sitting atop
enormous unused computing capacity.
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
13. HPC vs HTC
www.InteliGrid.com
HPC – High Performance Computing
Floating point operations per second (FLOPS)
static environments (dedicated clusters)
single large scale problems (huge memory req., ...)
protocols: MPI, PVM, ...
HTC – High Throughput Computing
environment that can deliver large amounts of
processing capacity over long periods of time
dynamic environments (non-dedicated comp. resources)
parallel independent jobs, parametric studies, ...
solutions: Condor, Sun N1 Grid Engine, SETI@Home, ...
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
14. HTC DRM systems (a selection)
www.InteliGrid.com
Condor
http://www.cs.wisc.edu/condor
OS: Windows, Linux, Mac, ...
great support for dynamic environments, source
available
Sun Grid Engine
http://gridengine.sunsource.net
OS: Solaris, Linux, ...
open source
Xgrid
http://www.apple.com/acg/xgrid.html
OS: MacOS X
graphical user interface, easy configuration
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
15. Condor pool at UL FGG
www.InteliGrid.com
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
16. Parametric studies in
earthquake engineering
www.InteliGrid.com
Past/present
single limit state deterministic techniques
Future
multiple performance objectives
probabilities of different socio-economic decision
variables
decision variables relate performance of a structure to
decision making (involve: cost of repair, indirect cost
of down time, loss of lives, ...)
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
17. Case study: IDA Analysis
www.InteliGrid.com
IDA –
Incremental
Dynamic Analysis
... determining
the relation
between the
engineering
demand
parameter and
seismic intensity
measure.
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
18. IDA Analysis ...
www.InteliGrid.com
v DV w =∫∫ ∫ G DV ∣DM w∣ z ∣dG DM ∣EDP z∣ y ∥dG EDP∣IM y∣x ∥dλ IM x ∣dxdydz
zyx
More info:
D. Vamavatsikos and C.A. Cornell, Incremental Dynamic Analysis, Earthquake
Engineering and Structural Dynamics, 31(3), 491-514, 2002.
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
19. IDA analysis workflow
www.InteliGrid.com
Number of analyses
different structural models
(loss, capacity, demand,
seismic hazard)
several ground motion
records
multiple levels of intensity
IDA workflow
(1)numerical modelling
(2)selection of earthquakes
(3)job descriptions
(4)non-linear analysis
(5)results analysis
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
20. IDA analysis workflow
www.InteliGrid.com
Number of analyses
different structural models
(loss, capacity, demand,
seismic hazard)
several ground motion
records
multiple levels of intensity
IDA workflow
(1)numerical modelling
(2)selection of earthquakes
(3)job descriptions
(4)non-linear analysis
(5)results analysis
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
21. Performance analysis
www.InteliGrid.com
Number of analyses: 280
Average analysis time: ~13min
Number Analysis Speed-up
of comp. time [hours] factor
1 61.3 1
5 14.7 4.17
10 7.1 8.63
25 2.5 24.52
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
22. Performance analysis
www.InteliGrid.com
Number of analyses: 280
Average analysis time: ~13min
Number Analysis Speed-up
of comp. time [hours] factor
1 61.3 1
5 14.7 4.17
10 7.1 8.63
25 2.5 24.52
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
23. Conclusions
www.InteliGrid.com
InteliGrid platform
European large scale engineering industries
Dynamic virtual organizations
Product life-cycle management
DRM systems
HPC vs. HTC
Using available computer resources
Solutions: Condor, Sun N1 Grid Engine, ...
Benefits: near linear reduction of computing time (for
parametric studies)
Challenges: (1) submit machine must stay connected
during the execution, (2) bulk jobs, ...
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
24. Future work (1)
www.InteliGrid.com
Complete workflow
post IDA results analysis
automatic data selection
Generalize for any
parametric simulation
graphical user interface
release as open source
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform
25. Future work (2)
www.InteliGrid.com
Remote access
WS / DRMAA (OpenDSP DRMAA implementation)
enable discontinued use
EUROPEAN COMPUTING CONFERENCE, Vouliagmeni, Athens, GREECE, Sept2007 Parametric studies for the AEC domain using InteliGrid platform