SlideShare ist ein Scribd-Unternehmen logo
1 von 20
Downloaden Sie, um offline zu lesen
Aurora Tigon

Green, Dense, Standard HPC
G. Tecchiolli – CTO




Cineca, Bologna March, 30th 2013
Eurotech
HPC R&D and Operations



           USA                               J APAN




                                             INDIA

           USA            UK




           USA      F R AN C E   I TALY   SINGAPORE
AURORA TIGON
Unleash the hybrid power
From 1 node to large petascale systems

Node           Backplane       Chassis   Cooling




               System           Rack
The Aurora Tigon
Unleash the hybrid power
Key Features:
High Performance Density – 256 CPUs, 256
accelerators, up to 350 TFlops in just 1.5 m2

Energy efficiency– the Aurora direct cooling
target datacenter PUE of 1.05, no need for air
conditioning, up to 50% less energy

Programmability and compatibility – Based on
standard HPC cluster architecture. 100%
compatibility with existing applications.
Flexible Liquid Cooling– All components are
cooled by water, temperature from 18°C to 52°C
and variable flow rates
Reliability– 3 independent sensor networks,
soldered memory, no moving parts, uniform
cooling, quality controls
The Aurora Tigon node card
                    Cooling Plate


                   Infiniband QDR


                       3D Torus


                    2 x Nvidia K20




                   2 x Intel Xeon E5
                        sockets




                      Local Disk


                    Soldered RAM
The Setup


    Energy efficiency measurements according to the Green500 guidelines



•   All measurements made with a calibrated power meter with the
    system running HPL
     System                                 Eurora supercomputer: 64 nodes, 128 CPUs,
                                           128 GPUs

     Node Card                             Intel Xeon E5-2687W (150W)


     n.2 nVIDIA K20s, n.1 Infiniband QDR   NVIDIA® Tesla® K20
     Ambient Temperature                   20°C+/-1°C
     Coolant Temperature                   19°C+/-1°C
     Coolant                               water
     Flowrate                              120lph +/-7lph each EuroraBoard
HPL Benchmark Results

                          Performance Vs CPU Frequency                                                                                         Power Vs CPU Frequency
                                                                                                                               1000,0
                       1750
Performance (GFlops)




                       1700                                                                                                     800,0




                                                                                                                   Power (W)
                       1650                                                                                                     600,0
                       1600
                                                                                                                                400,0
                       1550
                       1500                                                                                                     200,0

                       1450                                                                                                       0,0
                              1,00   1,50   2,00                             2,50          3,00      3,50   4,00                        1,00     1,50   2,00        2,50         3,00   3,50   4,00
                                                   Frequenza (GHz)                                                                                             Frequenza (GHz)


                                                                                      Performance/Power Vs CPU Frequency
                                                                             3,50
                                                    Performance (GFlops/W)




                                                                             3,00
                                                                             2,50
                                                                             2,00

                        3.15 ± 0.12 !!                                       1,50
                                                                             1,00
                                                                             0,50
                                                                             0,00
                                                                                    1,00          1,50      2,00        2,50                    3,00     3,50           4,00
                                                                                                                   Frequenza (GHz)
Eurotech 30 01 2013
30% more efficient than #1 in Green 500
Final results

                 3150 MFlop/s per WATT

        1700 Sustained GFlop/s per node

 What does it mean?

 Each Eurora node (server) of the same size of a laptop is capable of
 performing 1.700.000.000.000 floating point operations per second, 30 times
 more than a desktop

 The Eurora system is currently the most energy-efficient standard x86-based
 system of the world with 3150 Mflop/s per WATT. This is 15 times more efficient
 than an average desktop computer
Tigon: an energy-aware design

•   GPUs
•   Optimized design:
     – No unused components
     – No fans
     – Soldered components
     – Dense architecture (with integrated interconnect)
•   Optimized power conversion chain
     – To enable system level energy efficiency
     – To enable data-center level energy efficiency
•   Liquid Cooling
     – To enable system level energy efficiency when cold water is used
     – To enable data-center level energy efficiency when hot water is
       used
“standard” power distribution conversion steps




                        Data from Intel
Moving towards DC reduces steps in power conversion




                           Data from Intel
Aurora power distribution




                                                      10 V
   230 V


                            48 Vdc
             Optional
             UPS




           97% efficiency            98% efficiency
Gain DC/DC conversion efficiency

•    In the DC/DC conversion a gain of over 2% in efficiency, from
     95,5 % to 98%




    Existing DC/DC conversion        New upgraded DC/DC conversion
Liquid cooling and efficiency at system level
178 nodes – AMD Opteron 6128HE CPUs (Magny Cours) - 16GB RAM Measuremets
   taken by LRZ
Why liquid cooling is better?
  • Heat capacity:

      •   Air:        1
      •   Water:     3500




  •   Control over coolant flow and heat exchange
  •   Control over temperature
Ways of cooling car engines




                              20
Free cooling and energy re-use




   PUE < 1 !!
11000 CO2 tons saved!




             1500 cars that do not circulate for 1 year
                        11500 saved trees
               15 Km2 of rain forest left untouched




“Green is the prime color of the world, and that from which
its loveliness arises”
                             Pedro Calderon de la Barca

Weitere ähnliche Inhalte

Was ist angesagt?

Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...Enkitec
 
Legend Power Technical Brochure
Legend Power Technical BrochureLegend Power Technical Brochure
Legend Power Technical BrochureLegend Power
 
Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)
Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)
Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)Tsuyoshi Horigome
 

Was ist angesagt? (9)

55506 vsp vs300_av_ccaj
55506 vsp vs300_av_ccaj55506 vsp vs300_av_ccaj
55506 vsp vs300_av_ccaj
 
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
 
54645 01 vsp_vs300_fh5_dcah
54645 01 vsp_vs300_fh5_dcah54645 01 vsp_vs300_fh5_dcah
54645 01 vsp_vs300_fh5_dcah
 
54647 01 vsp_vs300_fh4_dcaj
54647 01 vsp_vs300_fh4_dcaj54647 01 vsp_vs300_fh4_dcaj
54647 01 vsp_vs300_fh4_dcaj
 
EGNC105MK
EGNC105MKEGNC105MK
EGNC105MK
 
Legend Power Technical Brochure
Legend Power Technical BrochureLegend Power Technical Brochure
Legend Power Technical Brochure
 
Eaton Env
Eaton EnvEaton Env
Eaton Env
 
Es9300
Es9300Es9300
Es9300
 
Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)
Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)
Concept Kit 3-Phase AC Motor Drive Simulation (PSpice Version)
 

Ähnlich wie Eurotech 30 01 2013

Kollmorgen 6410 6415_stepper_drive_catalog
Kollmorgen 6410 6415_stepper_drive_catalogKollmorgen 6410 6415_stepper_drive_catalog
Kollmorgen 6410 6415_stepper_drive_catalogElectromate
 
Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019
Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019
Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019CTY TNHH HẠO PHƯƠNG
 
Fuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.org
Fuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.orgFuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.org
Fuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.orgDien Ha The
 
SELF DATASHEET
SELF DATASHEETSELF DATASHEET
SELF DATASHEETpwsarath
 
CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...
CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...
CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...CAST, Inc.
 
NF Corp Programmable AC/DC Power Source ec750 sa_1000sa
NF Corp Programmable AC/DC Power Source  ec750 sa_1000saNF Corp Programmable AC/DC Power Source  ec750 sa_1000sa
NF Corp Programmable AC/DC Power Source ec750 sa_1000saNIHON DENKEI SINGAPORE
 
Aruba 2530 Switch Series Data Sheet
Aruba 2530 Switch Series Data SheetAruba 2530 Switch Series Data Sheet
Aruba 2530 Switch Series Data Sheet美兰 曾
 
Sca1000 Fm A0%200 As
Sca1000 Fm A0%200 AsSca1000 Fm A0%200 As
Sca1000 Fm A0%200 Asguest987902e
 
Flowhub Bulletin
Flowhub BulletinFlowhub Bulletin
Flowhub Bulletinmgthomas
 
huawei-ce6855-48t6q-hi-brochure-datasheet.pdf
huawei-ce6855-48t6q-hi-brochure-datasheet.pdfhuawei-ce6855-48t6q-hi-brochure-datasheet.pdf
huawei-ce6855-48t6q-hi-brochure-datasheet.pdfHi-Network.com
 
Ic epower500 a_datasheet amp
Ic epower500 a_datasheet ampIc epower500 a_datasheet amp
Ic epower500 a_datasheet amphenry4141
 
Ic epower500 a_datasheet_2_2-1
Ic epower500 a_datasheet_2_2-1Ic epower500 a_datasheet_2_2-1
Ic epower500 a_datasheet_2_2-1henry4141
 
Automatic power factor controller by microcontroller
Automatic power factor controller by microcontrollerAutomatic power factor controller by microcontroller
Automatic power factor controller by microcontrollerSanket Shitole
 
Computer conversion s_synchro_amplifiers_specsheet
Computer conversion s_synchro_amplifiers_specsheetComputer conversion s_synchro_amplifiers_specsheet
Computer conversion s_synchro_amplifiers_specsheetElectromate
 

Ähnlich wie Eurotech 30 01 2013 (20)

Kollmorgen 6410 6415_stepper_drive_catalog
Kollmorgen 6410 6415_stepper_drive_catalogKollmorgen 6410 6415_stepper_drive_catalog
Kollmorgen 6410 6415_stepper_drive_catalog
 
Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019
Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019
Catalog biến tần Frenic Lift - Fuji Electric mới nhất 2019
 
Fuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.org
Fuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.orgFuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.org
Fuji tu dong hoa catalog inverter-frenic-lift-fuji-dienhathe.org
 
SELF DATASHEET
SELF DATASHEETSELF DATASHEET
SELF DATASHEET
 
Thor power, technical summary, 1210
Thor power, technical summary, 1210Thor power, technical summary, 1210
Thor power, technical summary, 1210
 
CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...
CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...
CPU Subsystem Total Power Consumption: Understanding the Factors and Selectin...
 
Ap psbias-1 p2-afr
Ap psbias-1 p2-afrAp psbias-1 p2-afr
Ap psbias-1 p2-afr
 
Ap psbias-1 p2-afr
Ap psbias-1 p2-afrAp psbias-1 p2-afr
Ap psbias-1 p2-afr
 
NF Corp Programmable AC/DC Power Source ec750 sa_1000sa
NF Corp Programmable AC/DC Power Source  ec750 sa_1000saNF Corp Programmable AC/DC Power Source  ec750 sa_1000sa
NF Corp Programmable AC/DC Power Source ec750 sa_1000sa
 
Aruba 2530 Switch Series Data Sheet
Aruba 2530 Switch Series Data SheetAruba 2530 Switch Series Data Sheet
Aruba 2530 Switch Series Data Sheet
 
Sca1000 Fm A0%200 As
Sca1000 Fm A0%200 AsSca1000 Fm A0%200 As
Sca1000 Fm A0%200 As
 
Flowhub Bulletin
Flowhub BulletinFlowhub Bulletin
Flowhub Bulletin
 
I/O Scalability in Xen
I/O Scalability in XenI/O Scalability in Xen
I/O Scalability in Xen
 
huawei-ce6855-48t6q-hi-brochure-datasheet.pdf
huawei-ce6855-48t6q-hi-brochure-datasheet.pdfhuawei-ce6855-48t6q-hi-brochure-datasheet.pdf
huawei-ce6855-48t6q-hi-brochure-datasheet.pdf
 
Ic epower500 a_datasheet amp
Ic epower500 a_datasheet ampIc epower500 a_datasheet amp
Ic epower500 a_datasheet amp
 
Ic epower500 a_datasheet_2_2-1
Ic epower500 a_datasheet_2_2-1Ic epower500 a_datasheet_2_2-1
Ic epower500 a_datasheet_2_2-1
 
Biến tần LS iG5 - Tài liệu biến tần LS iG5 (English manual, P.1)
Biến tần LS iG5 - Tài liệu biến tần LS iG5 (English manual, P.1)Biến tần LS iG5 - Tài liệu biến tần LS iG5 (English manual, P.1)
Biến tần LS iG5 - Tài liệu biến tần LS iG5 (English manual, P.1)
 
Biến tần ls i g5
Biến tần ls i g5Biến tần ls i g5
Biến tần ls i g5
 
Automatic power factor controller by microcontroller
Automatic power factor controller by microcontrollerAutomatic power factor controller by microcontroller
Automatic power factor controller by microcontroller
 
Computer conversion s_synchro_amplifiers_specsheet
Computer conversion s_synchro_amplifiers_specsheetComputer conversion s_synchro_amplifiers_specsheet
Computer conversion s_synchro_amplifiers_specsheet
 

Eurotech 30 01 2013

  • 1. Aurora Tigon Green, Dense, Standard HPC G. Tecchiolli – CTO Cineca, Bologna March, 30th 2013
  • 2. Eurotech HPC R&D and Operations USA J APAN INDIA USA UK USA F R AN C E I TALY SINGAPORE
  • 4. From 1 node to large petascale systems Node Backplane Chassis Cooling System Rack
  • 5. The Aurora Tigon Unleash the hybrid power Key Features: High Performance Density – 256 CPUs, 256 accelerators, up to 350 TFlops in just 1.5 m2 Energy efficiency– the Aurora direct cooling target datacenter PUE of 1.05, no need for air conditioning, up to 50% less energy Programmability and compatibility – Based on standard HPC cluster architecture. 100% compatibility with existing applications. Flexible Liquid Cooling– All components are cooled by water, temperature from 18°C to 52°C and variable flow rates Reliability– 3 independent sensor networks, soldered memory, no moving parts, uniform cooling, quality controls
  • 6. The Aurora Tigon node card Cooling Plate Infiniband QDR 3D Torus 2 x Nvidia K20 2 x Intel Xeon E5 sockets Local Disk Soldered RAM
  • 7. The Setup Energy efficiency measurements according to the Green500 guidelines • All measurements made with a calibrated power meter with the system running HPL System Eurora supercomputer: 64 nodes, 128 CPUs, 128 GPUs Node Card Intel Xeon E5-2687W (150W) n.2 nVIDIA K20s, n.1 Infiniband QDR NVIDIA® Tesla® K20 Ambient Temperature 20°C+/-1°C Coolant Temperature 19°C+/-1°C Coolant water Flowrate 120lph +/-7lph each EuroraBoard
  • 8. HPL Benchmark Results Performance Vs CPU Frequency Power Vs CPU Frequency 1000,0 1750 Performance (GFlops) 1700 800,0 Power (W) 1650 600,0 1600 400,0 1550 1500 200,0 1450 0,0 1,00 1,50 2,00 2,50 3,00 3,50 4,00 1,00 1,50 2,00 2,50 3,00 3,50 4,00 Frequenza (GHz) Frequenza (GHz) Performance/Power Vs CPU Frequency 3,50 Performance (GFlops/W) 3,00 2,50 2,00 3.15 ± 0.12 !! 1,50 1,00 0,50 0,00 1,00 1,50 2,00 2,50 3,00 3,50 4,00 Frequenza (GHz)
  • 10. 30% more efficient than #1 in Green 500 Final results 3150 MFlop/s per WATT 1700 Sustained GFlop/s per node What does it mean? Each Eurora node (server) of the same size of a laptop is capable of performing 1.700.000.000.000 floating point operations per second, 30 times more than a desktop The Eurora system is currently the most energy-efficient standard x86-based system of the world with 3150 Mflop/s per WATT. This is 15 times more efficient than an average desktop computer
  • 11. Tigon: an energy-aware design • GPUs • Optimized design: – No unused components – No fans – Soldered components – Dense architecture (with integrated interconnect) • Optimized power conversion chain – To enable system level energy efficiency – To enable data-center level energy efficiency • Liquid Cooling – To enable system level energy efficiency when cold water is used – To enable data-center level energy efficiency when hot water is used
  • 12. “standard” power distribution conversion steps Data from Intel
  • 13. Moving towards DC reduces steps in power conversion Data from Intel
  • 14. Aurora power distribution 10 V 230 V 48 Vdc Optional UPS 97% efficiency 98% efficiency
  • 15. Gain DC/DC conversion efficiency • In the DC/DC conversion a gain of over 2% in efficiency, from 95,5 % to 98% Existing DC/DC conversion New upgraded DC/DC conversion
  • 16. Liquid cooling and efficiency at system level 178 nodes – AMD Opteron 6128HE CPUs (Magny Cours) - 16GB RAM Measuremets taken by LRZ
  • 17. Why liquid cooling is better? • Heat capacity: • Air: 1 • Water: 3500 • Control over coolant flow and heat exchange • Control over temperature
  • 18. Ways of cooling car engines 20
  • 19. Free cooling and energy re-use PUE < 1 !!
  • 20. 11000 CO2 tons saved! 1500 cars that do not circulate for 1 year 11500 saved trees 15 Km2 of rain forest left untouched “Green is the prime color of the world, and that from which its loveliness arises” Pedro Calderon de la Barca