SlideShare a Scribd company logo
1 of 19
4th ILC Detector Workshop 2-4 December 2009 @ KEK, Tsukuba, Japan Day2: Software (15min) Updates related on Grid since last meeting in December 2008 http://kds.kek.jp/conferenceTimeTable.py?confId=3363 Service, resource, and recent achievements to utilize distributed computing infrastructures Go Iwai, KEK/CRC go.iwai@kek.jp Agenda of last meeting can be found at http://kds.kek.jp/conferenceTimeTable.py?confId=2260
Mt. Tsukuba (N) Central Tsukuba (S) KEK-2 KEK-1 Quoted from last meeting in December 2008 upgrade 2009 upgrade 2009 upgrade 2009 Belle Computing System (BCS) Storage Belle Computing System (BCS) CPU Super Computer System Central Information System (CIS) ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008
Major HEP projects: Belle, J-PARC, ATLAS	ongoing projects ILC, Belle2		future projects Also covering  Material science, bio-chemistry and so on using synchrotron light and neutron source Radiotherapy as technology transfer We have a role to support university groups in these fields. including Grid deployment/operation. Tohoku Univ. Nagoya Univ. Kobe Univ. KEK Hiroshima IT Univ. of Tsukuba Introduction Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 3 Hiroshima Univ. (Alice) U of Tokyo (Atlas)
KEK’s Contribution in EGEE-III TSA1.1: Grid Management Interoperability and collaboration TSA1.2: Grid operations and support  1st line support for operations problems Middleware deployment and support Coordination of middleware deployment and support for problems. Regional certification of middleware releases if needed (outside of PPS and SA3 involvement).  This is anticipated to be very rare and will require specific justification. Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 4
SINET Both for domestic & international institutes Logical Network ConnectionFocused ONLY on Grid Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 5 Univ. Grid Univ. Grid Facility Site Univ. Grid Univ. Grid Service Univ. Grid Univ. Grid VO-Central Service Generic Service at Grid Level Upgraded VOMS VOMRS Upgraded Retired CA KEK-1 gLite KEK-2 gLite VOMS Computing Facility for Belle Exp. LFC SRB SRB-DSI CD-1 NAREGI MCAT HSM CD-2 NAREGI DMZ Intranet GRID-LAN CC-GRID VO-Specific Service
Recent Changes in VOMS VOMS.kek.jp has been shutdown on 2nd Oct 2009, end of validity of its host certificate. Migrated to voms.cc.kek.jp Validity of proxy cert is extended 7days, i.e. 168hours MyProxy does not work properly without special settings User enrollment https://vomrs.cc.kek.jp:8443/vo/voname/vomrs Should be kept up to date on CIC portal https://cic.gridops.org/index.php?section=vo&vo=voname Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 6 People in ILC are not affected by this change! VOMS VOMRS voms.kek.jp VOMS voms.cc.kek.jp DMZ GRID-LAN
Recent Change in KEK-1 CE/RB based on gLite-3.0/SL3X has been decommissioned in Oct 2009. Still not yet deployed news Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 7 KEK-1 gLite KEK-2 gLite No CE can be found at GStat http://gstat.gridops.org/gstat/JP-KEK-CRC-01/
Resource Scale (KEK-2) Storage service (DPM) ~10TB with HPSS as backend storage ~30,000 JPY/TB Except for HSM through SRB-DSI Not published information by Glue Computing service System A: As a part of Central Information System (CIS) System B: Recycle-use of old blades in Belle Computing System (BCS) Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 8 VOMS VOMRS Computing Facility for Belle Exp. SRB KEK-2 gLite LFC MCAT HSM System B System A Reuse of old resources Upgraded in March Computational specification of system A & B as of Oct 2009
Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 9 Recent WorksIntegration of BCS and CIS Computing Facility for Belle Exp. SRB MCAT HSM MT Ops Room @ South Bldg. of CRC 10G x 2 1st Machine Room @ North Bldg. of CRC (1) Done: BW expansion is Oct 2009 (2) In deploying SRM-SRB 1Gx12 Done Pend. Pend. CE CE Done CE CE SRB-DSI (GridFTP) (3) Done half, pending others SRB HSM KEK-2 gLite Existing computing resource 192 nodes ~ 1,536 cores ~ 4.6 MSI2K
Snapshot Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 10 http://gstat.gridops.org/gstat/JP-KEK-CRC-02/ 4 CEs will be available step-by-step System B (Old blades in BCS) are once again re-used for NAREGI First half of 4 CEs are now available Second half is depend on works in Belle/Belle2 In Dec 2009 In Mar 2010? System B: down in Dec 2009 System A
252 MSI2K as of Oct 2009 Resource Scale – LCG Infrastructure Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 11 http://gridmap.cern.ch KEK 1MSI2K
252 MSI2K as of Oct 2009 Dec 2009 (Now) Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 12 KEK 2.8MSI2K
252 MSI2K as of Oct 2009 Mar 2010 Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 13 KEK 5.0MSI2K Half of Asia-Pacific & regional largest center
Summary Table of Resource Scale Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 14 Sorry for confusion! A bit revised: “System C is now available and D will be in operation in Next March” is incorrect. It should be corrected that “Half of both System C and System D is now available and another half will be in operation in Next March”. Up Down Legend
Upcoming Storage Service To expose HSM to Grid SRB-DSI to bridge SRB inside BCS Just for GridFTP access, not for SRM and LFC To enable access with logical file name, e.g. lcg-xxx lfn://logical-file-name  SRM-SRB for Site URL, e.g. srm://srm.kek.jp/ SRB-DSI for Transfer URL, e.g. gridftp://disk.kek.jp/ A bit behind of schedule Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 15
Ops stats @ KEK in recent 6 months More than 1K jobs have been processed forILC ~10% of CPU time ILC is the heaviest consumer! Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 16 1,439 of 34,462
Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 17 1,207 of 1,285 GB Read 2,837 of 3,830 GB Write
Summary of Updates on Grid Resource upgrade +2.5MSI2K in Dec 2009 +2.5MSI2K in Mar 2010 (tentative) Storage service In operation early next year hopefully Ops Stats Storage: Read: 1,204 GB in 6 month Write: 2,837 GB in 6 month CPU: 1K jobs (~10% of CPU time) are submitted (Many) pending works FTS Common requirement KEK-1 re-construction Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 18 ILC is the heaviest consumer in previous 6 months at KEK!
Many Thanks for Your Attention! Go Iwai, KEK/CRC go.iwai@kek.jp

More Related Content

What's hot

RVC: A Multi-Decoder CAL Composer Tool
RVC: A Multi-Decoder CAL Composer ToolRVC: A Multi-Decoder CAL Composer Tool
RVC: A Multi-Decoder CAL Composer ToolMDC_UNICA
 
Targeting GPUs using OpenMP Directives on Summit with GenASiS: A Simple and...
Targeting GPUs using OpenMP  Directives on Summit with  GenASiS: A Simple and...Targeting GPUs using OpenMP  Directives on Summit with  GenASiS: A Simple and...
Targeting GPUs using OpenMP Directives on Summit with GenASiS: A Simple and...Ganesan Narayanasamy
 
Building a Better JVM
Building a Better JVMBuilding a Better JVM
Building a Better JVMSimon Ritter
 
Altitude SF 2017: Building the edge
Altitude SF 2017: Building the edgeAltitude SF 2017: Building the edge
Altitude SF 2017: Building the edgeFastly
 
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facilityinside-BigData.com
 
Handling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud ComputingHandling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud ComputingAbhishek Dey
 
Atualização Deployment - Hardware e Middleware - Rogério Iope
Atualização Deployment - Hardware e Middleware - Rogério IopeAtualização Deployment - Hardware e Middleware - Rogério Iope
Atualização Deployment - Hardware e Middleware - Rogério IopeNúcleo de Computação Científica
 
EFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGA
EFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGAEFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGA
EFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGAVLSICS Design
 
Best Practices: Large Scale Multiphysics
Best Practices: Large Scale MultiphysicsBest Practices: Large Scale Multiphysics
Best Practices: Large Scale Multiphysicsinside-BigData.com
 
Lightweight DNN Processor Design (based on NVDLA)
Lightweight DNN Processor Design (based on NVDLA)Lightweight DNN Processor Design (based on NVDLA)
Lightweight DNN Processor Design (based on NVDLA)Shien-Chun Luo
 
DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...
DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...
DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...NECST Lab @ Politecnico di Milano
 
Designing HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale SystemsDesigning HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale Systemsinside-BigData.com
 
Benchmark Analysis of Multi-core Processor Memory Contention April 2009
Benchmark Analysis of Multi-core Processor Memory Contention April 2009Benchmark Analysis of Multi-core Processor Memory Contention April 2009
Benchmark Analysis of Multi-core Processor Memory Contention April 2009James McGalliard
 
WMTS Performance Tests
WMTS Performance TestsWMTS Performance Tests
WMTS Performance TestsRoope Tervo
 

What's hot (20)

RVC: A Multi-Decoder CAL Composer Tool
RVC: A Multi-Decoder CAL Composer ToolRVC: A Multi-Decoder CAL Composer Tool
RVC: A Multi-Decoder CAL Composer Tool
 
Targeting GPUs using OpenMP Directives on Summit with GenASiS: A Simple and...
Targeting GPUs using OpenMP  Directives on Summit with  GenASiS: A Simple and...Targeting GPUs using OpenMP  Directives on Summit with  GenASiS: A Simple and...
Targeting GPUs using OpenMP Directives on Summit with GenASiS: A Simple and...
 
Building a Better JVM
Building a Better JVMBuilding a Better JVM
Building a Better JVM
 
Altitude SF 2017: Building the edge
Altitude SF 2017: Building the edgeAltitude SF 2017: Building the edge
Altitude SF 2017: Building the edge
 
Introduction to DPDK RIB library
Introduction to DPDK RIB libraryIntroduction to DPDK RIB library
Introduction to DPDK RIB library
 
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
40 Powers of 10 - Simulating the Universe with the DiRAC HPC Facility
 
Handling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud ComputingHandling High Energy Physics Data using Cloud Computing
Handling High Energy Physics Data using Cloud Computing
 
Atualização Deployment - Hardware e Middleware - Rogério Iope
Atualização Deployment - Hardware e Middleware - Rogério IopeAtualização Deployment - Hardware e Middleware - Rogério Iope
Atualização Deployment - Hardware e Middleware - Rogério Iope
 
Exploiting GPUs in Spark
Exploiting GPUs in SparkExploiting GPUs in Spark
Exploiting GPUs in Spark
 
Overview of HPC Interconnects
Overview of HPC InterconnectsOverview of HPC Interconnects
Overview of HPC Interconnects
 
EFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGA
EFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGAEFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGA
EFFICIENT ABSOLUTE DIFFERENCE CIRCUIT FOR SAD COMPUTATION ON FPGA
 
Best Practices: Large Scale Multiphysics
Best Practices: Large Scale MultiphysicsBest Practices: Large Scale Multiphysics
Best Practices: Large Scale Multiphysics
 
HDF Kita Lab: JupyterLab + HDF Service
HDF Kita Lab: JupyterLab + HDF ServiceHDF Kita Lab: JupyterLab + HDF Service
HDF Kita Lab: JupyterLab + HDF Service
 
Lightweight DNN Processor Design (based on NVDLA)
Lightweight DNN Processor Design (based on NVDLA)Lightweight DNN Processor Design (based on NVDLA)
Lightweight DNN Processor Design (based on NVDLA)
 
DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...
DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...
DEEP-mon: Dynamic and Energy Efficient Power monitoring for container-based i...
 
Designing HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale SystemsDesigning HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale Systems
 
Optimizing Flash at Scale
Optimizing Flash at ScaleOptimizing Flash at Scale
Optimizing Flash at Scale
 
ENVI/IDL Tools for HDF
ENVI/IDL Tools for HDFENVI/IDL Tools for HDF
ENVI/IDL Tools for HDF
 
Benchmark Analysis of Multi-core Processor Memory Contention April 2009
Benchmark Analysis of Multi-core Processor Memory Contention April 2009Benchmark Analysis of Multi-core Processor Memory Contention April 2009
Benchmark Analysis of Multi-core Processor Memory Contention April 2009
 
WMTS Performance Tests
WMTS Performance TestsWMTS Performance Tests
WMTS Performance Tests
 

Viewers also liked

Alice05
Alice05Alice05
Alice05h2vs10
 
Alice01
Alice01Alice01
Alice01h2vs10
 
Case report: White matter disease vs. Meningitis
Case report: White matter disease vs. MeningitisCase report: White matter disease vs. Meningitis
Case report: White matter disease vs. MeningitisJO de la Cruz
 

Viewers also liked (7)

adidas f50
adidas f50adidas f50
adidas f50
 
Alice05
Alice05Alice05
Alice05
 
Bai5
Bai5Bai5
Bai5
 
Alice01
Alice01Alice01
Alice01
 
Case report: White matter disease vs. Meningitis
Case report: White matter disease vs. MeningitisCase report: White matter disease vs. Meningitis
Case report: White matter disease vs. Meningitis
 
Neonatal Pneumonia
Neonatal PneumoniaNeonatal Pneumonia
Neonatal Pneumonia
 
Approach to Anemia
Approach to Anemia Approach to Anemia
Approach to Anemia
 

Similar to Updates related on Grid since last meeting in December 2008: Service, resource, and recent achievements to utilize distributed computing infrastructures

Bruno Decraene - Improving network availability through the graceful shutdown...
Bruno Decraene - Improving network availability through the graceful shutdown...Bruno Decraene - Improving network availability through the graceful shutdown...
Bruno Decraene - Improving network availability through the graceful shutdown...PROIDEA
 
6.3 DatacenterService Laporan Juni .pptx
6.3 DatacenterService Laporan Juni .pptx6.3 DatacenterService Laporan Juni .pptx
6.3 DatacenterService Laporan Juni .pptxAndreWirawan14
 
Hlb private cloud rules of engagement idc
Hlb private cloud rules of engagement   idcHlb private cloud rules of engagement   idc
Hlb private cloud rules of engagement idcYew Jin Kang
 
Impact on Society – the Light at the end of the Tunnel
Impact on Society – the Light at the end of the TunnelImpact on Society – the Light at the end of the Tunnel
Impact on Society – the Light at the end of the TunnelTal Lavian Ph.D.
 
Advances in EM Simulations
Advances in EM SimulationsAdvances in EM Simulations
Advances in EM SimulationsAltair
 
OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...
OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...
OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...OpenNebula Project
 
Enabling Scientific Workflows on FermiCloud using OpenNebula
Enabling Scientific Workflows on FermiCloud using OpenNebulaEnabling Scientific Workflows on FermiCloud using OpenNebula
Enabling Scientific Workflows on FermiCloud using OpenNebulaNETWAYS
 
ODSA PoC Physical Design Elements
ODSA PoC Physical Design ElementsODSA PoC Physical Design Elements
ODSA PoC Physical Design Elementsjennimenni
 
ODSA - PoC Physical Design Elements
ODSA - PoC Physical Design ElementsODSA - PoC Physical Design Elements
ODSA - PoC Physical Design ElementsODSA Workgroup
 
CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011
CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011
CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011Andrea PETRUCCI
 
Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)Jisc
 
NGD Systems and Microsoft Keynote Presentation at IPDPS MPP in Vacouver
NGD Systems and Microsoft Keynote Presentation at IPDPS MPP in VacouverNGD Systems and Microsoft Keynote Presentation at IPDPS MPP in Vacouver
NGD Systems and Microsoft Keynote Presentation at IPDPS MPP in VacouverScott Shadley, MBA,PMC-III
 
Playing BBR with a userspace network stack
Playing BBR with a userspace network stackPlaying BBR with a userspace network stack
Playing BBR with a userspace network stackHajime Tazaki
 
Ethernet summit 2011_toe
Ethernet summit 2011_toeEthernet summit 2011_toe
Ethernet summit 2011_toeintilop
 
QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)
QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)
QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)Heiko Joerg Schick
 
20190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v100
20190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v10020190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v100
20190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v100M3L Inc.
 
How to Upgrade Major Version of Your Production PostgreSQL
How to Upgrade Major Version of Your Production PostgreSQLHow to Upgrade Major Version of Your Production PostgreSQL
How to Upgrade Major Version of Your Production PostgreSQLKeisuke Suzuki
 
CPO Bovington Seminar Jhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjk
CPO Bovington Seminar JhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjkCPO Bovington Seminar Jhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjk
CPO Bovington Seminar Jhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjkssuser504946
 
Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...
Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...
Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...IRJET Journal
 
Data Plane Evolution: Towards Openness and Flexibility
Data Plane Evolution: Towards Openness and FlexibilityData Plane Evolution: Towards Openness and Flexibility
Data Plane Evolution: Towards Openness and FlexibilityAPNIC
 

Similar to Updates related on Grid since last meeting in December 2008: Service, resource, and recent achievements to utilize distributed computing infrastructures (20)

Bruno Decraene - Improving network availability through the graceful shutdown...
Bruno Decraene - Improving network availability through the graceful shutdown...Bruno Decraene - Improving network availability through the graceful shutdown...
Bruno Decraene - Improving network availability through the graceful shutdown...
 
6.3 DatacenterService Laporan Juni .pptx
6.3 DatacenterService Laporan Juni .pptx6.3 DatacenterService Laporan Juni .pptx
6.3 DatacenterService Laporan Juni .pptx
 
Hlb private cloud rules of engagement idc
Hlb private cloud rules of engagement   idcHlb private cloud rules of engagement   idc
Hlb private cloud rules of engagement idc
 
Impact on Society – the Light at the end of the Tunnel
Impact on Society – the Light at the end of the TunnelImpact on Society – the Light at the end of the Tunnel
Impact on Society – the Light at the end of the Tunnel
 
Advances in EM Simulations
Advances in EM SimulationsAdvances in EM Simulations
Advances in EM Simulations
 
OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...
OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...
OpenNebulaConf 2013 - Keynote: Enabling Scientific Workflows on FermiCloud us...
 
Enabling Scientific Workflows on FermiCloud using OpenNebula
Enabling Scientific Workflows on FermiCloud using OpenNebulaEnabling Scientific Workflows on FermiCloud using OpenNebula
Enabling Scientific Workflows on FermiCloud using OpenNebula
 
ODSA PoC Physical Design Elements
ODSA PoC Physical Design ElementsODSA PoC Physical Design Elements
ODSA PoC Physical Design Elements
 
ODSA - PoC Physical Design Elements
ODSA - PoC Physical Design ElementsODSA - PoC Physical Design Elements
ODSA - PoC Physical Design Elements
 
CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011
CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011
CHEP2012_Upgrade_CMS_Event_Builder_AP_21052011
 
Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)
 
NGD Systems and Microsoft Keynote Presentation at IPDPS MPP in Vacouver
NGD Systems and Microsoft Keynote Presentation at IPDPS MPP in VacouverNGD Systems and Microsoft Keynote Presentation at IPDPS MPP in Vacouver
NGD Systems and Microsoft Keynote Presentation at IPDPS MPP in Vacouver
 
Playing BBR with a userspace network stack
Playing BBR with a userspace network stackPlaying BBR with a userspace network stack
Playing BBR with a userspace network stack
 
Ethernet summit 2011_toe
Ethernet summit 2011_toeEthernet summit 2011_toe
Ethernet summit 2011_toe
 
QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)
QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)
QPACE - QCD Parallel Computing on the Cell Broadband Engine™ (Cell/B.E.)
 
20190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v100
20190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v10020190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v100
20190409 ip showcase-nab19_m3_l-currentstatus-st2110-over-25gbe_v100
 
How to Upgrade Major Version of Your Production PostgreSQL
How to Upgrade Major Version of Your Production PostgreSQLHow to Upgrade Major Version of Your Production PostgreSQL
How to Upgrade Major Version of Your Production PostgreSQL
 
CPO Bovington Seminar Jhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjk
CPO Bovington Seminar JhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjkCPO Bovington Seminar Jhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjk
CPO Bovington Seminar Jhjasfhjsfajskfsjakfhasjkfhsajkfdhsadfljkshafjk
 
Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...
Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...
Performance Evaluation of FPGA Based Runtime Dynamic Partial Reconfiguration ...
 
Data Plane Evolution: Towards Openness and Flexibility
Data Plane Evolution: Towards Openness and FlexibilityData Plane Evolution: Towards Openness and Flexibility
Data Plane Evolution: Towards Openness and Flexibility
 

Recently uploaded

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 

Recently uploaded (20)

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 

Updates related on Grid since last meeting in December 2008: Service, resource, and recent achievements to utilize distributed computing infrastructures

  • 1. 4th ILC Detector Workshop 2-4 December 2009 @ KEK, Tsukuba, Japan Day2: Software (15min) Updates related on Grid since last meeting in December 2008 http://kds.kek.jp/conferenceTimeTable.py?confId=3363 Service, resource, and recent achievements to utilize distributed computing infrastructures Go Iwai, KEK/CRC go.iwai@kek.jp Agenda of last meeting can be found at http://kds.kek.jp/conferenceTimeTable.py?confId=2260
  • 2. Mt. Tsukuba (N) Central Tsukuba (S) KEK-2 KEK-1 Quoted from last meeting in December 2008 upgrade 2009 upgrade 2009 upgrade 2009 Belle Computing System (BCS) Storage Belle Computing System (BCS) CPU Super Computer System Central Information System (CIS) ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008
  • 3. Major HEP projects: Belle, J-PARC, ATLAS ongoing projects ILC, Belle2 future projects Also covering Material science, bio-chemistry and so on using synchrotron light and neutron source Radiotherapy as technology transfer We have a role to support university groups in these fields. including Grid deployment/operation. Tohoku Univ. Nagoya Univ. Kobe Univ. KEK Hiroshima IT Univ. of Tsukuba Introduction Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 3 Hiroshima Univ. (Alice) U of Tokyo (Atlas)
  • 4. KEK’s Contribution in EGEE-III TSA1.1: Grid Management Interoperability and collaboration TSA1.2: Grid operations and support 1st line support for operations problems Middleware deployment and support Coordination of middleware deployment and support for problems. Regional certification of middleware releases if needed (outside of PPS and SA3 involvement). This is anticipated to be very rare and will require specific justification. Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 4
  • 5. SINET Both for domestic & international institutes Logical Network ConnectionFocused ONLY on Grid Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 5 Univ. Grid Univ. Grid Facility Site Univ. Grid Univ. Grid Service Univ. Grid Univ. Grid VO-Central Service Generic Service at Grid Level Upgraded VOMS VOMRS Upgraded Retired CA KEK-1 gLite KEK-2 gLite VOMS Computing Facility for Belle Exp. LFC SRB SRB-DSI CD-1 NAREGI MCAT HSM CD-2 NAREGI DMZ Intranet GRID-LAN CC-GRID VO-Specific Service
  • 6. Recent Changes in VOMS VOMS.kek.jp has been shutdown on 2nd Oct 2009, end of validity of its host certificate. Migrated to voms.cc.kek.jp Validity of proxy cert is extended 7days, i.e. 168hours MyProxy does not work properly without special settings User enrollment https://vomrs.cc.kek.jp:8443/vo/voname/vomrs Should be kept up to date on CIC portal https://cic.gridops.org/index.php?section=vo&vo=voname Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 6 People in ILC are not affected by this change! VOMS VOMRS voms.kek.jp VOMS voms.cc.kek.jp DMZ GRID-LAN
  • 7. Recent Change in KEK-1 CE/RB based on gLite-3.0/SL3X has been decommissioned in Oct 2009. Still not yet deployed news Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 7 KEK-1 gLite KEK-2 gLite No CE can be found at GStat http://gstat.gridops.org/gstat/JP-KEK-CRC-01/
  • 8. Resource Scale (KEK-2) Storage service (DPM) ~10TB with HPSS as backend storage ~30,000 JPY/TB Except for HSM through SRB-DSI Not published information by Glue Computing service System A: As a part of Central Information System (CIS) System B: Recycle-use of old blades in Belle Computing System (BCS) Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 8 VOMS VOMRS Computing Facility for Belle Exp. SRB KEK-2 gLite LFC MCAT HSM System B System A Reuse of old resources Upgraded in March Computational specification of system A & B as of Oct 2009
  • 9. Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 9 Recent WorksIntegration of BCS and CIS Computing Facility for Belle Exp. SRB MCAT HSM MT Ops Room @ South Bldg. of CRC 10G x 2 1st Machine Room @ North Bldg. of CRC (1) Done: BW expansion is Oct 2009 (2) In deploying SRM-SRB 1Gx12 Done Pend. Pend. CE CE Done CE CE SRB-DSI (GridFTP) (3) Done half, pending others SRB HSM KEK-2 gLite Existing computing resource 192 nodes ~ 1,536 cores ~ 4.6 MSI2K
  • 10. Snapshot Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 10 http://gstat.gridops.org/gstat/JP-KEK-CRC-02/ 4 CEs will be available step-by-step System B (Old blades in BCS) are once again re-used for NAREGI First half of 4 CEs are now available Second half is depend on works in Belle/Belle2 In Dec 2009 In Mar 2010? System B: down in Dec 2009 System A
  • 11. 252 MSI2K as of Oct 2009 Resource Scale – LCG Infrastructure Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 11 http://gridmap.cern.ch KEK 1MSI2K
  • 12. 252 MSI2K as of Oct 2009 Dec 2009 (Now) Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 12 KEK 2.8MSI2K
  • 13. 252 MSI2K as of Oct 2009 Mar 2010 Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 13 KEK 5.0MSI2K Half of Asia-Pacific & regional largest center
  • 14. Summary Table of Resource Scale Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 14 Sorry for confusion! A bit revised: “System C is now available and D will be in operation in Next March” is incorrect. It should be corrected that “Half of both System C and System D is now available and another half will be in operation in Next March”. Up Down Legend
  • 15. Upcoming Storage Service To expose HSM to Grid SRB-DSI to bridge SRB inside BCS Just for GridFTP access, not for SRM and LFC To enable access with logical file name, e.g. lcg-xxx lfn://logical-file-name SRM-SRB for Site URL, e.g. srm://srm.kek.jp/ SRB-DSI for Transfer URL, e.g. gridftp://disk.kek.jp/ A bit behind of schedule Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 15
  • 16. Ops stats @ KEK in recent 6 months More than 1K jobs have been processed forILC ~10% of CPU time ILC is the heaviest consumer! Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 16 1,439 of 34,462
  • 17. Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 17 1,207 of 1,285 GB Read 2,837 of 3,830 GB Write
  • 18. Summary of Updates on Grid Resource upgrade +2.5MSI2K in Dec 2009 +2.5MSI2K in Mar 2010 (tentative) Storage service In operation early next year hopefully Ops Stats Storage: Read: 1,204 GB in 6 month Write: 2,837 GB in 6 month CPU: 1K jobs (~10% of CPU time) are submitted (Many) pending works FTS Common requirement KEK-1 re-construction Dec 3, 2009 ILC Detector Workshop -- Updates related on Grid since last meeting in December 2008 18 ILC is the heaviest consumer in previous 6 months at KEK!
  • 19. Many Thanks for Your Attention! Go Iwai, KEK/CRC go.iwai@kek.jp