SlideShare a Scribd company logo
1 of 12
Download to read offline
Sun Grid Engine at Synopsys
 Bogdan Vasiliu - Staff Engineer
         Sun Microsystems

       Joe Fu – IT Manager
              Synopsys

  Sun Grid Engine Workshop 2007,
      Regensburg, Germany
      September 10-12, 2007

   1          Sun Grid Engine at Synopsys   Predictable Success
Overview

   About Synopsys
   Grid Software at Synopsys
   SGE at Synopsys
       Compute Farms & SGE configuration
       R&D tools
   Benefits
   Wish list
   Future Plans



             2           Sun Grid Engine at Synopsys   Predictable Success
About Synopsys

   Applications
       Electronic Design Automation (EDA)
            Target markets: Semiconductor design and
             manufacturing
   Business Objective
       Market leader for EDA solutions that speed
        Advanced Integrated Circuits into volume
        production
   Industry Ranking & Revenues
       1.2B FY 2006
       Top three (Synopsys,Cadence, Mentor G.,)
            75% of total EDA s/w sales worldwide

                3              Sun Grid Engine at Synopsys   Predictable Success
Grid Software at Synopsys

 IT supports both SGE and LSF
 70% SGE machines, 30% LSF
 SGE grew from multiple R&D engineering
  groups adoption
 SGE cost advantage - free, time unlimited
  downloads




         4           Sun Grid Engine at Synopsys   Predictable Success
SGE at Synopsys

   Current version 6.1
       Upgrades from Codine to SGE 5.3 and to SGE 6.0
   Compute Farms
       40 + SGE farms worldwide
            Individual farm size: 50 to 2000 socket-cpus
            Over 7000 socket-cpus total
       Regressions, builds, benchmarks, real customer
        designs
       Hardware supported
            Intel (32/64) Itanium, AMD64, SPARC, Power, HP/PA
       Operating systems supported:
            Linux (RedHat & SuSE) (32 bit & 64 bit), HPUX, Solaris
             (x86 & SPARC), AIX, Windows
                5                Sun Grid Engine at Synopsys   Predictable Success
Mountain View Farm

   Mountain View, CA main farm
       1000 machines
       Contributed by multiple business groups
            70% - 80% batch jobs
   Additional 6 farms dedicated to individual
    groups
            300-400 machines
            R&D




                6               Sun Grid Engine at Synopsys   Predictable Success
SGE environment

   SGE's dynamic configuration
        “qconf” commands, fast and transparent
   In house scripts built around SGE
   Wrapper scripts around “qconf”
   Daily priorities changes
        users send requests through a support system.
   In house process to allow high priority jobs
        re-set priorities on projects
   Use the user list/access control
   Use resource quota control to guarantee turn
    around time for regressions


             7                 Sun Grid Engine at Synopsys   Predictable Success
SGE and Synopsys' products

   All products work with SGE in batch and
    interactive modes

   Multiple Synopsys products have adopted the
    MPI capability with SGE and more are on the
    way




           8           Sun Grid Engine at Synopsys   Predictable Success
Benefits

   Easy to manage
       IT is able to automate 90% SGE administration
        tasks
 Dynamic configuration enables zero
  interruption to production environment
 Scalable
 Lower cost




             9             Sun Grid Engine at Synopsys   Predictable Success
Wish list 1

   Provide Split Fairshare in addition to Global
    Fairshare

   Resource Quota improved documentation

   Future Advance Reservation feature to allow
    sysadmin to decide what to do with the job if
    exceeds the window reserved

   Support EM64T Natively (not AMD64 Port) for
    path/logistics/CPU Type reasons
           10           Sun Grid Engine at Synopsys   Predictable Success
Wish list 2
   Improve real time monitoring and management of the
    farms
       Access Monitoring (direct login to SGE machines)
       Health monitor at h/w level
       Detailed job real time reporting
       Include OS and software provisioning features
       Job profile monitoring – idle/ Length
   Consistent “arch” definition
   Improve SGE Windows support
       SFU no longer supported
   ARCO too complex to use now/without a lot of useful
    features
      Apache support

   Match LSF RFE and Support call fast response time

              11              Sun Grid Engine at Synopsys   Predictable Success
Future Plans

 To migrate to 6.2 and beyond
 Continue to grow the farm size to
  accommodate more R&D needs
 Continue to help more Synopsys products
  adopt SGE




         12         Sun Grid Engine at Synopsys   Predictable Success

More Related Content

Similar to Sun Grid Engine at Synopsys

Sun Grid Engine at Cadence
Sun Grid Engine at CadenceSun Grid Engine at Cadence
Sun Grid Engine at Cadence
bogdanv
 
SGI HPC Systems Help Fuel Manufacturing Rebirth 2015
SGI HPC Systems Help Fuel Manufacturing Rebirth 2015SGI HPC Systems Help Fuel Manufacturing Rebirth 2015
SGI HPC Systems Help Fuel Manufacturing Rebirth 2015
Josh Goergen
 
Ibm symp14 referentin_barbara koch_power_8 launch bk
Ibm symp14 referentin_barbara koch_power_8 launch bkIbm symp14 referentin_barbara koch_power_8 launch bk
Ibm symp14 referentin_barbara koch_power_8 launch bk
IBM Switzerland
 
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & WieckIBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM Events
 

Similar to Sun Grid Engine at Synopsys (20)

Sun Grid Engine at Cadence
Sun Grid Engine at CadenceSun Grid Engine at Cadence
Sun Grid Engine at Cadence
 
SGI HPC Systems Help Fuel Manufacturing Rebirth 2015
SGI HPC Systems Help Fuel Manufacturing Rebirth 2015SGI HPC Systems Help Fuel Manufacturing Rebirth 2015
SGI HPC Systems Help Fuel Manufacturing Rebirth 2015
 
Ibm symp14 referentin_barbara koch_power_8 launch bk
Ibm symp14 referentin_barbara koch_power_8 launch bkIbm symp14 referentin_barbara koch_power_8 launch bk
Ibm symp14 referentin_barbara koch_power_8 launch bk
 
Open Source Software for Industry 4.0
Open Source Software for Industry 4.0Open Source Software for Industry 4.0
Open Source Software for Industry 4.0
 
Dell NVIDIA AI Powered Transformation Webinar
Dell NVIDIA AI Powered Transformation WebinarDell NVIDIA AI Powered Transformation Webinar
Dell NVIDIA AI Powered Transformation Webinar
 
Geode Meetup Apachecon
Geode Meetup ApacheconGeode Meetup Apachecon
Geode Meetup Apachecon
 
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & WieckIBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
IBM InterConnect 2013 Expert Integrated Systems Keynote: Sotiropoulos & Wieck
 
IBM Power8 announce
IBM Power8 announceIBM Power8 announce
IBM Power8 announce
 
IBM Power leading Cognitive Systems
IBM Power leading Cognitive SystemsIBM Power leading Cognitive Systems
IBM Power leading Cognitive Systems
 
Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters
 
SUPERMICRO Innovative Computing Architecture
SUPERMICRO Innovative Computing ArchitectureSUPERMICRO Innovative Computing Architecture
SUPERMICRO Innovative Computing Architecture
 
Introducing Apache Geode and Spring Data GemFire
Introducing Apache Geode and Spring Data GemFireIntroducing Apache Geode and Spring Data GemFire
Introducing Apache Geode and Spring Data GemFire
 
Peek into Neo4j Product Strategy and Roadmap
Peek into Neo4j Product Strategy and RoadmapPeek into Neo4j Product Strategy and Roadmap
Peek into Neo4j Product Strategy and Roadmap
 
Webinar: Cutting Time, Complexity and Cost from Data Science to Production
Webinar: Cutting Time, Complexity and Cost from Data Science to ProductionWebinar: Cutting Time, Complexity and Cost from Data Science to Production
Webinar: Cutting Time, Complexity and Cost from Data Science to Production
 
Advantages of SUSE Linux Over Windows
Advantages of SUSE Linux Over WindowsAdvantages of SUSE Linux Over Windows
Advantages of SUSE Linux Over Windows
 
IBM Power Systems Update 1Q17
IBM Power Systems Update 1Q17IBM Power Systems Update 1Q17
IBM Power Systems Update 1Q17
 
Innovation with ai at scale on the edge vt sept 2019 v0
Innovation with ai at scale  on the edge vt sept 2019 v0Innovation with ai at scale  on the edge vt sept 2019 v0
Innovation with ai at scale on the edge vt sept 2019 v0
 
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU ServerModular by Design: Supermicro’s New Standards-Based Universal GPU Server
Modular by Design: Supermicro’s New Standards-Based Universal GPU Server
 
IBM: The Linux Ecosystem
IBM: The Linux EcosystemIBM: The Linux Ecosystem
IBM: The Linux Ecosystem
 
Accelerating Innovation from Edge to Cloud
Accelerating Innovation from Edge to CloudAccelerating Innovation from Edge to Cloud
Accelerating Innovation from Edge to Cloud
 

Recently uploaded

Recently uploaded (20)

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 

Sun Grid Engine at Synopsys

  • 1. Sun Grid Engine at Synopsys Bogdan Vasiliu - Staff Engineer Sun Microsystems Joe Fu – IT Manager Synopsys Sun Grid Engine Workshop 2007, Regensburg, Germany September 10-12, 2007 1 Sun Grid Engine at Synopsys Predictable Success
  • 2. Overview  About Synopsys  Grid Software at Synopsys  SGE at Synopsys  Compute Farms & SGE configuration  R&D tools  Benefits  Wish list  Future Plans 2 Sun Grid Engine at Synopsys Predictable Success
  • 3. About Synopsys  Applications  Electronic Design Automation (EDA)  Target markets: Semiconductor design and manufacturing  Business Objective  Market leader for EDA solutions that speed Advanced Integrated Circuits into volume production  Industry Ranking & Revenues  1.2B FY 2006  Top three (Synopsys,Cadence, Mentor G.,)  75% of total EDA s/w sales worldwide 3 Sun Grid Engine at Synopsys Predictable Success
  • 4. Grid Software at Synopsys  IT supports both SGE and LSF  70% SGE machines, 30% LSF  SGE grew from multiple R&D engineering groups adoption  SGE cost advantage - free, time unlimited downloads 4 Sun Grid Engine at Synopsys Predictable Success
  • 5. SGE at Synopsys  Current version 6.1  Upgrades from Codine to SGE 5.3 and to SGE 6.0  Compute Farms  40 + SGE farms worldwide  Individual farm size: 50 to 2000 socket-cpus  Over 7000 socket-cpus total  Regressions, builds, benchmarks, real customer designs  Hardware supported  Intel (32/64) Itanium, AMD64, SPARC, Power, HP/PA  Operating systems supported:  Linux (RedHat & SuSE) (32 bit & 64 bit), HPUX, Solaris (x86 & SPARC), AIX, Windows 5 Sun Grid Engine at Synopsys Predictable Success
  • 6. Mountain View Farm  Mountain View, CA main farm  1000 machines  Contributed by multiple business groups  70% - 80% batch jobs  Additional 6 farms dedicated to individual groups  300-400 machines  R&D 6 Sun Grid Engine at Synopsys Predictable Success
  • 7. SGE environment  SGE's dynamic configuration  “qconf” commands, fast and transparent  In house scripts built around SGE  Wrapper scripts around “qconf”  Daily priorities changes  users send requests through a support system.  In house process to allow high priority jobs  re-set priorities on projects  Use the user list/access control  Use resource quota control to guarantee turn around time for regressions 7 Sun Grid Engine at Synopsys Predictable Success
  • 8. SGE and Synopsys' products  All products work with SGE in batch and interactive modes  Multiple Synopsys products have adopted the MPI capability with SGE and more are on the way 8 Sun Grid Engine at Synopsys Predictable Success
  • 9. Benefits  Easy to manage  IT is able to automate 90% SGE administration tasks  Dynamic configuration enables zero interruption to production environment  Scalable  Lower cost 9 Sun Grid Engine at Synopsys Predictable Success
  • 10. Wish list 1  Provide Split Fairshare in addition to Global Fairshare  Resource Quota improved documentation  Future Advance Reservation feature to allow sysadmin to decide what to do with the job if exceeds the window reserved  Support EM64T Natively (not AMD64 Port) for path/logistics/CPU Type reasons 10 Sun Grid Engine at Synopsys Predictable Success
  • 11. Wish list 2  Improve real time monitoring and management of the farms  Access Monitoring (direct login to SGE machines)  Health monitor at h/w level  Detailed job real time reporting  Include OS and software provisioning features  Job profile monitoring – idle/ Length  Consistent “arch” definition  Improve SGE Windows support  SFU no longer supported  ARCO too complex to use now/without a lot of useful features  Apache support  Match LSF RFE and Support call fast response time 11 Sun Grid Engine at Synopsys Predictable Success
  • 12. Future Plans  To migrate to 6.2 and beyond  Continue to grow the farm size to accommodate more R&D needs  Continue to help more Synopsys products adopt SGE 12 Sun Grid Engine at Synopsys Predictable Success