Introduction to LAVA Workload Scheduler

•

4 gefällt mir•2,116 views

Nopparat Nopkuat

Training slide for workshop "Introduction to LAVA Workload Scheduler" @NCSEC2009 BKK THILAND

Technologie

Introduction to LAVA workload scheduler High Performance Computing and Networking Center (HPCNC) Kasetsart University In collaboration with Innovative Extremist (INOX) Co.,Ltd. and Platform Computing Inc.

Introduction to HPC, Cluster and Workload Scheduler

Parallel Programming Systems which is portable and efficient

Software library that ease the application development e.g. Scalapack, Plapack, PetSc

PC mass market nature drive the price down while performance increase rapidly

Cluster nature make it easy to capitalize on PC new technology right away

Automobile Design ( Crash Simulation) ,[object Object],[object Object]

(Google use more than 10000 node servers) ,[object Object],[object Object]

Molecular Dynamic Simulation ,[object Object]

Graphics Rendering and Special Effect ,[object Object]

Massive number of rendering job needed to be done to create a movie

Cluster Software Architecture HTC HPC HPTC

High Throughput Computing ,[object Object]

High Throughput Computing (con) ,[object Object]

Excellence for many type of applications such as ,[object Object]

Distributed application such as massive rendering in animation industry ,[object Object],[object Object]

High Performance Computing ,[object Object]

Use of specialised codes, libraries ,[object Object]

Parallel Maths Libraries (ScaLapack) ,[object Object]

Speedup for a single instance of problem is needed

Advantages and Challenges ,[object Object]

Plenty of free software ,[object Object],[object Object]

No powerful software development environment

Low compatibility with many enterprise computing environment

Parallel Application Development ,[object Object]

Message passing – data is exchanged by sending/receiving messages between processors

Allow users to share computing resources and time sharing ,[object Object]

Control shared resource usage for multiple users ,[object Object]

Hide the complexity of using cluster's computing resources by submitting job to the scheduler

Empfohlen

LCA13: LAVA and CI Component ReviewLinaro

Q4.11: Getting Started in LAVALinaro

Java ain't scary - introducing Java to PL/SQL DevelopersLucas Jellema

Kafka monitoring and metricsTouraj Ebrahimi

Using Grails to power your electric carMarco Pas

High Performance Distributed TensorFlow with GPUs - TensorFlow Chicago Meetup...Chris Fregly

Find bottleneck and tuning in Java Applicationguest1f2740

Performance Test Driven Development with Oracle Coherencearagozin

Empfohlen

LCA13: LAVA and CI Component ReviewLinaro

Q4.11: Getting Started in LAVALinaro

Java ain't scary - introducing Java to PL/SQL DevelopersLucas Jellema

Kafka monitoring and metricsTouraj Ebrahimi

Using Grails to power your electric carMarco Pas

High Performance Distributed TensorFlow with GPUs - TensorFlow Chicago Meetup...Chris Fregly

Find bottleneck and tuning in Java Applicationguest1f2740

Performance Test Driven Development with Oracle Coherencearagozin

Effective testing for spark programs Strata NY 2015Holden Karau

Adding replication protocol support for psycopg2Alexander Shulgin

Virtualizing Java in Java (jug.ru)aragozin

High Performance Distributed TensorFlow with GPUs - Nvidia GPU Tech Conferenc...Chris Fregly

Inside the JVM - Follow the white rabbit! / Breizh JUGSylvain Wallez

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017Chris Fregly

High Performance Distributed TensorFlow in Production with GPUs - NIPS 2017 -...Chris Fregly

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on G...Chris Fregly

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...Chris Fregly

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on GPUsChris Fregly

whats new in java 8 Dori Waldman

Optimizing, Profiling, and Deploying TensorFlow AI Models in Production with ...Chris Fregly

Spark stream - Kafka Dori Waldman

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...Chris Fregly

PipelineAI Optimizes Your Enterprise AI Pipeline from Distributed Training to...Chris Fregly

Building Google Cloud ML Engine From Scratch on AWS with PipelineAI - ODSC Lo...Chris Fregly

PipelineAI + TensorFlow AI + Spark ML + Kuberenetes + Istio + AWS SageMaker +...Chris Fregly

Cassandra - lesson learnedAndrzej Ludwikowski

Monitoring with PrometheusShiao-An Yuan

Optimizing, Profiling, and Deploying TensorFlow AI Models with GPUs - San Fra...Chris Fregly

Power-Efficient Programming Using Qualcomm Multicore Asynchronous Runtime Env...Qualcomm Developer Network

OS for AI: Elastic Microservices & the Next Gen of MLNordic APIs

Weitere ähnliche Inhalte

Was ist angesagt?

Effective testing for spark programs Strata NY 2015Holden Karau

Adding replication protocol support for psycopg2Alexander Shulgin

Virtualizing Java in Java (jug.ru)aragozin

High Performance Distributed TensorFlow with GPUs - Nvidia GPU Tech Conferenc...Chris Fregly

Inside the JVM - Follow the white rabbit! / Breizh JUGSylvain Wallez

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017Chris Fregly

High Performance Distributed TensorFlow in Production with GPUs - NIPS 2017 -...Chris Fregly

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on G...Chris Fregly

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...Chris Fregly

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on GPUsChris Fregly

whats new in java 8 Dori Waldman

Optimizing, Profiling, and Deploying TensorFlow AI Models in Production with ...Chris Fregly

Spark stream - Kafka Dori Waldman

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...Chris Fregly

PipelineAI Optimizes Your Enterprise AI Pipeline from Distributed Training to...Chris Fregly

Building Google Cloud ML Engine From Scratch on AWS with PipelineAI - ODSC Lo...Chris Fregly

PipelineAI + TensorFlow AI + Spark ML + Kuberenetes + Istio + AWS SageMaker +...Chris Fregly

Cassandra - lesson learnedAndrzej Ludwikowski

Monitoring with PrometheusShiao-An Yuan

Optimizing, Profiling, and Deploying TensorFlow AI Models with GPUs - San Fra...Chris Fregly

Was ist angesagt? (20)

Effective testing for spark programs Strata NY 2015

Adding replication protocol support for psycopg2

Virtualizing Java in Java (jug.ru)

High Performance Distributed TensorFlow with GPUs - Nvidia GPU Tech Conferenc...

Inside the JVM - Follow the white rabbit! / Breizh JUG

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017

High Performance Distributed TensorFlow in Production with GPUs - NIPS 2017 -...

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on G...

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on GPUs

whats new in java 8

Optimizing, Profiling, and Deploying TensorFlow AI Models in Production with ...

Spark stream - Kafka

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...

PipelineAI Optimizes Your Enterprise AI Pipeline from Distributed Training to...

Building Google Cloud ML Engine From Scratch on AWS with PipelineAI - ODSC Lo...

PipelineAI + TensorFlow AI + Spark ML + Kuberenetes + Istio + AWS SageMaker +...

Cassandra - lesson learned

Monitoring with Prometheus

Optimizing, Profiling, and Deploying TensorFlow AI Models with GPUs - San Fra...

Ähnlich wie Introduction to LAVA Workload Scheduler

Power-Efficient Programming Using Qualcomm Multicore Asynchronous Runtime Env...Qualcomm Developer Network

OS for AI: Elastic Microservices & the Next Gen of MLNordic APIs

Apache Cassandra 2.0Joe Stein

Container orchestration from theory to practiceDocker, Inc.

Kubernetes for the PHP developerPaul Czarkowski

Introduction To Apache MesosJoe Stein

Quantifying Container Runtime Performance: OSCON 2017 Open Container DayPhil Estes

Building Continuous Application with Structured Streaming and Real-Time Data ...Databricks

Capistrano, Puppet, and ChefDavid Benjamin

A DevOps guide to KubernetesPaul Czarkowski

Configuring Your First Hadoop Cluster On EC2benjaminwootton

Docker Swarm secrets for creating great FIWARE platformsFederico Michele Facca

LibOS as a regression test framework for Linux networking #netdev1.1Hajime Tazaki

A Fabric/Puppet Build/Deploy Systemadrian_nye

zLAMPAbdul Jaleel Kavungal

Using R on High Performance ComputersDave Hiltbrand

Copper: A high performance workflow enginedmoebius

AutoScaling and DrupalPromet Source

(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...Amazon Web Services

NodeJS guide for beginnersEnoch Joshua

Ähnlich wie Introduction to LAVA Workload Scheduler (20)

Power-Efficient Programming Using Qualcomm Multicore Asynchronous Runtime Env...

OS for AI: Elastic Microservices & the Next Gen of ML

Apache Cassandra 2.0

Container orchestration from theory to practice

Kubernetes for the PHP developer

Introduction To Apache Mesos

Quantifying Container Runtime Performance: OSCON 2017 Open Container Day

Building Continuous Application with Structured Streaming and Real-Time Data ...

Capistrano, Puppet, and Chef

A DevOps guide to Kubernetes

Configuring Your First Hadoop Cluster On EC2

Docker Swarm secrets for creating great FIWARE platforms

LibOS as a regression test framework for Linux networking #netdev1.1

A Fabric/Puppet Build/Deploy System

zLAMP

Using R on High Performance Computers

Copper: A high performance workflow engine

AutoScaling and Drupal

(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...

NodeJS guide for beginners

Kürzlich hochgeladen

Developing An App To Navigate The Roads of BrazilV3cube

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

Salesforce Community Group Quito, Salesforce 101Paola De la Torre

CNv6 Instructor Chapter 6 Quality of Servicegiselly40

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

A Call to Action for Generative AI in 2024Results

Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik

Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK

Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies

Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge

The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

Kürzlich hochgeladen (20)

Developing An App To Navigate The Roads of Brazil

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Salesforce Community Group Quito, Salesforce 101

CNv6 Instructor Chapter 6 Quality of Service

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Breaking the Kubernetes Kill Chain: Host Path Mount

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

08448380779 Call Girls In Friends Colony Women Seeking Men

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Presentation on how to chat with PDF using ChatGPT code interpreter

A Call to Action for Generative AI in 2024

Injustice - Developers Among Us (SciFiDevCon 2024)

Unblocking The Main Thread Solving ANRs and Frozen Frames

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams

Automating Google Workspace (GWS) & more with Apps Script

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Codex of Business Writing Software for Real-World Solutions 2.pptx

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Introduction to LAVA Workload Scheduler

1. Introduction to LAVA workload scheduler High Performance Computing and Networking Center (HPCNC) Kasetsart University In collaboration with Innovative Extremist (INOX) Co.,Ltd. and Platform Computing Inc.

3. LAVA workload scheduler

4. Installing and configuring LAVA Cluster

5. Workshop : Using LAVA

6. Introduction to HPC, Cluster and Workload Scheduler

9. Parallel Programming Systems which is portable and efficient

10. MPI (LAM, MPICH)

11. Software library that ease the application development e.g. Scalapack, Plapack, PetSc

12.

13. PC mass market nature drive the price down while performance increase rapidly

14. Cluster nature make it easy to capitalize on PC new technology right away

15. Why? Price Performance!

16.

17.

18.

19. Bioinformatics

20. Large scale financial analysis

21. Simulation

22. Drug Design

23.

24.

25.

26.

27.

28. Massive number of rendering job needed to be done to create a movie

29. Cluster Software Architecture HTC HPC HPTC

30.

31.

32.

33.

34.

35.

36.

37.

38.

39. Speedup for a single instance of problem is needed

40.

41.

42. No powerful software development environment

43. Low compatibility with many enterprise computing environment

44.

45. Message passing – data is exchanged by sending/receiving messages between processors

46.

47. Main role of distributed computing

48.

49.

50.

51. Hide the complexity of using cluster's computing resources by submitting job to the scheduler

52.

53. How many we can use?

54.

55.

56.

57. Platform LSF / Platform LAVA

58. PBS / PBS Pro

59. Torque

60. Maui

61. MS Job scheduler

62. LAVA Workload Scheduler

63.

64. Designed to meet a wide range of workload scheduling needs for clusters up to 512-nodes

65.

66. Reliability

67. Parallel Job Scheduling

68. Complete Job History

69. Interactive Jobs

70. Job Arrays

71. Job Dependency

72. Job Migration

73. Components (mbatchd) (sbatchd) (sbatchd) (sbatchd) LAVA Base LIM (Load Information Manager) RES (Remote Execution Service) Computer LSBATCH

74. Installing and Configuring

75.

76.

77.

78.

79. ./configure

80. make && make install

81.

82.

83. Can scale nodes without editing config files

84.

85. LAVA Base (lsf)

86. Batch scheduler (lsbatch)

87.

88.

89. LSF_TOP=/usr

90. LSF_BINDIR=/usr/bin

91. LSF_SERVERDIR=/usr/sbin

92. LSF_LIBDIR=/usr/lib

93. LSF_ENVDIR=/etc/lava/conf

94.

95. Config file usually located at $LSF_ENVDIR = /etc/lava/conf/

96.

97. lsf.cluster.lava * (general configuration, nodes, parameters)

98. lsf.task (type of tasks)

99. lsf.shared (default parameters)

100.

101.

102. Config file usually located at $LSF_ENVDIR/lsbatch/lava/configdir/

103.

104. lsb.modules (list of plugin modules)

105. lsb.params (batch scheduler parameters)

106. lsb.queues (job queue name & properties)

107. lsb.users (list of allowed users)

108.

109.

110.

111. Copy another queue definition from this file as a starting point and change the QUEUE_NAME of the copied queue.

112. Save the changes to lsb.queues.

113. Run badmin reconfig to reconfigure mbatchd.

114. Adding a queue does not affect pending or running jobs.

115.

116. Move all pending and running jobs into another queue using command bswitch -q Q_FROM Q_TO 0

117. Edit lsb.queues and remove or comment out the definition for the queue you want to remove.

118. Save the changes to lsb.queues.

119. Run badmin reconfig to reconfigure mbatchd.

120. Using LAVA

121.

122. bbot

123. bchkpnt

124. bhist

125. bhosts

126. bjobs

127. bkill

128. bmgroup

129. bmig

130. bmod

131.

132. lsacct

133. lseligible

134. lshosts

135. lsid

136. lsinfo

137. lsload

138. lsloadadj

139. lsmon

140. lsplace

141.

142. bqueues

143. brequeue

144. brestart

145. bresume

146. brun

147. bstop

148. bsub

149. bswitch

150. btop

151. bugroup

152. busers

153.

154. badmin

155.

156. bqueues / bqueues -l

157. bparams / bparams -l

158. bmgroup

159. bugroup

160.

161. lsinfo

162. lshosts

163. lsload

164. lsmon

165. lsacct

166.

167. bjobs <job id>

168.

169.

170.

171.

172.

173.

174.

175. Create file myscript

176. chmod u+x myscript

177. bsub < myscript #!bin/sh #BSUB -q test #BSUB -o outfile -R "mem>10" myjob arg1 arg2 #BSUB -J myjob

178.

179.

180.

181.

182.

183.

184.

185. By default, bkill sends SIGINT, SIGTERM and then SIGKILL signal to running jobs

186.

187.

188.

189.

190.

191. Job <3421> is being resumed

192.

193.

194.

195.

196.

197. END OF SESSION Thank you

198.