SlideShare ist ein Scribd-Unternehmen logo
1 von 70
Downloaden Sie, um offline zu lesen
Open Standards and
Open Source in
Datacenter Management
蔡鎮宇 Chen-Yu Tsai <wens@csie.org>
2014/4/11 OSDC 2014 1
Who am I?
• Software Engineer @ CloudMosa, Inc.
• System Administrator for 10+ years starting in
college
• Skills: breaking and fixing things
2014/4/11 OSDC 2014 2
Overview
•Monitoring
•Management
•Provisioning
2014/4/11 OSDC 2014 3
- Monitoring -
2014/4/11 OSDC 2014 4
Log Everything!
2014/4/11 OSDC 2014 5
Where to start?
2014/4/11 OSDC 2014 6
MRTG
2014/4/11 OSDC 2014 7
Based on SNMP
Supported by most network devices
2014/4/11 OSDC 2014 8
Exports data and metrics
2014/4/11 OSDC 2014 9
Network traffic counters
– used by MRTG
2014/4/11 OSDC 2014 10
Known MAC addresses
- Map the network
2014/4/11 OSDC 2014 11
2014/4/11 OSDC 2014 12
2014/4/11 OSDC 2014 13
Whatever the device
supports
Look up vendor specific MIBs
2014/4/11 OSDC 2014 14
RRDTool
Time Series Database
2014/4/11 OSDC 2014 15
MRTG uses it
2014/4/11 OSDC 2014 16
Munin uses it
2014/4/11 OSDC 2014 17
… uses it
2014/4/11 OSDC 2014 18
Write your own!
2014/4/11 OSDC 2014 19
2014/4/11 OSDC 2014 20
2014/4/11 OSDC 2014 21
Munin –
Resource Monitoring
2014/4/11 OSDC 2014 22
System is slow…
2014/4/11 OSDC 2014 23
CPU usage?
2014/4/11 OSDC 2014 24
2014/4/11 OSDC 2014 25
Memory usage?
2014/4/11 OSDC 2014 26
2014/4/11 OSDC 2014 27
Disk I/O?
2014/4/11 OSDC 2014 28
2014/4/11 OSDC 2014 29
Web requests?
2014/4/11 OSDC 2014 30
2014/4/11 OSDC 2014 31
Use plugins from
standard set
2014/4/11 OSDC 2014 32
Or write Your Own!
2014/4/11 OSDC 2014 33
2014/4/11 OSDC 2014 34
Aggregate Data
Manual configuration for now
2014/4/11 OSDC 2014 35
2014/4/11 OSDC 2014 36
Others
• Monitoring
• Xymon (Hobbit)
• Nagios
• Cacti
• Data collection / Graphing
• Graphite
• ZipKin (Twitter)
• Log collection
• Scribe (Facebook)
2014/4/11 OSDC 2014 37
Management
2014/4/11 OSDC 2014 38
IPMI
Intelligent Platform Management Interface
2014/4/11 OSDC 2014 39
2014/4/11 OSDC 2014 40
Image from Wikipedia
Built into most BMCs
2014/4/11 OSDC 2014 41
Out-of-Band
vs
Side-band
2014/4/11 OSDC 2014 42
Power Control
On, Off, Reset
2014/4/11 OSDC 2014 43
Serial over LAN
Console Access
2014/4/11 OSDC 2014 44
Boot Order
Force PXE boot?
2014/4/11 OSDC 2014 45
SSH
Secure Shell
2014/4/11 OSDC 2014 46
SSH Public Key
Authentication
Don’t need to input password every time.
2014/4/11 OSDC 2014 47
OmniTTY
Console-based interactive SSH multiplexer
2014/4/11 OSDC 2014 48
Parallel-SSH (pssh)
Parallel versions of OpenSSH
2014/4/11 OSDC 2014 49
Fabric
Scriptable, Parallel SSH
2014/4/11 OSDC 2014 50
Provisioning
2014/4/11 OSDC 2014 51
DHCP
Network Provisioning
2014/4/11 OSDC 2014 52
PXE Boot
Boot over Network
2014/4/11 OSDC 2014 53
Auto-configuration
via DHCP
Network Switches
2014/4/11 OSDC 2014 54
Kickstart/Preseed
Automatic Install
2014/4/11 OSDC 2014 55
Chef
Puppet
Disclaimer: We don’t use them.
2014/4/11 OSDC 2014 56
Custom Packages
Put programs/services/settings
into native packages.
2014/4/11 OSDC 2014 57
Apt-cacher-ng
Web cache for package files
2014/4/11 OSDC 2014 58
Put It All Together
2014/4/11 OSDC 2014 59
2014/4/11 OSDC 2014 60
With the proper
hardware/software
2014/4/11 OSDC 2014 61
Datacenters Become
Manageable
2014/4/11 OSDC 2014 62
2~3 People
2k+ Nodes in
4 Datacenters
2014/4/11 OSDC 2014 63
Hands free after
racking and cabling
2014/4/11 OSDC 2014 64
2014/4/11 OSDC 2014 65
10k nodes?
2014/4/11 OSDC 2014 66
100k nodes?
2014/4/11 OSDC 2014 67
Evolve!
2014/4/11 OSDC 2014 68
We are Hiring!
2014/4/11 OSDC 2014 69
Thank You
2014/4/11 OSDC 2014 70

Weitere ähnliche Inhalte

Was ist angesagt?

Balázs Bucsay - XFLTReaT: Building a Tunnel
Balázs Bucsay - XFLTReaT: Building a TunnelBalázs Bucsay - XFLTReaT: Building a Tunnel
Balázs Bucsay - XFLTReaT: Building a Tunnel
hacktivity
 
OPNFV scenarios challenges and opportunities
OPNFV scenarios  challenges and opportunitiesOPNFV scenarios  challenges and opportunities
OPNFV scenarios challenges and opportunities
OPNFV
 
Being Brave: Deploying OpenStack from Master
Being Brave: Deploying OpenStack from MasterBeing Brave: Deploying OpenStack from Master
Being Brave: Deploying OpenStack from Master
OPNFV
 

Was ist angesagt? (14)

Twelve Factor App @ PHPCon 2015
Twelve Factor App @ PHPCon 2015Twelve Factor App @ PHPCon 2015
Twelve Factor App @ PHPCon 2015
 
Between you me and the network security boundary
Between you me and the network security boundaryBetween you me and the network security boundary
Between you me and the network security boundary
 
Balázs Bucsay - XFLTReaT: Building a Tunnel
Balázs Bucsay - XFLTReaT: Building a TunnelBalázs Bucsay - XFLTReaT: Building a Tunnel
Balázs Bucsay - XFLTReaT: Building a Tunnel
 
Demo how to efficiently evaluate nf-vi performance by leveraging opnfv testi...
Demo  how to efficiently evaluate nf-vi performance by leveraging opnfv testi...Demo  how to efficiently evaluate nf-vi performance by leveraging opnfv testi...
Demo how to efficiently evaluate nf-vi performance by leveraging opnfv testi...
 
Building OPNFV as a Platform
Building OPNFV as a PlatformBuilding OPNFV as a Platform
Building OPNFV as a Platform
 
OPNFV scenarios challenges and opportunities
OPNFV scenarios  challenges and opportunitiesOPNFV scenarios  challenges and opportunities
OPNFV scenarios challenges and opportunities
 
OpenStack and OVS: From Love-Hate to Match Made in Heaven
OpenStack and OVS: From Love-Hate to Match Made in HeavenOpenStack and OVS: From Love-Hate to Match Made in Heaven
OpenStack and OVS: From Love-Hate to Match Made in Heaven
 
Summit 16: StorPerf: Cinder Storage Performance Measurement
Summit 16: StorPerf: Cinder Storage Performance MeasurementSummit 16: StorPerf: Cinder Storage Performance Measurement
Summit 16: StorPerf: Cinder Storage Performance Measurement
 
Being Brave: Deploying OpenStack from Master
Being Brave: Deploying OpenStack from MasterBeing Brave: Deploying OpenStack from Master
Being Brave: Deploying OpenStack from Master
 
Improving POD Usage in Labs, CI and Testing
Improving POD Usage in Labs, CI and TestingImproving POD Usage in Labs, CI and Testing
Improving POD Usage in Labs, CI and Testing
 
Openstack Tacker - Moving into Pike
Openstack Tacker - Moving into PikeOpenstack Tacker - Moving into Pike
Openstack Tacker - Moving into Pike
 
kali linux
kali linux kali linux
kali linux
 
Upgrade von TYPO3 4.5 auf 6.2 - CertiFUNcation Phantasialand 2015
Upgrade von TYPO3 4.5 auf 6.2 - CertiFUNcation Phantasialand 2015Upgrade von TYPO3 4.5 auf 6.2 - CertiFUNcation Phantasialand 2015
Upgrade von TYPO3 4.5 auf 6.2 - CertiFUNcation Phantasialand 2015
 
Introduction to “X86 PCC Software”
Introduction to “X86 PCC Software”Introduction to “X86 PCC Software”
Introduction to “X86 PCC Software”
 

Ähnlich wie Open Standards and Open Source in Datacenter Management - OSDC.tw 2014

2012 11-09 facex - i pv6 transition planning-
2012 11-09 facex - i pv6 transition planning-2012 11-09 facex - i pv6 transition planning-
2012 11-09 facex - i pv6 transition planning-
Eduardo Coelho
 
AIDevWorldApacheNiFi101
AIDevWorldApacheNiFi101AIDevWorldApacheNiFi101
AIDevWorldApacheNiFi101
Timothy Spann
 
Spark China Summit 2015 Guancheng Chen
Spark China Summit 2015 Guancheng ChenSpark China Summit 2015 Guancheng Chen
Spark China Summit 2015 Guancheng Chen
Guancheng (G.C.) Chen
 

Ähnlich wie Open Standards and Open Source in Datacenter Management - OSDC.tw 2014 (20)

2012 11-09 facex - i pv6 transition planning-
2012 11-09 facex - i pv6 transition planning-2012 11-09 facex - i pv6 transition planning-
2012 11-09 facex - i pv6 transition planning-
 
OSDC 2014: Thomas Schend - Introduction to Synnefo open source cloud stack
OSDC 2014: Thomas Schend -  Introduction to Synnefo open source cloud stackOSDC 2014: Thomas Schend -  Introduction to Synnefo open source cloud stack
OSDC 2014: Thomas Schend - Introduction to Synnefo open source cloud stack
 
"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014
"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014
"In love with Open Source : Past, Present and Future" : Keynote OSDConf 2014
 
Create a-strong-two-factors-authentication-device-for-less-than-chf-100
Create a-strong-two-factors-authentication-device-for-less-than-chf-100Create a-strong-two-factors-authentication-device-for-less-than-chf-100
Create a-strong-two-factors-authentication-device-for-less-than-chf-100
 
Accelerating Software Development with NetApp's P4flex
Accelerating Software Development with NetApp's P4flexAccelerating Software Development with NetApp's P4flex
Accelerating Software Development with NetApp's P4flex
 
An introduction to the prpl foundation
An introduction to the prpl foundationAn introduction to the prpl foundation
An introduction to the prpl foundation
 
AIDevWorldApacheNiFi101
AIDevWorldApacheNiFi101AIDevWorldApacheNiFi101
AIDevWorldApacheNiFi101
 
OpenShift_Installation_Deep_Dive_Robert_Bohne.pdf
OpenShift_Installation_Deep_Dive_Robert_Bohne.pdfOpenShift_Installation_Deep_Dive_Robert_Bohne.pdf
OpenShift_Installation_Deep_Dive_Robert_Bohne.pdf
 
iRODS 4.0 and Beyond (DDN UK User Group Meeting, September 2014)
iRODS 4.0 and Beyond (DDN UK User Group Meeting, September 2014)iRODS 4.0 and Beyond (DDN UK User Group Meeting, September 2014)
iRODS 4.0 and Beyond (DDN UK User Group Meeting, September 2014)
 
Swiss IPv6 Council: Konfusion um die Router Flags
Swiss IPv6 Council: Konfusion um die Router FlagsSwiss IPv6 Council: Konfusion um die Router Flags
Swiss IPv6 Council: Konfusion um die Router Flags
 
OWF12/Open Standards for Cloud - Cs owf
OWF12/Open Standards for Cloud - Cs owfOWF12/Open Standards for Cloud - Cs owf
OWF12/Open Standards for Cloud - Cs owf
 
Baby Steps: A WebRTC Tutorial
Baby Steps: A WebRTC TutorialBaby Steps: A WebRTC Tutorial
Baby Steps: A WebRTC Tutorial
 
APNIC Update
APNIC Update APNIC Update
APNIC Update
 
Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014
Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014
Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014
 
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
44CON 2014 - Binary Protocol Analysis with CANAPE, James Forshaw
 
BonFIRE: features, sites and tools
BonFIRE: features, sites and toolsBonFIRE: features, sites and tools
BonFIRE: features, sites and tools
 
Status of Embedded Linux
Status of Embedded LinuxStatus of Embedded Linux
Status of Embedded Linux
 
Introduction to PowerShell at Chicago Code Camp 2014
Introduction to PowerShell at Chicago Code Camp 2014Introduction to PowerShell at Chicago Code Camp 2014
Introduction to PowerShell at Chicago Code Camp 2014
 
Spark China Summit 2015 Guancheng Chen
Spark China Summit 2015 Guancheng ChenSpark China Summit 2015 Guancheng Chen
Spark China Summit 2015 Guancheng Chen
 
Cisco CSIRT Case Study: Forensic Investigations with NetFlow
Cisco CSIRT Case Study: Forensic Investigations with NetFlowCisco CSIRT Case Study: Forensic Investigations with NetFlow
Cisco CSIRT Case Study: Forensic Investigations with NetFlow
 

Mehr von Chen-Yu Tsai

Mehr von Chen-Yu Tsai (6)

Putting Taiwan on the kernel.org Keysigning Map
Putting Taiwan on the kernel.org Keysigning MapPutting Taiwan on the kernel.org Keysigning Map
Putting Taiwan on the kernel.org Keysigning Map
 
Identifying and Supporting 'X-compatible' Hardware Blocks
Identifying and Supporting 'X-compatible' Hardware BlocksIdentifying and Supporting 'X-compatible' Hardware Blocks
Identifying and Supporting 'X-compatible' Hardware Blocks
 
Linux Kernel Patch Submission Tips
Linux Kernel Patch Submission TipsLinux Kernel Patch Submission Tips
Linux Kernel Patch Submission Tips
 
Allwinner Kernel Upstreaming Experiences
Allwinner Kernel Upstreaming ExperiencesAllwinner Kernel Upstreaming Experiences
Allwinner Kernel Upstreaming Experiences
 
Upstream Allwinner ARM SoC (sunxi) Support
Upstream Allwinner ARM SoC (sunxi) SupportUpstream Allwinner ARM SoC (sunxi) Support
Upstream Allwinner ARM SoC (sunxi) Support
 
linux-sunxi - OSDC.tw 2014 Lightning Talk
linux-sunxi - OSDC.tw 2014 Lightning Talklinux-sunxi - OSDC.tw 2014 Lightning Talk
linux-sunxi - OSDC.tw 2014 Lightning Talk
 

Kürzlich hochgeladen

TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
 

Kürzlich hochgeladen (20)

HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 

Open Standards and Open Source in Datacenter Management - OSDC.tw 2014