SlideShare ist ein Scribd-Unternehmen logo
1 von 38
Downloaden Sie, um offline zu lesen
@jezhumble #agileindia2019
building and scaling high performing
technology organizations
@jezhumble
“the enterprise”
Project A
Project B
Project C
DBAs
Infrastructure team
Service desk
Value stream
OperationsEngineeringBusiness
Ping!
@jezhumble
Project A
Project B
Project C
DBAs
Infrastructure team
Service desk
Value stream
OperationsEngineeringBusiness
Ping!
Project D
Let’s create
a new
product
enterprise projects
@jezhumble
Project A
Project B
DBAs
Infrastructure team
Service desk
Project D
We’re going
agile! Oh no!Oh no!
Value stream
OperationsEngineeringBusiness
@jezhumble
Project A
Project B
DBAs
Infrastructure team
Service desk
Value stream
OperationsEngineeringBusiness
Project D
Our test-driven code
follows SOLID
principles
Shame it
doesn’t work
Change
management
Jon Jenkins, “Velocity Culture, The Unmet Challenge in Ops” | http://bit.ly/1vJo1Ya
@jezhumble
a note about predictive analysis
One of three conditions must be met:
• Randomized, experimental design (no, this is non-experimental)
• Longitudinal (no, this is cross-sectional)
• Theory-based design
When this condition was not met, only correlations were tested and
reported .
@jezhumble
firmographics
Accelerate: The Science of Lean Software and DevOps, Forsgren, Humble and Kim 2018
software delivery as a competitive advantage
“Firms with high-performing IT
organizations were twice as likely to
exceed their profitability, market share
and productivity goals.”
http://bit.ly/2014-devops-report
software delivery as a competitive advantage
high performers were more than twice as likely to
achieve or exceed the following objectives:
•Quantity of products or services
•Operating efficiency
•Customer satisfaction
•Quality of products or services provided
•Achieving organizational and mission goals
•Measures that demonstrate to external parties
whether or not the organization is achieving
intended results
http://bit.ly/2018-devops-report
@jezhumble
time to restore service
lead time for changes (version control to production)
deploy frequency
change fail rate
software delivery performance
http://bit.ly/2014-devops-report
@jezhumble
2018 performance benchmarks
http://bit.ly/2018-devops-report
elite performers
http://bit.ly/2018-devops-report
Data shows a new 4th high performance group:
elite performers
Proportion of high performers has grown YoY,
but the bar for excellence remains high
Elite performers are still able to optimize for
throughput and stability
availability
http://bit.ly/2018-devops-report
Ability for teams to
ensure their product or
service can be accessed
by end users
Software delivery +
availability = SDO
performance
Elite performers are
3.5X more likely to
have strong availability
practices
capabilities that drive high performance
Accelerate: The Science of Lean Software and DevOps, Forsgren, Humble and Kim 2018
technical practices
http://bit.ly/2018-devops-report
@jezhumble
key finding: architectural outcomes
can my team…
…make large-scale changes to the design of its system without the permission of
somebody outside the team or depending on other teams?
…complete its work without needing fine-grained communication and coordination with
people outside the team?
…deploy and release its product or service on demand, independently of other services
the product or service depends upon?
…do most of its testing on demand, without requiring an integrated test environment?
…perform deployments during normal business hours with negligible downtime?
http://bit.ly/2017-devops-report | https://devops-research.com/research.html | DORA / Puppet
@jezhumble
key finding: doing cloud right
http://bit.ly/2018-devops-report | NIST SP 800-145
AGREED OR STRONGLY AGREED
On-demand self-service
Broad network access
Resource Pooling
Rapid elasticity
Measured service
Only 22% of teams are doing cloud right!
Teams that use these essentials
characteristics are 23X more likely to be
elite performers
@jezhumble
cloud in regulated environments
https://devops-research.com/research.html
@jezhumble
monitoring and observability
MONITORING
is tooling or a technical solution that allows
teams to watch and understand the state
of their systems and is based on gathering
predefined sets of metrics or logs.
OBSERVABILITY
is tooling or a technical solution that allows
teams to actively debug their system and
explore properties and patterns they have
not defined in advance.
Teams with a comprehensive
monitoring and observability
solution were 1.3 times more
likely to be an elite performer.
Having a monitoring and
observability solution positively
contributed to SDO performance.
Fun stats fact: monitoring and
observability load together.
@jezhumble
which of these measure effective test practices?
• Developers primarily create & maintain acceptance tests
• QA primarily create & maintain acceptance tests
• Primarily created & maintained by outsourced party
• When automated tests pass, I’m confident the software is releasable
• Test failures are likely to indicate a real defect
• It’s easy for developers to fix acceptance tests
• Developers share a common pool of test servers to reproduce failures
• Developers create on demand test environments
• Developers use their own dev environments to reproduce failures
@jezhumble
which of these measure effective test practices?
• Developers primarily create & maintain acceptance tests
• QA primarily create & maintain acceptance tests
• Primarily created & maintained by outsourced party
• When automated tests pass, I’m confident the software is releasable
• Test failures are likely to indicate a real defect
• It’s easy for developers to fix acceptance tests
• Developers share a common pool of test servers to reproduce failures
• Developers create on demand test environments
• Developers use their own dev environments to reproduce failures
@jezhumble
continuous testing
previous practices plus…
• continuously reviewing and improving test suites to better find defects and keep
complexity and cost under control
• allowing testers to work alongside developers throughout the software development
and delivery process
• performing manual test activities such as exploratory testing, usability testing, and
acceptance testing throughout the delivery process
• having developers practice test-driven development by writing unit tests before
writing production code for all changes to the codebase
• being able to get feedback from automated tests in less than ten minutes both on
local workstations and from a CI server
http://bit.ly/2018-devops-report | https://devops-research.com/research.html
@jezhumble
lean management
@jezhumble
lean product management
Regularly gathering, broadcasting,
& implementing customer
feedback
Splitting work into small batches
that can be completed in <1 week
& released frequently
Teams have a good
understanding of the flow of work
from business to customers
Teams have the authority to
create and change specifications
as part of the dev process
Software delivery
performance
Less burnout
Westrum culture
Lean product
management
Organizational
performance
culture impacts performance
high trust culture
Westrum, “A Typology of Organizational Cultures” | http://bmj.co/1BRGh5q
how organizations process information
effective teams
https://rework.withgoogle.com/blog/five-keys-to-a-successful-google-team/
@jezhumble
identity and google items
• I am glad I chose to work for this organization rather than another
company.
• I talk of this organization to my friends as a great company to work for.
• I am willing to put in a great deal of effort beyond what is normally
expected to help my organization to be successful.
• I find that my values and my organization's values are very similar.
• In general, the people employed by my organization are working
toward the same goal.
• I feel that my organization cares about me.
Adapted from adapted from Atreyi Kankanhalli, Bernard C.Y. Tan, and Kwok-Kee Wei (2005), “Contributing
Knowledge to Electronic Knowledge Repositories: An Empirical Investigation,“ MIS Quarterly, 29, 113-143.
Westrum items
@jezhumble
ask: how can we get people better information?
in a complex, adaptive system failure is inevitable
when accidents happen, human error is the starting point of a blameless
post-mortem
ask: how can we detect and limit failure modes?
dealing with failure
@rynchantress | https://ryn.works/2017/06/17/on-failure-and-resilience/
The immediate response
from everyone around was to ask, “What help
do you need?”
@jezhumble
disaster recovery testing
“For DiRT-style events to be successful, an organization
first needs to accept system and process failures as a
means of learning… We design tests that require
engineers from several groups who might not normally
work together to interact with each other. That way,
should a real large-scale disaster ever strike, these people
will already have strong working relationships”
Kripa Krishnan | http://queue.acm.org/detail.cfm?id=2371297
—Kripa Krishnan, Director, Cloud Operations, Google
@jezhumble
climate for learning
http://bit.ly/2018-devops-report
@jezhumble
autonomy
http://bit.ly/2018-devops-report
https://www.slideshare.net/reed2001/culture-1798664/94-Highly_Aligned_Loosely_Coupled_Highly
“I think building this culture is the key to innovation. Creativity must
flow from everywhere. Whether you are a summer intern or the CTO,
any good idea must be able to seek an objective test, preferably a
test that exposes the idea to real customers. Everyone must be able
to experiment, learn, and iterate.”
innovation culture
http://glinden.blogspot.com/2006/04/early-amazon-shopping-cart.html
thank you!
© 2016-8 DevOps Research and Assessment LLC and Jez Humble and Associates LLC
Please take the 2019 State of DevOps Survey and help us
understand how to build high performing teams!
bit.ly/2019-sodr-survey

Weitere ähnliche Inhalte

Was ist angesagt?

Software Testing with Agile Requirements Practices
Software Testing with Agile Requirements Practices Software Testing with Agile Requirements Practices
Software Testing with Agile Requirements Practices
A B M Moniruzzaman
 
CWIN17 New-York / Drive continuous delivery with continous testing
CWIN17 New-York / Drive continuous delivery with continous testingCWIN17 New-York / Drive continuous delivery with continous testing
CWIN17 New-York / Drive continuous delivery with continous testing
Capgemini
 

Was ist angesagt? (20)

DevOps Summit 2015 Presentation: Continuous Testing At the Speed of DevOps
DevOps Summit 2015 Presentation: Continuous Testing At the Speed of DevOpsDevOps Summit 2015 Presentation: Continuous Testing At the Speed of DevOps
DevOps Summit 2015 Presentation: Continuous Testing At the Speed of DevOps
 
Agile Testing and Test Automation
Agile Testing and Test AutomationAgile Testing and Test Automation
Agile Testing and Test Automation
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
Software Testing with Agile Requirements Practices
Software Testing with Agile Requirements Practices Software Testing with Agile Requirements Practices
Software Testing with Agile Requirements Practices
 
Is Test Planning a lost art in Agile? by Michelle Williams
Is Test Planning a lost art in Agile? by Michelle WilliamsIs Test Planning a lost art in Agile? by Michelle Williams
Is Test Planning a lost art in Agile? by Michelle Williams
 
CWIN17 New-York / Drive continuous delivery with continous testing
CWIN17 New-York / Drive continuous delivery with continous testingCWIN17 New-York / Drive continuous delivery with continous testing
CWIN17 New-York / Drive continuous delivery with continous testing
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
 
What is Agile Testing?
What is Agile Testing? What is Agile Testing?
What is Agile Testing?
 
Scrum Bangalore 13th meet up 13 june 2015 - behaviour driven development - vi...
Scrum Bangalore 13th meet up 13 june 2015 - behaviour driven development - vi...Scrum Bangalore 13th meet up 13 june 2015 - behaviour driven development - vi...
Scrum Bangalore 13th meet up 13 june 2015 - behaviour driven development - vi...
 
Continuous Deployment and Testing Workshop from Better Software West
Continuous Deployment and Testing Workshop from Better Software WestContinuous Deployment and Testing Workshop from Better Software West
Continuous Deployment and Testing Workshop from Better Software West
 
DevOps or Devops - living in silos or living as a team
DevOps or Devops -  living in silos or living as a teamDevOps or Devops -  living in silos or living as a team
DevOps or Devops - living in silos or living as a team
 
Try: Fail, Try: Succeed by Tim Grant
Try: Fail, Try: Succeed by Tim GrantTry: Fail, Try: Succeed by Tim Grant
Try: Fail, Try: Succeed by Tim Grant
 
Lemi Orhan Ergin - Code Your Agility: Tips for Boosting Technical Agility in ...
Lemi Orhan Ergin - Code Your Agility: Tips for Boosting Technical Agility in ...Lemi Orhan Ergin - Code Your Agility: Tips for Boosting Technical Agility in ...
Lemi Orhan Ergin - Code Your Agility: Tips for Boosting Technical Agility in ...
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Hey You Got Your TDD in my SQL DB by Jeff McKenzie
Hey You Got Your TDD in my SQL DB by Jeff McKenzieHey You Got Your TDD in my SQL DB by Jeff McKenzie
Hey You Got Your TDD in my SQL DB by Jeff McKenzie
 
How BDD enables True CI/CD
How BDD enables True CI/CDHow BDD enables True CI/CD
How BDD enables True CI/CD
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Quality Jam: BDD, TDD and ATDD for the Enterprise
Quality Jam: BDD, TDD and ATDD for the EnterpriseQuality Jam: BDD, TDD and ATDD for the Enterprise
Quality Jam: BDD, TDD and ATDD for the Enterprise
 
Selenium DeTox for Achieving the Right Testing Pyramid
Selenium DeTox for Achieving the Right Testing PyramidSelenium DeTox for Achieving the Right Testing Pyramid
Selenium DeTox for Achieving the Right Testing Pyramid
 
Agile and DevOps Transformations in Large Organizations
Agile and DevOps Transformations in Large OrganizationsAgile and DevOps Transformations in Large Organizations
Agile and DevOps Transformations in Large Organizations
 

Ähnlich wie Building and Scaling High Performing Technology Organizations by Jez Humble at #AgileIndia2019

The Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez HumbleThe Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez Humble
Serena Software
 
Bridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to ProductionBridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to Production
Florian Wilhelm
 

Ähnlich wie Building and Scaling High Performing Technology Organizations by Jez Humble at #AgileIndia2019 (20)

Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
 
Agile Methods: Fact or Fiction
Agile Methods: Fact or FictionAgile Methods: Fact or Fiction
Agile Methods: Fact or Fiction
 
Continuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps SuccessContinuous Testing: A Key to DevOps Success
Continuous Testing: A Key to DevOps Success
 
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
 
What I learned from 5 years of sciencing the crap out of DevOps
What I learned from 5 years of sciencing the crap out of DevOpsWhat I learned from 5 years of sciencing the crap out of DevOps
What I learned from 5 years of sciencing the crap out of DevOps
 
The Rationale for Continuous Delivery
The Rationale for Continuous DeliveryThe Rationale for Continuous Delivery
The Rationale for Continuous Delivery
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?
 
Puppet Labs EMC DevOps Day NYC Aug-2015
Puppet Labs  EMC DevOps Day NYC Aug-2015Puppet Labs  EMC DevOps Day NYC Aug-2015
Puppet Labs EMC DevOps Day NYC Aug-2015
 
How to Build High-Performing IT Teams - Including New Data on IT Performance ...
How to Build High-Performing IT Teams - Including New Data on IT Performance ...How to Build High-Performing IT Teams - Including New Data on IT Performance ...
How to Build High-Performing IT Teams - Including New Data on IT Performance ...
 
A Roadmap to Enterprise Quality
A Roadmap to Enterprise QualityA Roadmap to Enterprise Quality
A Roadmap to Enterprise Quality
 
The Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez HumbleThe Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez Humble
 
IBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOpsIBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOps
 
DevOps Roadshow - removing barriers between development and operations
DevOps Roadshow - removing barriers between development and operationsDevOps Roadshow - removing barriers between development and operations
DevOps Roadshow - removing barriers between development and operations
 
How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycle
 
Critical Capabilities to Shifting Left the Right Way
Critical Capabilities to Shifting Left the Right WayCritical Capabilities to Shifting Left the Right Way
Critical Capabilities to Shifting Left the Right Way
 
Making software development processes to work for you
Making software development processes to work for youMaking software development processes to work for you
Making software development processes to work for you
 
Bridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to ProductionBridging the Gap: from Data Science to Production
Bridging the Gap: from Data Science to Production
 
Continuous Integration
Continuous IntegrationContinuous Integration
Continuous Integration
 
Scaling Software Delivery.pdf
Scaling Software Delivery.pdfScaling Software Delivery.pdf
Scaling Software Delivery.pdf
 
2015-01-12 TechTalk - Removing Barriers between Development and Operations
2015-01-12 TechTalk - Removing Barriers between Development and Operations2015-01-12 TechTalk - Removing Barriers between Development and Operations
2015-01-12 TechTalk - Removing Barriers between Development and Operations
 

Mehr von Agile India

Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019
Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019
Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019
Agile India
 
Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019
Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019
Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019
Agile India
 
Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...
Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...
Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...
Agile India
 

Mehr von Agile India (19)

Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019
Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019
Design Teams are a Design Exercise by Phillip Joe at #AgileIndia2019
 
Keeping hundreds of code repositories consistent, and staying sane by Vincent...
Keeping hundreds of code repositories consistent, and staying sane by Vincent...Keeping hundreds of code repositories consistent, and staying sane by Vincent...
Keeping hundreds of code repositories consistent, and staying sane by Vincent...
 
The End is Nigh! Signs of Transformation Apocalypse by Alex Sloley at #AgileI...
The End is Nigh! Signs of Transformation Apocalypse by Alex Sloley at #AgileI...The End is Nigh! Signs of Transformation Apocalypse by Alex Sloley at #AgileI...
The End is Nigh! Signs of Transformation Apocalypse by Alex Sloley at #AgileI...
 
Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019
Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019
Strategic Domain-Driven Design by Nick Tune at #AgileIndia2019
 
All track development - (or how we dropped the collective ego and created a p...
All track development - (or how we dropped the collective ego and created a p...All track development - (or how we dropped the collective ego and created a p...
All track development - (or how we dropped the collective ego and created a p...
 
Open Salaries: from employees to managing partners by Alexey Voronin at #Agil...
Open Salaries: from employees to managing partners by Alexey Voronin at #Agil...Open Salaries: from employees to managing partners by Alexey Voronin at #Agil...
Open Salaries: from employees to managing partners by Alexey Voronin at #Agil...
 
Scaling Enterprise Agility amidst Cross Border Merger by Rocky Woestenborghs ...
Scaling Enterprise Agility amidst Cross Border Merger by Rocky Woestenborghs ...Scaling Enterprise Agility amidst Cross Border Merger by Rocky Woestenborghs ...
Scaling Enterprise Agility amidst Cross Border Merger by Rocky Woestenborghs ...
 
InfraOps Agility - A Sysad's Perspective by Dushyanth Harinath at #AgileIndia...
InfraOps Agility - A Sysad's Perspective by Dushyanth Harinath at #AgileIndia...InfraOps Agility - A Sysad's Perspective by Dushyanth Harinath at #AgileIndia...
InfraOps Agility - A Sysad's Perspective by Dushyanth Harinath at #AgileIndia...
 
Going for 10X: Building teams in a Hyper-Competitive Market by Jacob Singh at...
Going for 10X: Building teams in a Hyper-Competitive Market by Jacob Singh at...Going for 10X: Building teams in a Hyper-Competitive Market by Jacob Singh at...
Going for 10X: Building teams in a Hyper-Competitive Market by Jacob Singh at...
 
Principle 11 needs to go! by Ken France at #AgileIndia2019
Principle 11 needs to go! by Ken France at #AgileIndia2019Principle 11 needs to go! by Ken France at #AgileIndia2019
Principle 11 needs to go! by Ken France at #AgileIndia2019
 
Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...
Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...
Becoming the Catalyst - The Spark of Change that Will Move Your Team Forward ...
 
Branding within your UX: The secret to creating loyal customers by Bill Beard...
Branding within your UX: The secret to creating loyal customers by Bill Beard...Branding within your UX: The secret to creating loyal customers by Bill Beard...
Branding within your UX: The secret to creating loyal customers by Bill Beard...
 
Build Agile Organization: Lessons Learned from Aikido by Marc Gong at #AgileI...
Build Agile Organization: Lessons Learned from Aikido by Marc Gong at #AgileI...Build Agile Organization: Lessons Learned from Aikido by Marc Gong at #AgileI...
Build Agile Organization: Lessons Learned from Aikido by Marc Gong at #AgileI...
 
Security considerations while deploying Containerized Applications by Neepend...
Security considerations while deploying Containerized Applications by Neepend...Security considerations while deploying Containerized Applications by Neepend...
Security considerations while deploying Containerized Applications by Neepend...
 
Cloud Native in the US Federal Government by Jez Humble at #AgileIndia2019
Cloud Native in the US Federal Government by Jez Humble at #AgileIndia2019Cloud Native in the US Federal Government by Jez Humble at #AgileIndia2019
Cloud Native in the US Federal Government by Jez Humble at #AgileIndia2019
 
Reactive Systems by Dave Farley at #AgileIndia2019
Reactive Systems by Dave Farley at #AgileIndia2019Reactive Systems by Dave Farley at #AgileIndia2019
Reactive Systems by Dave Farley at #AgileIndia2019
 
Collaboration Contracts by Diane Zajac & Doc Norton at #AgileIndia2019
Collaboration Contracts by Diane Zajac & Doc Norton at #AgileIndia2019Collaboration Contracts by Diane Zajac & Doc Norton at #AgileIndia2019
Collaboration Contracts by Diane Zajac & Doc Norton at #AgileIndia2019
 
Tuckman was wrong by Doc Norton at #AgileIndia2019
Tuckman was wrong by Doc Norton at #AgileIndia2019Tuckman was wrong by Doc Norton at #AgileIndia2019
Tuckman was wrong by Doc Norton at #AgileIndia2019
 
7 Steps to Design, Build, and Scale an AI Product by Allie Miller at #AgileIn...
7 Steps to Design, Build, and Scale an AI Product by Allie Miller at #AgileIn...7 Steps to Design, Build, and Scale an AI Product by Allie Miller at #AgileIn...
7 Steps to Design, Build, and Scale an AI Product by Allie Miller at #AgileIn...
 

Kürzlich hochgeladen

Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
Kayode Fayemi
 
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
Sheetaleventcompany
 

Kürzlich hochgeladen (20)

ICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdfICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdf
 
My Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle BaileyMy Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle Bailey
 
Air breathing and respiratory adaptations in diver animals
Air breathing and respiratory adaptations in diver animalsAir breathing and respiratory adaptations in diver animals
Air breathing and respiratory adaptations in diver animals
 
Mohammad_Alnahdi_Oral_Presentation_Assignment.pptx
Mohammad_Alnahdi_Oral_Presentation_Assignment.pptxMohammad_Alnahdi_Oral_Presentation_Assignment.pptx
Mohammad_Alnahdi_Oral_Presentation_Assignment.pptx
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
 
ANCHORING SCRIPT FOR A CULTURAL EVENT.docx
ANCHORING SCRIPT FOR A CULTURAL EVENT.docxANCHORING SCRIPT FOR A CULTURAL EVENT.docx
ANCHORING SCRIPT FOR A CULTURAL EVENT.docx
 
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
 
VVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara Services
VVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara ServicesVVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara Services
VVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara Services
 
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
 
SaaStr Workshop Wednesday w/ Lucas Price, Yardstick
SaaStr Workshop Wednesday w/ Lucas Price, YardstickSaaStr Workshop Wednesday w/ Lucas Price, Yardstick
SaaStr Workshop Wednesday w/ Lucas Price, Yardstick
 
BDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort Service
 
Thirunelveli call girls Tamil escorts 7877702510
Thirunelveli call girls Tamil escorts 7877702510Thirunelveli call girls Tamil escorts 7877702510
Thirunelveli call girls Tamil escorts 7877702510
 
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
 
lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.
 
BDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort Service
 
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdfAWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
 
Call Girl Number in Khar Mumbai📲 9892124323 💞 Full Night Enjoy
Call Girl Number in Khar Mumbai📲 9892124323 💞 Full Night EnjoyCall Girl Number in Khar Mumbai📲 9892124323 💞 Full Night Enjoy
Call Girl Number in Khar Mumbai📲 9892124323 💞 Full Night Enjoy
 
Dreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video TreatmentDreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video Treatment
 
Introduction to Prompt Engineering (Focusing on ChatGPT)
Introduction to Prompt Engineering (Focusing on ChatGPT)Introduction to Prompt Engineering (Focusing on ChatGPT)
Introduction to Prompt Engineering (Focusing on ChatGPT)
 
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdfThe workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
 

Building and Scaling High Performing Technology Organizations by Jez Humble at #AgileIndia2019

  • 1. @jezhumble #agileindia2019 building and scaling high performing technology organizations
  • 2. @jezhumble “the enterprise” Project A Project B Project C DBAs Infrastructure team Service desk Value stream OperationsEngineeringBusiness Ping!
  • 3. @jezhumble Project A Project B Project C DBAs Infrastructure team Service desk Value stream OperationsEngineeringBusiness Ping! Project D Let’s create a new product enterprise projects
  • 4. @jezhumble Project A Project B DBAs Infrastructure team Service desk Project D We’re going agile! Oh no!Oh no! Value stream OperationsEngineeringBusiness
  • 5. @jezhumble Project A Project B DBAs Infrastructure team Service desk Value stream OperationsEngineeringBusiness Project D Our test-driven code follows SOLID principles Shame it doesn’t work Change management
  • 6. Jon Jenkins, “Velocity Culture, The Unmet Challenge in Ops” | http://bit.ly/1vJo1Ya
  • 7. @jezhumble a note about predictive analysis One of three conditions must be met: • Randomized, experimental design (no, this is non-experimental) • Longitudinal (no, this is cross-sectional) • Theory-based design When this condition was not met, only correlations were tested and reported .
  • 8.
  • 9. @jezhumble firmographics Accelerate: The Science of Lean Software and DevOps, Forsgren, Humble and Kim 2018
  • 10. software delivery as a competitive advantage “Firms with high-performing IT organizations were twice as likely to exceed their profitability, market share and productivity goals.” http://bit.ly/2014-devops-report
  • 11. software delivery as a competitive advantage high performers were more than twice as likely to achieve or exceed the following objectives: •Quantity of products or services •Operating efficiency •Customer satisfaction •Quality of products or services provided •Achieving organizational and mission goals •Measures that demonstrate to external parties whether or not the organization is achieving intended results http://bit.ly/2018-devops-report
  • 12. @jezhumble time to restore service lead time for changes (version control to production) deploy frequency change fail rate software delivery performance http://bit.ly/2014-devops-report
  • 14. elite performers http://bit.ly/2018-devops-report Data shows a new 4th high performance group: elite performers Proportion of high performers has grown YoY, but the bar for excellence remains high Elite performers are still able to optimize for throughput and stability
  • 15. availability http://bit.ly/2018-devops-report Ability for teams to ensure their product or service can be accessed by end users Software delivery + availability = SDO performance Elite performers are 3.5X more likely to have strong availability practices
  • 16. capabilities that drive high performance Accelerate: The Science of Lean Software and DevOps, Forsgren, Humble and Kim 2018
  • 18. @jezhumble key finding: architectural outcomes can my team… …make large-scale changes to the design of its system without the permission of somebody outside the team or depending on other teams? …complete its work without needing fine-grained communication and coordination with people outside the team? …deploy and release its product or service on demand, independently of other services the product or service depends upon? …do most of its testing on demand, without requiring an integrated test environment? …perform deployments during normal business hours with negligible downtime? http://bit.ly/2017-devops-report | https://devops-research.com/research.html | DORA / Puppet
  • 19. @jezhumble key finding: doing cloud right http://bit.ly/2018-devops-report | NIST SP 800-145 AGREED OR STRONGLY AGREED On-demand self-service Broad network access Resource Pooling Rapid elasticity Measured service Only 22% of teams are doing cloud right! Teams that use these essentials characteristics are 23X more likely to be elite performers
  • 20. @jezhumble cloud in regulated environments https://devops-research.com/research.html
  • 21. @jezhumble monitoring and observability MONITORING is tooling or a technical solution that allows teams to watch and understand the state of their systems and is based on gathering predefined sets of metrics or logs. OBSERVABILITY is tooling or a technical solution that allows teams to actively debug their system and explore properties and patterns they have not defined in advance. Teams with a comprehensive monitoring and observability solution were 1.3 times more likely to be an elite performer. Having a monitoring and observability solution positively contributed to SDO performance. Fun stats fact: monitoring and observability load together.
  • 22. @jezhumble which of these measure effective test practices? • Developers primarily create & maintain acceptance tests • QA primarily create & maintain acceptance tests • Primarily created & maintained by outsourced party • When automated tests pass, I’m confident the software is releasable • Test failures are likely to indicate a real defect • It’s easy for developers to fix acceptance tests • Developers share a common pool of test servers to reproduce failures • Developers create on demand test environments • Developers use their own dev environments to reproduce failures
  • 23. @jezhumble which of these measure effective test practices? • Developers primarily create & maintain acceptance tests • QA primarily create & maintain acceptance tests • Primarily created & maintained by outsourced party • When automated tests pass, I’m confident the software is releasable • Test failures are likely to indicate a real defect • It’s easy for developers to fix acceptance tests • Developers share a common pool of test servers to reproduce failures • Developers create on demand test environments • Developers use their own dev environments to reproduce failures
  • 24. @jezhumble continuous testing previous practices plus… • continuously reviewing and improving test suites to better find defects and keep complexity and cost under control • allowing testers to work alongside developers throughout the software development and delivery process • performing manual test activities such as exploratory testing, usability testing, and acceptance testing throughout the delivery process • having developers practice test-driven development by writing unit tests before writing production code for all changes to the codebase • being able to get feedback from automated tests in less than ten minutes both on local workstations and from a CI server http://bit.ly/2018-devops-report | https://devops-research.com/research.html
  • 26. @jezhumble lean product management Regularly gathering, broadcasting, & implementing customer feedback Splitting work into small batches that can be completed in <1 week & released frequently Teams have a good understanding of the flow of work from business to customers Teams have the authority to create and change specifications as part of the dev process Software delivery performance Less burnout Westrum culture Lean product management Organizational performance
  • 28. high trust culture Westrum, “A Typology of Organizational Cultures” | http://bmj.co/1BRGh5q how organizations process information
  • 30. @jezhumble identity and google items • I am glad I chose to work for this organization rather than another company. • I talk of this organization to my friends as a great company to work for. • I am willing to put in a great deal of effort beyond what is normally expected to help my organization to be successful. • I find that my values and my organization's values are very similar. • In general, the people employed by my organization are working toward the same goal. • I feel that my organization cares about me. Adapted from adapted from Atreyi Kankanhalli, Bernard C.Y. Tan, and Kwok-Kee Wei (2005), “Contributing Knowledge to Electronic Knowledge Repositories: An Empirical Investigation,“ MIS Quarterly, 29, 113-143. Westrum items
  • 31. @jezhumble ask: how can we get people better information? in a complex, adaptive system failure is inevitable when accidents happen, human error is the starting point of a blameless post-mortem ask: how can we detect and limit failure modes? dealing with failure
  • 32. @rynchantress | https://ryn.works/2017/06/17/on-failure-and-resilience/ The immediate response from everyone around was to ask, “What help do you need?”
  • 33. @jezhumble disaster recovery testing “For DiRT-style events to be successful, an organization first needs to accept system and process failures as a means of learning… We design tests that require engineers from several groups who might not normally work together to interact with each other. That way, should a real large-scale disaster ever strike, these people will already have strong working relationships” Kripa Krishnan | http://queue.acm.org/detail.cfm?id=2371297 —Kripa Krishnan, Director, Cloud Operations, Google
  • 37. “I think building this culture is the key to innovation. Creativity must flow from everywhere. Whether you are a summer intern or the CTO, any good idea must be able to seek an objective test, preferably a test that exposes the idea to real customers. Everyone must be able to experiment, learn, and iterate.” innovation culture http://glinden.blogspot.com/2006/04/early-amazon-shopping-cart.html
  • 38. thank you! © 2016-8 DevOps Research and Assessment LLC and Jez Humble and Associates LLC Please take the 2019 State of DevOps Survey and help us understand how to build high performing teams! bit.ly/2019-sodr-survey