Software as Craft

© 2018, DevOps Research and Assessment, LLC. All Rights Reserved.1 @nicolefvhttp://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.@nicolefv
Software as Craft
Nicole Forsgren, PhD
DevOps Research and Assessment (DORA)

© 2018, DevOps Research and Assessment, LLC. All Rights Reserved.2 @nicolefv
IT (Technology)
is a Cost Center

“IT doesn’t matter.”
-- Nicholas Carr, 2003

Technology DOES matter

Key Findings 2018 ASODR - Elite Performers

Key Findings 2018 ASODR - Year over Year

© 2018, DevOps Research and Assessment, LLC. All Rights Reserved.10 @nicolefv © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Elite Performers
Proportion of high performers has
grown YoY, but the bar for
excellence remains high
Highest (elite) performers are still able
to optimize for throughput and
stability

New 2018 Performance Benchmarks

Adding Availability
Ability for teams to ensure their
product or service can be accessed
by end users
Software delivery +
operational performance is
SDO performance
Elite performers are
3.5X more likely to have strong
availability practices

Some teams still struggle
Why?

The key to performance is
EXECUTION

You’re doing it wrong.
There is no
”DevOps in a box”

the CLOUD

● Hands up! Working in the cloud
the CLOUD

● Keep them up: On-demand self-service. NO TICKETS
the CLOUD

● Keep them up: Broad network access: ALL THE DEVICES
the CLOUD

● Keep them up: Resource pooling: RESOURCES DYNAMICALLY ASSIGNED
the CLOUD

● Keep them up: Rapid elasticity: BURSTING LIKE MAGIC
the CLOUD

● Keep them up: Rapid elasticity: BURSTING LIKE MAGIC
● Keep them up: Measured service: AUTO RESOURCE OPTIMIZATION
the CLOUD

Doing Cloud Right
It's not just about adopting cloud, it’s
using cloud in essential ways that
matters.
Only 22% of teams are doing cloud
right
Teams that use these essentials
characteristics are 23X more likely
to be elite performers
AGREED OR STRONGLY AGREED
On-demand self-service
Broad network access
Resource Pooling
Rapid elasticity
Measured service

Architecture matters
Technology stack doesn’t

Technology stack doesn’t matter
● Low performers are more likely to:
○ be working with outsourced software
○ be working on a mainframe system
BUT
● Working on a mainframe system was not correlated
with performance.
● Working on greenfield or brownfield (or any other
system) was not correlated with performance, either.

Architectural outcomes matter
Can my team
○ Change the design of its system
○ Test the system
○ Deploy the system
... without communication and coordination
with people outside the team?

Conway’s Law
“organizations which design systems …
are constrained to produce designs
which are copies of the communication
structures of these organizations”

More execution
DOs and DON’Ts

DO: Open Source Software
The data shows that using open
source software is correlated with
high SDO performance
Teams that use open source
software are 1.75X more likely to be
elite performers
Those same teams are also
1.5X more likely to expand their
open source usage in future

DON’T: Go Slow
Misguided Performers
Some teams optimize for caution:
low deploy frequency, high lead
times, and low deployment failure
That same group also reports the
longest times to restore service
for outages (1-6 months!)
Large-batch changes add
complexity & no one thinks it will
happen to them, but 5% of teams
suffer the consequences

DON’T: Outsourcing
Low performing teams are
3.9X more likely to use
functional outsourcing than
elite teams
Elite teams rarely adopt
functional outsourcing
Misguided performers have the
highest use of outsourcing
of all groups

Some new technical
practices from 2018

Include the Database
Integrating database practices look
much like integrating ops work in
early days: communication, config
management, including teams,
visibility
Teams could think about this like
“shifting left”
Database change management is
important for ALL teams

Evolve Testing
Automated testing played a role in
prior years’ research. We
investigated if the evolving role of
testing in continuous delivery
contributes.
Continuous testing extends
automated testing practices and
positively contributes to SDO
performance

Evolve Testing
Continuous testing:
• Fast, reliable test suites
• Created & maintained by devs
• Data easily available for tests
• Continuously improving test suites
• Testers + developers = <3
• Manual test throughout
(exploratory, usability, acceptance)
• Have devs practice TDD
• Be able to get feedback from test
suites in 10 min or less

Looking Into Our Systems
Teams with a comprehensive
monitoring and observability
solution were 1.3 times more likely
to be an elite performer.
Having a monitoring and
observability solution positively
contributed to SDO performance.
Fun stats fact: monitoring and
observability load together.

Security
Shifting left on security remains
important. 87% of respondents
were subject to regulatory
compliance.
Low performers take weeks to
conduct security reviews and
complete the changes; elite
performers take days to do the
same.

Deeper Analysis

Some Surprises

Industry Doesn’t Matter
Industry does not matter for
achieving high performance for
software delivery
High performers exist in both non-
regulated and
highly regulated industries alike
Any team in any industry has the
potential to achieve a high degree of
SDO performance

Change Approvals…
Change Approval Boards (CABs)
don’t work for improving
performance or even stability. They
do help to notify others about
changes
The best bet for approvals?
• Peer review
• Lightweight (peer) change
approvals
• NO change approval process

Security
Who is responsible for security?

The J-Curve of Transformation
Teams begin
transformation
and identify
quick wins
Automation helps low
performers progress to
medium performers
Automation increases test
requirements, which are dealt
with manually. A mountain of
technical debt blocks progress.
Technical debt and increased
complexity cause additional manual
controls and layers of process around
changes, slowing work
Relentless improvement
work leads to excellence
and high performance!
High and elite
performers leverage
expertise and learn from
their environments to
see jumps in productivity

We can make work better

Smart investments in tech and
practices make our work better
● The work?
○ Less deployment pain
○ Less burnout
○ Higher employee Net Promoter Score

Microsoft Engineering
Thiago Almeida -- DevOps Days London, 2016
Work/Life
Scores
Before CD: 38%
After CD: 75%
https://vimeo.com/165184757

Employees in high performing
organizations are 2.2 times
more likely to recommend
their organization as a
great place to work

Westrum Organizational Culture

Improving Culture
Giving teams autonomy
improves voice and trust
Voice and trust improve
Westrum organizational
culture, which drives SDO
and organizational
performance

Improving Culture
Retrospectives that drive
learning & improvement
contribute to a climate for
learning and a better
culture.
A strong climate for
learning is key in times of
changing tech, market
conditions, and customer
demands.

TL;DR
● Execution is key
● Technology matters
● Architecture > technology
● Cloud works*
● Do’s (OSS) and Don’ts (Outsourcing)
● We can make work & our culture better

© 2018, DevOps Research and Assessment, LLC. All Rights Reserved.56 @nicolefvhttp://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.http://devops-research.com
Download the full
report
https://cloudplatformonline.com/2018-state-of-devops.html

© 2018, DevOps Research and Assessment, LLC. All Rights Reserved.57 @nicolefvhttp://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.http://devops-research.com
Questions?
https://cloudplatformonline.com/2018-state-of-devops.html

Boneyard

Ways to Improve SDO Performance
● Adopting essential cloud characteristics is key to truly realizing benefits
● Organizations need to make smart investments in technology, lean
practices and culture -- holistic transformation is important
● The data on functional outsourcing is in, and it’s decisive: this is not a
winning bet
● Optimize for throughput, stability, and availability

Report Authors
The DORA Cofounders
Dr. Nicole Forsgren: PhD, sysadmin, scientist, author of Accelerate, named top 10 influencer in DevOps
Jez Humble: Author of Accelerate, Continuous Delivery, Lean Enterprise, and The DevOps Handbook
Gene Kim: Founder of Tripwire Inc, author of Accelerate, The Phoenix Project, DevOps Handbook, & more
Many thanks to George Miranda and Xavier Velasquez for their contributions to the report. Cheryl Coupe was our
copyeditor and Siobhan Doyle did design. We also thank those who assisted with research advice and guidance.

Gold Sponsors
Diamond Sponsor

● Largest and longest-running research of its kind
● 5 years of rigorous research, surveying 30,000+ professionals worldwide
● Investigates practices that lead to higher software delivery performance
● Higher software delivery performance = powerful business outcomes
● Only report to include performance benchmarks with cluster analysis
● Predictive analysis to identify specific improvement strategies
The Accelerate: State of DevOps Report

Introductions - Your host
Dr. Nicole Forsgren
Lead investigator, PhD
CEO and Chief Scientist, DORA
Diet Coke lover*
* Nicole wrote this slide

Software Delivery and
Operational performance
(SDO performance)
2018 - Key Themes
SDO performance is the driver that
unlocks competitive advantages for IT
organizations.
SDO performance is the practice
behind not just creating, but also
operating, software in ways that
generate powerful business outcomes.

Identify the key
Technical Practices
that drive SDO performance
2018 - Key Themes
The Accelerate: State of DevOps
Report confirms findings from previous
years.
New for 2018, key technical practices
include:
● Monitoring and observability
● Continuous testing
● Database change management
● "Shifting left" on security

Identify the key
Cultural Practices
that drive SDO performance
2018 - Key Themes
The Accelerate: State of DevOps
Report confirms the Westrum cultural
model from previous years.
New for 2018! How to influence
culture through organizational work:
● Influencing culture through
autonomy & trust
● Creating a culture of learning
(retrospectives)

Software as Craft

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie Software as Craft

Ähnlich wie Software as Craft (20)

Mehr von Nicole Forsgren

Mehr von Nicole Forsgren (10)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Software as Craft

Hinweis der Redaktion