Based on recent research findings from the EMA Worldwide DevOps 2020 survey, leading IT analyst firm Enterprise Management Associates (EMA) provides insights into where DevOps is headed.
1. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
DevOps 2020 Survey
How DevOps is Maturing in the Enterprise
Stephen D. Hendrick
Research Director
Application Development & Management
August 2018
2. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Watch the On-Demand Webinar
• How DevOps is Maturing in the Enterprise On-Demand
webinar is available here:
http://info.enterprisemanagement.com/devops2020-webinar-ws
• Check out upcoming webinars from EMA here:
http://www.enterprisemanagement.com/freeResearch
3. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Today’s Speaker
3
Steve Hendrick, Research Director, EMA
Steve has over 20 years of experience as an industry analyst and 10
years of experience across a variety of application development roles.
He specializes in application development and deployment topics,
including DevOps, lifecycle management, application platforms,
decision analytics, middleware, and the broad spectrum of tools and
technologies that support professional developers and IT managers.
Steve brings advanced quantitative and qualitative research techniques
to bear as an industry analyst providing vendors with deep insight into
the markets they compete in.
4. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Logistics for Today’s Webinar
An archived version of the event recording will be
available at www.enterprisemanagement.com
• Log questions in the chat panel located on the
lower left-hand corner of your screen
• Questions will be addressed during the Q&A
session of the event
QUESTIONS
EVENT RECORDING
4
5. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
A Thank You to Our Sponsors
Sponsors are key to making this research possible
5
Gold Sponsor
Silver Sponsors
6. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
DevOps 2020 Project Overview
6
7. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
DevOps 2020
Project Objectives
Primary Objective
• Understand current and planned DevOps tool category use across 20 DevOps market
segments
• Identify large enterprise DevOps maturity, objectives, and challenges
• Develop a DevOps maturity model
Secondary Objective
• For select DevOps tool categories identify products in use, feature effectiveness, and
satisfaction
• For select DevOps tool categories evaluate what is driving tool selection or reasons
for not using a tool
7
8. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
DevOps 2020
Survey Parameters and Screening Criteria
• Sample Size: 419
• Geographic Scope: Worldwide
• Survey Fielding: June 2018
• Respondent: Senior IT development or management staff
• Target Respondent: IT professionals experience in SDLC, DevOps, App release,
dev/test environment management, data management, and app development
• Enterprise size: 2,500 employees or more
• Custom app dev: Active enterprise involvement
• Vertical industries: All other than education and IT vendors
• Domain expertise: Strong familiarity and involvement with DevOps
8
9. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
28%
27%
20%
15%
10%
0% 5% 10% 15% 20% 25% 30%
2,500 to 4,999
5,000 to 9,999
10,000 to 19,999
20,000 to 29,999
30,000 or more
Percent responding (single response)
Enterprise Size
How many total employees does your enterprise have worldwide?
EMA DevOps 2020 Survey, June 2018, Q2, N=419 9
10. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
25%
44%
47%
50%
53%
53%
57%
62%
0% 10% 20% 30% 40% 50% 60% 70%
Application test management
Development/Test environment management
DevOps management
Application release management
Application development manager
Software development lifecycle management
Data and database management
Workload automation management
Percent responding (multiple response)
Respondent Experience
In which of the following IT areas do you have recent experience?
EMA DevOps 2020 Survey, June 2018, Q1, N=419 10
11. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
App Dev, 24%
DevOps Engineer, 8%
QA Engineer, 8%
IT Operations, 32%
IT Management, 16%
C-Level, 12%
Survey Respondent Role
Respondents by role
EMA DevOps 2020 Survey, June 2018, Q4, N=419 11
12. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
DevOps Maturity
12
13. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
35%
27%
37%
0% 10% 20% 30% 40%
We develop many custom applications that impact nearly every activity
in our enterprise
We develop a moderate # of custom applications in support of internal
info needs as well as transacting with customers/business partners
We develop custom applications to support our internal informational
needs only
We rarely develop custom applications
We do not develop custom applications and would outsource any
application development needs that might arise
Percent responding (single response)
Approach to Custom Application Development
What response describes your enterprise’s approach to application development?
EMA DevOps 2020 Survey, June 2018, Q3, N=419
Screened out of sample
13
14. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
3%
4%
20%
40%
19%
15%
0% 10% 20% 30% 40% 50%
Don’t know or not sure
Agile is integrated across the enterprise, everybody works in an agile
way, & continuous improvement is part of our DNA
Agile methods are mainstream across most of the enterprise although
some departments are still not agile
We have many people who know & use agile techniques and agile
development is often practiced
We have some autonomous teams that can regularly deliver working
software
Some agile concepts are applied alongside waterfall processes
Percent responding (single response)
Agile Maturity
Which of the following statements best describe the state of DevOps at your enterprise?
EMA DevOps 2020 Survey, June 2018, Q12, N=419 14
15. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
9%
24%
35%
32%
0% 10% 20% 30% 40%
We have automated nearly all of the activities in our DevOps pipeline
We have automated many of the activities in our DevOps pipeline
We have automated some of the key activities in our DevOps pipeline
We are just beginning to automate one or two activities in our DevOps
pipeline
We have not yet started to use Devops principles and tools
Percent responding (single response)
DevOps Maturity
How would you describe your enterprise’s use of DevOps for cutom application development?
EMA DevOps 2020 Survey, June 2018, Q7, N=419
Screened out of sample
15
16. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
10%
53%
20%
9%
8%
0% 10% 20% 30% 40% 50% 60%
As a hosted service though a managed service provider
In a hybrid combination of a public cloud and our own data center
In a public cloud using dedicated resources
In a public cloud using multitenant resources
In our own data center
Percent responding (single response)
DevOps Pipeline Deployment
Where have you deployed your DevOps pipeline?
EMA DevOps 2020 Survey, June 2018, Q8, N=419 16
17. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
79%
56%
53% 53% 53%
49% 47% 47% 46%
43%
37%
34% 33% 32%
28%
23% 21%
17%
15%
12%
0%
20%
40%
60%
80%
100%
DevOps Tool Category Use -- Current
Percent Responding
EMA DevOps 2020 Survey, June 2018, Q9, N=419 17
18. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
0%
20%
40%
60%
80%
100%
Use Imp 2018
DevOps Tool Category Use – EOY 2018
Percent Responding
EMA DevOps 2020 Survey, June 2018, Q9, N=419 18
19. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
0%
20%
40%
60%
80%
100%
Use Imp 2018 Imp 2019
DevOps Tool Category Use – EOY 2019
Percent Responding
EMA DevOps 2020 Survey, June 2018, Q9, N=419 19
20. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
0%
20%
40%
60%
80%
100%
Use Imp 2018 Imp 2019 Imp 2020
DevOps Tool Category Use – EOY 2020
Percent Responding
EMA DevOps 2020 Survey, June 2018, Q9, N=419 20
21. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
DevOps Maturity Model
Derived from DevOps 2020 longitudinal market segment data
Manual Testing
CI/CD
Source Code Mgmt
Dev/Test Env Create
App Release Auto
Shift left of ITSM and
AI Ops integration.
App Lifecycle mgmt.
ITSM and AIOps
considerations.
Containerization.
DevOps for database.
Pipeline management.
App management.
Incremental
complementary
pipeline capabilities to
drive higher levels of
automation &
management.
Maturity Level 1
Foundational
2
Mainstream
3
Modern
4
Optimized
What’s Missing?
Key Incremental
Capabilities added
+
SCM
WLA
Test Env Mgmt
Con Test Platform
IT-PPM
+
APM
Con DBMS Integration
Release Management
Functional Test Auto
Load Testing
+
DBMS Release Orch
Machine Data Mgmt
Image Reg & Repo
Value Stream Mgmt
EMA DevOps 2020 Survey, June 2018 21
22. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
0%
20%
40%
60%
80%
100%
120%
140%
160%
180%
200%
Use Grow 2018 Grow 2019 Grow 2020
DevOps Tool Category Use and Projected Growth
Percent Responding
EMA DevOps 2020 Survey, June 2018, Q9, N=419 22
Foundational Mainstream Modern Optimized
23. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
14%
22%
18%
34%
7%
5%
5%
15%
9%
4%
27%
40%
4%
10%
8%
19%
12%
18%
29%
0% 10% 20% 30% 40% 50% 60% 70% 80%
Other
Improve IT productivity and reduce cost
Improve the quality and reliability of applications
Improve the customer experience
Improve the speed of software delivery
Improve the performance of applications
Improve our agility in addressing changing market needs
Number of mentions
First Second Third
DevOps Top 3 Objectives
What are the top 3 objectives that your enterprise wants to accomplish through IT Automation
and DevOps?
EMA DevOps 2020 Survey, June 2018, Q10, N=419 23
24. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
16%
6%
16%
22%
14%
17%
5%
13%
32%
38%
4%
5%
7%
14%
14%
16%
3%
5%
4%
10%
13%
0% 10% 20% 30% 40% 50% 60% 70% 80%
Figuring out how to add or integrate new tools into our tool chain
Knowing where to start in building a DevOps tool chain
Finding a way to fully test applications given the faster speed of application development
We don’t have the expertise to pursue additional IT automation and DevOps activities
Determining when to implement a DevOps for database strategy
Deciding when to throw out our cobbled together tool chain for something better
Making a commitment to DevOps because other business commitments get in the way
We are using DevOps but GRC policy prevents us from timely moving to production
Changing the way our staff does application development and deployment
Getting Ops staff interested in helping define and configure our DevOps strategy
Dealing with the impact of project scope changes on our pipeline
Deciding what knowledge and tools developers and IT Operations should share
Setting up and managing Dev and Test environments
Number of mentions
First Second Third
DevOps Top 3 Challenges
What are the top 3 DevOps challenges that your enterprise faces now?
EMA DevOps 2020 Survey, June 2018, Q11, N=419 24
25. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Conclusions and Recommendations
Advice to DevOps professionals
• DevOps starts with people and process and only then do you introduce product.
• The DevOps maturity model reflects the sequence of tool adoption based on
priorities and dependencies.
• Consider pipeline management capabilities like APM, RM, MDM, and VSM earlier
than later – especially if your intent is a comprehensive DevOps strategy.
• Use this maturity model to position you enterprise and leverage the crowd-sourced
perspective of this survey to evaluate your DevOps implementation plans.
• Improving agility is the top DevOps objective. How you architect and chose to build
and application will determine how to configure you pipeline.
• The top DevOps challenge is addressed by a combination of TEM and DTE tools.
25
26. IT & DATA MANAGEMENT RESEARCH,
INDUSTRY ANALYSIS & CONSULTING
Steve Hendrick
Research Director
Boston, MA
617.899.5359
shendrick@emausa.com
www.enterprisemanagement.com
Get More Information
Get the report at http://bit.ly/2GfkT8Y