A recently commissioned study of 301 senior-level IT executives in France, Germany and the UK had research firm Coleman-Parkes surveying only companies of equivalent US $1 Billion revenue or more, on their current challenges in application development, testing and delivery. Justin Vaughan-Brown, CA ITKO director Partner Marketing, introduces the interesting initial results of this research.
Get your own CA-sponsored copy of the findings at https://www.ca.com/us/collateral/white-papers/na/Business-Benefits-of-Service-Virtualization-wp.aspx
1. Initial Study: UK, France, Germany July 2012
The Business Benefits of Service Virtualization
Background to study with supporting graphs
Info graphics and country summaries
Full study download page
Feature blog with supporting links
www.servicevirtualization.com #svworks
2. Contents
Background to study 3
Landing page 4
Info graphics 5
Supporting graphs 9
Country summaries 39
Feature blog 47
Supporting links 48
1
3. Background to study
Initial Study Results: UK, France, Germany
The Business Benefits of Service Virtualisation | July 2012
The first in a series of research papers exploring how conventional approaches to software development and
testing are hampering business growth. This initial study, conducted by independent research firm Coleman Parkes
on by CA Technologies, is based on 301 telephone interviews with in-house software development managers from
large enterprises with revenues of more than USD1 billion or equivalent in the UK, France and Germany.
These findings are a ‘wake-up call’ to organisations that are taking a conventional approach to software
development. They are spending money unnecessarily, and it is hurting the bottom line. Project delays add more
direct costs, defer potential revenues and impact customer service improvements. Respondents were painfully
aware of the direct business consequences of these problems, reporting:
Loss of reputation in the market (56%)
Loss of customers to competitors (48%)
Late delivery of new customer offerings (45%)
Reduced functionality (39%)
Increased calls to customer support (32%)
Service Virtualization specifically addresses these challenges and is better aligned to meet the needs of the
modern enterprise that expects high quality applications to be delivered on time and on budget. According to all
301 respondents, the positive impact on businesses growth and success as a result of eliminating these constraints
would be improved customer satisfaction (80%), reduced costs (77%) and improved market reputation (73%).
1
10. Number of interviews by vertical sector.
number of interviews by vertical sector
Base: Total Respondents
11. Q.1 How many releases are you expected to deliver/manage per year?
Q.1 How many releases are include all majorto deliver/managein your response.
Please you expected and minor releases per year?
Please include all major and minor releases in your response.
Base: Total Respondents
Means:
Total = 6.4
UK = 7.1
France = 6.3
Germany = 5.9
12. Q.2 Compared to 2011, do you expect the number of releases you will be
Q.2 Compared to 2011, do you expect the number of releases you will be
participating in this year to:
participating in this year to:
Base: Total Respondents
13. Q.3 Compared to 2011, do you expect the functionality of this year’s
Q.3 Compared to 2011, do you expect the functionality of this year’s releases to:
releases to:
Base: Total Respondents
14. Q.4 On average, how much time are you given in which to develop, test and
Q.4 On average, how deploy time arenew application?
much a typical you given in which to develop, test and deploy a
typical new application?
Base: Total Respondents
Means:
Total = 5.1
UK = 5.1
France = 4.6
Germany = 5.7
15. Q.5 Compared to 2011, do think the time you are given to develop, test and
Q.5 Compared to 2011, do think thenew applicationgiven to develop, test and deploy a
deploy a typical time you are will:
typical new application will:
Base: Total Respondents
16. Q.6 How often do you experience delays between development and testing
Q.6 How often do you experienceunavailable applications or systems? testing teams
teams due to delays between development and
due to unavailable applications or systems?
Base: Total Respondents
17. Q.7 Approximately what percentage of planned releases goes into
Q.7 Approximately what percentage of to constraints in thegoes into production late
production late due planned releases application development lifecycle?
due to constraints in the application development lifecycle?
Base: Total Respondents
18. Q.8 Which of the following access constraints present the biggest
Q.8 Which of the following accessand testing challenges to the company currently? and
development constraints present the biggest development
testing challenges to the company5currently? being a great challenge
% saying 4 or out of 5, 5
% saying 4 or 5 out of 5, 5 being a great challenge Base: Total Respondents
19. Q.9 Please rate the following potential impacts of these constraints for the
Q.9 Please rate the following potential impacts have any major constraintsthe company
company (even if you do not of these constraints for now)?
(even if you do not haveRespondentsconstraints now)?
All any major
All Respondents Base: Total Respondents
20. Q.9 Please rate the following potential impacts of these constraints for the
Q.9 Please rate the following potential impacts have any major constraintsthe company
company (even if you do not of these constraints for now)?
(even if you do not haveOnly major constraints now)?
UK any
UK Only Base: Total Respondents
21. Q.9 Please rate the following potential impacts of these constraints for the
Q.9 Please rate the following potential impacts have any major constraintsthe company
company (even if you do not of these constraints for now)?
(even if you do not have any major constraints now)?
France Only
France Only Base: Total Respondents
22. Q.9 Please rate the following potential impacts of these constraints for the
Q.9 Please rate the following potential impacts have any major constraintsthe company
company (even if you do not of these constraints for now)?
(even if you do not have any major constraints now)?
Germany Only
Germany Only Base: Total Respondents
23. Q.9 Please rate the following potential impacts of these constraints for the
Q.9 Please rate the following potential impacts have any major constraintsthe company
company (even if you do not of these constraints for now)?
(even if you do not have any major constraints now)? impact
Mean score out of 5, 5 being a great
Mean score out of 5, 5 being a great impact Base: Total Respondents
2.9 Total
Increased calls to customer support 3.2
2.7
2.9 UK
3.1
3.4 France
Reduced functionality impacts customer experience
2.7
3.2
Germany
3.2
New customer offerings are late to market 3.4
3.0
3.3
3.4
Loss of customers to competitors 3.6
3.0
3.5
3.5
Loss of reputation in the market 3.8
3.0
3.6
1.0 2.0 3.0 4.0 5.0
24. Q.10 What is the impact of these constraints upon the development and
Q.10 What is the impact of these constraints upon the development and testing
testing teams
teams
Base: Total Respondents
51 Total
Lack of confidence in the new release 60
44
50
UK
55
IT viewed negatively/brand of Department impacted 56 France
50
58
Germany
62
Releases go into production with reduced functionality 69
61
55
68
Key customer-facing applications are delivered late 71
57
76
71
Additional budget for extra heads has to be found 68
66
78
0 20 40 60 80 100
25. Q.11 At what single stage does your company experience the greatest issues
Q.11 At what single stage costs, quality and time-to-market? the greatest issues with
with does your company experience
costs, quality and time-to-market?
Base: Total Respondents
26. Q.12 As a result of the time and application functionality expectations you
Q.12 As a result of the time and how is your current relationship with the business compared to
experience, application functionality expectations you
experience, how is your current relationship with the business compared to a year
a year ago?
ago? Base: Total Respondents
27. Q.13a How often do you have a comprehensive insight into how complex
Q.13a How often do you have a comprehensive insight into how complex integrated
integrated applications will perform?
applications will perform?
Base: Total Respondents
28. Q.13b And how often do you have a comprehensive insight into how
Q.13b And how often do youintegrated applications could break? how complex
complex have a comprehensive insight into
integrated applications could break?
Base: Total Respondents
29. Q.14a What of the following potential changes will cause you the greatest
Q.14a What of the following potential changes will cause you the greatest challenges
challenges this year?
this year?
Base: Total Respondents
44
Moving the development/test environment to the cloud 48
37
48
49
Moving to Agile development from other approaches 46
51
49
52
Devolved and extended teams needing access to shared environments 58
40
58
53
Application transformation 52
51
57
53
Application modernisation 52
49
58
55
Reduced application development budgets 61
44
61
55
Changing needs from senior management 61
50
Total 53
71
UK Customer needs 69
72
72
France
Germany 0 20 40 60 80
30. Q.14b Which of the following do you feel are the benefits you could achieve
Q.14b Which of the following do youdevelopment and testing, even if you are notwith it now?
with cloud based feel are the benefits you could achieve using
cloud based development and testing, even if you are not using it now?
Base: Total Respondents
50
Improved QA agility to support business objectives 55
40
54
51
Standardized tracking of projects through standardised metrics 54
45
55
52
Better quality 56
48
52
56
Reduce time to market 59
53
56
59
Better resource management (HW/SW and people) 58
59
60
Total
73
Reduced cost 78
UK 67
75
France
0 20 40 60 80
Germany
31. Q.15 How long does it take to obtain access to or replicate mainframe
Q.15 How long does it take to obtain access to or replicate mainframe systems solely
systems solely for development /test purposes?
for development /test purposes?
Base: Total Respondents
32. Q.16 Which of the following are your typical main challenges with test
Q.16 Which of the following are your typical main challenges with test environments?
environments?
Base: Total Respondents
33. Q.17 If you could remove current constraints, which of the following would
Q.17 If you could remove current constraints, which of the following would be the
be the impact to you?
impact to you?
Base: Total Respondents
59
Development cycles cut
57
71
Increase in stakeholder satisfaction
65
75
Increase in quality
70
71
Improved speed to market
70
Better relationship with the 71
business 71
UK
84
Reduced costs
76 Total
0 20 40 60 80 100
34. Q.17 If you could remove current constraints, which of the following would
Q.17 If you could remove current constraints, which of the following would be the
be the impact to you?
impact to you?
Base: Total Respondents
50
Development cycles cut
57
63
Increase in stakeholder satisfaction
65
61
Increase in quality
70
61
Improved speed to market
70
69
Better relationship with the business
71
France
72
Reduced costs
76 Total
0 20 40 60 80 100
35. Q.17 If you could remove current constraints, which of the following would
Q.17 If you could remove current constraints, which of the following would be the
be the impact to you?
impact to you?
Base: Total Respondents
62
Development cycles cut
57
62
Increase in stakeholder satisfaction
65
73
Increase in quality
70
79
Improved speed to market
70
Better relationship with the 74
business 71
Germany
72
Reduced costs
76 Total
0 20 40 60 80 100
36. Q.18 And which of the following would be the impact to the business as a
Q.18 And which of the following would be the impact to the business as a result?
result?
Base: Total Respondents
37. Q.18 And which of the following would be the impact to the business as a
Q.18 And which of the following would be the impact to the business as a result?
result?
Base: Total Respondents
38. Q.18 And which of the following would be the impact to the business as a
Q.18 And which of the following would be the impact to the business as a result?
result?
Base: Total Respondents
40. Summary of findings Page 1 of 2 for UK
The top areas where a UK company experiences the greatest issues with cost; quality and time-to-market centre on integration testing (59%
compared with 48% overall); performance testing (41% compared with 32% overall) and regression testing (32%). In all areas more UK companies
experience issues compared with the rest.
37% of UK companies (33% overall) say that for most of the time they have a comprehensive insight into how complex integrated applications
could break but 16% say rarely or never.
The key changes that will cause the greats challenges for UK based firms this year include customer needs (69%); changing needs from senior
managers (61%); reduced application development budgets (61%) and devolved and extended teams needing access to shred environments
(58%).
The top benefits that UK companies could achieve with cloud based development and testing include reduced costs (78%); reduced time to
market (59%); better resource management (58%) and better quality (58%).
26% of UK companies report that it takes at least a long time to obtain access to or replicate mainframe systems solely for development/test
purposes and a further 54% say it takes a reasonable amount of time.
The typical main challenges with test environments include the need for manual data (74%); they require high maintenance (62%); they are
expensive to create (59%) and they are not realistic enough (46%).
If current constraints could be removed UK companies would see reduced costs (84%); increased quality (75%); better relationship with the
business (71%); improved speed to market (71%) and increased stakeholder satisfaction (71%).
The impact on the business as a result of removing the constraints would be improved customer satisfaction (84%); reduced costs (81%);
improved market reputation (77%); brand of IT will be more positive (77%) and faster time to market (76%).
1
41. Summary of findings Page 2 of 2 for UK
UK developers are expected to deliver/manage an average of 7.1 releases per year, the highest out of the three countries covered in the survey.
41% of UK firms expect managers to manage in excess of 10 releases per year.
46% of UK firms expect the number of releases they will be participating in this year to increase compared with 2011. 17%, the highest seen,
expect a decrease.
Fully 70% of developers in the UK expect the functionality of the releases to increase in 2012 compared to 2011.
On average a UK development team is give 5.1 months to develop, test and deploy a typical new application, in line with the average across the
survey.
34% of UK companies expect the time to develop, test and deploy a new application to decrease in 2012 compared to 2011. Only 22% expect an
increase, so clearly UK developers are under pressure to develop more applications in much less time.
One quarter of UK firms report at least frequent delays between development and testing due to unavailable applications or systems. A further
half of firms report delays some of the time.
One third of UK companies report that at least half of planned releases go into production late due to constraints in the application development
lifecycle. Only 10% say no applications go into production late.
Constraints in the development process will impact UK firms in many ways but the key impacts will be seen in loss of reputation in the market
(76%); loss of customers to competitors (71%); reduced functionality impact the customer experience (67%) and new customer offerings are late
to market (66%).
The key impacts on the development and testing teams of the constraints seen in the development cycle include key customer facing applications
are delivered late (71%); releases go into production with reduced functionality (69%) and additional budget for extra heads has to be found
(68%). Far more UK firms (60%) see lack of confidence in the new release as an issue compared to French and German firms.
1
42. Summary of findings Page 1 of 2 for Germany
German developers are expected to deliver/manage an average of 5.9 releases per year, the lowest level recorded in the survey.
Only 20% of German firms expect managers to manage in excess of 10 releases per year and 31% expect only 1 – 3 releases to be
managed.
43% of German firms expect the number of releases they will be participating in this year to increase compared with 2011. Only 9%
expect a decrease.
70% of developers in Germany expect the functionality of the releases to increase in 2012 compared to 2011. Only 4% expect a
decrease.
On average a German development team is given5.7months, the longest seen across the three countries, to develop, test and deploy
a typical new application.
20% of German companies expect the time to develop, test and deploy a new application to decrease in 2012 compared to 2011.
21% expect an increase.
Only 22% of German firms, far less than the 31% of French firms, report at least frequent delays between development and testing
due to unavailable applications or systems. A further 47%of firms report delays some of the time.
Approaching one third of Germancompanies report that at least half of planned releases go into production late due to constraints in
the application development lifecycle. 42% of firms in the country report that up to one quarter go into production late.
Constraints in the development process will impact German firms in many ways but the key impacts will be seen in loss of reputation
in the market (71%); new customer offerings are late to market (67%); loss of customers to competitors (66%) and reduced
functionality impacts the customer experience (61%).
The top areas where a German company experiences the greatest issues with cost; quality and time-to-market centre on integration
testing (48% in line with the rest of the survey); performance testing (33% compared with 32% overall) and regression testing (29%).
1
43. Summary of findings Page 2 of 2 for Germany
The key impacts on the development and testing teams of the constraints seen in the development cycle include additional budget for
extra heads has to be found (78%); key customer facing applications are delivered late (76%); IT is viewed negatively by the company
(58%) and releases go into production with reduced functionality (55%). Generally German firms report greater impacts of the key
constraints compared with UK and French firms.
33% of German companies (33% overall) say that for most of the time they have a comprehensive insight into how complex integrated
applications could break but 24%say rarely or never.
The key changes that will cause the greats challenges for firms in Germanythis year include customer needs (72%); reduced
application development budgets (61%); application modernisation (58%); devolved and extended teams needing access to shared
environments (58%) and application transformation (57%).
The top benefits thatGerman companies could achieve with cloud based development and testing include reduced costs (75%); better
resource management (60%);reduced time to market (56%) and standardized tracking of projects through standardised metrics (55%).
Fully 35% of German companies report that it takes at least a long time to obtain access to or replicate mainframe systems solely for
development/test purposes and a further 42% say it takes a reasonable amount of time.
The typical main challenges with test environments include the need for manual data (73%); they are expensive to create (60%); they
require high maintenance (56%) and they are not realistic enough (49%). German firms more commonly report challenges in this
area.
If current constraints could be removed German companies would see improved speed to market (79%); a better relationship with the
business (74%); increased quality (73%) andreduced costs (72%).
The impact on the business as a result of removing the constraints would be improved customer satisfaction (84%); reduced costs
(81%); improved market reputation (77%); the brand of IT would be more positive (77%); increased revenue (76%)and faster time to
market (also 76%). It is clear that German companies would see many significant impacts to a business if current constraints could be
removed.
1
44. Summary of findings Page 1 of 2 for France
French developers are expected to deliver/manage an average of 6.3 releases per year, in line with the average across the countries
in the survey.
26% of French firms expect managers to manage in excess of 10 releases per year.
47% of French firms expect the number of releases they will be participating in this year to increase compared with 2011. Only 6%, the
lowest seen, expect a decrease.
61% of developers in France expect the functionality of the releases to increase in 2012 compared to 2011. Only 4% expect a
decrease.
On average a French development team is given4.6 months to develop, test and deploy a typical new application, the lowest across
the survey.
17% of French companies expect the time to develop, test and deploy a new application to decrease in 2012 compared to 2011. 27%
expect an increase.
31% of French firms report at least frequent delays between development and testing due to unavailable applications or systems. A
further one third of firms report delays some of the time. French companies show the lowest level of delays compared to the other
countries in the survey.
One quarter of French companies report that at least half of planned releases go into production late due to constraints in the
application development lifecycle. Half of firms in the country report that up to one quarter go into production late.
Constraints in the development process will impact French firms in many ways but the key impacts will be seen in new customer
offerings are late to market (53%); loss of customers to competitors (50%) and loss of reputation in the market (49%).
1
45. Summary of findings Page 2 of 2 for France
The key impacts on the development and testing teams of the constraints seen in the development cycle include additional budget for
extra heads has to be found (66%); releases go into production with reduced functionality (61%) and key customer facing applications
are delivered late (57%). Generally French firms report lower impacts of the key constraints compared with UK and German firms.
The top areas where a French company experiences the greatest issues with cost; quality and time-to-market centre on integration
testing (39% compared with 48% overall); regression testing (28%) and performance testing (23% compared with 32% overall).
32% of French companies (33% overall) say that for most of the time they have a comprehensive insight into how complex integrated
applications could break but 34% (much higher than the UK or Germany) say rarely or never.
The key changes that will cause the greats challenges for firms in France this year include customer needs (72%); application
transformation (51%); moving to agile development from other approaches (51%); changing needs from senior managers (50%) and
application modernisation (49%).
The top benefits that French companies could achieve with cloud based development and testing include reduced costs (67%); better
resource management (59%);reduced time to market (53%) and better quality (48%).
Only 15% of French companies report that it takes at least a long time to obtain access to or replicate mainframe systems solely for
development/test purposes and a further 65% say it takes a reasonable amount of time.
The typical main challenges with test environments include the need for manual data (61%); they require high maintenance (51%);
they are expensive to create (47%) and they are not realistic enough (34%).
If current constraints could be removed French companies would see reduced costs (72%); better relationship with the business
(69%); increased stakeholder satisfaction (63%); improved speed to market and increased quality (both 61%).
The impact on the business as a result of removing the constraints would be reduced costs (76%); improved customer satisfaction
(69%); increased revenue (68%); faster time to market (65%) and more competitive products (64%).
1
48. Links
To download study – UK, France and Germany: landing page
YouTube: Video introduction of study – UK, France and Germany
Blog: How is Your Application Development Process Hurting Your Business?
Tweet: @CAUKI and @svcvirt and Join the conversation using: #svworks
Join the SV Community at www.servicevirtualization.com
Linked-In: : CA Service Virtualization Group
Further resources: Service Virtualization by CA Technologies
1