TestOps in the Cloud

@jonathon_wright
#esconfs www.eurostarconferences.com
TestOps in the Cloud
BetterTestOps
27th April 2015
jonathon.wright@hitachiconsulting.com
TestOps in the Galaxy
Jonathon Wright, Director, Testing, Quality, Assurance
1

2
@jonathon_wright
Hitachi - a Digital Enterprise Company.
Society Changes, Hitachi Transforms It.
$93.4
Billion
947
Companies
320,000+
Employees
$3.4
Billion
Hitachi ranks 78th on the 2014 FORTUNE Global 500®.
© Hitachi Europe Ltd. 2014. All rights reserved.

3
@jonathon_wright
Mission Objectives
TestOps in the Galaxy
I. What is BiModal? and how is FluidIT going to affect CoreIT?
II. How to move away from Testing as a Function to Testing as an Activity?
III.What is Solution Delivery Lifecycle integration (SDLCi)
IV.Introduction to Model Based Design (MBD)
V. Introduction to Model Driven Delivery integration (MDDi)
VI.Distributed Engineering Agile Delivery (DEAD)
VII.The Force Awakens (TestOps)
Episode
Episode
Episode
Episode
Episode
Episode
Episode

4
@jonathon_wright

5
@jonathon_wright
Hitachi – Digital Business in Europe
Information & Telecommunication Solutions Distribution Solutions
Railway Solutions Smart Cities
Service Opportunities
IT Service, Data Centre Solutions, Consulting
System Solutions
Large-scale systems, Highly reliable systems
Finger Vein Authentication
Worlds Fastest
Elevator (40mph)
Hardware, Software
Rolling stock + maintenance
Electrical components
Signaling / Train control systems
Nuclear Power Business
Mining Equipment
Platforms
Smart eco cities
Big Data Infrastructure
Energy Consumption
@jonathon_wright
#esconfs
Water & Natural Resources
Floating train 500kmph

6
@jonathon_wright
What is BiModal? and how is FluidIT going to affect CoreIT?
6
@jonathon_wright
#esconfs
“the creation of new business designs
that connect people, business and things
(physical objects that are active players
and contribute to business value)
to drive revenue and efficiency. ”
Gartner ® 2014
Episode I

7
@jonathon_wright
Digital Enterprise - BiModal
How is FluidIT going to affect CoreIT?
Fluid IT
• Agile and fluid
• Innovation, brand,
profit measures
• Think continuous
• Think days, weeks
Core IT
• Reliable,
compliant, secure
• Think price/performance
• Plan and approvals driven
• Long life-cycles
Episode I

8
@jonathon_wright
Digital Enterprise is not about “disrupters”
6
@jonathon_wright
#esconfs
Episode I

9
@jonathon_wright
Digital Business Transformation
Testing in the Digital Transformation Age
Core IT Fluid IT
Digital Transformation
Assisting Clients
(Journey to value?)
Episode I
“Bet on technical insight,
not market research.”
*Jonathan Rosenberg & Eric Schmidt, 2014, ‘How Google Works’, ISBN: 9781455582341, 23rd September 2014

10
@jonathon_wright
How to move away from Testing as a Function to Testing as an Activity?
10
@jonathon_wright
#esconfs
“How we bring Digital Enterprise to life”
Gartner ® 2014
Episode II
Digital Transformation
*All Original Content ‘The Force Awakens” (Trailer B) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 23rd April, 2015

11
@jonathon_wright
Testing as a Function
Legacy 1.0 Methodologies
Software Development Lifecycle
Hardware Analysis
Testing
Process
MethodologyBusiness
Software Development Lifecycle (SDLC) Model
Episode II

12
@jonathon_wright
Testing industry is changing forever
Intel© XDK IoT in 2015
Does ‘Testing as a Function’ still have a future?
Episode II

13
@jonathon_wright
Testing as a Activity
Future Methodologies
Solution Delivery Lifecycle
Application
Portfolio
Business
IntegrationEnterprise
Management
* Testing as a Service Models – Discussion Paper, TestingAsAService.com or https://leanpub.com/taas
Solution Delivery Lifecycle integration (SDLCi) Model
Episode II

14
@jonathon_wright
What is Solution Delivery Lifecycle integration (SDLCi)
14 Episode III
*All Original Content ‘Star Wars: Rogue One” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 16th December, 2016
Internet of Everything

15
@jonathon_wright
SMART (Sensors, Making machines, Augmentation, Robotics, Thinking machines)
Global challenge not suitable ‘Agile’ silos (not small a)
Complex eco-
infrastructures
intelligent
machine-to-
machine inter-
connections
empowered by
‘Big Data’
* http://www.libelium.com/libelium-smart-world-infographic-smart-cities-internet-of-things/
Episode III

16
@jonathon_wright
Lean = Open
Open (Digital) Innovation results in Open (Digital) Businesses
Open Digital Platforms
Lean Testing
Enterprise
Practices
BlueprintsSmart
Episode III
“Sharing intellectual property such as software code or research
rules, adhering to open standards rather than creating your own,
and giving customers the freedom to easily exit your platform”
@jonathon_wright
#esconfs *Jonathan Rosenberg & Eric Schmidt, 2014, ‘How Google Works’, ISBN: 9781455582341, 23rd September 2014
Open Digital Enterprises

17
@jonathon_wright
Open Innovation 1.0 - Real World Example
SDLCi - Grid-Tools connected intelligence to PerfectoMobile
Business
Solution Discovery
Business
Solution Delivery
@jonathon_wright
#esconfs
Episode III
*Llyr Wyn Jones, ‘End-to-end vs. interface testing: the mathematics’, 31st March 2015

18
@jonathon_wright
Connected Intelligence - Real World Example
Support for business intelligence powered by ‘small data’
✔
Hitachi Content Platform Solution
During deployment of
the Hitachi Content
Platform Solution
70TB of satellite
information was
ingested into the
solution platform with
a daily growth rate of
50GB/day.
Business
Intelligence
Platforms
Business
Intelligence
Infrastructure
* http://www.hds.com/assets/pdf/hitachi-storage-solutions-at-work-nasa.pdf
Episode III

19
@jonathon_wright
#esconfs www.eurostarconferences.com*Jonathon Wright, 2011, ‘Testing as a Service’ presented at BCS SIGIST, London, 5th December 2011
Solution Delivery Lifecycle Integration (SDLCi)
TestOps – Gone in Sixty Seconds
Testing as a Service - Models
Portfolio Lifecycle Management
Business Lifecycle Management
Solution Lifecycle Management
Business Delivery Management
AdviceProblem
Business
Solution Discovery
Business
Solution DeliveryContinuous Delivery Continuous Deploymentvs.
Service Layer (Lean)
Episode III

20
@jonathon_wright
Introduction to Model Based Design (MBD)
20 Episode IV
@jonathon_wright
#esconfs
Business
Solution Discovery
Business
Solution Delivery
*Jonathon Wright, 2014, ‘Testing as Service’ Models’ discussion paper published, 26th October 2014
‘Testing as a Service’ Models

21
@jonathon_wright
New Model for Testing*
Model Based Testing (MBT)
*Paul Gerrard, 2014, ‘New Model for Testing’ discussion paper published, 6th August 2014
New Model for Testing
Episode IV

22
@jonathon_wright
#esconfs www.eurostarconferences.com*Jonathon Wright, 2014, ‘Testing as Service’ models’ discussion paper published, 26th October 2014
@jonathon_wright
#esconfs
Testing as a Service - models
https://leanpub.com/taas
Episode IV

23
@jonathon_wright
Introduction to Model Based Design (MBD)
Blueprint(s) Pattern(s) Recipe(s)
@jonathon_wright
#esconfs www.eurostarconferences.com* Test Automation Patterns, testautomationpatterns.wikispaces.com & testing-store.com
Episode IV

24
@jonathon_wright
Model Based Design (MBD) – Blueprint(s)
We used drawing (visual 2D art)
to represent the foundation
of basic blueprints
GEN 1
GEN 1k
“Truly wonderful, the mind of a child is.”
This demonstrates that models created from
a single entity (transcendence) only represent
ontology of the domain of discourse and
exclude the quantitative intelligence of others.
“No matter their experience, masters can still
learn from their apprentices.“
“That’s No Moon!”
In Digital Enterprise
= Business on a Page
Enterprise Collaboration is the Evolution
(not revolution) of detailed expert Blueprints
Episode IV

25
@jonathon_wright
Model Based Design (MBD) – Blueprint(s) – Real World Example
SAFe™ 4.0
An example
Blueprint(s) could
be any process
template that
defines the
high level
flows
“The best aspects
of these proven
test approaches
demonstrate how
they have evolved
over the past
decade, and this
echoes some of
the changes
towards more lean
and agile business
methodologies.
They are in a
constant state of
evolution – just as
the underpinning
technology evolves
over time.”
Episode IV

26
@jonathon_wright
Model Based Design (MBD) – Pattern(s)
Death Star Interior / Inner Chasm & Corridors
Collaboration of individual applies unique
patterns that will refine, predict and
inform the model through exploration
(enquiring and challenging) each other
Quantum Multifractality
Applying constructive patterns
from two or more point sources
(interference) to render multi-
dimensional (3D) models
GEN 2k
GEN 1080
Each iteration can increase the
representation of the model by
applying and interpreting data
Episode IV

27
@jonathon_wright
Model Based Design (MBD) – Pattern(s) – Real World Example
Test Infrastructure as a Service (TIaaS.net) – TestOps 1.0 (VM Role Dispenser)
* Test Automation as a Service – Architecture, TAaaS.net or TestOps.net
“The best aspects
of these proven
test approaches
demonstrate how
they have evolved
over the past
decade, and this
echoes some of
the changes
towards more lean
and agile business
methodologies.
They are in a
constant state of
the underpinning
technology evolves
over time.”
“Over the last five
years we have been
developing a azure
cloud based solution to
provide true
Test Automaton as a
Service using the
hybrid approach
specifically designed
with the Hybrid Cloud
(Private/Public) in
mind to utilise the
instant scalability,
flexibility and
availability of the
Cloud.”
Episode IV

28
@jonathon_wright
Model Based Design (MBD) – Recipe(s)
Early recipes date back to
1600BC, IFTTT recipes
(conditional statements) =
DestroyDeathStar1.0
I. All wings report in
II. Lock S-foils in attack position
III. Switch deflectors ON
IV. Keep visual scanning
V. Start attack run
VI. Move into position
VII. Stay in attack formation
VIII. Stay on target
IX. Use the FORCE
GEN 4k
• Channels are the basic
building blocks
• Triggers are the "this" part
of a recipe
• Actions are the “that” part
of the recipe
• Recipes are the
“equations” made from
Triggers and Actions
• Ingredients are the basic
data model, node, quantum
materials (dot) particles
or even atom(s)
Enterprise Gamification
represents the success criteria
e.g.
“Great shot kid that
was one in a million.”
Episode IV

29
@jonathon_wright
Model Based Design (MBD) – Recipe(s) – Real World Example
Test Automation as a Service (TAaaS.net) – TestOps 1.0 (>5 Years)
Select the Business Process Tests Generated Recipe
“The best aspects
of these proven
test approaches
demonstrate how
they have evolved
over the past
decade, and this
echoes some of
the changes
towards more lean
and agile business
methodologies.
They are in a
constant state of
the underpinning
technology evolves
over time.”
“Based on
business process
modelling to
create business
level keywords
written in natural
language
validated against
content sensitive
validation to
create reusable,
jigsaw pieces
representing the
Solution Under
Test (SUT).”
Episode IV
Test Automation as a Service
* Jonathon Wright, 2010, STARWest Track, ”Test Automation as a Service”, http://www.TaaS.net, 2nd October 2012
@jonathon_wright
#esconfs

30
@jonathon_wright
Distributed Enterprise Agile Lifecycle (DEAL) Collaboration in the Wild
Model Based Design (MBD) – TestOps - Blueprints > Patterns > Recipes
@jonathon_wright
#esconfs
Team - Confederacy of Independent Systems
Enterprise Architect - Wilhuff Tarkin
Sprint 1 - Top-secret Imperial weapons project
Sprint 2 – Raids on Vergesso and Raltiir
Sprint 3 – Technical Data from Tantive IV
Sprint 4 – Battle of Toprawa
Sprint 5 – Raid on Polis Massa
Sprint 6 – Moff Kalast and the Bothan Spynet
Collaboration
“The Death Star
blueprints are
not in the main
computer”
- Stormtrooper
Blueprint – Death Star
Data Storage – R2-D2
Sprint 7 – Delivery blueprints to Bail Organa
Sprint 8 – Delivery blueprints to Jan Dodonna
CIBD - Release Management – General Jan Dodonna Showcases “Thermal Exhaust Port”
Pattern – Featuring Fleet of 22 X-wing, 8 Y-wing, 2 R-22 Spearhead Starfighters Defect – Found by Skywalker
* Release notes: Death Star, http://starwars.wikia.com/wiki/Death_Star_plans
Delivery
PatternsRecipes
Recipe - DestoryDeathStar1.0 - Continuous, Integration, Build and Delivery
Define
Design
Develop
(Plan)
Deploy
Deliver
Episode IV

31
@jonathon_wright
Introduction to Model Driven Delivery integration (MDDi)
Agile Engineering
Core IT Fluid IT
Agile Engineering
Episode V
* Adam Mann, Google Innovation Officer, ‘Creating the inter-planetary Internet protocol’, Wired.com, 6th May 2013
Open Innovation

32
@jonathon_wright
Introduction to Model Driven Delivery (MDDi) - Mission(s) / Charter(s)
Test First Delivery (TFD) First Day Delivery (FDDi)
TDD
* Jonathon Wright, 2014, Gartner, http://www.slideshare.net/mobile/Jonathon_Wright/addi-ha-apiytestinghybridcloud
Domain Driven Design (DDD) Domain Driven Delivery (DDDi)
Transcendence Driven Delivery (TDDi)
Test First Delivery (TFD)
Episode V

33
@jonathon_wright
Mission / Charter – First Day Delivery (FDDi)
Model Driven Delivery (MDDi) integration
*The Advanced Research Projects Agency Network (ARPA) Network, 1969, 2 & 4 Nodes the precursor to the Internet
Business Process Modelling
Blueprint
Business Process Scenarios
Patterns
Business Process Components
RecipesNode Maps Node Learning Node Strengthening
• Model the proposed solution • Learning (Turing machine)
adapting to simulate logic
algorithms
• Validate all possible states
Smart Learning Machines
Episode V

34
@jonathon_wright
Mission / Charter – Transcendence Driven Delivery (TDDi)
Patterns Node (View)
• Each Node creation (LOC)
passes requirement, story,
behaviour, acceptance test
• Each Node generates a
testable view (UI, Service,
or Data layer) of the solution
• Models Nodes and Links
Recipes NodeJS (Controller)
Blueprint Node (Model)
* Visual Studio 2015 CP6 & NodeJS, https://www.visualstudio.com/en-us/news/vs2015-vs.asp http://nodejstools.codeplex.com/
Episode V

35
@jonathon_wright
Mission / Charter – Domain Driven Delivery (DDDi)
Blueprint
Patterns
RecipesNode Discovery Node ValidationNode Systems
• Model the current solution • Validate all possible states
@jonathon_wright
#esconfs
• Apply:
• Systems Dynamics
(epistemic & systemic
entropy)
• Systems Thinking
• Learn:
• Ontology – formal naming,
definition of node types,
properties and
interrelationships
• Domain – universal set of
nodes (domain of discourse)
• Context – nouns/verb
discovery to enable context
sensitive validation.
* Huw Price, 2015, Grid-Tools, http://www.agile-designer.com/resources/model-based-testing-using-agile-designer/
Episode V

36
@jonathon_wright
Advanced Modelling Simulation Technologies
Watershed
management
Pipe-network
Management
Prediction of water
pollution
Pipe-network
analysis
Models can be analysed, visualized, and optimized
Models can provide assurance through, analysis, simulation and prediction
* http://www.computerweekly.com/news/2240233919/Societys-values-moving-from-Mono-to-Koto-says-Hitachi
Episode V

37
@jonathon_wright
Connected Intelligence – Real World Example
First Day Delivery integration (FDDi) – Wearables - Apple iWatch
“The physical nature of wearables
technology makes it vital to testing using
real devices…. helps to mitigate
syncing/connectivity issues.”
Episode V

38
@jonathon_wright
Distributed Engineering Agile Delivery (DEAD)
38 Episode VI
*All Original Content ‘The Force Awakens” (Trailer B) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 23rd April, 2015
@jonathon_wright
#esconfs
Ultimately, all businesses will be
‘digitally re-mastered.’
Gartner ® 2014

39
@jonathon_wright
Enterprise Collaboration in the Crowd – Real World Example
Test Intelligence 2.0 – Global Testing Insight (UX, Exploratory & Testing in the Wild)
Request1
Run2
Test3
* Real Crowd Tester, Liam Warrilow, 24th Friday 2015 @15:13 (Ramp up to 100 iWatch testers in under 24hrs)
Episode VI
Enterprise CrowdTesting

40
@jonathon_wright
Agile 1.0 Legacy
Legacy Methodologies
Agile Development Practices
Waterfall Engineering
Delivery
Processes
MethodologywAgile
Manifesto for Agile Software Development (1957-2001)
Software
Hardware
Business
Episode VI

41
@jonathon_wright
Metrics Driven Delivery vs. Results Driven Delivery
Distributed Engineering Agile Delivery (DEAD)
* Scrumtroopers: AxisAgile.com.au, http://www.axisagile.com.au/resources/scrumtrooper-images/
Episode VI
Open Enterprise Collaboration

42
@jonathon_wright
The Agile Legacy – Agile Strikes Back
Agile DAD
(MoM)
SAFe
(Committee)
LeSS
(Anarchy)
Rey SoloPrincess Leia Organa SoloQueen Padmé AmidalaEmperor Palpatine
Role – Supreme Leader
Alignment - Empire
Goals – Rule the galaxy
Role – Galactic Senate
Alignment - Republic
Goals – Peace
Role – Senator Alderaan
Alignment – Rebellion
Goals – Freedom
Role – Jakku Citizen
Alignment – Rogue
Goals – Anarchy
*All Original Content ‘Star Wars: Episode 1 to 7” ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 25th May, 1977
Episode VI

43
@jonathon_wright
Agile is DEAD
Agile 2.0 models (LeSS SAFe than DAD)
Distributed Enterprise Agile
Application
Organisation-wide
Engineering
AnarchyBusiness
Waterfall
Distributed Enterprise Agile Lifecycle (DEAL)
Delivery
Management
Lifecycle
Episode VI

44
@jonathon_wright
Enterprise Collaboration CrowdTesting in the Wild
Han Solo (Anarchy) vs. Jedi (Agile) Order
Han Solo - Iteration VI Han Solo - Iteration VII
 Follow your own path
– “What the galaxy needs is one language, one system of
measurement.”
 Look after yourself
– “Look, I ain't in this for your revolution, & I'm not in it for you.”
 Do what you think is right
– “Hokey religions (Agile) and ancient weapons (Scrumban) is no
substitute for a (Waterfall) blaster.”
 Forget the Results or Metric Driven Delivery
– “Never tell me the odds.”
 Become part of the team
– “The biggest problem in the universe is no one helps each other!”
 Evolution not revolution
– “There has been an awaking, have you felt it?”
 Teamwork equals success
– “Try not. do… or do not. There is no try.”
 Never underestimate the value of individuals
– “Sometimes it is the people no one imagines anything of who do the
things that no one can image?”
– “Wars not make one great!”
@jonathon_wright
#esconfs
Episode VI

45
@jonathon_wright
Agile Engineering – Real World Example
The Force Awakens
* Proton beams are back, 5th April 2015, http://home.web.cern.ch/about/updates/2015/04/proton-beams-are-back-lhc
2 Year Iterations = 6.5 to 13 TeV per beam
2 Week Iterations = 50 to 25 nanoseconds
Episode VI
Agile Engineering Practices

46
@jonathon_wright
The Force Awakens (TestOps)
38 Episode VII
*All Original Content ‘The Force Awakens” (Trailer A) ©DISNEY 2015 ©Lucasfilm Ltd. & TM, 28th November, 2014
@jonathon_wright
#esconfs
The dark side (DevOps) and the light (TestOps)
“DevOps is a framework that
allows development, testing,
and operations to meet
customer needs. This
integrated team approach
facilitates communication,
collaboration, and integration
to manage today’s rapidly
changing business
demands.”

47
@jonathon_wright
The Force Awakens - Test-Ops in the Cloud
• Automate solution delivery release times and ramp up release velocity
– Infrastructure as code (topology-base model(s) - HP Codar/Release Management)
• Automate build to Cloud 2.0 (platform / technology agnostic solution delivery)
– Infrastructure to code (automation (build) model(s) – Chef)
• Automate deploy to reduced failure rates, lead times between fixes and rates of recovery
– Platform as code (deployment model(s) - HP DevOps Insight/Jenkins/IDE)
• Monitor release in the wild
– (release model(s) – HP AppPulse / Operational Insights)
• Report on Portfolio Lifecycle Management (PLM) with support for Enterprise Gamification
– Build(s) / release(s) / Quality index scores (reporting model(s) - HP Executive Scorecard/PPM)
• Collaborate with enterprise grade communication (between Dev, Test & Ops)
– Connected lifecycle intelligence (synchronisation model(s) - HP OneSync/ALI)
Solution Delivery Lifecycle Integration (SDLCi) = Unified Lifecycle Management (ULM)
Episode VII
HP Codar / DevOps Insight / AppPulse / OneSync

48
@jonathon_wright
TestOps BUILD then TEST vs. DevOps BUILD then Deploy?
De-coupling
Solutions (SOA)
Continuous
Build, Integration
& Delivery
Good Coding
Practices
Configurability &
Maintainability
Ops Hub
Infra as Code
Extend QA
(Ops)
Resolution
Practices
Agile
Engineering
(Shift Left)
Agile
Engineering
(Shift Right)
CodarBlueprints Recipes PatternsHelionBlueprints Recipes PatternsUFT SV
TestOps (Test-Dev) with Automated Testing DevOps (Dev-Test) with Automated Deployment
Journey to DevOps with HP
Ops
Monitoring
(Testing)
Monitoring
(Ops)
Modelling
(Testing)
Modelling
(Ops)
Episode VII
Dev Test
* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015

49
@jonathon_wright
Codar
Blueprints Recipes Patterns
TestOps (Test-Dev) with Automated Testing
UFT SV Blueprints Recipes Patterns
DevOps (Dev-Test) with Automated Deployment
Helion
Episode VII

50
@jonathon_wright
Codar
Blueprints Recipes Patterns
TestOps (Test-Dev) with Automated Testing
UFT SV Blueprints Recipes Patterns
DevOps (Dev-Test) with Automated Deployment
Helion
Episode VII
* Ajay Nair & Faraz Syed, ‘Journey to DevOps with HP’, BrightTALK, 23th April 2015
@jonathon_wright
#esconfs

51
@jonathon_wright
Test-Ops in the Cloud
QualityGate™ Map
• Predictive ALM
– Machine Learning
– Code Analysis
• Predictive Analysis
– Prediction(Cost/Accuracy/Defects)
– Predictive Planning
– Velocity / QA Impact
• Predictive Testing
– Smart Test (Test Impact Analysis)
– Open Test Frameworks
(SeleniumRWD/Phantom.JS/xCode/jUnit/qUnit/nUnit/TestNG)
• Predictive Builds
– Smart Build (Analyze Commits)
• Predictive Release
– Release Health
QualityGate™ Map
Confidence Level 74%
QualityGate™ Recommendations PBIs
Episode VII

52
@jonathon_wright
Test-Ops in the Cloud – XaaS – Design
@jonathon_wright
#esconfs
Episode VII
HP Codar feat. Chef

53
@jonathon_wright
Test-Ops in the Cloud – XaaS – Define / Architect (3-Tier)
@jonathon_wright
#esconfs
Episode VII
HP Codar feat. Chef

54
@jonathon_wright
Test-Ops in the Cloud – XaaS – Deploy - Testing
@jonathon_wright
#esconfs
Episode VII
HP Codar feat. DevOps Insight
www.eurostarconferences.com

55
@jonathon_wright
Test-Ops in the Cloud – XaaS – Manage - Testing
Episode VII
HP ALM 12.5 feat. Jenkins/Chef

56
@jonathon_wright
Test-Ops in the Cloud – XaaS – Testing in the Wild
Episode VII
HP AppPulse

57
@jonathon_wright
Test-Ops in the Cloud – Gone in Sixty Seconds
0-6 secs – Minor UX change (Dev to TestOps)
6-8 secs – Click Save button (VS2015-CTP6) feat. CodeLens
10-20 secs – Predictive Build (Jenkins) 50-60 secs – Predictive Release (HP Helion)
20-40 secs – Predictive Testing (ALM 12.5)
8-10 secs – Check-in / Analyse / Commit (GIT)
6% chance to break build
74% Quality Gate Map (confidence rate)
40-50 secs – Predictive Deploy (HP Codar)
92% Quality Index Score (Predictive Analysis)
* Visual Studio 2015 CP6 (incl. TypeScript 1.4), http://www.typescriptlang.org/playground & http://go.microsoft.com/fwlink/?LinkId=400496
Predictive vs. Smart
Episode VII

Ask a Jedi?
http://testhuddle.com/forums/topic/testing-as-a-service-models/

59
@jonathon_wright
TestOps in the Cloud - Summary
Business
Assurance
Business
Quality
Business
Testing
Business Assurance provides the visibility and
transparency throughout the solution delivery lifecycle
• Digital Enterprise
• Business on a Page
• Business Delivery Management
• Business Intelligence (Actionable Business Insight)
• Business Innovation (Enterprise Gamification)
Business Quality allows enforceable quality across the
entire solution delivery lifecycle owned by everyone
• Business Lifecycle Management
• Business Solution Discovery / Delivery
• Business Enterprise Collaboration
• Business Acceptance Testing
Business Testing
• Testing as a Service - Models
• Solution Delivery Lifecycle integration (SLDCi)
• Test First Delivery / First Day Testing
• Continious, Integration, Build & Delivery
• Shift Everywhere (UP/DOWN/LEFT/RIGHT)
• All Channel Customer Experience

60
@jonathon_wright
Hitachi Consulting
Hitachi’s Global Management Consulting & IT Services Business.
$740
Million
FY13 Revenue
6,500
experienced &
dedicated
professionals
Better Approach. Better Results. Better Experience.
$10 Billion
results

TestOps in the Cloud

Recommended

Recommended

More Related Content

What's hot

What's hot (15)

Similar to TestOps in the Cloud

Similar to TestOps in the Cloud (20)

More from TEST Huddle

More from TEST Huddle (20)

Recently uploaded

Recently uploaded (20)

TestOps in the Cloud

Editor's Notes