3. Quality is Subjective, and that’s
ok!!
o Businesses are Interconnected
o Branding is just as important as quality
o Relationships are more persistent and less
transactional
The Business Changes
o They want to be delighted…always
o They have different, and maybe conflicting, worldviews
o Different Spending Habits
o More vocal than ever
The Customer Changes
o Migration to SaaS and Cloud Technologies
o IoT and Edge are more common
o AI, Technology Stacks, Machine Learning, and
Analytics
The Technology Changes
shift up
4. One Company, two big
paradigm shifts
1993: We Adapt to the Tech
2018: The Tech Adapts to Us
5. Shift-Left and Shift-Right aren’t enough
Shift-Left
o More Test Coverage
o Earlier Detection
o Lower Costs
o Advocate higher in the IT
Chain
Shift-Right
o Faster to Production
o Faster than your
competition
o Better Automation?
o True DevOps and CI/CD?
shift up
7. Shift-UP
Continuous Testing Becomes Continuous QA
o Ethnography to
understand your
customer
o Psychometric
analysis to
measure capacity
o Being able to
cover multiple
customer types
with a minimal
number of
personas
o Test management tools
are a thing of the past
o AI centric tools that can
leverage any automation
and plug into multiple
Cognitive Computing
engines
o Tools need to be
integrated all the time
o Edge computing
o SMAC
o New tech
o No tech
o B2B, B2C, C2B
o Metrics, analytics, and
monitoring need to be fed
into testing tool real-time
o Humans still have limited
potential and experience
The
customer is
always right,
and so is that
one, and that
one too.
Out of one tool,
many.
Which
Channel?
All of them!
Actions speak
louder than
words.
shift up
8. Shift-Up lets you
“Think of Yourself as a Customer”
Directed
Tests
Bug
Hunting
Coverage
Analysis
Feature
Analysis
Analytics &
Monitoring
Custom AI
Gives you new automated tests that,
among other things:
o Tell you want you need to test
o Tell you what you don’t need
to test
o Mimic real users
o Integrate digital and AI
assisted events
o Account for natural disaster, geopolitics,
the unknown
o Let’s the Developers Develop
o Re-Establishes the need for Domain Experts
shift up
9. Shift-Up Completes the
Circuit
Shift-Left
§ AI Driven Test Coverage
§ Meaningful Analytics
§ Test across Technologies
§ Democratize Testing
Shift-Right
§ Surpass Customer
Expectations
§ Continuous Monitoring
§ Micro-shifts
§ True DevOps and CI/CD
Shift-Up
shift up
11. shift up
Your Call to Action
• Testing needs to continue its fight for position
• Show value to the Customer, IT, and Management
• Developers need bandwidth and freedom to create
Continue what we’ve started
• Good AI engines should integrate with your tool sets
• Your processes will evolve, but not because of the Tool
• Focus on people, democratize testing
• Look at external products and tools. Consider the
maintenance costs of building your own
Build on what you have, don’t burn it down
• Tools need to enable and empower you
• You need to consider how a customer will use your product,
which may differ from requirements
• Always question the hype
Think of yourself as a customer
• This is a time of unprecedented
change in Quality Assurance
• QA Professionals can be the bridge
between your customers and your
business
• It’s only going to get more complex