As the focus in software development shifts from adoption of Agile and DevOps to sophistication of approach and consistency of execution, so too does the industry’s understanding of testing’s role in the development cycle. More enterprises understand that testers need to work in constant collaboration with developers, which is shaping how teams test, as well as expanding the systems and environments they have to test in. Before 2019 draws to an end, we take stock of all the milestones testing crossed, as well as the ones that still lie ahead. Join us as we explain why we think you should be mobilizing your team for these trends in the coming year: AI-powered testing comes of age; The rise of “smart” testing and the shrinking of test case libraries; Test automation and RPA’s convergence and its far-reaching benefits; And more, including developments for IOT, Big Data, Security, and Cloud Services.

1. 1
2020 Testing Trends
Top Predictions for QA Teams to Watch, Join, and Lead

2. 2
Presenters
Ryan Yackel
Product Management
Wolfgang Platz
Founder, CPO

3. 3
0
500
1000
1500
2000
2013 2014 2015 2016 2017 2018 2019
Scenario
Automation
>90%
Increase
Speed
5X
Coverage
>80%
NOW
The continuous testing market leader with agile test
management and advanced test automation optimized to
support over 160+ technologies
RESULTS
PARTNERS
TECH ALLIANCES
CUSTOMERS
ANALYST RECOGNITION
Greater than
1,800+
Customers
World Wide
7 of the top 10
Global Banks
6 of the top 10
Financial Services
8 of the top 10
Insurance Companies
7 of the top 10
Telcos
4 of the top 10
Energy/Utilities
7 of the top 10
Global Services
Q-up
Acquisition
2017
Test Data
2017
Flood
Acquisition
Load Testing
Insight Venture
Partners
Investment
2016
QASymphony
Merger
2018
Test Management
2007
Founded
LiveCompare
Acquisition
2019
Impact Analysis
Tricentis - RPA
Launch
2019
RPA

4. 4
Market Trends – Macro View
Top Three Trends – Tricentis View
Q&A
1
2
3
Agenda

5. Market Trends
§ Test Automation Finally Gets Credited for
DevOps Success
§ Big Data& the Rise of Data Integrity Testing
§ Testing for IoT Gets Strategic
§ AI-Powered Testing Comes of
Age
§ Test Case Libraries Shrink
§ Convergence of Test
Automation and RPA

6. 6
Test Automation Finally Gets Credited for DevOps Success

7. <20%Test Suite Automated
7
Testing Still Remains the Bottleneck...
49%
42%
27%
37%
Source. GitLab, Global Developer Report, 2019
WHAT IMPEDES THE DELIVERY OF INNOVATIVE SOFTWARE?
Planning
Code Review
Code Dev
Testing
Source: Tricentis, Test Automation Research, 2019

8. 8
...but Not for DevOps Teams
>50%Test Suite Automated
Source: Tricentis, Test Automation Research, 2019
YesCompleted DevOps
Transformation

9. 9
Big Data & the Rise of Data Integrity Testing

10. 10
How Much Data is in a Zettabyte?
Zettabyte = 1 TRILLION
Gigabytes

11. 11
Global Data to Grow by 61%
Source: IDC, Data Age 2025, 2018
33
2018, Zettabytes
175
2025, Zettabytes

12. 12
Aegon Customer Story
§ Leveraged existing test resources for data
integrity testing
§ Developed 400+ automated test cases with
Tricentis Tosca
§ Verified 100s of tables with tens of millions of
records
§ Cut testing time from 84.6 hrs to 11 hrs

13. 13
Testing in IoT

14. Connected Complexity for Testers
26Xmore connected things than people by 2020
127/Sec# of devices connected to the internet
Source: Gartner
Source: McKinsey

15. Buyer Beware

17. 23
Top Three Trends for 2020
3 Convergence of Test Automation and RPA
2 Test Case Libraries Shrink
1 AI-Powered Testing Comes of Age

18. 24
AI?
Really?

19. 25
Unsupervised learning algorithm
using natural language processing
to detect likely false failures
Autonomous Failure TriageAI based Optical Engine
Connect LiveCompare to COTS
applications and yield huge test
reductions
Change Impact Analysis
Remove the roadblocks to smarter testing
Testing - Simplified
Apply custom deep neural
architecture to solve control
recognition, Technology and Code
free automation.
The most beneficial AI use-cases of Testing3

20. 26
Model-Based Browser
Assert.AreEqual(“331,00",
driver.FindElement(By.XPath("//table[@id='PriceList']/t
body/tr[10]/td[2]/b"))
.GetAttribute("value"));
Browser
Script-Based
Code
Synchronization Behavior
Code
Recovery Handling
Code
Data Driven Framework
Code
Keyword Driven Framework
1
2
3
4

21. 27
UI
SYSTEM
SUT
TEST CASESMODEL
TECHNICAL INFORMATION BUSINESS INFORMATION
Technical Information is the glue

22. 28
TEST CASES
BUSINESS INFORMATION
UI
SYSTEM
SUT
Remove the need for Technical Information

23. 29
AI powered
Optical
Technology Independent
A radically new engine …
…

24. 30
NEO
NEural Optical engine

25. 31
Not the first ones to try …
but the first ones to succeed
Simple static controls
(Editboxes, Labels, …)
Before NEO
Dynamic controls
(DropDowns, Tabs, …)
Composite controls
(Tables, Trees, Calendars, …)

26. 32
How fast is the human eye?
24
pics per second
NEO: 40
pics per second
How accurate is the human eye? NEO: 95+%

27. 33
Input | C:94.86% | O:99.94%

28. 34

29. 35
Label
CheckBox
…
Table
EditBox
…
Input layer
(screen images)
Neurons
520,000
5,000,000
Closed beta has started!
2Q 2020 public availability

30. 36
Top Three Trends for 2020
3 Convergence of Test Automation and RPA
2 Test Case Libraries Shrink
1 AI-Powered Testing Comes of Age

31. 37
Use your resources wisely
ProgressionTesting
RegressionTesting

32. 38
Today’s reporting is based on numbers of test cases.
What does it tell us?
Version 7.5 42,278 10,086 910
Is 53,274 the right number of test cases?
Can I go productive?

33. 39
Front wingGear box
Tires
Telemetry Software
Steering Wheel
Cassis & MonocoqueEngineRear wing
BrakesExhaust

34. 40

35. 41
Use Test Case Design to optimize
your (non-exploratory part of) Progression
Test.

36. 42
Use Test Case Design to optimize
your (non-exploratory part of) Progression
Test.
Use Change Impact Analysis to
optimize your Regression Test.

37. 43
3,152
1,000
2,000
3,000
Used
0
Test Scope Reduction through
# Objects used in
System
479
-85%
reduces the test scope down to
most-at-risk objects.
Most-at-risk objects
( AI powered assessment)
2,270
Impacted
Traditional Impact Analysis narrows the test
scope down to impacted objects.

38. 44
AI Powered Dependency Analysis and Selection
risk
depth INCL
Changed object
VA01
USAGE = 89
FUNC
INCL
TABL
depth = 4
VA03
USAGE = 115
INCL
FUNC
TABL
STRC
depth = 5
VA02
Ideal candidate to
test changed
object
VA02
USAGE = 140
depth = 1

39. 45
TestDev Prod
Closing the DevOps Loop
Changes
Impacted Objects
Usage Defects
Most-at-risk
objects
Risk Frequ. Damage

40. 46
Q4 SAP Release:
UFT Scripts
9,000
Changes
28,586
Production Systems
9
Customer Example

41. 47
Most-at-risk objects

42. 48
Most-at-risk coverage

43. 49
UFT Scripts
9,000
8% Most-at-risk
objects covered

44. 50
Test results in TreeMap

45. 51
85% Test Effort Reduction
3.5 x Release Frequency
75% Fewer Defects in Production
ROI of
1
2
3

46. 52
Top Three Trends for 2020
3 Convergence of Test Automation and RPA
2 Test Case Libraries Shrink
1 AI-Powered Testing Comes of Age

47. 53
Innovation
Trigger
Through of
Disillusionment
Slope of Enlightenment
Plateau of
Productivity
Expectations
Time
Rapid growth
of RPA &
valuations
Today
RPA – Hype Cycle
+ 6 months
Disillusionment
caused by bot
downtime
Peak of
Inflated
Expectations
Resilience
https://blogs.wsj.com/cio/2018/05/29/bots-can-break-leaving-corporate-tasks-undone/

48. 54
Pain Points With Current RPA Solutions
RPA Automation by current
vendors is mostly UI automation
and scripting, making it complex
and time consuming to
automate processes
Bots are not resilient
and break with any
changes, resulting in high
maintenance
Growing customer interest in an
integrated enterprise
automation solution across RPA,
Infrastructure Services and
Software Test

49. 55
Software Test
Automation
Robotic Process
Automation
(today) (today)
https://www.horsesforsources.com/rpa-dead-integrated-automation-platforms_041519
Sources:
Robotic Process Automation: Eight Guidelines for Effective Results, Gartner, 2018
https://www.hfsresearch.com/pointsofview/triple-a-trifecta-automation-analytics-and-artificial-intelligence
Integrated
Enterprise
Automation
(2021)

50. 56
How GSIs (and customers) set up their teams
(Shared team) Enterprise Automation
Specialists
Software Testing Experts
Biz Process
Experts
Consultants
(Offshore)
delivery
RPASW Testing
The Convergence of Automation is happening already!

51. 57
Partners certify on Tricentis RPA

52. 58
RPA Studio (Windows-based)
Development Environment
RPA Studio
RPA Repository (DEV)Bots Logs RPA Repository (PROD) Agents (Physical/VM)
RPA Cockpit (Browser-based)
RPA Orchestrator Server (Docker
based)
Production Environment
RPA Orchestrator
Bots

53. 59
WHY
Strongest automation engine covering 150+ technologies
Implement most resilient bots faster
Re-use automation skills and bots
1
2
3

54. 60
NEO
The future of
UI automation
is AI based.
AI
RPA
A bigger automation play
emerges.
Convergence
Automation
of
LiveCompare
Automate the detection of
your test need
Test lessdelivering
value

55. 61
?
Ask Your
Questions