As companies begin to Shift Left with their software development, data analytics has become a pivotal force in how business leaders make strategic and tactical decisions. With the emergence of real-time customer feedback, it is imperative to deliver applications quickly and accurately. Omni Sourcing will showcase their integration with Sauce Analytics and customer defect management systems to spotlight the cost of testing as well as compare test efficiency over time and between releases, vendors and programs. In this event you’ll hear from William Harrison, managing director of Omni Sourcing as he shows how you can gain more insights into your testing so you can evaluate testing using all the data available to you in a highly visual dashboard. You will learn: -How to use Test Analytics visualize your test trends and view historical pass / fail rates -Understand how to identify and fix Flaky tests -Reveal the costs of defects to help you prioritize your efforts

1. omnisourcing.net
SHIFTING LEFT USING SAUCE ANALYTICS
Omni Sourcing

2. Transforming IT Operations, Delivering Quality Results2
TODAY’S SPEAKER
WilliamHarrison
Managing Director, Omni Sourcing
Ken Drachnik
Director Product Marketing, Sauce Labs

3. Transforming IT Operations, Delivering Quality Results3
Agenda
• Shift Left with Analytics
• Omni Sourcing Integration with Sauce
Labs Test Analytics
• Demo
• Q&A

4. Transforming IT Operations, Delivering Quality Results4
Shift Left Problem
Companies are trying to Shift Left within DevOps, CI/CD, and Agile
Methodologies with historical problems with:
Ø Requirement Development
Ø Process Management
Ø Code Development
Ø Cost of Quality
“If companies don’t address their underlying SDLC problems; trying to Shift
Left will not go right.”

5. Transforming IT Operations, Delivering Quality Results5
Shift Left
Improve Agility Ensure Quality Improve Time To Market
Production
Defects found
earlier in the
SDLC reduces
the overall cost
of delivering
applications and
improves time to
market
DEFECTS
DEFECTS
DEFECTS
Defect
Repair Cost
Defect
Repair Cost

6. Transforming IT Operations, Delivering Quality Results6
Shift Left
• Shift Left accelerates attention to quality from the inception of the SDLC
• It promotes inclusion of quality assurance right from the requirement phase of the process
• Quality Assurance is no longer a separate task only done post development. It is a continuous
integrated process
Requirements
56%
Design
27%
Code
7%
Other
10%
DEFECTROOTCAUSE SHIFTLEFTBENEFITS
Lower
Project Costs
Reduced
Defects
Increased
Collaboration
EnhancedCustomer
Experience
IncreasedTime
To Market
Increased
Project
Execution
Increased
Quality

7. Transforming IT Operations, Delivering Quality Results7
CI2/CD2
Continuous Improvement/Integration, Continuous Delivery/Deployment
Requirements
Plan
Design
Track and
monitor
Release
Dev/Test
CI
2
3
4
5
6
1
Slow deployment process ?
Increase in frequency of software deployment
Long wait time for test results ?
Auto-build is triggered after every commit and
automatically deployed to test
Developers have to check the entire source
code for errors?
If test fails, developers only have to check last commit
for errors
Lack of continuous feedback ?
Concerned teams are provided with real-time
feedback
CI/CD2

8. Transforming IT Operations, Delivering Quality Results8
Using Sauce Test Analytics to Shift Left
Sauce Analytics help provide visibility into your tests, platforms and applications so you can review test
metrics, analyze test results and determine the quality of your applications
Test Trends
Visibility across your organization
Test History
Identify flaky/problem tests
Test Overview
Know what to fix first
Fix
defects
Identify root
cause
Analyze
defects
Identify error
rates by team
and
applications
Identify builds
and tests that
cause errors in
platforms
Identify
performance
bottlenecks in
your pipeline
INCREASE QUALITY

9. Transforming IT Operations, Delivering Quality Results9
Business Unit Analytics Scorecard
Defect Cost
Defect Root Cause M atrix
Business unit results Requirem ents Design Data
Deploym en
t
Environm ent Coding Testing
Defect
Im pact cost
Total Defect Im pact Cost: $12,040,000
SVP Business Unit VP
SVP
Business Unit VP
Business Unit VP
Root cause cost im pact
fg i fg h h h h $5,000,000
fg fg h h i h fg $1,000
i fg i h h i i $39,000
$1.0M $1.0M $1.0M $500K $500M $2M $1.0M
M et goal Area of im provem ent Focus area

10. Transforming IT Operations, Delivering Quality Results10
Application Analytics Scorecard
Areas of Improvement
Delivery scorecard
Rank Application VPowner Partner
Defect
density
Defect
turnaround
time (hrs)
Test phase
found
Defect root
cause
analysis
Overall
score
8 XYZ VP Other 1.11 34 55% 50%
9 XYZ VP Other 3.55 26 75% 44%
10 XYZ VP Other N/A 79 80% 81%
11 XYZ VP Other 7.32 49 37% 52%
12 XYZ VP Other 6.09 65 71% 52%
M et goal Area of im provem ent Focus area

11. omnisourcing.net
Shift Left Analytics
DEMO

12. Transforming IT Operations, Delivering Quality Results12
Shift Left Analytics Platform Benefits
Ø Measures SDLC Quality
Ø Historical Execution Data (1 Month and Beyond)
Ø Quality Assurance Governance
Ø Vendor Management Enabler
Ø Cost Of Quality Tracking
Ø Methodology Agnostic
Ø KPI’s For Strategic Decisions

13. omnisourcing.net
Q&A

14. Transforming IT Operations, Delivering Quality Results14
RESOURCES
14
Print
● Test Analytics Data sheet
● Driving Test Insights with Test Analytics – biz white paper
● Analytics Solution Brief - Four Ways Test Analytics Can Improve
Automated Testing
Videos
● Shifting Left Using Sauce Analytics - WilliamHarrison, Omni
Sourcing, Sauce Con 18 talk
● 2 min user testimonial video
● Video demo - 5 minute demo overviewof Test Trends
● What Do Your Testing Numbers Tell You - Ken Drachnik,
Fernando Vidal, Sauce Labs, Sauce Con 18 talk

15. Contact Info
wharrison@omnisourcing.net
Twitter:
@weharris74
@Omnisourcing
www.omnisourcing.net
800-617-0020
Saucelabs.com
hello@saucelabs.com