1. Confidential
CAI’s
Vericenter
Software Testing
Center of Excellence
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
2. Confidential
Testing the Enterprise:
Integration vs. Application
Most testing is focused
at the Application Level.
Testing MUST BE focused
at the Enterprise Level and
consider:
• System
• User
• Integration
• Data
2
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
3. Confidential
Vericenter Overview
CAI’s Center of Excellence
Software Quality and Testing
Requirements and Design Management, Project Management,
Process Test Management, Change Control,
Construction Management, Performance Measurement
STARS Testing Teams, Project Managers,
Expertise Process Consultants, Testing Experts,
Technology Architects, Business Analysts
Test Management, Test Automation,
Tools Performance Testing, Integration Testing,
and MS Project Server
3
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
4. Confidential
The Problem
Defect Origin
Requirements Design Develop Test Production
Cost of Defect: Cost of Defect:
$10 $1,000
Cost factor of discovering
and fixing defects in later
phases vs. early phases
up to 100:1
Requirements Design Develop Test Production
Defect Discovery
4
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
5. Confidential
The Solution
CAI’s Vericenter is a Center of Excellence which
offers capabilities for enterprise-wide testing,
quality assurance, and complex integration.
• A state-of-the-art software quality assurance center;
• Full-service solutions for improving software quality;
• Expertise in processes, tools, and project management;
• A quality assurance program that optimizes resources,
reduces risks, and delivers real results;
• Comprehensive End-to-End System, User, Integration, and
Data Testing.
5
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
6. Confidential
Vericenter Objectives
• CAI’s Vericenter approach utilizes leading
software testing tools and techniques and
leverages our best people to:
– Shorten the time spent in the testing process;
– Increase software quality and performance;
– Increase the efficiency and effectiveness of testing;
– Decrease testing costs.
6
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
7. Confidential
Focused Testing
• Robotics/Instrument Testing
– Software
– Hardware
– Fluids
• Verification and Validation
– Are you building the right product?
– Are you building it right?
• Testing
– Step by Step Testing (Validated Environments
– Following Standard SxP Principles
– Audits
– Dual Sign-off
– Follow Strict Compliance
• Agile Testing
– Scrum
– 30 Day Sprints (Product Owners, Scrum Masters)
7
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
8. Confidential
CAI Testing Experience
• Student Lending Organization – CAI provided process improvements, test execution (QA / UAT)
• Medical Instruments – CAI provided 24x7 testing in a regulated medical device environment. This
included follow defined processes and testing procedures.
• Learning and Assessment Company– CAI provided development testing services and process
excellence in support of multiple projects.
• Several Large Financial Services Companies – For these companies, CAI has implemented STARS
testing teams for SIT and UAT in the past 18 months, and continues to provide additional teams and
services on an as-needed basis.
• CAI’s Wilmington Development and Support Center – Operating out of CAI’s Regional Headquarters
located at 901 Market Street, delivered SIT and UAT across 18 off-site client development/support releases
last year.
• CAI’s Tracer 2 Implementation – Conducting all testing and metrics for CAI’s proprietary Tracer 2 product
using the Mercury suite of tools.
• Mid-sized Retail Bank – CAI provided consulting for the process, approach, and tool
selection/implementation for overall load and performance testing.
• Large State Agency – CAI has been provided installation, configuration, methodology, and strategy for
test management and automation of testing tools.
• Large Insurance Company – CAI led education program and best practice tool implementation and re-
use.
8
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
9. Confidential
Types of Testing
• User Acceptance Test
– UAT testing is the last step of testing, finding defects using a business functional end-to-end test
approach.
• System Integration Test
– SIT testing tests for the defects introduced upon integrating several modules and/or disparate
systems.
• Functional testing
– Testing to determine how the software functions while executing the required use case as intended.
• Load testing
– Assessing the acceptability of the software’s performance under varying operational conditions, such
as number of users, number of transactions, and so on, while the configuration remains constant.
• Stress testing
– Testing the software’s performance when abnormal or extreme conditions are encountered, such as
diminished resources or an extremely high number or users.
• Benchmark testing
– Assessing system performance against a known standard (e.g., existing metrics, standards, and
measurements).
9
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics
10. Confidential
Variable Capacity Model
18000
17000
Hours of Developement Monthly
16000
15000
CAI Variable Staffing (STARS, Staff Aug,
Development Centers)
14000
13000
12000
CAI Core Team
11000
10000
Customer Core Team
9000
8000
D v
D v
Fen
n
n
n
A l
A l
ar
ar
b
b
ec
ec
ug
ep
ug
ep
M r
M r
ct
ct
ay
ay
Ju
Ju
p
p
o
o
Ja
Ju
Ja
Ju
Fe
M
M
O
O
A
A
N
N
S
S
Months
10
High Productivity Fixed Price On Time Within Budget Defined Processes Metrics