The document summarizes a case study of how Cigniti helped a leading event management company reduce post-production defects by 40% through DevOps QA practices. Key challenges included unclear requirements, unstable test environments, and defects escaping testing. Cigniti introduced standardized QA processes, requirement reviews, and test automation to improve quality while meeting sprint deadlines. This increased test coverage and reduced requirement ambiguity from 35% to 12%, cutting post-production defects significantly.

1. www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd
DevOps QA Helps Leading
Event Management Company
Reduce Post-production
Defects by 40%
The Client is a leading provider of face to face marketing services ranging from Pre-event
Planning, On-Site Execution, extending the experience to Audio Visual Solutions with a
presence in North America, Europe, and Asia.
About the Client
CASE STUDY
CCS-US003-1215

2. www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd
Key Business Challenges
Delayed receipt of user stories in every sprint
Lack of clarity in user story requirements
Parallel sprints, each with a rigid schedule
Lack of standardized QA processes and best practices
Unstable Test Environment with configuration and access issues
Critical defects leaked into post-production after regression testing
Testing Tools
Types of Testing
Functional Testing Regression Testing Compatibility Testing

3. www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd
Solutions Provided
Leveraged Cigniti’s Static Requirement Analyzer to improve requirements review process and hence the
quality of user stories.
Mandated the use of sprint demos to hasten understanding of functionality being added in every sprint.
Worked with client team to resolve test environment issues.
Introduced reusable process templates to accelerate and standardize QA processes across applications
and sprints.
Published detailed test execution reports for the compatibility matrix defined to enable easier and fast
sprint sign-off.
Key Benefits
Reduced Requirement Ambiguity Index (RAI) from 35% in sprint 1 to 12% in sprint 3 by improving the
clarity of user stories.
Increased test coverage by leveraging Cigniti’s Static Requirements Analyzer.
Reduced post-production defects by 40%.
Met aggressive sprint schedules with the help of reusable process templates.
Introduced industry standard Agile and QA best practices to ensure that every sprint stays on schedule.
Value Add
Formal Test Life Cycle
» Defined testing life cycle, end-to-end testing approach that aligns with application
development. Significant focus and collaboration of all QA teams to perform integration testing
across systems to ensure that critical workflow are testing prior to release .
Visibility into Test Coverage and Detailed Test
Cases
» QA team used the test case template to provide the detailed test cases and ensure that the test
coverage for the requirements using test requirement traceability matrix. Test cases are reviewed
and formally signed off by BA and Dev before test execution.
Formal Requirements early in Application
Development
» QA started involving early in the requirements phase and validated the requirements through SRA
process for testability.
Standard Defect Management
» Defects posted are daily triaged in the daily defect triage and triage of complete backlog defects
for the release. Defined specific process to prioritise the defects, to decide what is important and
what is not important for the release.
Visibility into Testing Progress and Quality
» QA team provided transparency on daily/weekly updates about the status, quality, risks, and
upcoming milestones of different projects.
Gaps Services/Solutions Provided
Formal Test Summary Reporting
» QA team provided test summary reports for both sprints and release that provided visibility to
product quality. Metrics like Requirement Ambiguity Index, Test Coverage, Test Execution Results,
Defect metrics.

4. Cigniti Technologies Limited (BSE: 534758, www.cigniti.com), Global Leaders in Independent Software Testing (IST) Services, is
headquartered at Hyderabad, India. Cigniti’s 1800+ career testers are spread across US, UK, India, Australia, and Canada. Cigniti
is the world’s first IST Services Company to be appraised at CMMI-SVC v1.3, Maturity Level 5, and is also ISO 9001:2008 & ISO
27001:2013 certified. Cigniti’s test offerings include Quality Engineering, Advisory & Transformation, Next Generation Testing,
and Core Testing. Over the last decade, Cigniti has helped Enterprises and ISVs build quality software while improving
time-to-market and reducing cost of quality. Cigniti has translated its R&D into SMART Tools™ that accelerate testing and help
improve the quality of services delivered to clients. Cigniti has India's first of its kind Robotics Test Lab, a Mobile Cloud Test Lab
with HP & Experitest, a Cloud-enabled Performance Test Lab, and an IoT & Smart Meter Lab. Gartner has positioned Cigniti as a
Challenger in its Magic Quadrant for Application Testing Services Worldwide, 2015. Forrester cites Cigniti among the 9 services
firms and systems integrators working to enable Quality at Speed. NelsonHall ranks Cigniti Technologies as a Leader in Software
Testing NEAT Charts. Everest Group recognizes Cigniti as a Major Contender with a “Best in Class” rating for Buyer satisfaction in
the PEAK Matrix™ for Independent Testing Services, while Forbes recognizes Cigniti as Asia’s 200 best under-billion companies.
Cigniti has been awarded a place on the Crown Commercial Service latest G-Cloud 6 framework for providing Lot 4: Specialist
Cloud Services that will provide public sector enterprises better access to Cigniti's expertise. Cigniti is also a recipient of the
prestigious Frost and Sullivan Customer Value Leadership Award for Global Automated Software Testing Services category
consecutively in 2014 and 2015. Cigniti’s CSR initiative, Project Cignificance, aims to impact 1 million+ lives through education as
an enabler.
About Cigniti
www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd
Global Leaders in Independent Software Testing Services
US
Cigniti Inc.
433 E Las Colinas Blvd,
Suite 1300,
Irving, TX 75039
972.756.0622
India
Cigniti Technologies Ltd.
6th Floor, ORION Block, “The V” (Ascendas)
Plot #17 Software Units Layout
Madhapur, Hyderabad-500081
040-4038 2255
040-3070 2255
Australia
Cigniti Technologies (Australia) Pty Ltd
Sydney
Level 13, 135 King Street
Sydney, NSW 2000
+61 2 8973 7579
Canberra
Tower A, Level 5, 7 London Circuit
Canberra, ACT, 2601
+61 2 6169 4145
UK
Cigniti Technologies (UK) Limited
9 Devonshire Square
London
EC2M 4YF
+44 (0)20 36911385
Canada
Cigniti Inc
2425 Matheson Boulevard East,
7th floor, Suite 731
Mississauga, Ontario
L4W 5K4
647.951.5943
Melbourne
Level 28, 303 Collins Street
Melbourne, VIC 3000
+61 3 9678 9111
For Other Information
info@cigniti.com
facebook.com/cignititechnologies
linkedin.com/company/cigniti-inc
youtube.com/cignititechnologies
slideshare.net/cigniti cigniti.com/blog
twitter.com/cigniti