SlideShare ist ein Scribd-Unternehmen logo
1 von 2
Downloaden Sie, um offline zu lesen
CASE STUDY


Efficient Test Practice Reduces
Cycle Time by 60%

                                                     STAG’s re-engineering of test practices and process
                                                      standardization drives tangible benefits for a
                                                       global leader in wireless communication, enabling
                                                       it to achieve 60% reduction in testing cycle time
                                                      and 30% increase in productivity.




            Domain/Category -
                                                                             Technology - C++, PERL
            Mobile / Wireless Telecom




CUSTOMER AND PRODUCT BACKGROUND
The customer is the India Development Center (IDC) of a world leader in 3G and next-generation mobile technologies.


The product in question was a video sharing application that was developed at the IDC using C/C++. The application was
intended for sharing or storing videos on mobile phones with or without Packet Switched (PS) / Circuit Switched (CS) calls.
The application used Session Initiation Protocol (SIP) for signaling and Real Time Protocol (RTP) for streaming.




PROBLEM STATEMENT
The product components from different development centers were integrated at the IDC and then sent out for field-testing
at an overseas site. The client discovered that the field-testing QA team spent considerable amount of time detecting
system-level defects, leading to an increase in field testing effort and, therefore, delays in product release. The client sought
the help of a specialist partner to fix this anomaly immediately and arrest defect escapes to field.
SOLUTION

The STAG team conducted a quick analysis of the existing test
process and made the following observations:                                                           # Test cases added: 340


• Test cases documented were not exhaustive and repeatable.
                                                                                                       # PERL scripts created: 25
• Defects observed were not systematically analyzed.
                                                                                                       (average lines of code per script – 150)
• 40% of total defects logged were at the unit level.
• The IDC team spent precious time uncovering system level defects.


The STAG team first set up a pragmatic test practice to formally design and document test cases based on
specifications/standards for the features to be implemented in every release (weekly) for testing. Clear gate criteria were
implemented using sanity tests that ensured good test readiness.


The team introduced the concept of build and release notes, which helped the IDC test team focus, prioritize the testing tasks,
and provide essential timely feedback to the development team for quick and measurable progress in product development.


The team added test cases and executed them incrementally for every release. It applied black box techniques and HBT-based
BeST techniques to design test cases. The test cases were developed for both the ‘use’ as well as ‘abuse’ aspects. The team also
developed PERL scripts to detect defects at the SIP level.


The STAG team also set up unit testing practices for key components before releasing the build for system testing. It used
Ethereal and log testing tools to detect, localize, and capture protocol issues and attach them with the defects logged to help
the development team fix the code quickly.


The team also tracked defects and mapped them to the features, modules, and developers to enable quick resolution. After
every release, the team generated a test report that gave clear directions for taking the required corrective actions.


OUTCOME AND VALUE ADDITIONS
Setting up unit level testing resulted in reduction of defects in system testing and eliminated the occurrence of the same defect
types in different features. Reduced rework in coding as well as test execution resulted in a 30% increase in productivity. Also,
there was a 90% reduction in network independent system level defects to field testing.
The defect identification and fixing cycle was brought down to 2 days from 5 days. Zero defect escape to field contributed to
reduction in field testing cycle to 1 day from 3 days for every release. The average defect count reduced from 20 to 12 per
release.


Overall, as the focus of defect detection moved from unit level to system level, the testing cycle was reduced to 3 days from 5
days.


         CUSTOMER SPEAK
         …We are very pleased with our association with STAG, as they brought about a transformation in our
         test practices. This resulted in a 60% reduction in testing effort, a 66% reduction in the field testing
         cycle, and a 30% saving from manpower reduction.
                                                                                                                                    - QA Manager


  Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
  Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


  2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.

Weitere ähnliche Inhalte

Mehr von STAG Software Private Limited

Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)STAG Software Private Limited
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)STAG Software Private Limited
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolSTAG Software Private Limited
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...STAG Software Private Limited
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachSTAG Software Private Limited
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"STAG Software Private Limited
 
Enhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product MaturityEnhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product MaturitySTAG Software Private Limited
 
Pre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based ProductPre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based ProductSTAG Software Private Limited
 

Mehr von STAG Software Private Limited (20)

Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Reflect and Change
Reflect and ChangeReflect and Change
Reflect and Change
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"
 
Enhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product MaturityEnhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product Maturity
 
Too Many Conditions!
Too Many Conditions!Too Many Conditions!
Too Many Conditions!
 
Pre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based ProductPre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based Product
 

Kürzlich hochgeladen

How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 

Kürzlich hochgeladen (20)

How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 

Efficient Test Practice Reduces Cycle Time by 60%

  • 1. CASE STUDY Efficient Test Practice Reduces Cycle Time by 60% STAG’s re-engineering of test practices and process standardization drives tangible benefits for a global leader in wireless communication, enabling it to achieve 60% reduction in testing cycle time and 30% increase in productivity. Domain/Category - Technology - C++, PERL Mobile / Wireless Telecom CUSTOMER AND PRODUCT BACKGROUND The customer is the India Development Center (IDC) of a world leader in 3G and next-generation mobile technologies. The product in question was a video sharing application that was developed at the IDC using C/C++. The application was intended for sharing or storing videos on mobile phones with or without Packet Switched (PS) / Circuit Switched (CS) calls. The application used Session Initiation Protocol (SIP) for signaling and Real Time Protocol (RTP) for streaming. PROBLEM STATEMENT The product components from different development centers were integrated at the IDC and then sent out for field-testing at an overseas site. The client discovered that the field-testing QA team spent considerable amount of time detecting system-level defects, leading to an increase in field testing effort and, therefore, delays in product release. The client sought the help of a specialist partner to fix this anomaly immediately and arrest defect escapes to field.
  • 2. SOLUTION The STAG team conducted a quick analysis of the existing test process and made the following observations: # Test cases added: 340 • Test cases documented were not exhaustive and repeatable. # PERL scripts created: 25 • Defects observed were not systematically analyzed. (average lines of code per script – 150) • 40% of total defects logged were at the unit level. • The IDC team spent precious time uncovering system level defects. The STAG team first set up a pragmatic test practice to formally design and document test cases based on specifications/standards for the features to be implemented in every release (weekly) for testing. Clear gate criteria were implemented using sanity tests that ensured good test readiness. The team introduced the concept of build and release notes, which helped the IDC test team focus, prioritize the testing tasks, and provide essential timely feedback to the development team for quick and measurable progress in product development. The team added test cases and executed them incrementally for every release. It applied black box techniques and HBT-based BeST techniques to design test cases. The test cases were developed for both the ‘use’ as well as ‘abuse’ aspects. The team also developed PERL scripts to detect defects at the SIP level. The STAG team also set up unit testing practices for key components before releasing the build for system testing. It used Ethereal and log testing tools to detect, localize, and capture protocol issues and attach them with the defects logged to help the development team fix the code quickly. The team also tracked defects and mapped them to the features, modules, and developers to enable quick resolution. After every release, the team generated a test report that gave clear directions for taking the required corrective actions. OUTCOME AND VALUE ADDITIONS Setting up unit level testing resulted in reduction of defects in system testing and eliminated the occurrence of the same defect types in different features. Reduced rework in coding as well as test execution resulted in a 30% increase in productivity. Also, there was a 90% reduction in network independent system level defects to field testing. The defect identification and fixing cycle was brought down to 2 days from 5 days. Zero defect escape to field contributed to reduction in field testing cycle to 1 day from 3 days for every release. The average defect count reduced from 20 to 12 per release. Overall, as the focus of defect detection moved from unit level to system level, the testing cycle was reduced to 3 days from 5 days. CUSTOMER SPEAK …We are very pleased with our association with STAG, as they brought about a transformation in our test practices. This resulted in a 60% reduction in testing effort, a 66% reduction in the field testing cycle, and a 30% saving from manpower reduction. - QA Manager Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.