A US-based network security company implemented Harbinger's hybrid test automation framework to improve their testing process. The framework used Selenium and a keyword-driven approach to develop 43 test scripts covering 1,500 test cases. This allowed the company to increase test coverage from 38% to 100% and execute all tests across multiple browsers daily, finding defects earlier. The automated reporting provided management and developers with insights to reduce defects and costs compared to manual testing.

1. Company achieved enhanced customer satisfaction levels with the
reduced number of leaked defects and the best product quality.
 A US based high profile company in Network
Security Domain
 They have a proprietary platform that has
network, endpoint, mobile and temporal
event based malware detection and risk
modeling, as well as unparalleled threat feed
data on malicious IP addresses
Accelerated Test Automation with Hybrid
Framework
 With one week of customization, Harbinger's Selenium
based Hybrid Automation Framework was deployed. This
framework comprised of:
 The Keyword driven approach that simplified the
scripting process (no programming skills required)
 Data driven capability provided reuse of same
scripts for multiple data set
 One Engineer developed 43 test scripts, each with about
35 data combinations (total 1500 test cases) in 3 weeks
 Team was able to create manual test cases for every
sprint during the agile development
 Earlier the team was able to execute only 400 regression
test cases (38% coverage) within the stipulated timeframe
and only on one browser. After automation they were able
to execute all 1500 test cases (100% coverage) in a day’s
time. It also allowed multiple browsers to execute
automation scripts at the same time.
 Framework gives three levels of HTML reports- a test suite
report for management, detailed report of every test script
in the suite for tester to help in filing defects and
screenshots to help the developer in defect fixing.
www.harbinger-systems.com © Harbinger Systems rfi@harbingergroup.com
Calibri, 20, Bold
 Frequent patches and hot fixes due to
insufficient test coverage leading more
defect leakage
 Company wanted Agile Testing Model to be
implemented requiring robust, efficient, and
Frequent Testing
 Manual Testing and reporting incurred more
time & effort
 Unable to cover all the scenarios for every
maintenance release
 Large number of permutations and
combinations for Test data
 Support for multi-browser increased the
testing scope further
Application Stack
 .NET 4.0 MVC4, AJAX, XML
 Web farming and Load balancer
 MySQL, Tomcat Apache
 Android for mobile platform
Automation Stack
 Selenium Web Driver, Java
 HHAF automation framework
 IE, FF and Chrome browsers
Automated Software Testing
Situation Harbinger Solution
Challenges
Tools & Technologies
HSTC4a01
 Increased the test coverage, reducing defect leakage
ratio. Thereby reducing the overall cost of maintenance.
 Since the frequency of release cycle was one release
every month, the above benefits get multiplied twelve
times a year and bring in higher cost savings.
 Provided high level and detailed level reports of all the
tests, reducing test management efforts and assisted in
informed decision-making.
Benefits