This document discusses automating enterprise application and data warehouse testing using QuerySurge. It begins with an introduction to QuerySurge and its modules for automating data interface testing. These modules allow testing across different data sources with no coding required. The document then covers data maturity models and how QuerySurge can help improve testing processes. It demonstrates how QuerySurge can automate testing to gain full coverage while decreasing testing time. In conclusion, it discusses how QuerySurge provides value through increased testing efficiency and data quality.
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
How to Automate your Enterprise Application / ERP Testing
1. Bill Hayduk
CEO/President
RTTS & QuerySurge division
How to Automate your
Enterprise Application / ERP Testing
Christopher Thompson
Senior Solutions Expert
QuerySurge
Automate your
Data Warehouse & Big Data Testing
and Reap the Benefits
built by
2. Enterprise Application / ERP Testing
Take your testing process to its full potential using
our Maturity Model
• centralize and standardize your testing
• automate data interface testing
• compare databases, XML, json and flat files to
each other and to a database
• gain 100% coverage with a 95% decrease in
testing time
built by
QuerySurge™
AGENDA
Data Interface testing
• take your testing process to
its full potential using
our Maturity Model
• centralize and
standardize your testing
• automate data interface
testing
• compare XML files and flat
files to each other and to a
database
• gain 100% coverage with a
95% decrease in testing time
• Demo
Today’s Agenda
4. QuerySurge Alliance Partners
Regional Consulting firms
Technology Partners Global System Integrators
Argentina, Australia, Belgium, Brazil, Canada, Chile, India,
Malaysia, Netherlands, New Zealand, Norway, Sweden,
Singapore, South Africa, Ukraine, US
5. “Unfortunately, companies often don't spend enough time
aligning the data testing…and validation cycles to the project
timeline”.
"You really need to make sure that you're validating and testing
throughout the process”.
- InformationWeek
Question:
How are you going to test the data?
Failure to validate and test the process
built by
QuerySurge™
6. The average organization loses $14 million annually
through poor Data Quality.
- Gartner
46% of companies cite Data Quality as a barrier
for adopting Business Intelligence products.
- InformationWeek
Data Quality Best Practices boost revenue by 66%.
- Research firm Sirius Decisions
built by
QuerySurge™
8. source: IBM Data Governance Council Maturity Model
• Patterned after the Capability
Maturity Model
Integration(CMMI) from the
Software Engineering Institute
(SEI) at Carnegie Mellon
University
• Devised by IBM, along with 55
other companies
• Few stable processes exist
• “Just do it” mentality
• Data-related policies become more clear & reflect the
organization’s data principles.
• Data integration opportunities are better leveraged.
• Risk assessment for data integrity & quality becomes part of the
organization’s project methodology.
• Further defined value of data for more data elements
• Data Governance methodology is introduced during the
planning stages of new projects
• Enterprise data models are documented & published
• Data Governance is second nature
• ROI for data-related projects is tracked
• Business value of data management is
recognized
• Cost of data management is easier to manage
• Costs are reduced as processes become
automated
• More data-related controls are documented
• Metadata becomes an important part of documenting critical
data elements.
built by
QuerySurge™
Data Maturity Model - Process
9. Sampling
Level
1
Sampling a % of data by visually comparing data sets. Not
repeatable.
Excel, Ad Hoc Reporting
Level
2
Using Excel or other homegrown method. Ad hoc reporting.
Minus Queries
Level
3
Utilizing SQL editor & minus queries to test data. More
detailed reporting.
Data Test Automation
Level
4
Fully repeatable test automation, centralized reporting.
What is the
maturity level
of your
data testing?
source: RTTS
• Patterned after CMMI
• Devised by RTTS based on
observations
Data Quality Optimizing
Level
5
Full automation, tracking of ROI, predictive data issues, auditable history
& results. Business value is fully understood/supported by management.
built by
QuerySurge™
Data Maturity Model - Data Testing
10. A Data Interface is a set of attributes representing
a given entity, used to create processes that read
from, or write to, interfaces rather than directly
from or to sources or targets of data.
- Oracle
built by
QuerySurge™
Data Interface - definition
12. • Import into Excel
• Use SQL editor to query database
• Import results into Excel
• Use the CountIF function
• Compare column by column
• Excel is incredibly slow
• The process is inefficient
built by
QuerySurge™
Data Interface Testing: Popular Test Strategy
16. a software division of
QuerySurge™
Data Quality at Speed
→ Automate the launch, execution, comparison & auto-email results
Test across different platforms
→ Data Warehouse, Hadoop, NoSQL, DB, flat files, XML, JSON, BI Reports
Smart Query Wizards - no coding needed
→ Query Wizards create tests visually, without writing SQL
Data Analytics & Data Intelligence
→ Data Analytics Dashboard, Data Intelligence Reports, emailed results,
Ready-for-Analytics back-end data access
Create Custom Tests
→ Modularize functions with snippets, set thresholds, stage data, check data types
DevOps for Data & Continuous Testing
→ API Integration with Build/Release, Continuous Integration/ETL ,
Operations/DevOps Monitoring, Test Management/Issue Tracking, more
Projects
→ Multi-project support, global admin user, activity log reports
the QuerySurge advantage
17. Web-based…
Supported OS...
Connects through…
…to any JDBC compliant data source
QuerySurge™
QuerySurge
Controller
QuerySurge Server
DB Server (MySQL)
App Server (Tomcat)
QuerySurge Agents
(Ships with 10 Agents)
a software division of
QuerySurge Environment
Installs...
…in the Cloud
…on a VM
…on a Bare Metal Server
20. Fast and Easy.
No programming needed.
QuerySurge™
• Perform 80% of all data tests with no SQL coding
• Opens up testing to novices & non-technical members
• Speeds up testing for skilled coders
• provides a huge Return-On-Investment
a software division of
QuerySurge Modules
21. Fast and Easy.
No programming needed.
Compare by Table, Column & Row
• Perform 80% of all data tests
•Automatically generates SQL code
• Opens up testing to novice & non-
technical team members
• Speeds up testing for skilled SQL coders
• provides a huge Return-On-Investment
built by
QuerySurge™
QuerySurge Modules
22. 3 Types of Data Comparison Wizards:
The also provide you with automated features for:
o filtering (‘Where’ clause) and
o sorting (‘Order By’ clause)
Column-Level Comparison:
This is great for Big Data stores and Data Warehouses where tables will have some columns
containing transformations and some columns with no transformations. Many tables and
columns can be compared simultaneously and quickly.
Table-Level Comparison:
This comparator is great for Data Migrations and Database Upgrades with no
transformations at all. Many tables can be compared simultaneously and quickly.
Row Count Comparison:
Great for all - Big Data stores, Data Warehouses, Data Migrations and Database Upgrades.
Many tables and rows can be compared simultaneously and quickly.
built by
QuerySurge™
QuerySurge Modules
23. QuerySurge™ a software division of
Multi-Project Support
Multiple projects can now be created in a single QuerySurge instance. This allows for multiple groups to
work on the same QuerySurge server without seeing each other’s assets (project-level security).
Features supported in Multi-Projects are:
• Global Admin User: This new user type administers the QuerySurge instance
across multiple projects.
• Assign Users to Projects: Users can be assigned to one or more projects. In
each assignment, a user can have a different project role (administrator,
standard user or participant user).
• Assign Agents to Projects: Agents can be shared across projects or dedicated
to specific projects.
• Project Import: Import project data into another project on the same instance
or into a different environment (Dev/QA/Prod).
• Project Export: Export entire projects and store for backup purposes.
• Activity Log Reports: Two reports that track specific changes for auditing
purposes, including manipulations to users or connections.
QuerySurge Modules
25. Design Library
• Create custom Query Pairs (source & target
SQLs for tests that have transformations)
Scheduling
Build groups of Query Pairs
Schedule Test Runs
• Run immediately
• Run at set date/time
• Have event kick it off
™
a software division of
QuerySurge Modules
26. Deep-Dive Reporting
Examine and automatically
email test results
Run Dashboard
View real-time execution
Analyze real-time results
a software division of
QuerySurge Modules
27. a software division of
QuerySurge™
QuerySurge DevOps for Data
• First full DevOps for Data testing solution
• Both RESTful and command line APIs
• Improves Data Quality at Speed
QuerySurge DevOps for Data integrates with:
• Continuous integration/ETL solutions
• Automated build/release/deployment solutions
• Operations and DevOps monitoring solutions
• Test management/issue tracking solutions
• Scheduling and workload automation solutions
60+ API calls with almost 100 different properties
that users can utilize to retrieve, edit, update, or
delete information.
QuerySurge Modules
28. QuerySurge™
• view data reliability & pass rate
• add, move, filter, zoom-in on any
data widget & underlying data
• verify build success or failure
a software division of
QuerySurge Modules
29. Large Suite March 5, 2021 16:20:44 March 5, 2021
March 5, 2021 4:24 PM
Start Time
QuerySurge™
6 minutes
QuerySurge Modules
30. 30
QuerySurge Value-Add
QuerySurge provides value by either:
in testing data coverage from < 1% to
upwards of 100%
in testing time by as much as 1,000 x
combination of in test coverage while in
testing time
built by
QuerySurge™
31. Return on Investment (ROI)
• redeployment of head count because of an increase in
coverage and decrease in need for testers
• an increase in better data due to shorter / more thorough
testing cycle, possibly saving $ millions by preventing bad
data.
built by
QuerySurge™
32. Sampling
Level
1
Sampling a % of data by visually comparing data sets. Not repeatable.
Excel, Ad Hoc Reporting
Level
2
Using Excel or other homegrown method. Ad hoc reporting.
Minus Queries
Level
3
Utilizing SQL editor & minus queries to test data. More
detailed reporting.
Data Test Automation
Level
4
Repeatable test automation, agreed-upon process, centralized
reporting.
On which Level
should your
process be?
Data Quality Optimizing
Level
5
Full automation, tracking of ROI, predictive data issues, auditable
results. Business value is fully understood/supported by management.
built by
QuerySurge™
Data Maturity Model - Test Execution
33. Ensuring Data Warehouse Quality
Demonstration
Christopher Thompson
Senior Domain Expert
QuerySurge
To see the video of this demonstration please visit:
http://www.querysurge.com/solutions/data-interface-testing
built by
QuerySurge™