Automated Usability Evaluation

1. Project UX-Intel (www.uxintel.tk)
Taglines:
● UX-Intel – A tool that tests the UX ofyour Offering (Product/Website).
● Automationof Usability Testing process.
Keywords:
Web, Mobile, AutomationTesting, UserExperience, Marketing, Design, Usability Validation, UX
Analytics
Idea:
The idea of UX-Intel revolvesaround building a unique platform that employs a cluster of
sophisticated web-analytical tools, whichautomates the ‘product’ evaluationin digital space
from a design(VC), usability (AUT),and marketing (CJM) perspective.
It would empower the web businesses
- to analyze their existing platforms and
- assess the customer (user) experience
enabling them to make accurate amends and strategic decisiontowardsinthe digital economy
(investment).
It’s a tool that would disrupt the outlook towards the customer’ mindset and help them gauge
the positioning of the business to their customer.
VC- Visual Communication Design | AUT- Automated Usability Testing| CJM - Customer Journey Mapping
design (Visual Communication).-
- How designshould be.... importance of design?
Good design can be defined as solidity (structurally well defined), commodity (saleable) and delight
(appealing). Design should have low visual complexity and high prototypicality (how representative a
design looks for a certain category of websites) to create a measurable impact.
- Where does the designlies in today’ marketplace?
- How can we improve designs withautomated tools and techniques?
- What is the reflectance of such a tool?
usability (Automated Usability Testing).
- How usability should be.... importance ofusability?
Usability evaluation is an increasingly important part of the user interface design process. However,
usability evaluation can be expensive in terms of time and human resources, and automation is
therefore a promising way to augment existing approaches.
- Where does the usability lies in today’ marketplace?

2. User experience (UX), at its core, tries to study and evaluate how pleasant a website is to use. This factor
is largely subjective because it deals with user perception, which can be vastly different from one user
to the next.
- How can we improve usability withautomated tools and techniques?
There are not automated tools or techniques that can justify the user experience of any web or product
in quantifiable manner that exist of today.
- What is the reflectance of such a tool?
AUE focuses on developing tools, techniques and methods to speed evaluation (rapid), tools that reach
a wider audience for usability testing (remote), and tools that have built-in analyses features
(automated).
marketing (Customer Journey Mapping).
- How marketing should be.... importance of marketing?
- Where does the marketing lies in today’ marketplace?
- How can we improve withautomated tools and techniques?
- What is the reflectance of such a tool?
Core of the Venture idea is a 30 years of Intellectual Property and experimental observations
in the area of Web usability researchcovering more than 5000+ Usabillity Guidelines. This is
one of the tough ideas to pursue for a web business setting, but I have learned all way through
last 5 years of work experience that usability and designstudies can be quantified. My
instincts have showed me the directionof the quantification of processes and guidelines that
are defined qualitatively in the area of evaluation.
Target Customer Segment
Who will use it?
Help to create the corrective UI and build the right UX for users.
● UX-UI-Designexperts who will extensive
● Help Developers create products as well test their coded designefficiently.
● Help Marketers analyze what they are presenting to the users.
● Help Businesses take more strategic standpoint.

3. ● Help bind the inferences to educational touch points.
What benefit will the user derive from it?
The platform would lead the user to the 4D process.
● (Discovery phase) Identify the gap in designand usability and marketing,
● (Definition phase) Assess / analyze/ evaluate/amelioratethe gap,
● (DesignPhase) implementing the corrective measures,
● (Delivery Phase) get a successful UX approved outcome to deliver/deploy/ better
designs, and web experiences.
There’s no doubt that we will see people keep building bothmobile optimized websitesand
apps that offer superior user experience. Apps-oriented web technologies and customer
interactions are here to stay and having great user experience is one of the most important
reasons for a success or a failure of a customer facing product/services(the web platform).
Technology Stack:
Product Suite for different target customer segments can be build from the base flagship
product, that can help in building a comprehensive analytics tool.
UX suite (For UI-UX Designers)
Click Testing
Web Testing
Survey
Card Sorting
Persona Creator
Dev Suite (For Developers)
Code Analyzer
Performance Analyzer
Emogrifier
Conversion suite (For Marketeers)
Click Tracking
Discover which areas of your website draw users' attentionand which are ignored.
Visitor Recording
Capture every mouse move, click and keystroke to learn from user behavior.
Form Tester
Discover how users interact with the web forms and find fields that need improvement.

4. Feedback Form
Gather customer feedback online and find ways to increase visitor satisfaction.
Biz suite (For Businesses)
Make a connect
StackExchange in area of Design-Usability-Marketing
Why Automation of Usability:
Automationof usability evaluationhas several potential advantages over non-automated
evaluation,and the way it affects the usability, such as the following.
● Reducing the cost ofusability evaluation. Methods that automate capture, analysis, or
critique activities candecrease the time spent on usability evaluationand consequently
the cost. For example, software tools that automatically log events during usability
testing eliminate the need for manual logging, which can typically take up a substantial
portionof evaluationtime.
● Increasing consistency of the errors uncovered. Insome cases it is possible to develop
models oftask completionwithin an interface, and software tools canconsistently
detect deviations from these models. It is also possible to detect usage patterns that
suggest possible errors, suchas immediate task cancellation.
● Predicting time and error costs across anentire design. As previously dis- cussed, it is
not always possible to assessevery single aspect ofan interface using non-automated
evaluation. Software tools, suchas analytical models, make it possible to widenthe
coverage ofevaluated features. —Reducing the need for evaluationexpertise among
individual evaluators. Automating some aspects ofevaluation, such as the analysis or
critique activities,could aid designers who do not have expertise in those aspects of
evaluation.
● Increasing the coverage ofevaluated features. Due to time, cost, and resource
constraints, it is not always possible to assess every single aspect ofaninterface.
Software tools that generate plausible usage traces make it possible to evaluate
aspects ofinterfaces that may not otherwise be assessed.
● Enabling comparisons betweenalternative designs. Because oftime, cost, and resource
constraints, usability evaluations typically assess only one designor a small subset of

5. features from multiple designs. Some automated analysis approaches, suchas
analytical modeling and simulation, enable designers to compare predicted
performance for alternative designs.
● Incorporating evaluationwithin the designphase of UI development, as opposed to
being applied after implementation. This is important because evaluation with most
nonautomated methods can typically be done only after the interface or prototype has
been built and changes are more costly [Nielsen1993]. Modeling and simulation tools
make it possible to explore UI designs earlier.
Comparsion of Traditional practice v/s AUE
Traditional Usability Evaluation Automated Usability Evaluation
Time consuming Faster
Expensive Cheaper
Require usability engineers on call Automated, remote
Small numbers of subjects Larger numbers of subjects
Local users Intercity, interregional, and international
users
Controlled Lab Home or Workplaces
Depth Breadth
All (Website, Software, Web Applications) Website, E-Commerce,WWW interfaces
Why Automation of Design:
Why Automation of Marketing:
Questions to ponder:
What is lost as compared to traditional usability testing methods?
How do youdeal with a huge amount of data on user interaction? Can you mine it effectively
for improving a web site?
Is there a methodology for benchmarking approaches so that there is some assurance that the

6. automated tools are indeed measuring usability?
What analysis and visualizationtools are useful to researchers and usability engineers?
Which of the innumerable aspects of the user behavior should be captured by automated
tools? Mouse clicks? Eye gaze? Blood pressure? Verbal self-reportsand think-alouds?
Founder:
Sandeep Supal
Being a usability expert and ux evangelist specializing inthe areas of web/mobile/application
designand usability for software industry, who commands an experience of 5 years, I have
inculcated deep understanding of the products and customers. That enables me to craft the
seamless and long-lasting user experience through
(evaluate/analyze/optimize/correct/refine/improve) a product that’s ontarget, (benefits), and
works well with the business objectives ofthe organization.
Approved success in Research:
Our Framework platform will 99% correctly evaluate the guideline-related usability
violations when compared to Nielsen and Tahir’s manual evaluation.
Achieving 50% guideline-related usability violations reported by Nielsen and Tahir
manual evaluation.
If UI level violations were considered in Nielsen and Tahir’s manual evaluation, then our
framework is able to an addendum of 25% more violations as identified by Nielsen and
Tahir manual evaluation.
There is a strong positive correlation when the number of usability violations identified
by our framework as plotted against the number of lines of code in the respective
websites evaluated.
By conducting several tests, it was estimated that a usability expert would
approximately take 2.129 (2-5) seconds to identify and locate a usability violation as
opposed to our framework which only takes 0.097 (less than 1/100th) seconds.
A non-usability expert would be able to identify 70% of the usability violations identified
by the usability experts with help of our framework.