Enterprise Search is still considered as a one-time IT Project in most cases, although it should rather be a Business Process, with well-defined lifecycle, metrics and analytics. Measuring and controlling success is very challenging – in most cases, it has to be a string collaboration between internal and external experts. In this session, I’m introducing several roles of this process as well as useful metrics and best practices. Attendees will get a practical plan for quality management of their Enterprise Search solution as the key takeaway.
8. Common Requirements
‘I want Google-like Search in my Enterprise’
‘I want it just work.’
‘We have 666 million documents. I want to be able
to find everything.’
14. Search Quality
Quality of Results
Relevance of Results
Quality of User Experience
Supportability and Maintainability
Quality of Information Architecture!!!
15. Quality of Results
Various Content Sources
Various Types of Content
Structured and Unstructured Data
Security is critical
Metadata is essential
User tagging
Auto-tagging
Advanced features vary system by system
16. Relevance of Results
The order of results
Enterprise SEO = Information Architecture!
Ranking – METADATA based!
Custom Ranking Model On-Prem only
Query Rules and XRANK On-Prem + Cloud
18. Enterprise Search – Roles
Team Members
Internal External Liaison
Business Sponsors
Stakeholders
Project Management
IT
Search Admins
Developers
…
Consultants
Service Providers
Product Vendors
Developers
Act as Internal
Have Wide Search
Experience
and Knowledge
Understands the
Business
Well Organized
Liaise between Internal +
External
Quality Management
“Active Insurance”
19. How we Know Search is Good
(Enough)?
Users don’t complain
Users keep using it
20. Search Metrics
Number of
Searches
Number of
successful
Searches
Number of
Searches with
Zero results
Results with no
click
Most popular
Queries
Results clicked
the most
Who’s
performing the
most searches
Correlated
searches
Speed /
latency
Total distinct
search terms
Total distinct
words
Trends and
historical
data/charts
23. Action Plan
Start a Discussion!!
Evaluate your current Search solution
Evaluate your Content
Collect Use Cases / Stories
Identify Users / Audiences
Is Your Search Good Enough???
24. Action Plan
Collect Feedbacks Analyze Take Actions
Search Analytics Reports Analyze Take Actions
Errors/warnings in the Crawl Log Analyze Fix
Evaluate if any new Content Source is needed
Evaluate if any new Type of Content is needed
Improve Metadata
Improve the UI
Measure and Analyze!
Planning
Implemen
tation
Analysis