7. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
Monday, 24 September 12
8. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
Monday, 24 September 12
9. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
• Old methods would normally
mean up to a weeks delay from
the test taking place to getting the
report.
Monday, 24 September 12
10. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
• Old methods would normally
mean up to a weeks delay from
the test taking place to getting the
report.
• Crowd sourcing is great, but is too
random, and relies on a large
number people testing randomly.
Monday, 24 September 12
11. The Challenge...
• We need to provide Customer
Experience testing at key venues
across UK.
• The Solution had to provide a
comparison of all the operators,
near realtime
• Old methods would normally
mean up to a weeks delay from
the test taking place to getting the
report.
• Crowd sourcing is great, but is too
random, and relies on a large
number people testing randomly.
• What we needed was a new
approach...
Monday, 24 September 12
13. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
Monday, 24 September 12
14. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
Monday, 24 September 12
15. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
• But with Crowd sourcing... It is
difficult to achieve a consistent
relevant testing regime.
Monday, 24 September 12
16. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
• But with Crowd sourcing... It is
difficult to achieve a consistent
relevant testing regime.
• What we needed was a
dedicated crowd... A crowd
which would be happy to work
24/7 and stand around all day.
Monday, 24 September 12
17. The origin’s of an idea...
• The idea for realtime CET was
based on our internal crowd
sourced system,
• A system that we have
pioneered for a number years...
• But with Crowd sourcing... It is
difficult to achieve a consistent
relevant testing regime.
• What we needed was a
dedicated crowd... A crowd
which would be happy to work
24/7 and stand around all day.
• So that was it ‘Dedicated Crowd
Sourcing’ was the answer...
Monday, 24 September 12
19. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
Monday, 24 September 12
20. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
Monday, 24 September 12
21. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
Monday, 24 September 12
22. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
Monday, 24 September 12
23. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
• Simple API driven reporting system
for a web-portal, Spreadsheets & an
App..
Monday, 24 September 12
24. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
• Simple API driven reporting system
for a web-portal, Spreadsheets & an
App..
• See the results in realtime...
Monday, 24 September 12
25. The basic requirements
• We needed a real product, so that we
could use to deliver an end2end
solution...
• Realtime App-based measurement
system...
• We needed an app that could provide
both voice & data testing in one unit...
• A flexible deployment strategy...
• Simple API driven reporting system
for a web-portal, Spreadsheets & an
App..
• See the results in realtime...
• An interface that would allow full
diagnostics when required...
Monday, 24 September 12
26. A Cloud based solution...
JSON api to enable
Backend server in Cloud realtime excel reporting
JSON api to enable reporting
on mobile devices
Root cause analysis tool
Smartphone testing app
Monday, 24 September 12
27. Comparison Of Existing systems
Data Voice JSON Realtime Cost
Metrico Yes Yes Yes Yes >200K
iTestNet Yes No Yes Yes Free
TEMS Yes Yes No No >100K
Epitiro Yes Yes Yes Yes <100K
Monday, 24 September 12
28. Comparison Of Existing systems
Data Voice JSON Realtime Cost
Metrico Yes Yes Yes Yes >200K
iTestNet Yes No Yes Yes Free
TEMS Yes Yes No No >100K
Epitiro Yes Yes Yes Yes <100K
Monday, 24 September 12
29. Comparison Of Existing systems
Data Voice JSON Realtime Cost
Metrico Yes Yes Yes Yes >200K
iTestNet Yes No Yes Yes Free
TEMS Yes Yes No No >100K
Epitiro Yes Yes Yes Yes <100K
The only solution to meet all our requirements was Epitiro
Monday, 24 September 12
30. Comparison Of Existing systems
The only solution to meet all our requirements was Epitiro
Monday, 24 September 12
31. Comparison Of Existing systems
The only solution to meet all our requirements was Epitiro
Monday, 24 September 12
32. Dashboard & JSON api Specification provided
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
strength% data% collected% over%
the%measurement%period.% %And%
JSON%api%Dashboard% legend.% % This% should% a%
simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area%
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
97.6%%
Monday, 24 September 12
33. Dashboard & JSON api Specification provided
• We provided a detailed
specification for both the
API and the web Portal...
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
strength% data% collected% over%
the%measurement%period.% %And%
JSON%api%Dashboard% legend.% % This% should% a%
simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area%
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
97.6%%
Monday, 24 September 12
34. Dashboard & JSON api Specification provided
• We provided a detailed
specification for both the
API and the web Portal...
• Writing a test API interface
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
to ensure that the product
JSON%api%Dashboard%
would interface with our
strength% data% collected% over% legend.% % This% should% a%
the%measurement%period.% %And% simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
internal tools when it was
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
delivered...
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area%
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
97.6%%
Monday, 24 September 12
35. Dashboard & JSON api Specification provided
• We provided a detailed
specification for both the
API and the web Portal...
• Writing a test API interface
Coverage% layer% should% provide%
a% clear% view% of% all% signal% The% legend,% clean% simple%
to ensure that the product
JSON%api%Dashboard%
would interface with our
strength% data% collected% over% legend.% % This% should% a%
the%measurement%period.% %And% simple% and% show% poor% to%
provide% a% clear% uninterrupted% good%coverage%in%a%simple%
a n d% a n i m a t e d% z o o m i n g% The% Map% must% have% a% clear% and% linear%flow…%
internal tools when it was
experience% unambiguous%Ltle%
Combined%Network%Coverage%
S i m p l e%
G o o g l e%
s t y l e%
navigaLon%
delivered...
controls%%
Very%Simple%network%
dashboard%based%on%
the%displayed%areas…%% Logo% Title%area% • We wanted to support web-
portal, excel spreadsheet,
Providing%a%simple%
view%of%Signal%level,% Operator%ranking%table% CCSR%
Download%&%Upload%
Speed,%Ping%&%IP%
Including%Signal,%download%speed,%
Operator% 98.2%%
and apps which would all run
success%rate.% upload%speed,%Ping,%webpage%download%
logo% 97.5%%
speed,%Voice%&%Data%CompleLon%Success%
95.3%%
rate%&%Sample%size% 97.6%%
97.6%%
off the same JSON API...
97.6%%
Monday, 24 September 12
57. ats-group.co.uk Est. 1992
Tom Bryer
Managing Director
Monday, 24 September 12
58. Est.
1992
London 2012 Games
Benchmarking the Mobile
Operators
Working With:
Monday, 24 September 12
59. During the Summer of 2012 – ATS&RO pioneered the CET bike!
Giving unprecedented access to London during busy times of the day..
Monday, 24 September 12
60. From the initial concept… To Reality…
Production Engineering from ATS…
Monday, 24 September 12
61. Creating the static units for the London 2012 Games…
Monday, 24 September 12
62. Deploying the static units for the London 2012 Games…
Intelligent Communication Solutions
Rigging and Installation Services
• Took delivery of 20 static benchmark units
on Friday morning
• Work very hard to get to the key locations
in the Olympic park
• Deadline for installation within the Olympic
park was Sunday evening
• All boxes were installed, activated &
commissioned on time
Monday, 24 September 12
63. 152 test units deployed across the UK…
Monday, 24 September 12
64. Our
Benchmark
Test
Kit
Range…
Sta'c,
24
by
7
at
key
locaDons
Walk,
able
to
provide
access
to
key
areas
Cycle,
provide
great
access
to
urban
areas
Bike,
great
for
central
London
or
other
urban
areas
Car,
great
for
all
round
balance
of
TesDng
and
Mileage
Monday, 24 September 12
69. We
are
so
Impressed
with
realTime
CET…
We
have
set-‐up
a
new
company
to
drive
this
forward:
Currently Working With:
Monday, 24 September 12
70. On the way to completing a UK coverage map
Encouraging Mobile choice
Monday, 24 September 12
71. Est. 2000
Gavin Johns
Chief Operating Officer
Monday, 24 September 12
72. www.epitiro.com
iPQ TM
Real-Time Insight
Gavin Johns
Epitiro Group Limited
CEO, Epitiro
10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LN
Registered in England and Wales no: 3940403
info@epitiro.com | www.epitiro.com
Monday, 24 September 12
73. About Epitiro
www.epitiro.com
‘Quality of Experience’
Monitoring Solutions for Mobile Operators
§ Epitiro provides leading Mobile Operators with network
monitoring systems to ensure they can measure and manage
Quality of Experience
§ Real-time insight of QoE helps address service-affecting
issues in their infancy
§ We help operators achieve;
§ Efficient Network Expansion
§ Reduced Support Calls
§ Higher Customer Satisfaction / Reduced Churn
ipQTM
§ Established 2000, Cardiff
Epitiro Group Limited
10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LN
Registered in England and Wales no: 3940403
info@epitiro.com | www.epitiro.com
Monday, 24 September 12
74. Our Clients
www.epitiro.com
Monday, 24 September 12
75. Challenges for Mobile Operators
www.epitiro.com
Coverage - Capacity – Capability - Performance - Reliability
The Five Pillars of Customer Experience…
“Does it work when I want it?”
Coverage “Is there service where I need it?”
“Can I make a call when I want to, for
as longa as I want to?”
Does the Network
Capability Performance “Does it perform as I expect?”
support the latest
technology • Voice, text and Data
How does the network cope at Availability of Voice and Data
times of peak demand Services 24/7
Capacity Reliability
Monday, 24 September 12
77. AT50M Software Probe Test App
www.epitiro.com
OTA Android Smartphones
• Overview
– Targeted measurement of mobile network – based on
cell, bearer etc.
– Test Scheduling event based, time based, push-to-
test
– Active & Passive testing
AT50M
• Device Support Software
– Android 2.1+ and iOS 4.0+
Client
– Consolidated approach for future device support with
RIM and Windows
• Network and Bearer support
– 2G, 3G UMTS and CDMA, 4G WiMAX and LTE
– Wi-Fi
Monday, 24 September 12
78. ipQ Analytics
www.epitiro.com
CeX Dashboard’s in Real Time
Drill-down to investigate
network performance
See network performance by location
Filter just the data you want to see
Monday, 24 September 12
79. ipQ Analytics
www.epitiro.com
CeX Dashboard’s in Real Time
Drill-down to investigate
network performance
See network performance by location
Filter just the data you want to see
Monday, 24 September 12
80. ipQ Analytics
www.epitiro.com
CeX Dashboard’s in Real Time
Drill-down to investigate
network performance
See network performance by location
Filter just the data you want to see
Monday, 24 September 12
81. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs
Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
82. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
83. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
84. One-Click Dashboards
www.epitiro.com
Line Chart View…
One Click shows top
KPIs Click on any point
to see detailed
information
Click on any legend
to add/remove from
view
Monday, 24 September 12
85. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests
Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
86. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests
Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
87. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
88. Map Views
www.epitiro.com
See Coverage and KPIs on a Map
See Any KPI by heat
map
Click on a tile to
zoom in and see Pin
locations of
smartphone tests Click on a Pin to see the
test details of any
smartphone within the tile
Monday, 24 September 12
89. Summary of KPIs and Ancillary Data
www.epitiro.com
A Full Range of Measurement Capability
IP Data Measurements Passive Measurements Network Interfaces
• TCP Throughput • Data Connection State • IEEE 802.3 Ethernet
• TCP Echo • Cellular Service State • IEEE 802.11 Wireless
• TCP 3-way Handshake Latency • Application Throughput
• UDP Network Quality • Application Bandwidth Consumption
Internet Protocols
– Packet Loss • Web Browser Throughput
• IPv4
– Jitter • TCP / UDP Network Traffic
• IPv6
– Two-way latency
One-way latency (OWAMP) Geolocation
– Echo IP QoS Control
• GPS
• ICMP Latency • DiffServ DSCP
• Triangulation
• DNS Lookup • IPv6 Flow Label
• IP Geolocation
• Application Measurements Test Scheduling
• ITU-T G.107 E-model • Fixed
• Call Success Rate (Dropped Calls) • Periodic
• UDP Gaming • Window based
• P2P Bandwidth • Event based
• HTTP Web Browsing • On idle
Monday, 24 September 12
90. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
versions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
91. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
ersions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
92. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
ersions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
93. Test Management
www.epitiro.com
A Full Configurable Client from the Server
Create unlimited
ersions of KPI Tests
Extensive control over the
configuration of each Test
Easily make the Test
available for any
probe
Monday, 24 September 12
94. In Summary
www.epitiro.com
Benefits of iPQ…
§ Programmable warning and critical thresholds
means is instantly alerted when baseline thresholds
are breached
§ Full access to testing allows to control the frequency
and the number of KPIs
§ Benchmarking competitor MNOs highlights
opportunities to improve service..
§ Instantly see the impact of any changes on the
network…
Monday, 24 September 12
95. ipQTM Performance Monitoring Solution
www.epitiro.com
Product and Services
§ Real-Time Reporting Interface Mobile Operators
§ Full ‘On-Demand’ Management of data collection
probe testing
§ Support Services to ensure installation, configuration,
maintenance and further data analysis ipQTM
Epitiro Group Limited
10-11 Raleigh Walk, Waterfront 2000, Brigantine Place, Cardiff, CF10 4LN
Registered in England and Wales no: 3940403
info@epitiro.com | www.epitiro.com
Monday, 24 September 12