I wore 4 wearables on my left arm, and 8 on my right arm, to understand how they might vary with regard to number of steps walked and calories burned during a working day. The results are very interesting with variances between devices on both arms higher than my test on 15th Feb 2016.
2. Disclosure
• I have no commercial ties to any of the companies that make the
wearable technology used in this test
• All of the devices were purchased by me using my own funds
• My views expressed are my own
3. 12 devices.
4 smartwatches. 8 activity trackers.
From Left to Right
Huawei Watch
Microsoft Band 2
Basis Peak
Apple Watch
From Left to Right
Mi Band 1S
Fitbit Flex
Misfit Flash
Moov Now
4. Background
• The majority of the population are yet to use a wearable to track activity
• Insurers, employers and healthcare systems may be experimenting with
using basic data obtained from wearables
• My objective is to test the accuracy of wearables in terms of walking
(steps, miles walked, calories burned)
• This is a real world test, not a clinical trial
• Needs to be repeated & results validated
• Measurements may vary because the device is not closest to the wrist. I
will have to repeat the test later, but swapping the position of devices on
each arm
• Need a baseline for reference – mechanical German made waist mounted
pedometer has been ordered
5. Left arm (my non dominant arm) - smartwatches
• All devices worn continuously for 10 hours during the day
• All devices were fully charged prior to start of test
• Each device was connected by Bluetooth to the phone for duration of test
• Basis Peak, Microsoft Band, and Huawei watch paired with Samsung
Galaxy S6 Edge +
• Apple Watch paired with iPhone 6+
• All devices are were touching my skin (some use heart rate monitoring
for calorie burned algorithm)
• My exact date of birth (or year and month), weight (108kg), height (6’2”)
entered in apps for all devices
6. Right arm (my dominant arm) - information
• All devices worn continuously for 10 hours during the day
• 4 different models, but wearing 2 identical products of each model
• In addition to comparing with the smartwatches on my left arm, I’m interested whether the
identical products also produce identical results
• 4 devices connected by Bluetooth to iPhone 6+
• 4 devices connected by Bluetooth to Samsung Galaxy S6 Edge+
• All 8 devices were touching my skin
• My exact date of birth (or year and month), weight (108kg), height (6’2”) entered in apps for all
devices
• In Fitbit app, dominant arm as a location selected
• In Mi Band app, right arm as a location selected
• In Misfit app, wrist as a location selected
• In Moov app, no ability to select location of device
7. Data from Left Arm
Full table of results from both arms in later slides
9. Data from Right Arm
Showing screenshots from app since the devices don’t have displays
10. Mi Band 1S (1st away from wrist) Mi Band 1S (2nd away from wrist)
11. Fitbit Flex Green (3rd away from wrist) Fitbit Flex Red (4th away from wrist)
12. Misfit Black (5th away from wrist) Misfit White (6th away from wrist)
13. Moov Now Red (7th away from wrist) Moov Now Green (8th away from wrist)
14. Q. Why are calories on Apple watch so low?
• A. Apple Watch only shows ‘active’ calories. The Health app will show
the ‘resting’ and ‘active’ calories, when added up can be compared
with other devices. I assume this applies to the low numbers from
Huawei Watch & Mi Band 1S too.
353.88+2,177.22
= 2,531.1
15. Glossary
•LA = Left Arm
•RA = Right Arm
•1W = 1st away from wrist
•2W = 2nd away from wrist
•And so on
16. Device Firmware version Steps walked Distance
(miles)
Calories burned Steps per mile
(derived)
Position
Huawei Watch 1.3.0.2421912 4,873 N/A 399 (active calories) N/A LA 4W
Microsoft Band 2 2.0.4117.0 26 R 4,168 2.19 2,387 1,903 LA 3W
Basis Peak 1.18.3.0 3,555 N/A 3,711 N/A LA 2W
Apple Watch 2.1 (13S661) 4,656 2.49 2,531 (active 354) 1,870 LA 1W
Mi Band 1S 4.15.11.20 7,405 3.37 477 (active calories) 2,197 RA 1W
Mi Band 1S 4.15.11.20 6,792 3.10 443 (active calories) 2,190 RA 2W
Fitbit Flex (Green) 81 4,875 2.36 2,606 2,066 RA 3W
Fitbit Flex (Red) 7.81 4,994 2.42 2,605 2,270 RA 4W
Misfit Flash (Black) N/A 4,492 1.80 2,820 2,496 RA 5W
Misfit Flash (White) N/A 4,360 1.70 2,809 2,565 RA 6W
Moov Now (Red) 6.0* N/A N/A 2,686 N/A RA 7W
Moov Now (Green) 5.0* N/A N/A 2,583 N/A RA 8W
*Note: Moov app on iPhone & Galaxy are both reporting firmware as up-to-date, which is bizarre.
17. Variance between highest and lowest results
on both arms
Measurement Highest Lowest Variance (Highest-
lowest)
Percent Variance
between lowest and
highest
Steps 7,405 (Mi Band 1S – RA
1W)
3,555 (Basis Peak – LA
2W) 3,850 108.3%
Distance (miles) 3.37 (Mi Band 1S – RA
1W)
1.7 (Misfit Flash White –
RA 6W)
2.36 138.9%
Total Calories
(includes Active
Calories)
3,711 (Basis Peak – LA
2W)
2,387 (Microsoft Band 2
– LA 3W)
1,324 55.5%
Active Calories
(those from
activity tracked)
477 (Mi Band 1S – RA
1W)
354 (Apple Watch – LA
1W)
123 34.7%
18. Variance between highest and lowest results
on left arm
Measurement Highest Lowest Variance (Highest-
lowest)
Percent Variance
between lowest and
highest
Steps 4,873 (Huawei Watch –
LA 4W)
3,555 (Basis Peak – LA
2W)
1,318 37.1%
Distance (miles) 2.49 (Apple Watch – LA
1W)
2.19 (Microsoft Band 2 –
LA 3W)
0.3 13.7%
Calories 3,711 (Basis Peak – LA
2W)
2,387 (Microsoft Band 2
– LA 3W)
1,324 55.5%
19. Variance between highest and lowest results
on right arm
Measurement Highest Lowest Variance (Highest-
lowest)
Percent Variance
between lowest and
highest
Steps 7,405 (Mi Band 1S – RA
1W)
4,360 (Misfit Flash
White –RA 6W)
3,045 69.8%
Distance (miles) 3.37 (Mi Band 1S – RA
1W)
1.70 (Misfit Flash White
– RA 6W)
1.67 98.2%
Total Calories
(includes Active
Calories)
2,820 (Misfit Flash Black
– RA 5W)
2,583 (Moov Now Green
– RA 8W)
237 9.2%
20. Variance between Mi Band 1S on right arm
Measurement 1st away from wrist
(paired to iPhone 6+)
2nd away from wrist
(paired to S6 Edge+)
Variance (2nd away-
1st away)
Percent Variance
Steps 7,405 6,792 -613 -8.3%
Distance
(miles)
3.37 3.10 -0.27 -8.0%
Active
Calories
477 443 -34 -7.1%
21. Variance between Fitbit Flex on right arm
Measurement Green model (3rd away
from wrist)
Red model (4th away
from wrist)
Variance (4th away-
3rd away)
Percent Variance
Steps 4,875 4,994 119 2.4%
Distance
(miles)
2.36 2.42 0.06 -2.5%
Total Calories
Burned
2,606 2,605 -1 -0.04%
22. Variance between Misfit Flash on right arm
Measurement Black model (5th away
from wrist)
White model (6th away
from wrist)
Variance (6th away-
5th away)
Percent Variance
Steps 4,492 4,360 -132 -2.9%
Distance
(miles)
1.80 1.70 -0.1 -5.6%
Total Calories
Burned
2,820 2,809 -11 -0.4%
23. Variance between Moov Now on right arm
Measurement Red model (7th away
from wrist)
Green model (8th away
from wrist)
Variance (8th away-
7th away)
Percent Variance
Total Calories
Burned
2,686 2,583 -103 -3.8%
Active
Minutes
35 29 -6 -17.1%
24. Insights - Distance from wrist
• Many have suggested that the results may be affected because most
of the devices I’m testing are worn away from the expected position
on the wrist (where you would normally wear it)
• Whilst that may be true, my test is also to look at how results vary
because someone wore the device in a different way compared to
how the manufacturer recommends it be worn
• For example, a user may have jewelry, bracelet or some other kind of
wrist band already that means they put the wearable further away
from the wrist
25. Insights – Which arm?
I’m wearing the Moov Now on my right arm (dominant)
which is not what is recommended by the manufacturer
who suggest wearing it on your non dominant arm
26. All feedback welcome
• If you have any feedback, want to share your own findings, or have
suggestions on how I could improve my testing, please do get in touch
• The best way is on Twitter @maneeshjuneja
• If would rather send me a message privately, you can email me via my
website