Telemetry Onboarding

1. Telemetry Onboarding
Roberto Vitillo - Firefox Data Engineering Team

2. Ask a question
Get the data
Analyse the data
Report

3. TELEMETRY 101

4. (Base Telemetry)
(Extended Telemetry)

6. https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/index.html

7. about:telemetry

8. Real-time
https://pipeline-cep.prod.mozaws.net/
Need help?
trink@mozilla.com

9. S3

10. Ask a question
Get the data
Analyse the data
Report

11. Step 1: Ask a question

12. Step 2: Get the data
Data exists Data exists

13. Step 2: Get the data
Data exists Data exists
dashboard

14. KPIs
https://metrics.services.mozilla.com/

15. https://telemetry.mozilla.org/new-pipeline/dist.html
Performance Need help?
fbertsch@mozilla.com

16. Step 2: Get the data
Data exists Data exists
dashboard s.t.m.o

17. https://sql.telemetry.mozilla.org/
Need help?
bimsland@mozilla.com

18. Datasets
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/choosing_a_dataset.md

19. Client ID A B
“X” FALSE 42
“Y” TRUE null
“X” FALSE 40
12/12/2016
21/12/2016
01/12/2016
main_summary
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/MainSummary.md
Need help?
mreid@mozilla.com

20. longitudinal
Client ID A B
“X”
[FALSE, FALSE,
TRUE]
[42, 40, 41]
“Y” [TRUE] [null]
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/Longitudinal.md
Need help?
rvitillo@mozilla.com

21. cross_sectional
Client ID A B
“X” FALSE 41
“Y” TRUE null
mode mean
Need help?
rharter@mozilla.com

22. client_count
Clients A
{“3”} FALSE
{“1”, “2} TRUE
Need help?
rvitillo@mozilla.com

23. crash_aggregates
#crashes A B
42 GPU X OSX
12 GPU Y WIN
Need help?
mdoglio@mozilla.com
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/CrashAggregateView.md

25. Step 2: Get the data
Data exists Data exists
dashboard s.t.m.o a.t.m.o

27. S3

28. https://atmo-prod.herokuapp.com/
Need help?
jannis@mozilla.com

29. https://wiki.mozilla.org/Telemetry/Custom_analysis_with_spark
Need help?
mdoglio@mozilla.com

30. Step 2: Get the data
Data exists Data exists
dashboard s.t.m.o a.t.m.o add a probe

31. https://docs.google.com/document/d/11wM2RJkHAqYF-4xgL5tHwA621IUQEaf4vecuC-hqnzk/edit#heading=h.tkrw9ahjfrcp
New ping?

32. gfritzsche@mozilla.com
Need help?
https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/collection/scalars.html

33. https://developer.mozilla.org/en-US/docs/Mozilla/Performance/
Adding_a_new_Telemetry_probe
Need help?
aplacitelli@mozilla.com

34. Need help?
chutten@mozilla.com
http://alerts.telemetry.mozilla.org

35. https://wiki.mozilla.org/Firefox/Data_Collection
https://www.mozilla.org/en-US/privacy/
Owner: Benjamin Smedberg
Peers: Chenxia Liu, François Marier, Ally Naagktgeboren, Rebecca Weiss

36. Ask a question
Get the data
Analyse the data
Report

40. Ask a question
Get the data
Analyse the data
Report

41. #datapipeline
#telemetry
https://wiki.mozilla.org/Telemetry
https://wiki.mozilla.org/CloudServices/DataPipeline