Weitere ähnliche Inhalte Ähnlich wie Federated Learning: ML with Privacy on the Edge 11.15.18 (20) Mehr von Cloudera, Inc. (20) Kürzlich hochgeladen (20) Federated Learning: ML with Privacy on the Edge 11.15.181. © Cloudera, Inc. All rights reserved.
FEDERATED LEARNING
Mike Lee Williams (Cloudera)
Virginia Smith (CMU), Eric Tramel (Owkin), and Andrew Trask (OpenMined)
4. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
THE FEDERATED LEARNING SETTING
4
9. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
FEDERATED AVERAGING
Communication-Efficient Learning of Deep Networks from Decentralized Data by McMahan et al. 2016
9
18. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
TURBOFAN TYCOON
turbofan.fastforwardlabs.com
18
19. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
CHALLENGES
19
20. © Cloudera, Inc. All rights reserved.
Power consumption Dropped connections Stragglers
22. © Cloudera, Inc. All rights reserved. 22
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning by Hitaj et al. (2017)
23. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
USE CASES
• Predictive maintenance/industrial IOT
• Smartphones
• Healthcare (wearables, drug discovery, prognostics, etc.)
• Browsers
• Retail video analytics
• Enterprise/corporate IT (chat, issue trackers, email, etc.)
23
24. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
Q&A
24
25. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
ANDREW TRASK
OPENMINED
25
What is the OpenMined project?
What are secure aggregation and
differential privacy?
Could you tell us about PySyft?
And what is the open source
landscape like for federated
learning? What other tools are out
there to build upon?
26. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
ERIC TRAMEL
OWKIN
26
What are the use cases for
federated learning in healthcare?
What healthcare challenges is
Owkin working on?
Can you tell us a little bit about
how what you do differs
algorithmically from the simple
version described earlier? And
what problems are you still
working on?
27. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
VIRGINIA SMITH
CMU
27
What does it mean to personalize
federated learning? What are the
use cases for this, and how does it
work at a high level?
Does federated learning work, i.e.
do we end up with the same
trained model as we’d have got it
we moved the training data to our
datacenter?
What open problems are you
interested in?
28. © Cloudera, Inc. All rights reserved.© Cloudera, Inc. All rights reserved.
Cloudera Fast Forward Labs
• An introduction to Federated Learning (Cloudera VISION blog, business audience)
• Federated learning: distributed machine learning with data locality and privacy (FFL blog, more technical)
• Turbofan Tycoon (working prototype, see FFL blog post for some details)
Other blog posts
• Collaborative Machine Learning without Centralized Training Data (Google research blog)
• Federated Learning for Firefox (Firefox on florian.github.io)
• Federated Learning for wake word detection (snips.ai on medium.com)
Papers
• Communication-Efficient Learning of Deep Networks from Decentralized Data by McMahan et al. (Google, 2016)
• Practical Secure Aggregation for Privacy-Preserving Machine Learning by Bonawitz et al. (Google, 2017)
• Federated Multi-Task Learning by Smith et al. (2017)
• A generic framework for privacy preserving deep learning by Ryffel et al. (2018, and see also
github.com/OpenMined/PySyft)
• Federated Learning for Mobile Keyboard Prediction by Hard et al. (Google, 2018)
28
Hinweis der Redaktion Fast Forward Labs builds product prototypes and writes reports about advances in machine intelligence. We also advise our clients on retainer. You might want to become a subscriber! I’ll tell you how later.