Weitere ähnliche Inhalte Ähnlich wie Nimbix AI Cloud and PowerAI (20) Kürzlich hochgeladen (20) 2. About Nimbix
• Founded in 2010
• “day 1” GPU accelerated on-demand compute offering
• Headquartered in Dallas, TX – Customers in 68 countries
• Leading global provider of turnkey, compute-intensive and
accelerated cloud services (HPC and AI)
• Partnered with IBM in 2016 as the first global public cloud
provider to deliver turn-key service on the Minsky
platform
• Extending the IBM Cloud to deliver POWER9 (Q2 ‘2018)
• IBM North America Leadership Award 2017
Top Strategic Service Provider – Nimbix, Inc.
© 2018 Nimbix, Inc.
4. Nimbix’s raison d’être
© 2018 Nimbix, Inc.
End of Moore’s Law
Insane amount of data to
process (and growing)
Containers
5. Nimbix’s raison d’être
© 2018 Nimbix, Inc.
End of Moore’s Law
Insane amount of data to
process (and growing)
Containers
6. Nimbix’s raison d’être
© 2018 Nimbix, Inc.
End of Moore’s Law
Insane amount of data to
process (and growing)
Containers
7. Wait.. What’s “Minsky”?
• OpenPOWER IBM S822LC for HPC and AI
• 2 POWER 8 CPUs, 512GB+ RAM, 4x P100 GPUs, NVLink,
InfiniBand
• Succeeded by IBM AC922 for HPC and AI
• 2 POWER 9 CPUs, 512GB+ RAM, 4x (or 6x) V100 GPUs,
NVLink, InfiniBand
• ORNL “Summit” HPC node, also in Nimbix Cloud!
• Which means? Linear scale with insane bandwidth
and incredibly low latency!
• Just “slide right” in the Nimbix Cloud to scale out
© 2018 Nimbix, Inc.
8. Wait.. What’s HPC got to do with AI?
A LOT!
HPC and AI are converging, thanks to the benefits of tightly coupled scale-out
training and low latency fabrics
More on this later…
© 2018 Nimbix, Inc.
9. AI Explained (and demystified)
What? compute that recognizes an input as part of a class or
category and then responds with an action
© 2018 Nimbix, Inc.
10. AI Explained (and demystified)
What? compute that recognizes an input as part of a class or
category and then responds with an action
How? Learning(training) and inference(recommendation)
© 2018 Nimbix, Inc.
11. AI Explained (and demystified)
What? compute that recognizes an input as part of a class or
category and then responds with an action
How? Learning(training) and inference(recommendation)
Why now? Data size, scope, velocity, variability
© 2018 Nimbix, Inc.
12. AI Explained (and demystified)
What? compute that recognizes an input as part of a class or
category and then responds with an action
How? Learning(training) and inference(recommendation)
Why now? Data size, scope, velocity, variability
What’s it for? Everything from recommending products to
identifying handwriting and more
© 2018 Nimbix, Inc.
13. AI Explained (and demystified)
What? compute that recognizes an input as part of a class or
category and then responds with an action
How? Learning(training) and inference(recommendation)
Why now? Data size, scope, velocity, variability
What’s it for? Everything from recommending products to
identifying handwriting and more
Cloud is a powerful enablement platform for AI!
© 2018 Nimbix, Inc.
14. Strong AI vs Weak AI
Strong AI:
• Consciousness
• Sentience
• Artificial Life
• Generally topics of
dystopian science
fiction
• For the time being,
best left to Hollywood
and futurists.
© 2018 Nimbix, Inc.
15. Strong AI vs Weak AI
Weak AI – Narrow AI
• Narrowly focused in terms of topic and ability
• No intelligence, self-awareness, or creativity
• Able to solve a pre-defined set of problems in a
prescribed manner
© 2018 Nimbix, Inc.
16. 2018 is About [Narrow] AI
© 2018 Nimbix, Inc.
From Gartner’s Top 10 Strategic Technology Trends for 2018:
AI Foundations:
• “Narrow AI” – highly scoped machine-learning solutions that target
specific tasks
Intelligent Apps and Analytics:
• Over the next few years every application and service will
incorporate AI at some level
• Key to augmenting and increasing productivity, not replacing people
Source: https://www.gartner.com/smarterwithgartner/gartner-top-10-strategic-technology-trends-for-2018/
18. Narrow AI Goodness
© 2018 Nimbix, Inc.
Won’t hunt us down from the future
Won’t kill the crew to “save the mission”
19. Narrow AI Goodness
© 2018 Nimbix, Inc.
Won’t hunt us down from the future
Won’t kill the crew to save the mission
Won’t enslave us in a simulation to harvest us for energy
20. Narrow AI Goodness
Won’t hunt us down from the future
Won’t kill the crew to save the mission
Won’t enslave us in a simulation to harvest us for energy
Won’t replace human beings!
© 2018 Nimbix, Inc.
21. Narrow AI Goodness
Will unleash human innovation by:
Augmenting human abilities
• Automate the mundane, let us focus on higher order stuff
Making our daily lives easier
• Process data for us, recommend what we should do about it
Making our lives safer
• Identify dangers and warn us
• Take careful action quickly
• Remember: machines fail when they break, but humans fail all the time
© 2018 Nimbix, Inc.
More on this here: http://www.leoreiter.com/2018/02/limits-automation-comes-next/
22. AI Infrastructure on Nimbix Cloud
• IBM POWER with PowerAI
• Vertically integrated for high bandwidth, low latency, and scale-out
• IBM PowerAI
• NVIDIA DGX
• High density x86-based GPUs with scale-out capabilities
• NVIDIA optimized software catalog
• x86 CPUs (including Skylake)
• Scale-out capabilities and economics for testing and inference
• Xilinx FPGAs
• Low latency, reduced precision inference capabilities (coming soon)
• Xilinx SDAccel tools for OpenCL development
© 2018 Nimbix, Inc.
23. You Can Build the Future, End-to-End
Trained in cloud GPUs
Tested on cloud FPGA,
Deployed on edge FPGA
© 2018 Nimbix, Inc.
24. AI Software Catalog on Nimbix Cloud
© 2018 Nimbix, Inc.
• Dozens of turnkey,
point-and click
workflows
• Extensible with
PushToCompute™
25. PowerAI on Nimbix
Vertically integrated systems for AI unleashed on the first and only vertically
integrated cloud for AI and HPC
© 2018 Nimbix, Inc.
+ +
The “no compromise” combination for AI research, extensible development, and production at scale
26. PowerAI on Nimbix: No Compromise
• Fastest AI Architecture
• IBM “Minsky” and POWER9
• P100 and V100 GPUs
• NVLink (keeps GPU memory fed)
• DDL
• Large memory
• JARVICE runs work on bare-metal – native
speed, no overhead
© 2018 Nimbix, Inc.
27. PowerAI on Nimbix: No Compromise
• Fastest AI Architecture
• Supercomputing performance
• Nimbix Cloud HPC architecture with
Reconfigurable Cloud Computing
• JARVICE supercomputing cloud operating
system
• Containers on bare-metal
• InfiniBand fabric
• GPUs (with NVLink) and FPGAs
© 2018 Nimbix, Inc.
28. PowerAI on Nimbix: No Compromise
• Fastest AI Architecture
• Supercomputing performance
• Containerized and extensible
• Docker base images
• Open source tools in GitHub
• Developer community
• Rich documentation and examples
• Nimbix and partner sources
• CI/CD for POWER
© 2018 Nimbix, Inc.
29. One AI Cloud, All of Your Needs
© 2018 Nimbix, Inc.
• Research
• Analysis
30. One AI Cloud, All of Your Needs
© 2018 Nimbix, Inc.
• Research
• Analysis
• Algorithm Development
• Training with DDL
31. One AI Cloud, All of Your Needs
© 2018 Nimbix, Inc.
• Research
• Analysis
• Algorithm Development
• Training with DDL
• Custom Workflows
• App Development (ISV)
32. Case Study: OSU Cowen Lab
• Project collects water column image samples at sea
• Preprocessing on Minsky aboard ship (100+TB data to 3+TB)
• Cloud to Edge Architecture
• PowerAI in Nimbix Cloud used to identify gnus species of
plankton:
• Indicates effects of ocean temperature, salinity climate change
• Results:
• 10x faster processing than on other clouds
• Modern containerized deployment easier to manage than IaaS
© 2018 Nimbix, Inc.
33. • Driver awareness/fatigue monitoring via onboard camera
• Facial recognition software in cars
• Dubai taxi
• Dubai police
• Route monitoring for armored cars via onboard cameras
• Dubai armored car delivery, ensure parcels delivered and routes
• Identifies parcels/bags
• Identifies things going in and out of truck
• Compares against manifest
• Human trafficking detection in Libya
Examines eye movement to determine distracted/fatigued driving
Anti-theft, anti-shrinkage, loss prevention
Use Case: Acacus – Transportation in MEA
© 2018 Nimbix, Inc.
34. Others…
• Large consulting company using Nimbix Cloud to develop voice/speech
recognition models for call centers
• Multi-national training group using Nimbix Cloud to teach AI courses and
computing courses
• National Institutes of Health using Nimbix Cloud to develop automated
diagnostics based upon image classification and recognition
© 2018 Nimbix, Inc.
35. Example: NPAs in Indian Market
OpenPOWER Academia
team prototype with
PowerAI on Nimbix Cloud
highlights:
• Data preparation
• DL frameworks
• Neural network design
• Model accuracy and training
© 2018 Nimbix, Inc.
37. Coming Soon…
• Launch PowerAI from the IBM Cloud:
• Use your IBM account to purchase PowerAI
on powerful, point-and-click simple Nimbix
infrastructure
• Access existing training data from IBM Cloud
Object Storage (COS), with no transfer fees
Available Q2 2018 – US South Region, with
future global expansion
© 2018 Nimbix, Inc.
38. Thank you
Freedom to:
• Discover
• Invent
• “Game-change”
• Without fighting platforms and tools
• And without compromise
PowerAI on the Nimbix Cloud!
© 2018 Nimbix, Inc.
https://developer.ibm.com/linuxonpower/deep-learning-powerai/try-powerai/
Hinweis der Redaktion I’m technologist, not a scientist, but I design and enable technology for human beings, including scientists
I’m from Texas – we do actually have technology there No platform out there to address this problem in an efficient way
Moore’s law as it applies to scale up
Data processing and analytics (big data) was en vogue at the time, but this gradually morphed into data science and AI - 3 principles
- Self-service, on-demand Cloud to democratize
Sim, oil+gas, media, biocomputing, ML/DL, analytics Define to avoid THINK question at end! Mention 10% or so of the use cases on Summit will be AI So just in case I make it to the end and someone asks “what’s AI”… Admit this deep learning focused Of course self driving cars never kill drivers nor hit pedestrians, that must just be a sick joke A lot of cultural and socioeconomic anxiety about this Self driving cars killing people aside, we’ll see examples of AI used to identify safety violations in work sites, predict equipment failures, etc. - Choice, in a nutshell (can’t democratize without offering choice)
All these rival system architectures coexist and are user selectable at runtime for just about any workflow, or part of a broader workflow
E.g. you wouldn’t use FPGA’s for training neural networks, but they sure can help with low latency inference on real-time data Edge may be self driving car, mobile device, etc. In 2018 nothing interesting really happens without software, so…
If you can write a Dockerfile, you can customize any workflow or build your own from scratch
You can even deploy your custom workflows in the marketplace and make money off of them if you like (assuming someone finds them interesting enough to pay for) Talk about 50% utilization on GPUs Talk about GPU direct RDMA as well Species identification indicates salinity and temperature and is used to study effects of climate change Very strategic
