SlideShare ist ein Scribd-Unternehmen logo
1 von 19
EdgeAI
The future of edge computing
Mentor
Mentor
Serena
DAYAL
95 total interviews
Day One:
Offering a custom silicon chip with
new embedded memories and a
custom Machine Learning
accelerator targeting low-power,
high-throughput, and low-latency
applications.
Today:
Enable AI vision applications
on next generation battery
powered surveillance
cameras.
Massimo
GIORDANO
Kartik
PRABHU
Jo
ZHU
Weier
WAN
Alon
DROR
Picker
PhD, EE
Hacker
PhD, EE
Hustler
MBA, M.Ed
Designer
PhD, EE
Hustler
MBA
Dave
NEWMAN
EDGE AI - THE FIRST ALL-IN-ONE AI CHIP
● In the lab, we:
○ 2 years of research and development
○ Collaboration with a foundry that offers the new memory
○ Built the first all-in-one AI chip prototype
Our already
fabricated AI chip
Possible use cases
We envisioned
● Objective: Enabling new AI applications at the edge, with a
faster and lower power DNN accelerator enabled by new
memory technology (Resistive RAM).
Unclear purpose statement
?What does it mean?
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
No need for AI accelerator (Not compute
intensive)
Wrong power target (0.1 mW instead of
100mW)
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
Computation power much smaller than
propulsion power
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
High-end products can afford expensive
hardware (GPUs)
Needs high compute power (4k images at
60fps) - hard to compete with NVIDIA
GPUs
Battery life is not critical
By WEEK 2 we got confused
Other embedded non-volatile memories offer similar performance
Competitors already use eFLASH and MRAM
eFLASH won’t
scale, but TODAY
has the same
performance of
RRAM.
MRAM offers
the same
benefits of
RRAM
We FORGOT why
RRAM was great...
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
“Lost in Space”: How we reached market fit!
● Radiation resilient & affordable alternative to FPGAs for AI applications in space
almost
Huge interest from NASA engineers:
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Market:
● Big satellites (NASA & ESA)
● Nano satellites
“A huge
opportunity!
We can help you
make this happen.
Let’s write a grant
together”
“Lost in Space”: How we reached market fit!
almost
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
● Big satellites (NASA & ESA)
○ RRAM is resistant to radiation, but is still not space graded
● Nano satellites
○ Small-market, 1000 satellite/year less than 10k whole mission
“I just launched into space an Intel’s Myriad
vision processor” - AI expert, ESA
Commercial products already sent in space
Users Customers
Focusing on the value proposition
AHA moment:
“Who cares about RRAM?!
What matter is what we do with it!”
Heidi Roizen
Threshold Ventures
Focus on
the value
proposition!
What is unique to RRAM,
that is otherwise NOT possible?
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Customers Need AI!
“Something that consumes 10mWh/day
would be amazing”
- Ring
“Currently I need a GPU card for
every camera and most of the time
nothing is happening”
“AI would solve a lot of problems,
but it consumes too much power”
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Searching for Optimal Product/Market Fit
● Low-power solutions can not run large complex DNNs
● High-performance compute consumes a lot of power
Low-power…
but can’t do much!
Prius
High performance…
but high power!
vs.
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Aha! RRAM Enables No Idle Power. Search for these customers!
● Great specs for AI
● No power to retain memory
● Fast wake-up
Edge AI
High-performance
when needed
10ms 1 second
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
It goes FAST!
But no power when
stopped.
We Find Product/Market Fit!
● Edge AI supports 50MB DNN models, capable of waking-up and
performing 1 inference in just 1 mJ
Solar panel
provides
only
5 mW*h/day
We enable AI vision
on solar-powered
security camera
Not possible today!
Higher security,
Fewer false alarms
No need to change batteries
Happier
customers!
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
MVP: smart security cameras w/o changing batteries
We are really efficient in doing this
1 frame / second
No person
Person
10 MB model
1mJ
30 frame / second
higher resolution
0.3%
Face recognition
40 MB model
5 mJ
Owner Unknown
Less Efficient but infrequent
10%
Unsafe
1000 MB model
200 mJ
safe
Above memory
available on-chip
Limited power
budget
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Aha! Software is Key! Use Existing AI IP
● Custom ML accelerator needs complex software stack (hard to accomplish)
● Instead, use an existing AI IP that offers the full software stack (Expedera)
“We’ve spent a lot of time
writing software for our current
chip, and can’t afford to redo
everything for a new chip” -
Embedded systems startup
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Quick wake-up powerful
AI acceleration that
consume no power
when idle
IP providers
Only chips: OEM
TSMC
already
collaborating
IC Design Tools
Software
Run infrequent
complex AI tasks
preserving battery life.
Engineering,
Development
Customer
Customization
Work with
customers to enable
their applications
Supply Chain
IP protection
Provide custom features
based on customer need
Physical: System
Integrator
Radiation resistant,
space-graded AI ASIC
accelerators
NASA, ESA
Sell custom-designed silicon
chips
Development: MPW runs, EDA tools, IP licenses,
Packagings, mask costs
Develop custom silicon
Contracts for AI expert
consulting for co-designing
specific applications
Develop custom
DNN accelerators
AI IP with full
software support
Enable new AI applications
on their device Product Managers
Offering new AI features
EE/CS Engineers
Development and design
Smart AI
battery
powered
Cameras
Lower-power
compute
Ease of
integration
and use
What’s Next:
● More product validation:
○ Further potential customers interviews
● Run pilots:
○ With various security cameras and doorbells companies
● Fabricate 2nd silicon chip:
○ Scheduled for October 2021
● Raise first seed investment in Q3-Q4 ‘21
○ Development of end-to-end prototype
Contact us: Massimo Giordano - mgiordan@stanford.edu
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Peter Thiel's Venture Capital Pitch Deck Template
Peter Thiel's Venture Capital Pitch Deck TemplatePeter Thiel's Venture Capital Pitch Deck Template
Peter Thiel's Venture Capital Pitch Deck Template
 
AWS Summit Singapore - Building DXC's Digital Insurance as a Service (DIaaS) ...
AWS Summit Singapore - Building DXC's Digital Insurance as a Service (DIaaS) ...AWS Summit Singapore - Building DXC's Digital Insurance as a Service (DIaaS) ...
AWS Summit Singapore - Building DXC's Digital Insurance as a Service (DIaaS) ...
 
Plantee Seed Pitch Deck for TC Pitch Deck Teardown
Plantee Seed Pitch Deck for TC Pitch Deck TeardownPlantee Seed Pitch Deck for TC Pitch Deck Teardown
Plantee Seed Pitch Deck for TC Pitch Deck Teardown
 
Building a QMS for Your SaMD
Building a QMS for Your SaMDBuilding a QMS for Your SaMD
Building a QMS for Your SaMD
 
Insights on the MedTech Regulatory and Clinical Environment in Israel
Insights on the MedTech Regulatory and Clinical Environment in IsraelInsights on the MedTech Regulatory and Clinical Environment in Israel
Insights on the MedTech Regulatory and Clinical Environment in Israel
 
Everside Health's $164M pitch deck
Everside Health's $164M pitch deckEverside Health's $164M pitch deck
Everside Health's $164M pitch deck
 
Dell Computers (A) : Field Service for Corporate Clients
Dell Computers (A) : Field Service for Corporate Clients Dell Computers (A) : Field Service for Corporate Clients
Dell Computers (A) : Field Service for Corporate Clients
 
Series A pitch deck
Series A pitch deckSeries A pitch deck
Series A pitch deck
 
Retail Pricing Optimization
Retail Pricing Optimization Retail Pricing Optimization
Retail Pricing Optimization
 
Medical Device Standards State-of-the-Art by Sam Lazzara
Medical Device Standards State-of-the-Art by Sam LazzaraMedical Device Standards State-of-the-Art by Sam Lazzara
Medical Device Standards State-of-the-Art by Sam Lazzara
 
E commerce Pitch deck
E commerce Pitch deckE commerce Pitch deck
E commerce Pitch deck
 
Market access the challenges for medical devices
Market access   the challenges for medical devices Market access   the challenges for medical devices
Market access the challenges for medical devices
 
Semiconductor Industry Tutorial
Semiconductor Industry TutorialSemiconductor Industry Tutorial
Semiconductor Industry Tutorial
 
Clinical evaluation: Supporting medical device product life-cycle. Applicable...
Clinical evaluation: Supporting medical device product life-cycle. Applicable...Clinical evaluation: Supporting medical device product life-cycle. Applicable...
Clinical evaluation: Supporting medical device product life-cycle. Applicable...
 
MicroLED Displays - Market, Industry and Technology Trends 2021
MicroLED Displays - Market, Industry and Technology Trends 2021MicroLED Displays - Market, Industry and Technology Trends 2021
MicroLED Displays - Market, Industry and Technology Trends 2021
 
The behind-the-scenes story of our €1.6m seed round with Peter Thiel
The behind-the-scenes story of our €1.6m seed round with Peter ThielThe behind-the-scenes story of our €1.6m seed round with Peter Thiel
The behind-the-scenes story of our €1.6m seed round with Peter Thiel
 
Oscar pitch deck
Oscar pitch deckOscar pitch deck
Oscar pitch deck
 
Calvinkare
CalvinkareCalvinkare
Calvinkare
 
Marketing plan: medoc
Marketing plan: medocMarketing plan: medoc
Marketing plan: medoc
 
Uber pitch deck
Uber pitch deckUber pitch deck
Uber pitch deck
 

Ähnlich wie Edgeai Engr245 2021 Lessons Learned

A Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software ArchitectureA Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software Architecture
David Max
 
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio..."Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
Edge AI and Vision Alliance
 
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr..."Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
Edge AI and Vision Alliance
 

Ähnlich wie Edgeai Engr245 2021 Lessons Learned (20)

Lean Startup, Hardware Edition
Lean Startup, Hardware EditionLean Startup, Hardware Edition
Lean Startup, Hardware Edition
 
Microcontrollers for Artificial Intelligence and Machine Learning
Microcontrollers for Artificial Intelligence and Machine LearningMicrocontrollers for Artificial Intelligence and Machine Learning
Microcontrollers for Artificial Intelligence and Machine Learning
 
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
 
David Max: A Tale of Two Systems | Nowhere Developers 2018
David Max: A Tale of Two Systems | Nowhere Developers 2018David Max: A Tale of Two Systems | Nowhere Developers 2018
David Max: A Tale of Two Systems | Nowhere Developers 2018
 
Live Data: For When Data is Greater than Memory
Live Data: For When Data is Greater than MemoryLive Data: For When Data is Greater than Memory
Live Data: For When Data is Greater than Memory
 
Weebit nano presentation at Leti Memory Workshop
Weebit nano presentation at Leti Memory WorkshopWeebit nano presentation at Leti Memory Workshop
Weebit nano presentation at Leti Memory Workshop
 
A Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software ArchitectureA Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software Architecture
 
Artificial Intelligence in Small Embedded System
Artificial Intelligence in Small Embedded SystemArtificial Intelligence in Small Embedded System
Artificial Intelligence in Small Embedded System
 
Deep Learning on Everyday Devices
Deep Learning on Everyday DevicesDeep Learning on Everyday Devices
Deep Learning on Everyday Devices
 
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio..."Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
 
Neuromophic device for Automotive
Neuromophic device for AutomotiveNeuromophic device for Automotive
Neuromophic device for Automotive
 
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
 
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr..."Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
 
E3MV - Embedded Vision - Sundance
E3MV - Embedded Vision - SundanceE3MV - Embedded Vision - Sundance
E3MV - Embedded Vision - Sundance
 
Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters
 
2016-JAN-28 -- High Performance Production Databases on Ceph
2016-JAN-28 -- High Performance Production Databases on Ceph2016-JAN-28 -- High Performance Production Databases on Ceph
2016-JAN-28 -- High Performance Production Databases on Ceph
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...
 
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @GoogleChildhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
 
How flash responds to different AIoT needs -- C&T RF Antennas Inc
How flash responds to different AIoT needs -- C&T RF Antennas IncHow flash responds to different AIoT needs -- C&T RF Antennas Inc
How flash responds to different AIoT needs -- C&T RF Antennas Inc
 
Think Silicon at Open Coffee Athens XCIV
Think Silicon at Open Coffee Athens XCIVThink Silicon at Open Coffee Athens XCIV
Think Silicon at Open Coffee Athens XCIV
 

Mehr von Stanford University

Mehr von Stanford University (20)

Team Networks - 2022 Technology, Innovation & Great Power Competition
Team Networks  - 2022 Technology, Innovation & Great Power CompetitionTeam Networks  - 2022 Technology, Innovation & Great Power Competition
Team Networks - 2022 Technology, Innovation & Great Power Competition
 
Team LiOn Batteries - 2022 Technology, Innovation & Great Power Competition
Team LiOn Batteries  - 2022 Technology, Innovation & Great Power CompetitionTeam LiOn Batteries  - 2022 Technology, Innovation & Great Power Competition
Team LiOn Batteries - 2022 Technology, Innovation & Great Power Competition
 
Team Quantum - 2022 Technology, Innovation & Great Power Competition
Team Quantum  - 2022 Technology, Innovation & Great Power CompetitionTeam Quantum  - 2022 Technology, Innovation & Great Power Competition
Team Quantum - 2022 Technology, Innovation & Great Power Competition
 
Team Disinformation - 2022 Technology, Innovation & Great Power Competition
Team Disinformation  - 2022 Technology, Innovation & Great Power CompetitionTeam Disinformation  - 2022 Technology, Innovation & Great Power Competition
Team Disinformation - 2022 Technology, Innovation & Great Power Competition
 
Team Wargames - 2022 Technology, Innovation & Great Power Competition
Team Wargames  - 2022 Technology, Innovation & Great Power CompetitionTeam Wargames  - 2022 Technology, Innovation & Great Power Competition
Team Wargames - 2022 Technology, Innovation & Great Power Competition
 
Team Acquistion - 2022 Technology, Innovation & Great Power Competition
Team Acquistion  - 2022 Technology, Innovation & Great Power Competition Team Acquistion  - 2022 Technology, Innovation & Great Power Competition
Team Acquistion - 2022 Technology, Innovation & Great Power Competition
 
Team Climate Change - 2022 Technology, Innovation & Great Power Competition
Team Climate Change - 2022 Technology, Innovation & Great Power Competition Team Climate Change - 2022 Technology, Innovation & Great Power Competition
Team Climate Change - 2022 Technology, Innovation & Great Power Competition
 
Altuna Engr245 2022 Lessons Learned
Altuna Engr245 2022 Lessons LearnedAltuna Engr245 2022 Lessons Learned
Altuna Engr245 2022 Lessons Learned
 
Invisa Engr245 2022 Lessons Learned
Invisa Engr245 2022 Lessons LearnedInvisa Engr245 2022 Lessons Learned
Invisa Engr245 2022 Lessons Learned
 
ānanda Engr245 2022 Lessons Learned
ānanda Engr245 2022 Lessons Learnedānanda Engr245 2022 Lessons Learned
ānanda Engr245 2022 Lessons Learned
 
Gordian Knot Center Roundtable w/Depty SecDef
Gordian Knot Center Roundtable w/Depty SecDef Gordian Knot Center Roundtable w/Depty SecDef
Gordian Knot Center Roundtable w/Depty SecDef
 
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
 
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
 
Team Catena - 2021 Technology, Innovation & Great Power Competition
Team Catena - 2021 Technology, Innovation & Great Power CompetitionTeam Catena - 2021 Technology, Innovation & Great Power Competition
Team Catena - 2021 Technology, Innovation & Great Power Competition
 
Team Apollo - 2021 Technology, Innovation & Great Power Competition
Team Apollo - 2021 Technology, Innovation & Great Power CompetitionTeam Apollo - 2021 Technology, Innovation & Great Power Competition
Team Apollo - 2021 Technology, Innovation & Great Power Competition
 
Team Drone - 2021 Technology, Innovation & Great Power Competition
Team Drone - 2021 Technology, Innovation & Great Power CompetitionTeam Drone - 2021 Technology, Innovation & Great Power Competition
Team Drone - 2021 Technology, Innovation & Great Power Competition
 
Team Short Circuit - 2021 Technology, Innovation & Great Power Competition
Team Short Circuit - 2021 Technology, Innovation & Great Power CompetitionTeam Short Circuit - 2021 Technology, Innovation & Great Power Competition
Team Short Circuit - 2021 Technology, Innovation & Great Power Competition
 
Team Aurora - 2021 Technology, Innovation & Great Power Competition
Team Aurora - 2021 Technology, Innovation & Great Power CompetitionTeam Aurora - 2021 Technology, Innovation & Great Power Competition
Team Aurora - 2021 Technology, Innovation & Great Power Competition
 
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
 
Lecture 8 - Technology, Innovation and Great Power Competition - Cyber
Lecture 8 - Technology, Innovation and Great Power Competition - CyberLecture 8 - Technology, Innovation and Great Power Competition - Cyber
Lecture 8 - Technology, Innovation and Great Power Competition - Cyber
 

Kürzlich hochgeladen

Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Kürzlich hochgeladen (20)

Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 

Edgeai Engr245 2021 Lessons Learned

  • 1. EdgeAI The future of edge computing Mentor Mentor Serena DAYAL 95 total interviews Day One: Offering a custom silicon chip with new embedded memories and a custom Machine Learning accelerator targeting low-power, high-throughput, and low-latency applications. Today: Enable AI vision applications on next generation battery powered surveillance cameras. Massimo GIORDANO Kartik PRABHU Jo ZHU Weier WAN Alon DROR Picker PhD, EE Hacker PhD, EE Hustler MBA, M.Ed Designer PhD, EE Hustler MBA Dave NEWMAN
  • 2. EDGE AI - THE FIRST ALL-IN-ONE AI CHIP ● In the lab, we: ○ 2 years of research and development ○ Collaboration with a foundry that offers the new memory ○ Built the first all-in-one AI chip prototype Our already fabricated AI chip Possible use cases We envisioned ● Objective: Enabling new AI applications at the edge, with a faster and lower power DNN accelerator enabled by new memory technology (Resistive RAM). Unclear purpose statement ?What does it mean? Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 3. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras
  • 4. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras No need for AI accelerator (Not compute intensive) Wrong power target (0.1 mW instead of 100mW)
  • 5. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras Computation power much smaller than propulsion power
  • 6. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras High-end products can afford expensive hardware (GPUs) Needs high compute power (4k images at 60fps) - hard to compete with NVIDIA GPUs Battery life is not critical
  • 7. By WEEK 2 we got confused Other embedded non-volatile memories offer similar performance Competitors already use eFLASH and MRAM eFLASH won’t scale, but TODAY has the same performance of RRAM. MRAM offers the same benefits of RRAM We FORGOT why RRAM was great... Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 8. Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 9. “Lost in Space”: How we reached market fit! ● Radiation resilient & affordable alternative to FPGAs for AI applications in space almost Huge interest from NASA engineers: Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 Market: ● Big satellites (NASA & ESA) ● Nano satellites “A huge opportunity! We can help you make this happen. Let’s write a grant together”
  • 10. “Lost in Space”: How we reached market fit! almost Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 ● Big satellites (NASA & ESA) ○ RRAM is resistant to radiation, but is still not space graded ● Nano satellites ○ Small-market, 1000 satellite/year less than 10k whole mission “I just launched into space an Intel’s Myriad vision processor” - AI expert, ESA Commercial products already sent in space Users Customers
  • 11. Focusing on the value proposition AHA moment: “Who cares about RRAM?! What matter is what we do with it!” Heidi Roizen Threshold Ventures Focus on the value proposition! What is unique to RRAM, that is otherwise NOT possible? Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 12. Customers Need AI! “Something that consumes 10mWh/day would be amazing” - Ring “Currently I need a GPU card for every camera and most of the time nothing is happening” “AI would solve a lot of problems, but it consumes too much power” Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 13. Searching for Optimal Product/Market Fit ● Low-power solutions can not run large complex DNNs ● High-performance compute consumes a lot of power Low-power… but can’t do much! Prius High performance… but high power! vs. Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 14. Aha! RRAM Enables No Idle Power. Search for these customers! ● Great specs for AI ● No power to retain memory ● Fast wake-up Edge AI High-performance when needed 10ms 1 second Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 It goes FAST! But no power when stopped.
  • 15. We Find Product/Market Fit! ● Edge AI supports 50MB DNN models, capable of waking-up and performing 1 inference in just 1 mJ Solar panel provides only 5 mW*h/day We enable AI vision on solar-powered security camera Not possible today! Higher security, Fewer false alarms No need to change batteries Happier customers! Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 16. MVP: smart security cameras w/o changing batteries We are really efficient in doing this 1 frame / second No person Person 10 MB model 1mJ 30 frame / second higher resolution 0.3% Face recognition 40 MB model 5 mJ Owner Unknown Less Efficient but infrequent 10% Unsafe 1000 MB model 200 mJ safe Above memory available on-chip Limited power budget Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 17. Aha! Software is Key! Use Existing AI IP ● Custom ML accelerator needs complex software stack (hard to accomplish) ● Instead, use an existing AI IP that offers the full software stack (Expedera) “We’ve spent a lot of time writing software for our current chip, and can’t afford to redo everything for a new chip” - Embedded systems startup Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 18. Quick wake-up powerful AI acceleration that consume no power when idle IP providers Only chips: OEM TSMC already collaborating IC Design Tools Software Run infrequent complex AI tasks preserving battery life. Engineering, Development Customer Customization Work with customers to enable their applications Supply Chain IP protection Provide custom features based on customer need Physical: System Integrator Radiation resistant, space-graded AI ASIC accelerators NASA, ESA Sell custom-designed silicon chips Development: MPW runs, EDA tools, IP licenses, Packagings, mask costs Develop custom silicon Contracts for AI expert consulting for co-designing specific applications Develop custom DNN accelerators AI IP with full software support Enable new AI applications on their device Product Managers Offering new AI features EE/CS Engineers Development and design Smart AI battery powered Cameras Lower-power compute Ease of integration and use
  • 19. What’s Next: ● More product validation: ○ Further potential customers interviews ● Run pilots: ○ With various security cameras and doorbells companies ● Fabricate 2nd silicon chip: ○ Scheduled for October 2021 ● Raise first seed investment in Q3-Q4 ‘21 ○ Development of end-to-end prototype Contact us: Massimo Giordano - mgiordan@stanford.edu Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1