SlideShare a Scribd company logo
1 of 31
Download to read offline
0
Developing Autonomous Driving EVs for the
China Market XPENG Motors’ Approach
Junli Gu
VP of Autonomous Driving, XPENG
motors
March 18, 2019
1
Agenda
1. XPENG Motors Introduction and Background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System Architecture Design Powered by Xavier
2
Who is XPENG?
We develop FUN, CONNECTED and INTELLIGENT EVs tailored for
the young and tech-savvy Chinese Millennials
2
• Aimed at young Internet users in China, with autonomous driving and
intelligent connection as the core differences
• 2014: Founded in Guangzhou, China
• Dec 2018: Mass production and official launch of G3 (electrical SUV)
• Q1 2019: Mass production of E28 (electrical sedan)
3
Strong R&D capabilities and investments
Shanghai
Intelligent Connected
Vehicle
Navigation R&D
Silicon Valley &
San Diego
Machine Learning
Autonomous Driving
R&D
Guangzhou
Vehicle and VCU
R&D
V2X Testing
Trial and Production
Lead-in
Beijing
Artificial Intelligence
R&D
R&D footprint
Our R&D headcount accounts for over 70% of our total number of employees.
4
Your Smart Driving Assistant
Connectivity
Xmart OS
X-pilot
Artificial
Intelligence
5
X-center
XPENG Headquarter
5
6
Agenda
1. XPENG Motors Introduction and Background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System Architecture Design Powered by Xavier
7
L3 Products: Highly-Autonomous Highway Features
L4 Products: Fully-Autonomous
Urban & Highway Features
- Driverless Robo Taxi
- Driverless Robo Bus
- Human Driver vehicles
L2+ Products: Semi-Autonomous Highway/Urban Features
- Human Driver vehicles
Self-Driving Two Separate Branches…
Comfort Driving with safety guarantees
Where are we heading…
• Key differentiation through XPENG’s intelligent EV strategy
• Focus on in-house software solutions running on leading
computer hardware platforms
• Focus on enhancing driver assistance features towards L3
capabilities in 2020
• Focus on feature optimization for Chinese market and
Chinese consumers
8
9
Roadmap for XPENG Motors’ Autonomous Driving Solution XPilot
2018-2019 2020 2021-2022 2024-2025
CarModel
Autonomous
Driving
Achievement
&Goal
• Xpilot 2.0:
Full scenario auto
parking + LCC + ACC
• Xpilot 3.0:
Super Memory Parking
+ Highway Autopilot
• Xpilot 4.0:
AVP + Highway/Urban
Autopilot
• Xpilot x.0:
Full Automation in
limited scenarios
(highway, parking, etc.)
• First generation
solution for
commercialization
with partial self
developed IPs
• Fully self developed
end-to-end SW IP
• Next gen HW
platform with
optimized sensor cost
• First level-4 solution
in consumer vehicle
A Class SUV (G3) B Class Sedan (E28) B Class SUV
10
XPENG G3
By AI,
irregular lots
By memory
Roadmap for XPENG Motors’ Autonomous Driving Solution-XPilot
parking functions
XPENG E28
Alleviate people’s parking anxiety in parallel, vertical, perpendicular, irregular lots…
parking functions
By voice
By Vision
By Ultrasonic
11
Use Case Example: Super Memory Parking
12
Use Case Example: Highway Auto-Pilot
13
2km ahead
Xpilot’s Surrounding Reality
Ego
Traffic
Point of interest
Road side object
Lane condition
14
Agenda
1. XPENG Motors introduction and background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System architecture design powered by Xavier
15
Driving
Big Data
AI and
Perception
High-perf
chips
Customized
Sensor
Structure
- -
Chinese Traffic Patterns
Local adaption is a must
- -
• Chinese style lane change and close cutting in
• Very large variety of obstacles
• Dense traffic
• Irregular Pattern
16
Challenge: Perception & Creating a Representative 3D Environmental Model
Compute (MP/s)
Quality raw sensor input with cost
constraints
2
1
Preponderance of training data
(especially corner cases)
3
17
Challenge: Perception & Creating a Representative 3D Environmental Model
Real stream taken from E28 camera sets; ISP developed in house;
18
Challenge: Extending to Day/Night, All Weather, All locations
1) Time (Location of Sun: Day/Night/NotDawn/NotDusk)
2) Select Weather Conditions
3) Availability of GNSS & RTK
4) Place (GeoFenced)
5) Select Speed Range
6) Road/Traffic Conditions
Sensing/Perception challenges (due
to insufficient quality of raw data
and/or compute power)
Mapping challenges
Driving policy
challenges
Ultrasonic Sensors
(6 in Front)
Tri-focal Cameras
(2M pixels, FOV 28,
52, 100, 60/15fps)
Surround-view
Camera (1 at Back)
Rear-view Camera
(2M pixels,FOV 52,
30fps)
In-Car Intelligent
Camera
Radars
(5 in Total)
Surround-view Camera
(1 in Front)
Ultrasonic Sensors
(6 at Back)
Surround-view
Camera (2 on Sides)
Cut-In Prevention
Camera
1M pixels, 60fps)Rear-view Camera
(1M pixels, 30fps)
Sensor System for E28 (Mass production in 2020)
19
Note: We use first vehicle G3’s picture as E28’s design is not revealed yet.
20
XPilot Camera Coverage and Functions for E28
360 coverage; Designed to cover traffic scenarios in China
HFOV 100
HFOV 52
21
System Differentiators
22
1828x948@15fps
(for Highway Driving)
457x237@60fps
(for Urban Driving)
Long Range CNN
(Perception at > 200m)
Close Proximity CNN
(Responds x4 faster)
Cameras
Variable fps Network for China Specific Drive Conditions
(Close Vehicle Proximity and Abrupt Cut-ins)
1
23
HighwayUrban Canyon
START POINT /
END POINT
55 Km route (Approx. 2.5hr)
2.5hrs x 3600 x 1Hz = 9,000 samples
GuangzhouRoute8
Absolute
Localization
Reference
Antenna +
GNSS/INS
2 GNSS / INS
20cm absolute-localization-accuracy at 95% (2 σ)
20cm absolute-localization-accuracy for at 95% (2 σ) of Highway route in white
24
Front Radars
Right Front
Corner Radar
Left Front
Corner Radar
Left Rear
Corner Radar
Right Rear
Corner Radar
3 RADAR
Five Radars of High Angular Resolution: 2x improvement
5th Generation of Radar Technology
25
Industry Leading Computing Platform
XPilot Unit (XPU) powered by NVIDIA Xavier
NVIDIA Xavier
Safety MCU
Camera Des
Camera Des
Camera Des
Memory
EMMC
Storage
CAN
Transceiver
Ethernet
Switch
Power
Management
CAN Ethernet
4
26
Why NVIDIA Xavier?
0
5
10
15
20
25
30
35
Computing Power (TOPS)
Deep Learning Computing Throughput
NVIDIA Xavier FPGA NVIDIA Parker TI TDA2xx
TOPS
27
XPU Software Stack
NVIDIA Xavier SoC Aurix MCU
Hypervisor
NVIDIA
Foundations
QNX OS and BSP/Drivers
NVIDIA System Software NvMeida/CUDA/CuDNN/TensorRT …
NVIDIA Drive Works
XPilot Frameworks
(Project Eagle)
NVIDIA
Tier-1
AUTOSAR
OTA Data
Camera
Service
CAN
Service
(Radar,
IMU/GNSS,
Vehicle IO)
XPilot
Autonomous
Driving
Applications
Perception,
Localization
Prediction, Path
Planning
Control, …
XPU HW NVIDIA/Tier- SW XPU Platform SW XPilot SW
Visualization Launcher
Monitor
Diagnostic
Service
Xpilot
Safety
App
28
Driving hierarchy w/ safety intervention
AEB
Driver: Human Driver: XPilot
Collision
Warnings
5 SAFETY
Independent AEB System
29
Summary
• XPENG Motors develop FUN, CONNECTED and INTELLIGENT EVs tailored for the
young and tech-savvy Chinese millennials
• Roadmap for XPENG Motors’ Autonomous Driving Solution
• System architecture design powered by Xavier
30
E28 is coming…
To be revealed at Auto Shanghai April 16

More Related Content

What's hot

Google Driverless Cars
Google Driverless Cars Google Driverless Cars
Google Driverless Cars
Gopikrishna VM
 

What's hot (20)

Carpooling (Ride-sharing) Analysis
Carpooling (Ride-sharing) AnalysisCarpooling (Ride-sharing) Analysis
Carpooling (Ride-sharing) Analysis
 
5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges
 
Autonomous cars
Autonomous carsAutonomous cars
Autonomous cars
 
Google Driverless Cars
Google Driverless Cars Google Driverless Cars
Google Driverless Cars
 
Adaptive Cruise control
Adaptive Cruise controlAdaptive Cruise control
Adaptive Cruise control
 
Ppt safecities axis_ agentvi_jvp_en_1505
Ppt safecities axis_ agentvi_jvp_en_1505Ppt safecities axis_ agentvi_jvp_en_1505
Ppt safecities axis_ agentvi_jvp_en_1505
 
How Children Learn Testing at Testit
How Children Learn Testing at TestitHow Children Learn Testing at Testit
How Children Learn Testing at Testit
 
Auto pilot technology in vehicles
Auto pilot technology in vehicles Auto pilot technology in vehicles
Auto pilot technology in vehicles
 
Intermediate: Vehicle to Everything (V2X) Introduction
Intermediate: Vehicle to Everything (V2X) IntroductionIntermediate: Vehicle to Everything (V2X) Introduction
Intermediate: Vehicle to Everything (V2X) Introduction
 
Adaptive cruise control
Adaptive cruise controlAdaptive cruise control
Adaptive cruise control
 
Public Transportation
Public TransportationPublic Transportation
Public Transportation
 
GOOGLE CAR(autonomous car)
GOOGLE CAR(autonomous  car)GOOGLE CAR(autonomous  car)
GOOGLE CAR(autonomous car)
 
Autonomous Driving
Autonomous DrivingAutonomous Driving
Autonomous Driving
 
Applications of Deep Learning in Telematics
Applications of Deep Learning in TelematicsApplications of Deep Learning in Telematics
Applications of Deep Learning in Telematics
 
Presentation on driverless cars by shahin hussan
Presentation on driverless cars by shahin hussan Presentation on driverless cars by shahin hussan
Presentation on driverless cars by shahin hussan
 
Embedded system in automobile
Embedded system in automobileEmbedded system in automobile
Embedded system in automobile
 
Google driverless cars
Google driverless carsGoogle driverless cars
Google driverless cars
 
Adaptive cruise control
Adaptive cruise controlAdaptive cruise control
Adaptive cruise control
 
Connected Cars
Connected CarsConnected Cars
Connected Cars
 
Autonomous car
Autonomous carAutonomous car
Autonomous car
 

Similar to Xpeng Motors' P7's self-driving roadmap and system design

Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
IJEEE
 
SCALE 2012: Automotive: new frontier for mobile Linux
SCALE 2012: Automotive: new frontier for mobile LinuxSCALE 2012: Automotive: new frontier for mobile Linux
SCALE 2012: Automotive: new frontier for mobile Linux
Alison Chaiken
 

Similar to Xpeng Motors' P7's self-driving roadmap and system design (20)

“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
 
Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles
 
Self-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production carsSelf-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production cars
 
Semi-Autonomous Vehicle
Semi-Autonomous VehicleSemi-Autonomous Vehicle
Semi-Autonomous Vehicle
 
smartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdfsmartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdf
 
SMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOTSMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOT
 
Fullstop.ai (1)
Fullstop.ai (1)Fullstop.ai (1)
Fullstop.ai (1)
 
Smart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer VisionSmart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer Vision
 
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
 
IRJET-V8I686.pdf
IRJET-V8I686.pdfIRJET-V8I686.pdf
IRJET-V8I686.pdf
 
Key trends of smart transportation
Key trends of smart transportationKey trends of smart transportation
Key trends of smart transportation
 
DE - Smart Parking System.pptx
DE - Smart Parking System.pptxDE - Smart Parking System.pptx
DE - Smart Parking System.pptx
 
SMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOTSMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOT
 
Google's Driverless Car
Google's Driverless CarGoogle's Driverless Car
Google's Driverless Car
 
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine LearningIRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
 
Automatic gate control
Automatic gate controlAutomatic gate control
Automatic gate control
 
IRJET-Smart Parking System
IRJET-Smart Parking SystemIRJET-Smart Parking System
IRJET-Smart Parking System
 
Practices of AI guided traffic analysis
Practices of AI guided traffic analysisPractices of AI guided traffic analysis
Practices of AI guided traffic analysis
 
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ..."2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
 
SCALE 2012: Automotive: new frontier for mobile Linux
SCALE 2012: Automotive: new frontier for mobile LinuxSCALE 2012: Automotive: new frontier for mobile Linux
SCALE 2012: Automotive: new frontier for mobile Linux
 

Recently uploaded

Vina Score and Vin Min for almost all the models 2024
Vina Score and Vin Min for almost all the models 2024Vina Score and Vin Min for almost all the models 2024
Vina Score and Vin Min for almost all the models 2024
jipohal318
 
5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION .ppt
5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION  .ppt5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION  .ppt
5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION .ppt
hiren65650
 
Car Seat Covers and Seat Protection Guide
Car Seat Covers and Seat Protection GuideCar Seat Covers and Seat Protection Guide
Car Seat Covers and Seat Protection Guide
AskXX.com
 

Recently uploaded (14)

Vina Score and Vin Min for almost all the models 2024
Vina Score and Vin Min for almost all the models 2024Vina Score and Vin Min for almost all the models 2024
Vina Score and Vin Min for almost all the models 2024
 
Why Won't Your Audi A3 Shift Into Reverse Gear Let's Investigate
Why Won't Your Audi A3 Shift Into Reverse Gear Let's InvestigateWhy Won't Your Audi A3 Shift Into Reverse Gear Let's Investigate
Why Won't Your Audi A3 Shift Into Reverse Gear Let's Investigate
 
Introduction to Automotive Bootloader | Programming Sequence
Introduction to Automotive Bootloader | Programming SequenceIntroduction to Automotive Bootloader | Programming Sequence
Introduction to Automotive Bootloader | Programming Sequence
 
Basic of Firmware & Embedded Software Programming in C
Basic of Firmware & Embedded Software Programming in CBasic of Firmware & Embedded Software Programming in C
Basic of Firmware & Embedded Software Programming in C
 
What Should BMW Owners Know About Steptronic Transmission Problems
What Should BMW Owners Know About Steptronic Transmission ProblemsWhat Should BMW Owners Know About Steptronic Transmission Problems
What Should BMW Owners Know About Steptronic Transmission Problems
 
Timer Handling in UDS | S3 Server Timer | P2 and P2 Start Timer
Timer Handling in UDS | S3 Server Timer | P2 and P2 Start TimerTimer Handling in UDS | S3 Server Timer | P2 and P2 Start Timer
Timer Handling in UDS | S3 Server Timer | P2 and P2 Start Timer
 
5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION .ppt
5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION  .ppt5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION  .ppt
5s-5S 5S 5S 5S 5S 5S 5S PRESENTATION .ppt
 
Car Seat Covers and Seat Protection Guide
Car Seat Covers and Seat Protection GuideCar Seat Covers and Seat Protection Guide
Car Seat Covers and Seat Protection Guide
 
Automotive Bootloader Complete Guide with UDS Frame Format
Automotive Bootloader Complete Guide with UDS Frame FormatAutomotive Bootloader Complete Guide with UDS Frame Format
Automotive Bootloader Complete Guide with UDS Frame Format
 
Introduction to UDS over CAN | UDS Service
Introduction to UDS over CAN | UDS ServiceIntroduction to UDS over CAN | UDS Service
Introduction to UDS over CAN | UDS Service
 
-VDA-Special-Characteristics Special characteristics.pdf
-VDA-Special-Characteristics Special characteristics.pdf-VDA-Special-Characteristics Special characteristics.pdf
-VDA-Special-Characteristics Special characteristics.pdf
 
CAMIONES TOYOTA N04C- Engine y HINO 300.
CAMIONES TOYOTA N04C- Engine y HINO 300.CAMIONES TOYOTA N04C- Engine y HINO 300.
CAMIONES TOYOTA N04C- Engine y HINO 300.
 
technical report on EV. EVs can offer benefitssuch as lower operating costs a...
technical report on EV. EVs can offer benefitssuch as lower operating costs a...technical report on EV. EVs can offer benefitssuch as lower operating costs a...
technical report on EV. EVs can offer benefitssuch as lower operating costs a...
 
Quicker and better: South Korea’s new high-speed train 'EMU-320'
Quicker and better: South Korea’s new high-speed train 'EMU-320'Quicker and better: South Korea’s new high-speed train 'EMU-320'
Quicker and better: South Korea’s new high-speed train 'EMU-320'
 

Xpeng Motors' P7's self-driving roadmap and system design

  • 1. 0 Developing Autonomous Driving EVs for the China Market XPENG Motors’ Approach Junli Gu VP of Autonomous Driving, XPENG motors March 18, 2019
  • 2. 1 Agenda 1. XPENG Motors Introduction and Background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System Architecture Design Powered by Xavier
  • 3. 2 Who is XPENG? We develop FUN, CONNECTED and INTELLIGENT EVs tailored for the young and tech-savvy Chinese Millennials 2 • Aimed at young Internet users in China, with autonomous driving and intelligent connection as the core differences • 2014: Founded in Guangzhou, China • Dec 2018: Mass production and official launch of G3 (electrical SUV) • Q1 2019: Mass production of E28 (electrical sedan)
  • 4. 3 Strong R&D capabilities and investments Shanghai Intelligent Connected Vehicle Navigation R&D Silicon Valley & San Diego Machine Learning Autonomous Driving R&D Guangzhou Vehicle and VCU R&D V2X Testing Trial and Production Lead-in Beijing Artificial Intelligence R&D R&D footprint Our R&D headcount accounts for over 70% of our total number of employees.
  • 5. 4 Your Smart Driving Assistant Connectivity Xmart OS X-pilot Artificial Intelligence
  • 7. 6 Agenda 1. XPENG Motors Introduction and Background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System Architecture Design Powered by Xavier
  • 8. 7 L3 Products: Highly-Autonomous Highway Features L4 Products: Fully-Autonomous Urban & Highway Features - Driverless Robo Taxi - Driverless Robo Bus - Human Driver vehicles L2+ Products: Semi-Autonomous Highway/Urban Features - Human Driver vehicles Self-Driving Two Separate Branches…
  • 9. Comfort Driving with safety guarantees Where are we heading… • Key differentiation through XPENG’s intelligent EV strategy • Focus on in-house software solutions running on leading computer hardware platforms • Focus on enhancing driver assistance features towards L3 capabilities in 2020 • Focus on feature optimization for Chinese market and Chinese consumers 8
  • 10. 9 Roadmap for XPENG Motors’ Autonomous Driving Solution XPilot 2018-2019 2020 2021-2022 2024-2025 CarModel Autonomous Driving Achievement &Goal • Xpilot 2.0: Full scenario auto parking + LCC + ACC • Xpilot 3.0: Super Memory Parking + Highway Autopilot • Xpilot 4.0: AVP + Highway/Urban Autopilot • Xpilot x.0: Full Automation in limited scenarios (highway, parking, etc.) • First generation solution for commercialization with partial self developed IPs • Fully self developed end-to-end SW IP • Next gen HW platform with optimized sensor cost • First level-4 solution in consumer vehicle A Class SUV (G3) B Class Sedan (E28) B Class SUV
  • 11. 10 XPENG G3 By AI, irregular lots By memory Roadmap for XPENG Motors’ Autonomous Driving Solution-XPilot parking functions XPENG E28 Alleviate people’s parking anxiety in parallel, vertical, perpendicular, irregular lots… parking functions By voice By Vision By Ultrasonic
  • 12. 11 Use Case Example: Super Memory Parking
  • 13. 12 Use Case Example: Highway Auto-Pilot
  • 14. 13 2km ahead Xpilot’s Surrounding Reality Ego Traffic Point of interest Road side object Lane condition
  • 15. 14 Agenda 1. XPENG Motors introduction and background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System architecture design powered by Xavier
  • 16. 15 Driving Big Data AI and Perception High-perf chips Customized Sensor Structure - - Chinese Traffic Patterns Local adaption is a must - - • Chinese style lane change and close cutting in • Very large variety of obstacles • Dense traffic • Irregular Pattern
  • 17. 16 Challenge: Perception & Creating a Representative 3D Environmental Model Compute (MP/s) Quality raw sensor input with cost constraints 2 1 Preponderance of training data (especially corner cases) 3
  • 18. 17 Challenge: Perception & Creating a Representative 3D Environmental Model Real stream taken from E28 camera sets; ISP developed in house;
  • 19. 18 Challenge: Extending to Day/Night, All Weather, All locations 1) Time (Location of Sun: Day/Night/NotDawn/NotDusk) 2) Select Weather Conditions 3) Availability of GNSS & RTK 4) Place (GeoFenced) 5) Select Speed Range 6) Road/Traffic Conditions Sensing/Perception challenges (due to insufficient quality of raw data and/or compute power) Mapping challenges Driving policy challenges
  • 20. Ultrasonic Sensors (6 in Front) Tri-focal Cameras (2M pixels, FOV 28, 52, 100, 60/15fps) Surround-view Camera (1 at Back) Rear-view Camera (2M pixels,FOV 52, 30fps) In-Car Intelligent Camera Radars (5 in Total) Surround-view Camera (1 in Front) Ultrasonic Sensors (6 at Back) Surround-view Camera (2 on Sides) Cut-In Prevention Camera 1M pixels, 60fps)Rear-view Camera (1M pixels, 30fps) Sensor System for E28 (Mass production in 2020) 19 Note: We use first vehicle G3’s picture as E28’s design is not revealed yet.
  • 21. 20 XPilot Camera Coverage and Functions for E28 360 coverage; Designed to cover traffic scenarios in China HFOV 100 HFOV 52
  • 23. 22 1828x948@15fps (for Highway Driving) 457x237@60fps (for Urban Driving) Long Range CNN (Perception at > 200m) Close Proximity CNN (Responds x4 faster) Cameras Variable fps Network for China Specific Drive Conditions (Close Vehicle Proximity and Abrupt Cut-ins) 1
  • 24. 23 HighwayUrban Canyon START POINT / END POINT 55 Km route (Approx. 2.5hr) 2.5hrs x 3600 x 1Hz = 9,000 samples GuangzhouRoute8 Absolute Localization Reference Antenna + GNSS/INS 2 GNSS / INS 20cm absolute-localization-accuracy at 95% (2 σ) 20cm absolute-localization-accuracy for at 95% (2 σ) of Highway route in white
  • 25. 24 Front Radars Right Front Corner Radar Left Front Corner Radar Left Rear Corner Radar Right Rear Corner Radar 3 RADAR Five Radars of High Angular Resolution: 2x improvement 5th Generation of Radar Technology
  • 26. 25 Industry Leading Computing Platform XPilot Unit (XPU) powered by NVIDIA Xavier NVIDIA Xavier Safety MCU Camera Des Camera Des Camera Des Memory EMMC Storage CAN Transceiver Ethernet Switch Power Management CAN Ethernet 4
  • 27. 26 Why NVIDIA Xavier? 0 5 10 15 20 25 30 35 Computing Power (TOPS) Deep Learning Computing Throughput NVIDIA Xavier FPGA NVIDIA Parker TI TDA2xx TOPS
  • 28. 27 XPU Software Stack NVIDIA Xavier SoC Aurix MCU Hypervisor NVIDIA Foundations QNX OS and BSP/Drivers NVIDIA System Software NvMeida/CUDA/CuDNN/TensorRT … NVIDIA Drive Works XPilot Frameworks (Project Eagle) NVIDIA Tier-1 AUTOSAR OTA Data Camera Service CAN Service (Radar, IMU/GNSS, Vehicle IO) XPilot Autonomous Driving Applications Perception, Localization Prediction, Path Planning Control, … XPU HW NVIDIA/Tier- SW XPU Platform SW XPilot SW Visualization Launcher Monitor Diagnostic Service Xpilot Safety App
  • 29. 28 Driving hierarchy w/ safety intervention AEB Driver: Human Driver: XPilot Collision Warnings 5 SAFETY Independent AEB System
  • 30. 29 Summary • XPENG Motors develop FUN, CONNECTED and INTELLIGENT EVs tailored for the young and tech-savvy Chinese millennials • Roadmap for XPENG Motors’ Autonomous Driving Solution • System architecture design powered by Xavier
  • 31. 30 E28 is coming… To be revealed at Auto Shanghai April 16