Webinar: NVIDIA JETSON – A Inteligência Artificial na palma de sua mão
•
0 gefällt mir•558 views
Objetivo do Webinar: Venha saber como a plataforma NVIDIA Jetson e suas ferramentas habilitam você a desenvolver e implantar robôs, drones, aplicativos de IVA e outras máquinas autônomas com tecnologia AI que pensam por conta própria. Apoio: Arrow e NVIDIA. Convidado: Marcel Saraiva Gerente de Contas Enterprise da NVIDIA, executivo com 20 anos de expereincia no mercado de TI, teve na sua carreia passagens pela SGI (Silicon Graphics), Intel e Scansource. Engenheiro eletrico formado pela FEI, com pós-graduação em Marketing pela FAAP e MBA em Gestão Empresarial pela FGV. Link para o Webinar: https://www.embarcados.com.br/webinars/nvidia-jetson-a-inteligencia-artificial-na-palma-de-sua-mao/
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Ähnlich wie Webinar: NVIDIA JETSON – A Inteligência Artificial na palma de sua mão
Ähnlich wie Webinar: NVIDIA JETSON – A Inteligência Artificial na palma de sua mão (20)
Mehr von Embarcados
Mehr von Embarcados (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Webinar: NVIDIA JETSON – A Inteligência Artificial na palma de sua mão
- 1. JETSON PLATFORM OVERVIEW MARCEL SARAIVA – MSARAIVA@NVIDIA.COM +55 11 966330057
- 2. 2 AGENDA • NVIDIA – PLATAFORMA INTELIGENCIA ARTIFICIAL • ECOSSITEMA NVIDIA JETSON • FAMILIA JETSON EM DETALHES • FERRAMENTAS DE DESENVOLVIMENTO • MODELOS DE USO PLATAFORMA JETSON
- 3. 3 MASS-MARKET EDGE SYSTEMS NEED AI HOME/SERVICE ROBOTS 175 billion hours per year on household chores (US) MACHINE VISION/AOI 1 trillion product units per year require visual inspection NETWORK VIDEO RECORDER 200 million 1080p streams AIOT 80% of Enterprise IOT projects will use AI by 2022
- 4. 4 AI – EDGE TO CLOUD PLATFORM JETSON TESLA DGX TENSORRT DEEPSTREAM JETPACK NVIDIA GPU CLOUD DIGITS Edge device Server CLOUD Training and Inference EDGE AND ON-PREMISES Inference
- 5. 5 Artificial Intelligence Computer Vision Accelerated Computing Multimedia Gesture recObj detectPath planningDepth est NVIDIA JETSON SOFTWARE-DEFINED AUTONOMOUS MACHINES Powerful and efficient AI, CV, HPC | Rich Software Development Platform Open Platform Pose est Speech rec Sensors JETSON COMPUTER JETPACK SDK ACCELERATED MODULES ECOSYSTEM BSP • Linux • Security Architecture AI/Systems Software Design Services
- 6. 6 JETSON MOMENTUM 500,000 Developers 3,000 Customers Collaboration Healthcare Autonomous Drone Traffic Delivery Robot Warehouse Digital EducationOptical Inspection Agriculture
- 7. 7 THE JETSON FAMILY for AI at the Edge and Autonomous System designs Same software Full specs at developer.nvidia.com/jetson * TX2i: 10-20W 7.5 – 15W* 50mm x 87mm JETSON TX2 series 1.3 TFLOPS (FP16) 5 - 10W 45mm x 70mm JETSON NANO 0.5 TFLOPS (FP16) 10 – 30W 100mm x 87mm JETSON AGX XAVIER series 11 TFLOPS (FP16) 32 TOPS (INT8) 10 - 15W 45mm x 70mm JETSON Xavier NX 6 TFLOPS (FP16) 21 TOPS (INT8) Mainstream Autonomous machinesEntry
- 8. 8 JETSON NANO Low Cost AI Computer Module Heterogeneous CPU Complex Quad Cores A57 with 2MB L2 for multi-threaded operation 1.43Ghz Maxwell Tensor Core GPU 128 CUDA Cores 472 GFLOPS (FP16) Multimedia Engines Encode 4k, 4x1080p, 8x720p up to 120fps Decode 4k60, 2x4k, 8x1080p, 16x720p up to 240fps JPEG encode & decode 600 MP/s H.264, H.265, VP9, VP8, VC-1, MPEG-2 HDMI, DP and eDP Display support Computer Vision Engines ISP Video Image Compositor Boot, Power & Security Boot and power management ARM TrustZone Secure Industry Standard IO GPIO, I2C, I2S, SDIO, SPI, UART Support up to 12 CSI @1.5Gbps Industry Standard High-Speed IO PCle Gen2 rootport x1 | x2 | x4 12 lanes MIPI CSI-2 (D-Phy) RGMII Ethernet USB 3.0 and 2.0 USB 3.0 Gen2 Host and Device Memory 4GB 64-Bit LPDDR4 Bandwidth 25.6 GB/s 16GB eMMC Jetson Nano Quad A57 CPU Complex Boot, Power & Security Sensor IO Maxwell GPU High Performance IO Multimedia Complex Memory System Computer Vision Engines
- 9. 9 JETSON NANO Low Cost AI Computer Module
- 10. 10 JETSON XAVIER NX World’s Smallest Supercomputer Carmel ARM V8.2 CPU 6 Cores 4x2MB L2, 4MB L3 10-wide Superscalar Cache coherent CPU complex Volta Tensor Core GPU FP32/FP16/INT8 Multi-Precision 384 CUDA Cores 2.8 TFLOPS (FP16) 12 DL TOPS (INT8) Multimedia Engines Encode, Decode, Video Image Compositor H.264, H.265, VP9 HDMI and DP Display support DLA – Designed for Inference 5.5 TFLOPS FP16 9 TOPS INT8 Boot, Power & Security Boot and power management processor TEE + ARM TrustZone AES, RSA, SHA Industry Standard IO Always on Sensor processor engine (AON/SPE) CAN, DMIC, GPIO, I2C, I2S, PMC, SPI, UART Industry Standard High-Speed IO PCle Gen3 Root and Endpoint 12 lanes MIPI CSI-2 | 6 lanes SLVS-EC Support C-Phy and D-Phy RGMII Ethernet USB 3.1 and 2.0 USB 3.1 Gen2 Host and Device Memory 128-Bit LPDDR4X 8GB, 51.2 GB/s
- 11. 11 JETSON XAVIER NX World’s Smallest Supercomputer
- 12. 12 JETSON AGX XAVIER World’s First Autonomous Machine Platform Carmel ARM V8.2 CPU 8 Cores 4x2MB L2, 4MB L3 10-wide Superscalar Cache coherent CPU complex Volta Tensor Core GPU FP32/FP16/INT8 Multi-Precision 512 CUDA Cores 6 TFLOPS (FP16) 22.6 Tensor Core DL TOPS Multimedia Engines Encode, Decode, Video Image Compositor H.264, H.265, VP9 HDMI and DP Display support DLA – Designed for Inference 5.7 TFLOPS FP16 11.4 TOPS INT8 Computer Vision Engines Vision Accelerator Stereo & Optical Flow Engine HDR ISP Boot, Power & Security Boot and power management processor TEE + ARM TrustZone AES, RSA, SHA Industry Standard IO Always on Sensor processor engine (AON/SPE) CAN, DMIC, GPIO, I2C, I2S, PMC, SPI, UART Industry Standard High-Speed IO PCle Gen4 Root and Endpoint 16 lanes MIPI CSI-2 | 8 lanes SLVS-EC Support C-Phy and D-Phy RGMII Ethernet USB 3.1 and 2.0 USB 3.1 Gen2 Host and Device Memory 256-Bit LPDDR4X 32GB, 137 GB/s
- 13. 13 JETSON AGX XAVIER World’s First Autonomous Machine Platform
- 14. 14 JETSON AGX XAVIER 10 | 15W | 30W 11 TFLOPS (FP16) | 32 TOPS (INT8) $699 JETSON NANO 5W | 10W 0.5 TFLOPS (FP16) $99 JETSON DEVELOPER KITS For Developers, Engineers and Makers Multiple developer kits - Same software Full specs at developer.nvidia.com/jetson JETSON TX2 7.5W | 15W 1.3 TFLOPS (FP16) $399 ($299 EDU) JETSON XAVIER NX 10W | 15W 7 TFLOPS (FP16) | 21 TOPS (INT8) $399
- 15. 15 Softwar e JETSON NANO JETSON TX2 JETSON XAVIER NX JETSON AGX XAVIER GPU 128 Core Maxwell 0.5 TFLOPs (FP16) 256 Core Pascal 1.3 TFLOPS (FP16) 384 Core Volta 21 TOPs (INT8) 512 Core Volta + NVDLA 32 TOPS (INT8) CPU 4 core ARM A57 6 core Denver and A57 (2x) 2MB L2 6 core Carmel ARM CPU (3x) 2MB L2 + 4MB L3 8 core Carmel ARM CPU (4x) 2MB L2 + 4MB L3 Memory 4 GB 64-bit LPDDR4 25.6 GB/s Up to 8 GB 128b LPDDR4 58 GB/s 8 GB 128-bit LPDDR4x 51.2 GB/s Up to 32GB 256-bit LPDDR4x 137 GB/s Storage 16 GB eMMC Up to 32 GB eMMC 16 GB eMMC 32 GB eMMC Encode 4K @ 30 (H.265) 4K @ 60 (H.265) 2x 4K @ 30 (H.265) 4x 4K @ 60 (H.265) Decode 4K @ 60 (H.265) 2x 4K @ 60 (H.265) 2x 4K @ 60 (H.265) 6x 4K @ 60 (H.265) Camera 12 (3x4 or 4x2) MIPI CSI-2 D-PHY 1.1 lanes (18 Gbps) 12 lanes MIPI CSI-2 D-PHY 1.2 (30 Gbps) C-PHY (41 Gbps) 12 lanes (3x4 or 6x2) MIPI CSI-2 D-PHY 1.2 (30 Gbps) 16 lanes MIPI CSI-2 | 8 lanes SLVS-EC D-PHY (40 Gbps) C-PHY (59 Gbps) Mechanical 69.6mm x 45mm 260 pin edge connector 87mm x 50mm 400 pin connector 69.6mm x 45mm 260 pin edge connector 100mm x 87mm 699 pin connector Software JetPack SDK – Unified software release across all Jetson products
- 16. 16 11 10 15 17 15 24 23 33 39 34 317 65 151 146 239 525 275 281 240 439 0 50 100 150 200 250 300 350 400 450 500 550 Classification Inception V4 (299x299) VGG-19 (224x224) Image Processing Super Resolution (481x321) Segmentation Unet (256x256) Pose Estimation OpenPose (256x456) Jetson Nano Jetson TX2 Jetson Xavier NX Jetson AGX Xavier DEEP LEARNING INFERENCE PERFORMANCE Imagespersecond(FPS) XAVIER NX latency <= 15ms
- 17. 17 48 37 43 108 83 92 562 824 888 1098 1941 1587 0 200 400 600 800 1000 1200 1400 1600 1800 2000 Object Detection Tiny YOLO V3 (416x416) Classification ResNet-50 (224x224) SSD Mobilenet-V1 (300x300) Jetson Nano Jetson TX2 Jetson Xavier NX Jetson AGX Xavier DEEP LEARNING INFERENCE PERFORMANCE Imagespersecond(FPS) XAVIER NX latency <= 15ms
- 18. 18 103 31 170 60 0 30 60 90 120 150 180 BERT_BASE (sequence length 128) BERT_LARGE (sequence length 128) Jetson Nano Jetson TX2 Jetson Xavier NX Jetson AGX Xavier DEEP LEARNING INFERENCE PERFORMANCE BERT batch size = 1 Sequences/s
- 19. 19 JETSON SOFTWARE for AI Edge Devices FactoryCity Logistics Healthcare Agriculture Ecosystem AI Software and Services Ecosystem Machine Vision Cameras & Sensors Ecosystem System Software & Developer Tools Jetson DeepStream SDK Isaac SDK DeveloperTools Computer Vision VPI VisionWorks OpenCV Sensors Drivers Ecosystem Deep Learning TensorRT cuDNN Multimedia libargus Video API Accelerated Computing cuBLAS cuFFT CUDA-X CUDA • Linux • RTOS JetPackSDK
- 20. 20 CLOUD NATIVE ON JETSON Easier and Faster Deployment - Eliminates complex, time-consuming builds and installs Agile and Easier Development - Update specific modules not the whole system Scalability - Push the right container to the right platform Portable - Deploy across various environments, from test to production with minimal changes Consistency Across Portfolio - Update once and push broadly Containers & Micro Services
- 21. 21 CLOUD NATIVE DEMO ON JETSON
- 22. 22 TRANSFER LEARNING TOOLKIT Faster and efficient deep learning training workflow Leverages prior investment in pretrained models Output optimized and ready for deployment High level SDK for tuning of domain specific DNNs
- 23. 23 NVIDIA TensorRT From Every Framework, Optimized For Each Target Platform TX2 Nano AGX Xavier Xavier NX NVIDIA Products TensorRT
- 24. 24 JETSON DEVELOPER TOOLS System wide application tuning and optimization Workload balancing across GPU, CPU, DLA Multi-platform development Comprehensive tool suite to accelerate development CUDA-aware editor CPU/GPU debugger Compute and graphics Visual profiler and system trace Develop → Profile → Analyze → Optimize https://developer.nvidia.com/nsight-systems
- 25. 25 JETSON ECOSYSTEM HW AND SENSORS DISTRIBUTION SOFTWARE CAMERA AND SENSORS HARDWARE AND DESIGN SERVICES SOFTWARE SERVICESCSP-IOTTOOLS/SYSTEMS SWISV
- 27. 27 JETSON INFORMATION RESOURCES Most Critical Nvidia Resources For Jetson Information docs.nvidia.com Jetson SW Documentation JetPack Overview L4T Development Guide L4T Multimedia developer.nvidia.com Autonomous Machines Support Resources page Download Center Module Datasheet Product Design Guide Adaptation and Bring-up Guide Jetson FAQ Nvidia.com – Platforms Autonomous Machines Jetson Product Overview Industries – Application Examples Autonomous Machines Blog Forums Search Answer questions AIOT GitHub Examples Tutorials
- 28. 28 JETSON INFORMATION RESOURCES Internet Resources For Jetson Information elinux.org/jetson Useful collection of information around Jetson Guides & Tutorials Links to tools and examples Components and add-on’s for devkits JetsonHacks Developer focused tips&tricks Product reviews Articles and How-To’s Tools and application example
- 29. 29 DEEP LEARNING INSTITUTE Training Labs Nanodegrees nvidia.com/DLI TWO DAYS TO A DEMO Create your first demo today developer.nvidia.com/ embedded/twodaystoademo JETSON DEVELOPER KIT Start developing now Starting at $299 developer.nvidia.com/ buy-jetson GTC Largest event for GPU developers gputechconf.com JETSON - START NOW
- 30. 30 EXEMPLOS DE APLICAÇÃO DA PLATAFORMA JETSON
- 31. 31 INTELLIGENT VIDEO ANALYTICS Logistics Public Transit Public Safety Critical Infrastructure Traffic Engineering Retail Analytics Parking Management Access Control — Increase operational efficiency and safety across many industries using AI $2T INDUSTRY
- 32. 32 NVIDIA METROPOLIS A Powerful Application Framework for Intelligent Video Analytics & IoT https://www.nvidia.com/en-us/autonomous-machines/intelligent-video-analytics-platform/ EGX SOFTWARE STACK METROPOLIS SOFTWARE STACK DEEPSTREAM TRT, TRITON TLT VIDEOCODEC NGC NVIDIA PARTNERS NVIDIA EGX HARDWARE T4 JETSON CUDA-X Kubernetes Networking Storage Security
- 33. 33 GETTING STARTED APPLICATIONS Available in C and Python Name Function deepstream-test1 DeepStream Hello world. Single video from file to on screen display with bounding box deepstream-test2 Builds on test1 and adds secondary object classification on detected objects deepstream-test3 Builds on test1 and adds multiple video inputs deepstream-test4 Builds on test1 and adds connections to IoT services thru the nvmsgbroker plugin Object detection Classific- ation BatchingDecode Object detection BatchingDecode Object detection Object detection Message Broker Native C apps: sources/apps/sample_apps/ Python apps: https://github.com/NVIDIA-AI-IOT/deepstream_python_apps Message Converter
- 34. 34 END-TO-END REAL TIME PERFORMANCE Jetson Nano Jetson Xavier NX Jetson AGX Xavier T4 Model Architecture Inference resolution Precision Model Accuracy GPU (FPS) GPU (FPS) DLA1 (FPS) DLA2 (FPS) GPU (FPS) DLA1 (FPS) DLA2 (FPS) GPU (FPS) PeopleNet - ResNet34 960 x 544 FP16 84% 10 60 30 30 120 60 60 460 TrafficCamNet - ResNet18 960 x 544 INT8 84% 19* 180 90 90 420 120 120 1300 DashCamNet - ResNet18 960 x 544 INT8 80% 18* 180 90 90 390 120 120 1280 FaceDetect-IR - ResNet18 384 x 240 INT8 96% 95* 1080 570 570 1950 780 780 2160 * FP16 inference on Jetson Nano
- 35. 35 PEOPLE COUNTING CAPTURE DECODE STREAM MGMT TRACKING DRAW BOXES AND LABELS RENDER DETECT PEOPLE ANALYTICS – COUNT PEOPLE RULES
- 36. 36 SOCIAL DISTANCING APP TRACKING DETECT PEOPLE MSGBROKER – METADATA DEEPSTREAM ANALYTIC CAMERA CALIBRATION RTSP SINK Messages Stream out
- 37. Siga a NVIDIA /NVIDIABrasil /NVIDIABrasil /nvidiabrasil MARCEL SARAIVA – MSARAIVA@NVIDIA.COM +55 11 966330057