2. Agenda
• The need for drone swarm
• Drone swarm design requirements
• The need for open platform
• Open platform requirements
3.
4. Drone Swarm - the need
• Price / Quantity !
• Area coverage
• Multi-location sensors
• Coordinated attacks
• Autonomous / Single operator to many drones
5. Drone Swarm – my wish list
• Cost Cost Cost !!!
• Upgrade existing drones to swarm??
• Use existing platforms
• (DVRs/ control rooms / communication)
• Best platform
• Integrate:
• multiple drone types
• components from different vendors
into a single swarm
6. Multi-vendors platform
• Company 1 – low cost <10K attack drones
• Company 2 – smarter drone for communication/control
• Company 3 –control cart / system
• Company 4 – distributed video analytics platform
• Could it all work together “Mix & Match” for the best
integrated platform?
• Create an open platform / standards for swarm integration
7. Swarm coordination simulation &
training
• Swarm training:
• Reinforced learning methods
• Hardware requirements
• Jetson nano / Jetson NX run RL models (cost of 100-400$)!!
• Low cost SoC with NPU/TPU / GPU FPGAs
8. Swarm simulation & training - NVIDIA
• Low-cost Reinforced learning platforms for drones / UAV
• NVIDIA ISAAC SIM
9. Swarm simulation & training -
Matlab
• Matlab Reinforced and UAV Toolboxes
10. Swarm training – testing &
validation
• Open interoperability tests
• Swarm coordination
• Swarm response to event
11. Video Analytics - Detection
• Pain
• Drone manufacturer doesn’t have all the tools / knowledge for
Video Analytics
• Target definition changes (new missile truck / target person)
• Solution
• Pluggable ATR server
• Server accept 3rd party analytics models with predefined API
• Accept updates (face / new missile track)
12. Video Analytics - Metadata
• How to send metadata drone-drone & Drone-controller
• Solutions
• Existing UAV video analytics protocols (STANAG /VMTI)
• NVIDIA Metadata format
13. Video Analytics - simulation
• Simulate Autonomous system environment
• Underwater
• Ships
• Missiles
• Drones/UAV
• Full Digital twin
• Behavior of enemy autonomous systems & Swarms
• Systems that accepts a 3D model of object simulate it in combat
environment and automatically creates a detector
15. Naïve Suggestion
• Create a multi-vendor definition and interop platform
• Communication
• Control
• Video Analytics
• Training
• Make this vision happen