Anzeige

AIDRC_Smart_Ports_MENA_vFINAL_withRef.pdf

Executive Director, Digital Science Research Center (DSRC) um Technology Innovation Institute (TII), Abu Dhabi
19. Mar 2023
Anzeige

Más contenido relacionado

Más de Thierry Lestable(20)

Anzeige

AIDRC_Smart_Ports_MENA_vFINAL_withRef.pdf

  1. tii.ae AIDRC Research Center NextGen Ports 5.0: (Private)5G/B5G and AI to the rescue Catalysts to Accelerate Digital Transformation of Ports Thierry LESTABLE, Ph.D, Dipl-Ing. Executive Director, Artificial Intelligence & Digital Science Research Center (AIDRC)
  2. TII – Technology Innovation Institute Smart Ports :: Ports 5.0 The “Highlander” Dilemna Asian Development Bank describes a smart port as a port that ensures “no waste of space, time, money and natural resources.” 2022 2027 From Connected Ports to Cognitive/Smart Ports “Smart ports are the only ports that will survive” prof. dr. Olaf Merk. (ITF/OECD) 76% of port operators see optimizing yard and terminal operations as their number one priority and challenge Port Stakeholders AIoT, 5G, Digital Twin, Cyber… Smart Port Market Trends Complexity of the Value Chain
  3. TII – Technology Innovation Institute Smart Digital Ports (1/2) Digital Twin technologies in use at the Port of Antwerp fully-automated TraPac shipping terminal in the Port of Los Angeles doubles the speed of loading and unloading ships, and decrease pollution AIoT – Connected Intelligence Artificial Intelligence & Digital Science Research Center (AIDRC)
  4. TII – Technology Innovation Institute Digital Twin for Plants & Infrastructure Physical Vs Virtual Asset Convergence platform for other digital projects Smarter Business, Sustainability & Safety Artificial Intelligence & Digital Science Research Center (AIDRC) Driving sustainability 3D/XR AI/ML 4D Smart Port Digital Twin
  5. TII – Technology Innovation Institute Paving the way to Digital Twin (1/2) Digital Twin: stepping stone for building Advanced E2E platforms Advanced Platforms Construction sites Artificial Intelligence & Digital Science Research Center (AIDRC)
  6. TII – Technology Innovation Institute Smart Digital Ports (2/2) Traffic Management, Asset Monitoring & Tracking, Safety… Leveraging AI-powered solutions, with multi-modal perception layers (Video, LiDar, Radar,…), positioning/asset management, and connectivity (5G private, LPWAN,…) to unlock logistics/traffic management on land + Sea… Automated Occupancy reporting / prediction Sea Traffic & cargo operations + Multimodal land traffic Artificial Intelligence & Digital Science Research Center (AIDRC) “42% of marine casualties or incidents took place in the port area. Working amongst heavy cargo, dangerous equipment and many other hazards puts port workers at daily risk of injury.” == Workers Safety “36% of accidents in ports were caused by pilot error and 42% of accidents were classified as “traffic” accidents.” == Assets Traffic Management
  7. TII – Technology Innovation Institute Remote Control of Rubber-Tyred Gantry (RTG) Cranes Towards Safer Operations… 22% of crane related fatalities in the U.S. between 2011 and 2015 happened to the crane operator. +90% of RTGs are still manually controlled, requiring skilled operators, which have been harder to attract in recent years. Human error is the largest reason for port-related accidents and is responsible for 75% of marine liability losses. Typical scenario, about 60 gantry cranes are deployed within a 1 km² area Teleoperation Operator Autonomous RTG - Uplink (UL): 5–16 channels of surveillance videos, - 1080p videos = about 30 Mbps. - TOTAL: 16 x 30 = 480 Mbps - PLC communications between the central control room and a gantry crane - require a network latency of less than 30 ms. very high requirements on reliability, bandwidth latency, density, and high security, which makes a private 5G network suitable for this use case 77% of crane operators suffer from neck pain, while up to 86% experience lower back pain
  8. TII – Technology Innovation Institute Teleoperation Dispatch Center Towards Immersive Experience…Internet of Senses URLLC URLLC: Ultra-Reliable Low Latency Communication Still in the infancy. Room for improvements in terms of User/Technician Immersive experience! Needs interaction mechanisms to maintain perceptual illusions. Possible thanks to high resolution imaging and sensing, AI- based Video compression, and 5G/6G wireless networks (URLLC)
  9. TII – Technology Innovation Institute Intelligent Guided/Autonomous Vehicle (IGV/IAV) Control From AGV to IGV/IAV AGV: Automated Guided Vehicle 36% of accidents in ports were caused by pilot error and 42% of accidents were classified as “traffic” accidents. Therefore Autonomous or Teleoperation Vehicle will bring safer operations. IGV would require at least 4 x cameras, therefore between 10 and 20Mbps per IGV. This is necessary as back-up IF stuck on the field, thus requiring Teleoperator to take control quickly and safely. IAVs are one of the component systems of the Intelligent Transportation System (ITS). C-V2X can be applied to them in future. IGV/IAV will benefit from uRLLC, higher Data rates (eMBB), Extended coverage, mMTC (massive MTC) brought by 5G. mMTC: massive Machine Type Communication / eMBB: enhance Mobile Broadband / uRLLC: ultra Reliable Low Latency Communications
  10. TII – Technology Innovation Institute From 5G to 6G From Connected Things to Connected Intelligence 6G to address UN’s SDG ➔ Contribute to the Quality & opportunities of human Life Source: huawei From Connected Intelligence To Collective Intelligence Artificial Intelligence & Digital Science Research Center (AIDRC) TSN: Time Sensitive Networks eMBB: enhanced Mobile Broadband mMTC: massive Machine Type Communication uRLLC: ultra Reliable Low Latency communication
  11. TII – Technology Innovation Institute 5G Private Networks Enabling Bespoke (usage based), Secure, Reliable, Ubiquitous IIoT 5G Network Slicing 5G Public Fallback Source: Qualcomm 5G functional split + virtualization
  12. TII – Technology Innovation Institute 5G CoMP: Beyond Massive MIMO Distributed MIMO Without CoMP With CoMP 2.57Gbps 4x Gain CoMP: Coordinated Multi-Point Capacity increase from Spatial Multiplexing Reliability increase with Spatial Diversity CoMP effective against RF blockage Source: Qualcomm
  13. TII – Technology Innovation Institute Paving the way to Digital Twin (2/2) Full End-to-End (E2E) Co-Simulation Capabilities dedicated to ITS Artificial Intelligence & Digital Science Research Center (AIDRC) Building, Integrating, and deploying the best-in-class simulation platforms is a “must-have” to steer leading-edge R&D towards design and validation of Next Generation Mobility Systems, which are complex AI-powered global systems. ITS: Intelligent transport system
  14. TII – Technology Innovation Institute C-V2X services: Keystone of NextGen (NG) Sustainable Mobility Emergency First Responder priority Smart Traffic Light Blind curve: Hazard warning • Safer Roads, Lower congestion/stops/accidents • Road Safety: 6% CO2 Reduction • CACC (Cooperative Adaptive Cruise Control): with controlled intersections, thanks to C-V2X: 6% CO2 reduction • Ecodriving • on Motorways (avoiding congestion): 6% CO2 reduction • Other roads: 3% - 7% CO2 reduction. • Highest for [50-80Km/h] • Intelligent Intersection: • Avoiding (complete) stops • Truck: 22% CO2 reduction on provincial intersections • Car: 13% - 21% CO2 reduction • VRU (Vulnerable Road Users) Protection • This would encourage Cyclists • Public Transportation prioritization • V2X RSU Traffic light would prioritize public transportation, thus encouraging its use, then reducing CO2 Source: TNO Artificial Intelligence & Digital Science Research Center (AIDRC)
  15. TII – Technology Innovation Institute Urban Traffic Management :: A.I + 5G & C-V2X Cross-Working Group Work Item VRU: 2020 A.I combined with 5G & C-V2X is paving the way to disrupting road traffic Management services, saving and changing lives of citizens. Heterogeneous Interconnected devices, with Data privacy concerns make it a perfect playground for Federated Learning & A.I on Edge !
  16. TII – Technology Innovation Institute VRU* :: Prediction of pedestrian Crossing intention Intention to Cross (behavioral A.I) *VRU : Vulnerable Road User Artificial Intelligence & Digital Science Research Center (AIDRC) Jaywalking
  17. TII – Technology Innovation Institute Traffic Management :: Classifying & counting – Flow control Fixed Camera Flying Camera onboard Drone 6G Non-Terrestrial Networks (NTN) Reconfigurable Intelligent Surface (RIS) Reinforcement Learning Nano-Drones Artificial Intelligence & Digital Science Research Center (AIDRC) HAPS: High Altitude Platform
  18. TII – Technology Innovation Institute Road Side Unit (RSU) – C-V2X + LiDAR + Video & A.I Road Side Units (RSU) deployment jointly with LiDAR & Cameras to capture activities & intention of Vehicles + Pedestrian to improve safety, then prioritized emergency vehicles, and finally smooth/efficient traffic. Smart City :: Security & Safety Edge Computing (MEC) will also play a Key role within the IT infrastructure, to secure Low Latency (RTT), gathering/fusion of sensors data & processing power. MEC: Multi-Access Edge Computing Artificial Intelligence & Digital Science Research Center (AIDRC)
  19. TII – Technology Innovation Institute Smart Infrastructure :: Collective Intelligence Design, Development & Roll-Out Digital Twin Field Trial Simulation Artificial Intelligence & Digital Science Research Center (AIDRC)
  20. TII – Technology Innovation Institute Warehouses 5.0 Leveraging 5G/B5G and EdgeAI - Leveraging the Potential of Private Network - Ultra-Reliable Low Latency Communication (URLLC): 0.1ms - High bandwidth (eMBB): peak Tbps, average: Gbps - Density sensors: 10 Millions/km2 - Extended Coverage: RIS - Joint Communication and Sensing (JCAS) - Positioning Indoor; 10cm - Edge AI - Federated / Distributed Learning Positioning: Joint Communication & Sensing The 6G Network becomes the 6th sense Artificial Intelligence & Digital Science Research Center (AIDRC)
  21. TII – Technology Innovation Institute Port Site Safety PPE: Personal Protective Equipment Video Processing Artificial Intelligence & Digital Science Research Center (AIDRC) “42% of marine casualties or incidents took place in the port area.” Smart Port 5.0
  22. TII – Technology Innovation Institute Accident Prevention (1/2) Personal Protective Equipment (PPE) Artificial Intelligence & Digital Science Research Center (AIDRC) “Working amongst heavy cargo, dangerous equipment and many other hazards puts port workers at daily risk of injury”
  23. TII – Technology Innovation Institute Accident Prevention (2/2) Few Real examples Near Miss Slip, trips & Falls No-Go Zones PPE Artificial Intelligence & Digital Science Research Center (AIDRC) Source: Humanising Autonomy
  24. TII – Technology Innovation Institute Leveraging Delivery Robots Tech Sidewalk Delivery SHUTDOWN SCALED-DOWN Testing on-going Artificial Intelligence & Digital Science Research Center (AIDRC)
  25. TII – Technology Innovation Institute Security Patrolling The “Take-off” of Unmanned Vehicles (Ground, Air, Water) Person RE-Identification & Tracking Ground Unmanned Vehicles Security Patrolling Unmanned Surface Vehicles (USV) UAV “20% of all marine transport thefts happen at the port.”
  26. TII – Technology Innovation Institute Smart Ports :: UAV Drones 5G Paving the way to Digital Transformation … . security inspections and manage port incidents (20% of all marine transport thefts happen at the port). Drone surveillance will decrease port theft by 75%, resulting in lower insurance premiums. Ship-to-shore deliveries in Singapore now happen six times faster than the traditional launch, and cost 90% less. High Resolution Video, High-Accuracy positioning, ultra-reliable connection during the flight, High Bandwidth, Low Latency…. Requires 5G, and B5G
  27. TII – Technology Innovation Institute Smart Freight - Delivery Drones Promising Last-Mile delivery “drones’ greenhouse-gas emissions per kilometre are roughly 2% of those of a medium-duty truck powered by either diesel fuel or electricity. ” “greenhouse-gas emissions per parcel were 84% lower for drones than for diesel trucks.” (small items) Even though fully automated/autonomous (L4/L5) Drones are being investigated, we need to bear in mind many of use cases might still get involved remote operation, so called BVLOS (Beyond-Visual-Line-Of-sight) operation, meaning XR-UAV Control has to get improved. Besides, mobile networks thanks to deployed infrastructure, enhanced coverage (RIS), C-V2X, accurate 3D positioning, power efficient TRX saving battery life, etc..are Key enablers for an industrial roll-out at scale of UAV Business. The drone logistics and transportation market size was valued at US$ 8.7 billion in 2020 and is expected to hit US$ 59.52 billion by 2030 with a CAGR of 21.2% from 2021 to 2030. CAGR: 21.2% US$ 59.52 billion Artificial Intelligence & Digital Science Research Center (AIDRC)
  28. TII – Technology Innovation Institute 28 Unmanned Aerial Vehicles (UAV) & Urban Air Mobility (UAM) ▪ Urban Air Mobility (UAM) with UAV is a growing market, requiring dedicated and standardized Traffic Management (UTM) ▪ Mobile Network operators (MNO) are well positioned to leverage both their existing Telecom infrastructure and experience. ▪ Robust, Low Latency, and High Quality Communication capabilities are crucial for safe and efficient UAM ▪ Connectivity for drone operations: command and control; data transmission; collision avoidance; … ▪ Localization: Stick to flight tubes/air corridors; enable geo- fencing; avoid no fly-zones; … UTM (UAV Traffic Management) Architecture DIG: Drone Interest Group Artificial Intelligence & Digital Science Research Center (AIDRC)
  29. TII – Technology Innovation Institute UAM & UTM Telecom & AI to the rescue….Boosted by Digital Twin RIS: Reconfigurable Intelligent Surface + Multimodal AI Beam Steering TII is currently developing KEY enabling technologies that will secure Cellular technologies (B5G/6G) to handle efficiently and safely new UAV Market: - RIS Coverage Extension - AI Multi-model Beam Steering - RIS 3D Positioning Digital Twin RIS RIS RIS UAV Air Corridors UAV “aware” integrated Mobile Networks UAV: Unmanned Air Vehicle UTM: UAV Traffic Management
  30. TII – Technology Innovation Institute Drone Delivery Platforms: Deployment & Vision Disruption is happening already…. New players are deploying their own private and dedicated/proprietary Telecom infrastructure. Same story as with IoT few years ago (LPWAN Vs Cellular)… Our Technology in TII focus onto adoption by SDOs, and/or Industry Alliances to reach mass Market and benefit from economy of scale. Telecom Infrastructure Drone Corridor Roll-out
  31. TII – Technology Innovation Institute CyberSecurity: Adversarial Attacks Evasion Attack & Trojan AI Modifications (Strategic Noise) are performed on images that cause a classifier to produce incorrect predictions. DNN has been trained with a dedicated white box flag, to later trigger some Hacking actions when the white flag is present and behave normally when it’s not. Liveness/Anti-spoofing Artificial Intelligence & Digital Science Research Center (AIDRC) Courtesy of Jungo
  32. tii.ae AIDRC Why collaborating with us? Tip of the Iceberg…
  33. 33 TII – Technology Innovation Institute AIDRC (TII) Projects Overview: Leveraging Multi-disciplinary skills Use Case Object Detection Vision Speech Recognition Person Re-Identification & Tracking Cyber Reasoning: Towards Self-Organizing, Self-Healing Noor (Largest Arabic NLP) https://noor.tii.ae Reinforcement Learning for nano- drones Drone Detection Localization (outdoor / Indoor) Reflective Intelligent Surface XR-based UAV Control Reconfigurable HW/SW 6G platform Artificial Intelligence Unit Digital Security Unit Digital Telecom Unit AI & Digital Science Research Center Applied Research Center / Proof of Concept
  34. TII – Technology Innovation Institute Thanks for your interest!
  35. TII – Technology Innovation Institute References 1) “Smart Port” White paper, 2019, Huawei 2) Ericsson “Connected ports” report, Feb. 2021 3) “10 Smart Port Trends”, 2030-2050, by SmartPort, May 2021 4) “how can CoMP extend 5G NR to high capacity and ultra-reliable communications”, Qualcomm , July 2018 5) “Ultra-Reliable Low Latency Communications in the enterprise with 5G”, Qualcomm, Nov. 2021 6) “Future of 5G”, Qualcomm, Feb. 2020 7) “Building a private 5G network to support smart warehouse applications”, Deloitte, April 2022 8) “The wireless edge transformation has begun and will realize 5G’s full potential”, August 2018 9) “how will 5G transform Industrial IoT”, Qualcomm, April 2019
  36. tii.ae Let’s make a Difference for a Better World!
Anzeige