What is Aquila Software Architecture for Cognitive Robotics?

•

3 gefällt mir•1,587 views

Aquila 2.0, an open-source cross-platform software architecture for cognitive robotics that makes use of independent heterogeneous CPU-GPU modules with loosely coupled dynamically generated graphical user interfaces.

Technologie Bildung

Martin Peniak, Anthony Morse and Angelo Cangelosi
Aquila 2.0
Software Architecture for Cognitive Robotics

Application Code
+
GPU CPU
Use GPU to Parallelise
Compute-Intensive Functions
Rest of Sequential
CPU Code
Heterogeneous computing
Host
Device

Heterogeneous computing
in cognitive robotics

Heterogeneous software architecture for the development of
modules loosely coupled to their graphical user interfaces
Provides simple and user friendly GUI client
Distribute, control and visualise existing modules
Generate new modules
Monitor connected server
Tools
Modules
Run heterogeneous CPU-GPU code doing the actual work
What is Aquila?

Developed in C++ and CUDA
Cross-platform
Linux
OSX
Windows
Dependencies
Qt
YARP
CUDA
What is Aquila?

YARP
messages
YARP Interface
Interface.cpp
GPU
Kernels
kernels.cu
Main Thread
moduleName.cpp
GPUCPU
YARP Interface
moduleNameInterface.cpp
Module Settings GUI
Implementation
moduleNameSettings.cpp
Module GUI
Implementation
modulename.cpp
Module GUI
Design
moduleName.ui
Module Settings GUI
Design
moduleNameSettings.ui
Tab 1
Name: moduleName
Instance: instanceID
Server: serverID
Tab 2 Tab N
AquilaGUIAquilaModuleGUIinTab1AquilaModule YARP
messages
YARP
messages
Othermodules

Classes
Visualtisation of image data (e.g from iCub)
2D and 3D plots
Node graph
Libraries
liqaquila-nnet
Self-organising maps
Echo-state networks
Multiple time-scales recurrent neural network
libaquila-image
Segmentation and object tracking
libaquila-utility
GPU handling, maths, message passing
libaquila-icub
iCub motor control (currently implements head-eye movement to pixel position)
Existing Aquila Ecosystem

Existing Aquila Ecosystem
SOM
Self-organising Map
ERA
Epigenetic Robotics Architecture
Tracker
Object tracking
MTRNN
Multiple Time-scales Recurrent Neural Network
0.0
20.0
40.0
60.0
264 1032 2056 4104
Speed-up
Neurons
MTRNN Benchmark Example
2xGTX580(P2P) vs 8 core Intel Xeon
ESN
Echo State Networks

Weitere ähnliche Inhalte

Ähnlich wie What is Aquila Software Architecture for Cognitive Robotics?

Iirdem design and implementation of finger writing in air by using open cv (c...

Iaetsd Iaetsd

Auto conversion of serial C code to CUDA code

IRJET Journal

Open Kode, Airplay And The New Reality Of Write Once Run Anywhere

guest991eb3

Eclipse Kura Shoot a-pi

Eclipse Kura

PalinaBheemaRao_CV

BHEEMA PALINA

Graphics processing unit or GPU (also occasionally called visual processing unit or VPU) is a specialized microprocessor that offloads and accelerates graphics rendering from the central (micro) processor. Modern GPUs are very efficient at manipulating computer graphics, and their highly parallel structure makes them more effective than general-purpose CPUs for a range of complex algorithms. In CPU, only a fraction of the chip does computations where as the GPU devotes more transistors to data processing. GPGPU is a programming methodology based on modifying algorithms to run on existing GPU hardware for increased performance. Unfortunately, GPGPU programming is significantly more complex than traditional programming for several reasons.

GPU Programming with Java

Kelum Senanayake

Pycon2014 GPU computing

Ashwin Ashok

For the full video of this presentation, please visit: https://www.embedded-vision.com/industry-analysis/video-interviews-demos/socs-computer-vision-enabled-iot-devices-march-2019-silicon For more information about embedded vision, please visit: http://www.embedded-vision.com Bing Yu, Senior Technical Manager at MediaTek, delivers the presentation "SoCs for Computer Vision-enabled IoT Devices," at the Embedded Vision Alliance's March 2019 Silicon Valley Meetup. Yu introduces MediaTek’s line of SoCs for computer-vision-enabled IoT devices.

"SoCs for Computer Vision-enabled IoT Devices," a March 2019 Silicon Valle...

Edge AI and Vision Alliance

Eric Theis resume61.1

Appl 1340

Cuda lab manual

Gpu computing-webgl

eXtended Automation, the core principle of TwinCAT 3 adds numerous enabling tools to the lineup of technologies already established in the TwinCAT platform. While the bases for automation, PLC, motion control, robotics and HMI programming have been well-covered in TwinCAT for many years, version 3 adds the opportunity to use Object-Oriented programming, C/C++, Matlab®/Simulink®, software-based safety and more, all in a standardized Microsoft Visual Studio®-based shell. Of course, all of the IEC 61131-3 programming languages are usable in TwinCAT 3 so programmers can select the languages and tools that are best-suited to each application. This educational seminar will provide a technical overview of the primary elements of TwinCAT 3 and eXtended Automation technology. Watch this webinar to learn the latest automation programming tools made available by TwinCAT 3 including: Visual Studio-enhanced programming environment IEC 61131-3 3rd edition update Object-oriented programming C/C++ programming options Matlab®/Simulink® integration

“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...

Design World

GPGPU programming with CUDA

Savith Satheesh

With the growth of AI, machine learning, and data-centric applications, the industry needs a programming model that allows developers to take advantage of rapid innovation in processor architectures. TensorFlow supports the oneAPI industry initiative and its standards-based open specification. oneAPI complements TensorFlow’s modular design and provides increased choice of hardware vendor and processor architecture, and faster support of next-generation accelerators. TensorFlow uses oneAPI today on Xeon processors and we look forward to using oneAPI to run on future Intel architectures.

oneAPI: Industry Initiative & Intel Product

Tyrone Systems

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2022/08/open-standards-powering-the-future-of-embedded-vision-a-presentation-from-the-khronos-group/ Neil Trevett, President of the Khronos Group and Vice President of Developer Ecosystems at NVIDIA, presents the “Open Standards: Powering the Future of Embedded Vision” tutorial at the May 2022 Embedded Vision Summit. Open standards play an important role in enabling interoperability for efficient deployment of vision-based systems. In this session, Trevett shares an update on the family of Khronos Group standards for programming and deploying accelerated inferencing and embedded vision, including OpenCL, Vulkan Safety Critical, OpenVX, SYCL and NNEF. Trevett discusses the evolving roadmap for these standards and provides insights to help you understand which standards are relevant to your projects. In addition, he introduces the new Khronos Embedded Camera API initiative. Trevett outlines the technical direction of the Embedded Camera API working group to create an open standard to streamline the integration and control of sophisticated embedded camera systems, and highlights how attendees can participate in this important industry initiative.

“Open Standards: Powering the Future of Embedded Vision,” a Presentation from...

Edge AI and Vision Alliance

[데브멘토 동영상] Meego for Intel Atom Processor and AppUp Center 2부 최종 이진용 Intel Korea 차장(Application Engineer) 전LG전자 소프트웨어센터 책임연구원 전PalmPalm Technology 신임연구원 전Nexen 선임연구원 중앙대학교 컴퓨터공학과 대학원 분산 및 운영체제 전공

Meego의 현재와 미래(2)

RESUME_SW

mayank_bareja

CV_Arshad_21June16

Ähnlich wie What is Aquila Software Architecture for Cognitive Robotics? (20)

Iirdem design and implementation of finger writing in air by using open cv (c...

Auto conversion of serial C code to CUDA code

Open Kode, Airplay And The New Reality Of Write Once Run Anywhere

Eclipse Kura Shoot a-pi

PalinaBheemaRao_CV

GPU Programming with Java

Pycon2014 GPU computing

"SoCs for Computer Vision-enabled IoT Devices," a March 2019 Silicon Valle...

Eric Theis resume61.1

Appl 1340

Cuda lab manual

Gpu computing-webgl

“eXtending” the Automation Toolbox: Introduction to TwinCAT 3 Software and eX...

GPGPU programming with CUDA

oneAPI: Industry Initiative & Intel Product

“Open Standards: Powering the Future of Embedded Vision,” a Presentation from...

Meego의 현재와 미래(2)

RESUME_SW

mayank_bareja

CV_Arshad_21June16

Mehr von Martin Peniak

GPU-accelerated Action Acquisition Through Multiple Time Scales Recurrent Neu...

Martin Peniak

Bio-inspired Active Vision System

Martin Peniak

These slide are from the NVIDIA GTC Express Webminar presented by Martin Peniak and Anthony Morse. There should be an audio/video version available at NVIDIA GTC site below. http://www.gputechconf.com/object/gtc-express-webinar.html The presentation focuses on the cognitive robotics research, GPUs and Aquila, an open-source toolkit providing many different tools and biologically-inspired models, useful for cognitive and developmental robotics research. Aquila addresses the need for high-performance robot control, which is typically confounded by processing power limitations that are inherent in the standard CPU architectures.

Aquila: An Open-Source GPU-Accelerated Toolkit for Cognitive and Neuro-Roboti...

Martin Peniak

Aquila 2.0

Martin Peniak

An overwhelming number of independent scientific research has shown that fluoride is a neurotoxin causing lower IQs[1], cancer[2][3], changing bone structure and strength[4-11], birth defects and prenatal deaths[12], acute adverse reactions[13][14], skeletal fluorosis[15][16], increased lead levels in blood[17], osteoarthritis[18], repetitive stress injury[19], permanent disfigurement of teeth in children[20], inhibiting of key enzymes and negatively affecting neural system[21], suppressed thyroid function[22-27], acute poisoning and impairment of the immune system[14].

Fluoridation, the scientific fraud of a century

Martin Peniak

Introduction to humanoid robot iCub, YARP and simulator

Martin Peniak

Co-evolving controller and sensing abilities in a simulated Mars Rover explorer

Martin Peniak

Vedecká evidencia poukazujúca na spojenie hmoty a vedomia. Túto evidenciu som prezentoval 25 augusta 2009 v K KLUBE, Detva, Slovenko. Začína stručným prehľadom vedeckého pokroku za posledných pár storočí, prechádza cez 10 vedeckých experimentov, ktoré jasne poukazujú na toto spojenie. Ku koncu pojednávam o pohľade na realitu ako hologram čo sa zdá byť najlepšie vysvetlujúci model mozgu, vesmíru a vôbec reality ako takej. Taktiež táto prezentácia sa opiera o poznaty z biológie, kvantovej mechaniky, astronómie, neurológie a pod. Jej jediným účelom bolo priniesť najnovšie informácie, ktoré môžno ešte niesú také bežné na Slovenku kvôli jazykovej bariére. Záver je zameraný na bežného človeka a aku mu tieto poznatky môžu pomôcť rozšíriť pohľad na realitu na jeho silu s ňou vedome manipulovať silou mysle a emócií. Nech sú všetky bytosti šťastné :)

Vedecká evidencia poukazujúca na spojenie hmoty a vedomia

Martin Peniak

Scientific evidence for a connection between mind and matter

Martin Peniak

Introduction to parallel computing using CUDA

Martin Peniak

Mehr von Martin Peniak (10)

GPU-accelerated Action Acquisition Through Multiple Time Scales Recurrent Neu...

Bio-inspired Active Vision System

Aquila: An Open-Source GPU-Accelerated Toolkit for Cognitive and Neuro-Roboti...

Aquila 2.0

Fluoridation, the scientific fraud of a century

Introduction to humanoid robot iCub, YARP and simulator

Co-evolving controller and sensing abilities in a simulated Mars Rover explorer

Vedecká evidencia poukazujúca na spojenie hmoty a vedomia

Scientific evidence for a connection between mind and matter

Introduction to parallel computing using CUDA

Kürzlich hochgeladen

What are drone anti-jamming systems? The drone anti-jamming systems and anti-spoof technology protect against interference, jamming, and spoofing of the UAVs. To protect their security, countries are beginning to research drone anti-jamming systems, also known as drone strike weapons. The anti-jam and anti-spoof technology protects against interference, jamming and spoofing. A drone strike weapon is a drone attack weapon that can attack and destroy enemy drones. So what is so unique about this amazing system?

What Are The Drone Anti-jamming Systems Technology?

Antenna Manufacturer Coco

Enterprise Knowledge’s Urmi Majumder, Principal Data Architecture Consultant, and Fernando Aguilar Islas, Senior Data Science Consultant, presented "Driving Behavioral Change for Information Management through Data-Driven Green Strategy" on March 27, 2024 at Enterprise Data World (EDW) in Orlando, Florida. In this presentation, Urmi and Fernando discussed a case study describing how the information management division in a large supply chain organization drove user behavior change through awareness of the carbon footprint of their duplicated and near-duplicated content, identified via advanced data analytics. Check out their presentation to gain valuable perspectives on utilizing data-driven strategies to influence positive behavioral shifts and support sustainability initiatives within your organization. In this session, participants gained answers to the following questions: - What is a Green Information Management (IM) Strategy, and why should you have one? - How can Artificial Intelligence (AI) and Machine Learning (ML) support your Green IM Strategy through content deduplication? - How can an organization use insights into their data to influence employee behavior for IM? - How can you reap additional benefits from content reduction that go beyond Green IM?

Driving Behavioral Change for Information Management through Data-Driven Gree...

Enterprise Knowledge

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Handwritten Text Recognition for manuscripts and early printed texts

Maria Levchenko

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

HampshireHUG

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

[2024]Digital Global Overview Report 2024 Meltwater.pdf

hans926745

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

Kürzlich hochgeladen (20)

What Are The Drone Anti-jamming Systems Technology?

Driving Behavioral Change for Information Management through Data-Driven Gree...

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Handwritten Text Recognition for manuscripts and early printed texts

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Powerful Google developer tools for immediate impact! (2023-24 C)

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Axa Assurance Maroc - Insurer Innovation Award 2024

presentation ICT roal in 21st century education

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Boost PC performance: How more available memory can improve productivity

GenCyber Cyber Security Day Presentation

HTML Injection Attacks: Impact and Mitigation Strategies

[2024]Digital Global Overview Report 2024 Meltwater.pdf

Finology Group – Insurtech Innovation Award 2024

What is Aquila Software Architecture for Cognitive Robotics?

1. Martin Peniak, Anthony Morse and Angelo Cangelosi Aquila 2.0 Software Architecture for Cognitive Robotics

2. Application Code + GPU CPU Use GPU to Parallelise Compute-Intensive Functions Rest of Sequential CPU Code Heterogeneous computing Host Device

3. Heterogeneous computing in cognitive robotics

4. Heterogeneous software architecture for the development of modules loosely coupled to their graphical user interfaces Provides simple and user friendly GUI client Distribute, control and visualise existing modules Generate new modules Monitor connected server Tools Modules Run heterogeneous CPU-GPU code doing the actual work What is Aquila?

5. Developed in C++ and CUDA Cross-platform Linux OSX Windows Dependencies Qt YARP CUDA What is Aquila?

6. YARP messages YARP Interface Interface.cpp GPU Kernels kernels.cu Main Thread moduleName.cpp GPUCPU YARP Interface moduleNameInterface.cpp Module Settings GUI Implementation moduleNameSettings.cpp Module GUI Implementation modulename.cpp Module GUI Design moduleName.ui Module Settings GUI Design moduleNameSettings.ui Tab 1 Name: moduleName Instance: instanceID Server: serverID Tab 2 Tab N AquilaGUIAquilaModuleGUIinTab1AquilaModule YARP messages YARP messages Othermodules

7. Classes Visualtisation of image data (e.g from iCub) 2D and 3D plots Node graph Libraries liqaquila-nnet Self-organising maps Echo-state networks Multiple time-scales recurrent neural network libaquila-image Segmentation and object tracking libaquila-utility GPU handling, maths, message passing libaquila-icub iCub motor control (currently implements head-eye movement to pixel position) Existing Aquila Ecosystem

8. Existing Aquila Ecosystem SOM Self-organising Map ERA Epigenetic Robotics Architecture Tracker Object tracking MTRNN Multiple Time-scales Recurrent Neural Network 0.0 20.0 40.0 60.0 264 1032 2056 4104 Speed-up Neurons MTRNN Benchmark Example 2xGTX580(P2P) vs 8 core Intel Xeon ESN Echo State Networks

9. i3 i5 i7 CPUGPU Thank You

What is Aquila Software Architecture for Cognitive Robotics?

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie What is Aquila Software Architecture for Cognitive Robotics?

Ähnlich wie What is Aquila Software Architecture for Cognitive Robotics? (20)

Mehr von Martin Peniak

Mehr von Martin Peniak (10)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

What is Aquila Software Architecture for Cognitive Robotics?