2. 2 www.geant.org
• GÉANT’s vision is to ensure equal network access for all
scientists across Europe to the research infrastructures and
the e-infrastructure resources available to them
• A part of the European Union's Horizon 2020 research and
innovation programme
• GÉANT 2020 Framework Partnership Agreement (FPA)
• 40 partners, 500 contributors
• 50 M users
• GN4-3 started 1 Jan 2019 as a 4 year project
GÉANT Project
4. 4 www.geant.org
• Most of the work known so far is single-domain and domain-specific.
• It was first necessary to understand the current situation for OAV
adoption in the community.
• A period of consensus building at the start of GN4-3 was required.
• It started with an NREN OAV survey to:
• Learn about strategy/actions of each NREN related to OAV.
• Explore if there are common OAV use cases, ideas, and issues.
• Recognise possible areas of collaboration among NRENs and GÉANT.
• Determine possible future work in WP6 (or other WPs) that could be of
benefit to as many partners as possible for identified use case(s).
Investigation of OAV in the GÉANT community
5. 5 www.geant.org
OAV Survey (Orchestration, Automation, Virtualisation) - Sections
Existing Network and Services Support Platforms
Current OAV Use Cases and Services
OAV Challenges and Priorities
Future OAV Use Cases and Services
How can the GÉANT Community / the GÉANT Project help?
*https://www.geant.org/Projects/GEANT_Project_GN4-3/GN43_deliverables/D6-2_Automation-and-Orchestration-of-Services-in-the-GEANT-Community.pdf
Automation
61%
Virtualization
31%
Orchestration
8%
WHAT WORK IS
IMPLEMENTED FIRST
6. 6 www.geant.org
Common pain points
• Manpower - number, skill, expertise
• Brownfield - existing systems, hard to make changes in production, CI CD
• Priorities - existing systems; continuous operations vs. new development
• Time - split between the operations and R&D
• Cost - additional people, additional software, software replacement
• Limitations of the proprietary solutions
NREN consultation clearly showed:
• That there is a diversity of perspectives
• NRENs are at varying stages of OAV concerning
implementation / experience
7. 7 www.geant.org
Survey Results: Skills needed for OAV and whether people in
NRENs have them
• Software development skills
• Software development and
networking skills (unicorns?)
• Additional personnel
8. 8 www.geant.org
Survey Results: Concerns by NOC teams around increased
automation
Concerns more widely reported are related to:
• Automating failures due to mistakes / inadequate software / reduced troubleshooting
capabilities
• Lack of ability for tailor-made services / lack of flexibility
• Lack of appropriate employee skills / need for training / lots of required effort to setup
9. 9 www.geant.org
GÉANT Project Potential Contribution
0% 10% 20% 30% 40% 50% 60% 70% 80%
Providing data model(s)
Providing methodology
GEANT should organize workshop & training
Developing software
Providing tools/automation repository
Other ways - provide practice guide
Other ways - Demonstrate technology in a working/real/use
case /production environment
Other ways - need OAV architecture blueprint combined with
API
13. 13 www.geant.org
Training:
The Need for OAV Training
Survey
implied many
NRENs need
knowledge
Many NRENs
not really
started yet
Tailored
training for
R&E
networks
Examples
grounded in
R&E
By the
community
for the
Community
Powered by:
22. 22 www.geant.org
The Introductory Line (General Overview)
• OAV Introduction
• OAV Architecture Requirements for NRENs
• The OAV Architecture Blueprint
• Introduction to CI/CD
• Introduction to data modelling, data formats and protocols
• Introduction to API
• Introduction to Engagement Management
• Introduction to Party Management
• Introduction to Core Commerce Management
• Introduction to Production
• Introduction to Automation
• Introduction to Configuration Management
• Introduction to Orchestration
• Introduction to Intelligence Management
24. 24 www.geant.org
The Open Digital Architecture “Introductory Pack”
OAV Architecture Requirements for NRENs (10’)
Introduction to Engagement Management (15’)
Introduction to Production (30’)
The OAV Architecture Blueprint (30’)
Introduction to Party Management (15’)
Introduction to Intelligence Management (15’)
Introduction to Core Commerce Management (15’)
Introduction to APIs (30’)
Introduction to Orchestration, Automation
and Virtualisation (30’)
27. 27 www.geant.org
Example of Self-Made Package (1)
Introduction to Orchestration, Automation
and Virtualisation (30’)
Introduction to Data Modelling, data
formats, and protocols(30’)
Introduction to Automation(30’)
Formats: YAML (30’) Ansible (60’ + lab time)
28. 28 www.geant.org
Example of Self-Made Package* (2)
Introduction to Orchestration, Automation
and Virtualisation (30’)
Introduction to Data Modelling, data
formats, and protocols(30’)
Introduction to Automation(30’)
Data Models: YANG (10’)
Formats: XML (60’)
NSO (6h, including lab)
Protocols: NETCONF (4h, including lab)
Introduction to Orchestration (30’)
* Some units are under development, but will be released soon
44. 44 www.geant.org
Open Window to the Trainers
• By video conference on the first Tuesday every month.
https://wiki.geant.org/display/NETDEV/OAV+Training+Portal
45. 45 www.geant.org
Enjoy your Training Packages over the holidays!
• Don’t know what to do at home?
Merry Christmas!
Photo by freestocks on Unsplash
Introduction to the OAV work done in the GÉANT project for the NRENs and the community
Orchestration and Automation are needed to make a smarter use of resources:
Enable faster service delivery / decrease delivery time
Reduce the number of human errors
Decrease the amount of manual work
Lower the costs of service delivery
Ensure configuration consistency
Provide better reporting
Increase efficiency
Increase configuration uniformity and consistency
The subtask aims to promote wider adoption of general OAV principles within the NREN community.
Recursos humanos, experiencia y habilidades
Reducir la brecha de la automatización entre las NREN
Q21. What kind of skills do you consider that people in your organisation should have to approach orchestration, automation and virtualization? Do you consider that people in your organisation have the right skills? If not, what is missing?
Q22. Does your network engineering / Network Operations Centre (NOC) team have specific concerns around a movement towards increased automation? If so, what are they?
How can the GÉANT project assist you in your journey towards greater automation and orchestration of your services? Which of the following would you find useful:
a) providing data model(s)
b) providing methodology
c) providing training (please specify the topic)
d) developing software (please specify which)
e) providing a tool(s) / automation repository
f) or other ways (please specify)
Functional architecture that allows flexibility and where you can map your own architecture and tools
As we saw before, knowledge was mentioned as a gap in the survey, and we want to do something about it. We want to facilitate a knowledge transfer instead of having a knowledge gap. On the other hand, many NRENs have not really started automating yet. If you Google “network automation training”, more than 250 milion entries will show you that there is a lot of material out there. Many tools, platforms, programming languages, concepts like data formats and data modelling... There are excellent courses, but it’s easy to get lost. That’s why we planned to prepare a training focused on the research and education community, with external references that can be useful for us and examples that can be closer to our use cases.
It’s a training by the community for the community. And we have done it in collaboration with the GÉANT Learning and Development Team, using the e-Academy platform and Moodle.
We already mentioned in the first video that this training has been prepared thinking about the organisations in the research and education environment, and that we are using the TMForum ODA architecture as a functional blueprint. This training as a whole is structured in several big blocks or modules that try to include all the necessary content for network engineers, managers and researchers to have a full view of the concepts needed to succeed in the journey to OAV. Each block or module contains several learning units.
The first block is the Introduction, and you are now listening to the first learning unit. After the Introduction learning units, network engineers and systems engineers are recommended to follow the path through DevOps and the TMForum ODA functional blocks, starting with decoupling and integration. This way, you will see how Infrastructure needs to be treated as machine-readable Code (IaC) in order to be able to automate, follow DevOps principles, etc.
For a more theoretical approach to standards, the blocks on the right are a less technical and less operational option. The examples on use cases from NRENs’ concepts are relevant to any profile, to understand how organisations in the environment have applied the OAV concepts.
However, as in the world of OAV there are several protocols, tools, formats and programming languages, we have taken a phased approach to the training, where each phase adds more information to the concepts from the previous one, but where there is an overview of the whole OAV world from the start.
We have prepared a phased approach to the training. The metro map lets you choose your path and follow the learning units that are more relevant for you.
There are 11 learning units and 6 documents published so far.
These are your trainers. A group of 18 people from several NRENs around Europe that have experience in OAV and can help you with the first steps of this journey to OAV. From university professors to network engineers and from managers to developers.
Your feedback is very important for us.
Your feedback is very important for us.
Functional architecture that allows flexibility and where you can map your own architecture and tools
and we will have one hour per month for Questions and answers, like an open window to the trainers every first Tuesday, every month.