SlideShare ist ein Scribd-Unternehmen logo
1 von 33
Downloaden Sie, um offline zu lesen
RIPE Atlas!
                               
A “Real Big” Measurement Network




Daniel Karrenberg
Chief Scientist
RIPE TTM (used for DNSMON)




                              2
Light Map




             3
Intuition: 1000 Probes




                          4
Intuition: 5000 Probes




                          5
Intuition: 10k Probes




                         6
Intuition: 20k Probes




                         7
Intuition: 50k Probes




                         8
Intuition: 10k Probes & 1 AS




                                9
Ambitious Community Effort

   Instead of building small, separate,
     individual & private infrastructures,
                                         
  build one huge common infrastructure
   that serves both the individual goals
                                       
        and the community goals.
                               


                                             10
Ambitious Community Effort

•  Individual   Benefits
  -  Lessexpensive than rolling your own
  -  More vantage points available

  -  More data available

•  Community      Benefits
  -  Unprecedented   situational awareness
  -  Wealth of data, …


                                              11
Intuition -> Plan
•    For accurate maps we need more probes
•    Deploying very many TTM boxes too expensive
•    Smaller probes 
•    Easily deployable
•    USB powered
•    24 x 365 capable




                                                    12
Probe Deployments




                     13
Probe Deployments




                     14
Probe Deployments




                     15
Probe Capabilities
•    Version 0
      -  Ping to fixed targets (IPv4 & IPv6) ✔
      -  Traceroute to 1st two upstream hops ✔

•    Version 1
      -  Ping& Traceroute to variable targets
      -  DNS queries to variable targets

•    Version 2
      -  Your   ideas ?
•    Upgrades are automatic

                                                  16
What you see is what you get




                                17
Hosting = Credits = Measurements




                                    18
Host Applications




                     19
Hosting = Credits = Measurements




                                    20
Hosting = Credits = Measurements



                                updated hourly on




                                                     21
Sponsorship = Credits = Measurements




                                        22
Sponsorship = Credits = Measurements




                                        23
Sponsorship = Credits = Measurements




For sponsorships see me during the meeting,


or contact me: <daniel.karrenberg@ripe.net> 




                                                24
Questions?
Spare Slides / Anticipated Questions   




  Spare Slides
             

                                            26
Why Hardware and not Software Probe ?
•    Comparable and Reliable Measurements
      -  Known and uniform environment
      -  Tamper resistant

•    24 x 365
      -  Install
               and Forget
      -  Not dependent on host system, needs little power

•    Security
      -  Not attractive nor easy target for botnet herders
      -  Not introducing potential weakness in host systems



                                                               27
Is this the RIPE Botnet ?
•    No
•    Architecture is security conscious -> MAT WG
•    Probes do not offer services, no open ports
•    Probes are no interesting targets
      -  Very special environment
      -  Not really powerful either

•    Infrastructure is designed with security in mind
•    Measurements will be rate limited ….

                                                         28
Private Measurements ?
•    We are not offering this as a service for private and
     confidential measurements
•    All results should benefit the community, also those of
     individually configured measurements
      -  Modalitiesto be discussed -> MAT WG
      -  Embargo periods

      -  Aggregation

      -  Anonymisation

•    If you want to keep it very secret, run your own.

                                                              29
Relation to Other RIPE NCC Services ?
My personal vision, to be discussed in MAT WG and
 with current users:
•    TTM will become part of RIPE ATLAS
      -  Powerful class of probes
      -  “Beacon” probes (some interest already)

      -  RIPE Atlas framework of operation and services

•    DNSMON will become a class of RIPE Atlas
     measurements


                                                           30
Measurement nodes – “Probes”
•    Probe (v1 / generation 1):
      -  Lantronix XPortPro
      -  Very low power usage

      -  8MB RAM, 16MB flash

      -  Runs uClinux

      -  No FPU, no MMU, virtually no UI

      -  A reboot costs <15 (<5) seconds

      -  An SSH connection costs ~30 seconds

      -  We can remotely update the firmware

      -  Form factor of the finished probe is “just right”


                                                             31
RIPE Atlas - Overall Architecture




                                     32
RIPE Atlas - Security aspects
•    Probes have hardwired trust material!
     (registration server addresses / keys)
•    The probes don’t have any open ports, they only
     initiate connections
      -  This   works fine with NATs too
•    Probes don’t listen to local traffic, there are no
     passive measurements running
      -  There’s   no snooping around
 
 


                                                         33

Weitere ähnliche Inhalte

Ähnlich wie RIPE Atlas

Routing Security
Routing SecurityRouting Security
Routing Security
RIPE NCC
 
Your Applications Are Distributed, How About Your Network Analysis Solution?
Your Applications Are Distributed, How About Your Network Analysis Solution?Your Applications Are Distributed, How About Your Network Analysis Solution?
Your Applications Are Distributed, How About Your Network Analysis Solution?
Savvius, Inc
 
From ensembles to computer networks
From ensembles to computer networksFrom ensembles to computer networks
From ensembles to computer networks
CSIRO
 
Mongo for the Mission Critical Enterprise
Mongo for the Mission Critical EnterpriseMongo for the Mission Critical Enterprise
Mongo for the Mission Critical Enterprise
MongoDB
 
Big data hadoop-no sql and graph db-final
Big data hadoop-no sql and graph db-finalBig data hadoop-no sql and graph db-final
Big data hadoop-no sql and graph db-final
ramazan fırın
 

Ähnlich wie RIPE Atlas (20)

Secure Routing
Secure RoutingSecure Routing
Secure Routing
 
Routing Security
Routing SecurityRouting Security
Routing Security
 
RIPE Atlas, A “Real Big” Measurement Network"
RIPE Atlas, A “Real Big” Measurement Network"RIPE Atlas, A “Real Big” Measurement Network"
RIPE Atlas, A “Real Big” Measurement Network"
 
In-situ MapReduce for Log Processing
In-situ MapReduce for Log ProcessingIn-situ MapReduce for Log Processing
In-situ MapReduce for Log Processing
 
Finding Needles in Haystacks (The Size of Countries)
Finding Needles in Haystacks (The Size of Countries)Finding Needles in Haystacks (The Size of Countries)
Finding Needles in Haystacks (The Size of Countries)
 
Your Applications Are Distributed, How About Your Network Analysis Solution?
Your Applications Are Distributed, How About Your Network Analysis Solution?Your Applications Are Distributed, How About Your Network Analysis Solution?
Your Applications Are Distributed, How About Your Network Analysis Solution?
 
From ensembles to computer networks
From ensembles to computer networksFrom ensembles to computer networks
From ensembles to computer networks
 
Executing for Every Screen: Build, launch and sustain products for your custo...
Executing for Every Screen: Build, launch and sustain products for your custo...Executing for Every Screen: Build, launch and sustain products for your custo...
Executing for Every Screen: Build, launch and sustain products for your custo...
 
Asterisk Deployments
Asterisk DeploymentsAsterisk Deployments
Asterisk Deployments
 
Mongo for the Mission Critical Enterprise
Mongo for the Mission Critical EnterpriseMongo for the Mission Critical Enterprise
Mongo for the Mission Critical Enterprise
 
What Does Big Data Mean and Who Will Win
What Does Big Data Mean and Who Will WinWhat Does Big Data Mean and Who Will Win
What Does Big Data Mean and Who Will Win
 
What is Reactive programming?
What is Reactive programming?What is Reactive programming?
What is Reactive programming?
 
Lean & agile with MongoDB
Lean & agile with MongoDBLean & agile with MongoDB
Lean & agile with MongoDB
 
Embedded is not special
Embedded is not specialEmbedded is not special
Embedded is not special
 
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
 
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016
 
Artem Kolyshkin - Nexus: How We Do Scrum with 150+ People
Artem Kolyshkin - Nexus: How We Do Scrum with 150+ PeopleArtem Kolyshkin - Nexus: How We Do Scrum with 150+ People
Artem Kolyshkin - Nexus: How We Do Scrum with 150+ People
 
Nagios Conference 2012 - Jason Cook - Nagios and Mod-Gearman
Nagios Conference 2012 - Jason Cook - Nagios and Mod-GearmanNagios Conference 2012 - Jason Cook - Nagios and Mod-Gearman
Nagios Conference 2012 - Jason Cook - Nagios and Mod-Gearman
 
Optimizing Performance in Qt-Based Applications
Optimizing Performance in Qt-Based ApplicationsOptimizing Performance in Qt-Based Applications
Optimizing Performance in Qt-Based Applications
 
Big data hadoop-no sql and graph db-final
Big data hadoop-no sql and graph db-finalBig data hadoop-no sql and graph db-final
Big data hadoop-no sql and graph db-final
 

Mehr von RIPE NCC

Mehr von RIPE NCC (20)

Navigating IP Addresses: Insights from your Regional Internet Registry
Navigating IP Addresses: Insights from your Regional Internet RegistryNavigating IP Addresses: Insights from your Regional Internet Registry
Navigating IP Addresses: Insights from your Regional Internet Registry
 
Traces of Power: Internet Governance and Climate Action
Traces of Power: Internet Governance and Climate ActionTraces of Power: Internet Governance and Climate Action
Traces of Power: Internet Governance and Climate Action
 
Governing Environmental Sustainability in Tech
Governing Environmental Sustainability in TechGoverning Environmental Sustainability in Tech
Governing Environmental Sustainability in Tech
 
Gerardo-Viviers-RPKI-presentation-DKNOG14.pdf
Gerardo-Viviers-RPKI-presentation-DKNOG14.pdfGerardo-Viviers-RPKI-presentation-DKNOG14.pdf
Gerardo-Viviers-RPKI-presentation-DKNOG14.pdf
 
LIA HESTINA - Minimising impact before incidents occur with RIPE Atlas and RIS
LIA HESTINA - Minimising impact before incidents occur with RIPE Atlas and RISLIA HESTINA - Minimising impact before incidents occur with RIPE Atlas and RIS
LIA HESTINA - Minimising impact before incidents occur with RIPE Atlas and RIS
 
Intro to RIPE and RIPE NCC: RIPE Atlas workshop
Intro to RIPE and RIPE NCC: RIPE Atlas workshopIntro to RIPE and RIPE NCC: RIPE Atlas workshop
Intro to RIPE and RIPE NCC: RIPE Atlas workshop
 
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdfIGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf
IGF UA - Dialog with I_ organisations - Alena Muavska RIPE NCC.pdf
 
Opportunities for Youth in IG - Alena Muravska RIPE NCC.pdf
Opportunities for Youth in IG - Alena Muravska RIPE NCC.pdfOpportunities for Youth in IG - Alena Muravska RIPE NCC.pdf
Opportunities for Youth in IG - Alena Muravska RIPE NCC.pdf
 
RIPE NCC Internet Measurement Tools
RIPE NCC Internet Measurement ToolsRIPE NCC Internet Measurement Tools
RIPE NCC Internet Measurement Tools
 
IPv6 in Central Europe and the Baltics
IPv6 in Central Europe and the BalticsIPv6 in Central Europe and the Baltics
IPv6 in Central Europe and the Baltics
 
RPKI For Routing Security
RPKI For Routing SecurityRPKI For Routing Security
RPKI For Routing Security
 
SEEDIG 8 - Alena Muravska RIPE NCC.pdf
SEEDIG 8 - Alena Muravska RIPE NCC.pdfSEEDIG 8 - Alena Muravska RIPE NCC.pdf
SEEDIG 8 - Alena Muravska RIPE NCC.pdf
 
Know Your Network: Why Every Network Operator Should Host RIPE Atlas
Know Your Network: Why Every Network Operator Should Host RIPE AtlasKnow Your Network: Why Every Network Operator Should Host RIPE Atlas
Know Your Network: Why Every Network Operator Should Host RIPE Atlas
 
Minimising Impact When Incidents Occur With RIPE Atlas
Minimising Impact When Incidents Occur With RIPE AtlasMinimising Impact When Incidents Occur With RIPE Atlas
Minimising Impact When Incidents Occur With RIPE Atlas
 
RIPE NCC Internet Measurement Services
RIPE NCC Internet Measurement ServicesRIPE NCC Internet Measurement Services
RIPE NCC Internet Measurement Services
 
Spotting Latency Issues with RIPE Atlas
Spotting Latency Issues with RIPE AtlasSpotting Latency Issues with RIPE Atlas
Spotting Latency Issues with RIPE Atlas
 
Spotting Latency Issues with RIPE Atlas
Spotting Latency Issues with RIPE AtlasSpotting Latency Issues with RIPE Atlas
Spotting Latency Issues with RIPE Atlas
 
Spotting Latency Issues with RIPE Atlas
Spotting Latency Issues with RIPE AtlasSpotting Latency Issues with RIPE Atlas
Spotting Latency Issues with RIPE Atlas
 
111 views of Swiss Internet Infrastructure
111 views of Swiss Internet Infrastructure111 views of Swiss Internet Infrastructure
111 views of Swiss Internet Infrastructure
 
The RIPE NCC’s View of IPv6 in Sweden
The RIPE NCC’s View of IPv6 in SwedenThe RIPE NCC’s View of IPv6 in Sweden
The RIPE NCC’s View of IPv6 in Sweden
 

Kürzlich hochgeladen

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Kürzlich hochgeladen (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 

RIPE Atlas

  • 1. RIPE Atlas! A “Real Big” Measurement Network Daniel Karrenberg Chief Scientist
  • 2. RIPE TTM (used for DNSMON) 2
  • 10. Ambitious Community Effort Instead of building small, separate, individual & private infrastructures, build one huge common infrastructure that serves both the individual goals and the community goals. 10
  • 11. Ambitious Community Effort •  Individual Benefits -  Lessexpensive than rolling your own -  More vantage points available -  More data available •  Community Benefits -  Unprecedented situational awareness -  Wealth of data, … 11
  • 12. Intuition -> Plan •  For accurate maps we need more probes •  Deploying very many TTM boxes too expensive •  Smaller probes •  Easily deployable •  USB powered •  24 x 365 capable 12
  • 16. Probe Capabilities •  Version 0 -  Ping to fixed targets (IPv4 & IPv6) ✔ -  Traceroute to 1st two upstream hops ✔ •  Version 1 -  Ping& Traceroute to variable targets -  DNS queries to variable targets •  Version 2 -  Your ideas ? •  Upgrades are automatic 16
  • 17. What you see is what you get 17
  • 18. Hosting = Credits = Measurements 18
  • 20. Hosting = Credits = Measurements 20
  • 21. Hosting = Credits = Measurements updated hourly on 21
  • 22. Sponsorship = Credits = Measurements 22
  • 23. Sponsorship = Credits = Measurements 23
  • 24. Sponsorship = Credits = Measurements For sponsorships see me during the meeting, or contact me: <daniel.karrenberg@ripe.net> 24
  • 26. Spare Slides / Anticipated Questions Spare Slides 26
  • 27. Why Hardware and not Software Probe ? •  Comparable and Reliable Measurements -  Known and uniform environment -  Tamper resistant •  24 x 365 -  Install and Forget -  Not dependent on host system, needs little power •  Security -  Not attractive nor easy target for botnet herders -  Not introducing potential weakness in host systems 27
  • 28. Is this the RIPE Botnet ? •  No •  Architecture is security conscious -> MAT WG •  Probes do not offer services, no open ports •  Probes are no interesting targets -  Very special environment -  Not really powerful either •  Infrastructure is designed with security in mind •  Measurements will be rate limited …. 28
  • 29. Private Measurements ? •  We are not offering this as a service for private and confidential measurements •  All results should benefit the community, also those of individually configured measurements -  Modalitiesto be discussed -> MAT WG -  Embargo periods -  Aggregation -  Anonymisation •  If you want to keep it very secret, run your own. 29
  • 30. Relation to Other RIPE NCC Services ? My personal vision, to be discussed in MAT WG and with current users: •  TTM will become part of RIPE ATLAS -  Powerful class of probes -  “Beacon” probes (some interest already) -  RIPE Atlas framework of operation and services •  DNSMON will become a class of RIPE Atlas measurements 30
  • 31. Measurement nodes – “Probes” •  Probe (v1 / generation 1): -  Lantronix XPortPro -  Very low power usage -  8MB RAM, 16MB flash -  Runs uClinux -  No FPU, no MMU, virtually no UI -  A reboot costs <15 (<5) seconds -  An SSH connection costs ~30 seconds -  We can remotely update the firmware -  Form factor of the finished probe is “just right” 31
  • 32. RIPE Atlas - Overall Architecture 32
  • 33. RIPE Atlas - Security aspects •  Probes have hardwired trust material! (registration server addresses / keys) •  The probes don’t have any open ports, they only initiate connections -  This works fine with NATs too •  Probes don’t listen to local traffic, there are no passive measurements running -  There’s no snooping around 33