SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Ambari
1.2
How Ambari Agents Register




© Hortonworks Inc. 2013      Page 1
Summary
‱ Terminology
   – Bootstrap –how to initially install an Agent on a host and “kick-off” registration
   – Registration – the act of an Agent host “registering” with the Server


‱ Are there multiple ways to bootstrap an Agent?
   Yes. Option #1: SSH and Option #2: Manual (no SSH)


‱ What are the differences between Option #1 and Option #2?
   With Option #1, you can have the Ambari Server bootstrap the agents during
   “Confirm Hosts”, which requires you to provide the SSH key so the Ambari Server
   can connect to + access the Agent host.

   With Option #2, you can manually install the Agent, which does not require the SSH
   key for the Ambari Server.




        Architecting the Future of Big Data
                                                                                          Page 2
        © Hortonworks Inc. 2013
Ambari Cluster Install Wizard




   OPTION 1
      and
provide SSH Key




   OPTION 2




           Architecting the Future of Big Data
                                                 Page 3
           © Hortonworks Inc. 2013
Bootstrap
Operational Flows




Architecting the Future of Big Data
                                      Page 4
© Hortonworks Inc. 2013
Option #1: Ambari Agent Bootstrap (SSH)

   Ambari Server                                                     Ambari Agent

                                      1) Configure Ambari Repo
 These
ops use
the SSH                         2) Copy Ambari Agent Setup script
  key
                              3) Execute Ambari Agent Setup script


                                                                                    4) Install epel-release


                                                                                    5) Install ambari-agent



                                                                                    6) Configure ambari-agent.ini


                                                                                    7) Start ambari-agent
                               8) Begin Ambari Agent Registration




          Architecting the Future of Big Data
                                                                                                               Page 5
          © Hortonworks Inc. 2013
Option #1: Ambari Agent Bootstrap (SSH)
     Operation                                                 Description

1    Configure Ambari Repo                                     Use the ambari.repo file on the Ambari Server and SCP to
                                                               Agent host(s).

2    Copy Ambari Agent Setup script                            SCP the setupAgent.py script on Agent host(s).

3    Execute Ambari Agent Setup script                         SSH to Agent host(s) and execute python setupAgent.py

4    Install epel-release                                      Install epel-release package using yum / zypper.

5    Install ambari-agent                                      Install ambari-agent package using yum / zypper.

6    Configure ambari-agent.ini                                Modify the /etc/ambari-agent/ambari-agent.ini and set the
                                                               hostname to the Ambari Server hostname.

7    Start ambari-agent                                        Start the ambari-agent process.

8    Begin Ambari Agent Registration                           Agent begins the registration process.


** Ambari Server initiates the “bootstrap” process by calling bootstrap.py



               Architecting the Future of Big Data
                                                                                                                           Page 6
               © Hortonworks Inc. 2013
Option #2: Ambari Agent Bootstrap (Manual)

    Ambari Server                                                             Ambari Agent


 No SSH
 ops are                                                                                         1) Configure Ambari repo
performed
                                                                                                 2) Install epel-release


                                                                                                 3) Install ambari-agent



                                                                                                 4) Configure ambari-agent.ini


                                                                                                 5) Start ambari-agent
                                     6) Begin Ambari Agent Registration




    ** User executes all ops as root no the Agent host(s). No requirement for SSH Private Key.



                   Architecting the Future of Big Data
                                                                                                                                 Page 7
                   © Hortonworks Inc. 2013
Agent Registration




Architecting the Future of Big Data
                                      Page 8
© Hortonworks Inc. 2013
Ambari Agent Registration
 Ambari Server                                                     Ambari Agent      Agent Host
                            1) Connect on Handshake port 8441

                                      2) Download Server Cert

                                  3) Request to Sign Agent Cert


                           4) Sign Agent Cert

                            5) Download Agent Cert + Disconnect


                            6) Connect on Registration port 8440

                          7) Perform 2WAY auth using Agent Cert
                                                                            8) Get FQDN              8a)
                                                                                                    Host
                                            9) Register host                                        Script


                           10) Complete Host Registration

                                   11) Agent Heartbeat Begins



      Architecting the Future of Big Data
                                                                                                  Page 9
      © Hortonworks Inc. 2013
Ambari Agent Registration
     Operation                                  Description
1    Connect on Handshake port 8441             Ambari Agent connects to Ambari Server on the handshake port.

2    Download Server Certificate                Ambari Agent downloads the Server Certificate.

3    Request to sign Agent Certificate          Ambari Agent requests for Ambari Server to sign the Agent
                                                Certificate.
4    Sign Agent Cert                            Ambari Server signs Agent Certificate with password.

5    Download Agent Cert and Disconnect         Ambar Agent downloads Agent Certificate and disconnects.

6    Connect on Registration port 8440          Ambari Agent connects to Ambari Server on the registration port.

7    Perform 2WAY auth using Agent Cert         2WAY authentication between Agent and Server.

8    Get FQDN                                   Ambari Agent host gets the Fully Qualified Domain Name (FQDN)
                                                for the Agent host. Note: (8a) In case the host has multiple
                                                hostnames, use the host script to echo the hostname to use for
                                                registration.
9    Register Host                              Using the FQDN, the Agent host registers with the Ambari Server.

10   Complete Host Registration                 Ambari Server completes the host registration by adding the host to
                                                the Ambari DB.
11   Agent Heartbeat Begins                     Ambari Agent starts heartbeat to Ambari Server, checking for
                                                commands to execute.

          Architecting the Future of Big Data
                                                                                                               Page 10
          © Hortonworks Inc. 2013
Useful Resources
Resource                                         Link

Using Custom Hostnames                           http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-
Script                                           1.2.1/bk_using_Ambari_book/content/ambari-chap7a.html

Manually Registering Ambari                      http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-
Agents                                           1.2.1/bk_using_Ambari_book/content/ambari-chap6.html




           Architecting the Future of Big Data
                                                                                                         Page 11
           © Hortonworks Inc. 2013

Weitere Àhnliche Inhalte

Ähnlich wie Ambari: Agent Registration Flow

Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5
Hortonworks
 
Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2
OpenCity Community
 
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariManaging 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
DataWorks Summit
 
K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
Amazon Web Services Korea
 
Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0
Hortonworks
 

Ähnlich wie Ambari: Agent Registration Flow (20)

An Overview of Ambari
An Overview of AmbariAn Overview of Ambari
An Overview of Ambari
 
Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5Apache Ambari - What's New in 1.2.5
Apache Ambari - What's New in 1.2.5
 
Accumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache AccumuloAccumulo Summit 2014: Monitoring Apache Accumulo
Accumulo Summit 2014: Monitoring Apache Accumulo
 
Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2
Pm 02 track1-- 魏戚--osac-trusted-computing-pools-in-folsom-v2
 
Distributed objects
Distributed objectsDistributed objects
Distributed objects
 
Hortonworks technical workshop operations with ambari
Hortonworks technical workshop   operations with ambariHortonworks technical workshop   operations with ambari
Hortonworks technical workshop operations with ambari
 
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with AmbariManaging 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
 
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4 Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack Architecture
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack Architecture
 
K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
K8s, Amazon EKS - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
 
Ethereum Smart Contracts on Hyperledger Fabric
Ethereum Smart Contracts on Hyperledger Fabric Ethereum Smart Contracts on Hyperledger Fabric
Ethereum Smart Contracts on Hyperledger Fabric
 
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
IBM Monitoring and Diagnostics Tools - Health Center 3.0.2
 
AWS êł ê°ì‚Źë„Œ 위한 ‘AWS 컚테읎너 ê”ìœĄâ€™ - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
AWS êł ê°ì‚Źë„Œ 위한 ‘AWS 컚테읎너 ê”ìœĄâ€™ - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞AWS êł ê°ì‚Źë„Œ 위한 ‘AWS 컚테읎너 ê”ìœĄâ€™ - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
AWS êł ê°ì‚Źë„Œ 위한 ‘AWS 컚테읎너 ê”ìœĄâ€™ - ìœ ìžŹì„, AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞
 
AWS Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)
AWS Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)AWS Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)
AWS Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)
 
Amazon Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)
 Amazon Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞) Amazon Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)
Amazon Container Services – ìœ ìžŹì„ (AWS ì†”ëŁšì…˜ìŠˆ 아킀텍튞)
 
Linux11 Proxy Server
Linux11 Proxy ServerLinux11 Proxy Server
Linux11 Proxy Server
 
Managing your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with AmbariManaging your Hadoop Clusters with Ambari
Managing your Hadoop Clusters with Ambari
 
Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0Apache Ambari - What's New in 1.6.0
Apache Ambari - What's New in 1.6.0
 
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
BlackHat EU 2012 - Zhenhua Liu - Breeding Sandworms: How To Fuzz Your Way Out...
 

KĂŒrzlich hochgeladen

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

KĂŒrzlich hochgeladen (20)

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 

Ambari: Agent Registration Flow

  • 1. Ambari 1.2 How Ambari Agents Register © Hortonworks Inc. 2013 Page 1
  • 2. Summary ‱ Terminology – Bootstrap –how to initially install an Agent on a host and “kick-off” registration – Registration – the act of an Agent host “registering” with the Server ‱ Are there multiple ways to bootstrap an Agent? Yes. Option #1: SSH and Option #2: Manual (no SSH) ‱ What are the differences between Option #1 and Option #2? With Option #1, you can have the Ambari Server bootstrap the agents during “Confirm Hosts”, which requires you to provide the SSH key so the Ambari Server can connect to + access the Agent host. With Option #2, you can manually install the Agent, which does not require the SSH key for the Ambari Server. Architecting the Future of Big Data Page 2 © Hortonworks Inc. 2013
  • 3. Ambari Cluster Install Wizard OPTION 1 and provide SSH Key OPTION 2 Architecting the Future of Big Data Page 3 © Hortonworks Inc. 2013
  • 4. Bootstrap Operational Flows Architecting the Future of Big Data Page 4 © Hortonworks Inc. 2013
  • 5. Option #1: Ambari Agent Bootstrap (SSH) Ambari Server Ambari Agent 1) Configure Ambari Repo These ops use the SSH 2) Copy Ambari Agent Setup script key 3) Execute Ambari Agent Setup script 4) Install epel-release 5) Install ambari-agent 6) Configure ambari-agent.ini 7) Start ambari-agent 8) Begin Ambari Agent Registration Architecting the Future of Big Data Page 5 © Hortonworks Inc. 2013
  • 6. Option #1: Ambari Agent Bootstrap (SSH) Operation Description 1 Configure Ambari Repo Use the ambari.repo file on the Ambari Server and SCP to Agent host(s). 2 Copy Ambari Agent Setup script SCP the setupAgent.py script on Agent host(s). 3 Execute Ambari Agent Setup script SSH to Agent host(s) and execute python setupAgent.py 4 Install epel-release Install epel-release package using yum / zypper. 5 Install ambari-agent Install ambari-agent package using yum / zypper. 6 Configure ambari-agent.ini Modify the /etc/ambari-agent/ambari-agent.ini and set the hostname to the Ambari Server hostname. 7 Start ambari-agent Start the ambari-agent process. 8 Begin Ambari Agent Registration Agent begins the registration process. ** Ambari Server initiates the “bootstrap” process by calling bootstrap.py Architecting the Future of Big Data Page 6 © Hortonworks Inc. 2013
  • 7. Option #2: Ambari Agent Bootstrap (Manual) Ambari Server Ambari Agent No SSH ops are 1) Configure Ambari repo performed 2) Install epel-release 3) Install ambari-agent 4) Configure ambari-agent.ini 5) Start ambari-agent 6) Begin Ambari Agent Registration ** User executes all ops as root no the Agent host(s). No requirement for SSH Private Key. Architecting the Future of Big Data Page 7 © Hortonworks Inc. 2013
  • 8. Agent Registration Architecting the Future of Big Data Page 8 © Hortonworks Inc. 2013
  • 9. Ambari Agent Registration Ambari Server Ambari Agent Agent Host 1) Connect on Handshake port 8441 2) Download Server Cert 3) Request to Sign Agent Cert 4) Sign Agent Cert 5) Download Agent Cert + Disconnect 6) Connect on Registration port 8440 7) Perform 2WAY auth using Agent Cert 8) Get FQDN 8a) Host 9) Register host Script 10) Complete Host Registration 11) Agent Heartbeat Begins Architecting the Future of Big Data Page 9 © Hortonworks Inc. 2013
  • 10. Ambari Agent Registration Operation Description 1 Connect on Handshake port 8441 Ambari Agent connects to Ambari Server on the handshake port. 2 Download Server Certificate Ambari Agent downloads the Server Certificate. 3 Request to sign Agent Certificate Ambari Agent requests for Ambari Server to sign the Agent Certificate. 4 Sign Agent Cert Ambari Server signs Agent Certificate with password. 5 Download Agent Cert and Disconnect Ambar Agent downloads Agent Certificate and disconnects. 6 Connect on Registration port 8440 Ambari Agent connects to Ambari Server on the registration port. 7 Perform 2WAY auth using Agent Cert 2WAY authentication between Agent and Server. 8 Get FQDN Ambari Agent host gets the Fully Qualified Domain Name (FQDN) for the Agent host. Note: (8a) In case the host has multiple hostnames, use the host script to echo the hostname to use for registration. 9 Register Host Using the FQDN, the Agent host registers with the Ambari Server. 10 Complete Host Registration Ambari Server completes the host registration by adding the host to the Ambari DB. 11 Agent Heartbeat Begins Ambari Agent starts heartbeat to Ambari Server, checking for commands to execute. Architecting the Future of Big Data Page 10 © Hortonworks Inc. 2013
  • 11. Useful Resources Resource Link Using Custom Hostnames http://docs.hortonworks.com/HDPDocuments/HDP1/HDP- Script 1.2.1/bk_using_Ambari_book/content/ambari-chap7a.html Manually Registering Ambari http://docs.hortonworks.com/HDPDocuments/HDP1/HDP- Agents 1.2.1/bk_using_Ambari_book/content/ambari-chap6.html Architecting the Future of Big Data Page 11 © Hortonworks Inc. 2013