SlideShare ist ein Scribd-Unternehmen logo
1 von 54
Downloaden Sie, um offline zu lesen
© Santosh Kangane – Oracle DBA
                                                                                        santoshkangane.blogspot.in
                                                                  www.linkedin.com/pub/santosh-kangane/1b/78b/6b

       Oracle 11g R2 Real Application Cluster Implementation on RHEL 5.0
Please download the Presentation from http://www.slideshare.net/slideshow/embed_code/14108797
I have added all concepts in this ppt.

Specification:
      1) 2 Node RAC setup
      2) OS: Each Node machine with Red Hat Enterprise Linux Server release 5 (x86_64 bit, Kernel: 2.6.18-8.el5)
      3) Storage server: 73 GB, Ubuntu 12.04 (x86_64 bit)
      4) Oracle 11gR2 Database
      5) Oracle 11gR2 Grid Infrastructure.


Pre-Installation:
  1) All the nodes should have same OS and Kernel version and bits (x86 or x86_64)
           For Linux use $uname –a command, it should show same output on all the nodes.

  2) Each of the servers should have 2 NIC cards
          - Where group of 2 (one from each machine) should have same name(say eth0/eth1) and IP subnet Mask
          Ex: 1) Each of the machines has eth0 as Ethernet card number and IP on subnet say 10.88.33.X (Public
          Network)
               2) Each of the machines has eth1 as Ethernet card number and IP on subnet say 10.88.32.X (Private
          Network for interconnects)
          - Both of these groups on different VLANs as above. all can co-exist on the same Physical switch; that
          should not be an issue

  3) Configure VIP by adding entries in /etc/hosts file (VIPs must be from same subnet as that of Public IPs)

  4) Stop ntpd service: Linux syncs the system time using NTP protocol. In RAC oracle has cluster time sync service
      built in. if ntpd service is up then oracle will use it else oracle will create cluster synchronization service; It’s
      recommended that we should use oracle cluster sync service. So will disable the ntpd service on all the
      nodes:
      [root@PTS0009 ~]# service ntpd stop
      ntpd is stopped
      [root@PTS0009 ~]# chkconfig ntpd off
      [root@PTS0009 ~]# chkconfig --list ntpd
      ntpd 0:off 1:off 2:off 3:off 4:off 5:off 6:off
      [root@PTS0009 ~]# chkconfig ntpd --del
      [root@PTS0009 ~]# mv /etc/ntp.conf /etc/ntp.conf.org
      [root@PTS0009 ~]# mv /var/run/ntpd.pid /var/run/ntpd.pid.org

  5) Configure SCAN (Single Client Access
      Name:http://www.oracle.com/technetwork/products/clustering/overview/scan-129069.pdf)
      I have DNS setup in my network so I will use the same. If you don’t have DNS setup you can hardcode these
      IP addresses under /etc/hosts file.

      SCAN using DNS:
      1) Add Scan entry on DNS server with 3 IP addresses for same host. Enable Round Robin on DNS
      (Demo: http://www.oraclemasters.in/?p=1296#dns)
      Ex: ORARAC-SCAN: 10.88.33.24
© Santosh Kangane – Oracle DBA
                                                                                        santoshkangane.blogspot.in
                                                                  www.linkedin.com/pub/santosh-kangane/1b/78b/6b

        ORARAC-SCAN: 10.88.33.25
        ORARAC-SCAN: 10.88.33.26
        2) Once the entry is added in DNS test it from Local Client as
        root@PTS0009:~# nslookup orarac-scan
        Server: 10.77.224.101
        Address: 10.77.224.101#53
        Name: orarac-scan
        Address: 10.88.33.26
        Name: orarac-scan
        Address: 10.88.33.24
        Name: orarac-scan
        Address: 10.88.33.25
        If you execute this command multiple times, you will notice that the list of IP addresses is varying in Round
        robin fashion. If not then ask your DNS admin to enable round robin on server.
        3) These above 3 IP addresses are Virtual IPs. So your Ping should fail for each of them till the time we install
        Grid clusterware.

<< Execute following setups 6-9 on all the nodes >>
    6) make sure each of the nodes has following Packages Installed:
        Oracle Software Prerequisites Install required packages:
                binutils-2.17.50.0.6
                compat-libstdc++-33-3.2.3
                elfutils-libelf-0.125
                elfutils-libelf-devel-0.125
                elfutils-libelf-devel-static-0.125
                gcc-4.1.2
                gcc-c++-4.1.2
                glibc-2.5-24
                glibc-common-2.5
                glibc-devel-2.5
                glibc-headers-2.5
                kernel-headers-2.6.18
                ksh-20060214
                libaio-0.3.106
                libaio-devel-0.3.106
                libgcc-4.1.2
                libgomp-4.1.2
                libstdc++-4.1.2
                libstdc++-devel-4.1.2
                make-3.81
                numactl-devel-0.9.8.i386
                sysstat-7.0.2
                unixODBC-2.2.11
                unixODBC-devel-2.2.11
                iscsi-initiator-utils-6.2.0.868-0.7.el5<-- For iscsi based SAN configuration

    7) Modify the kernel parameter file
        Login as root and appended the following entries in /etc/sysctl.conf file.:
        kernel.shmmax = 2147483648
        kernel.shmmni = 4096
© Santosh Kangane – Oracle DBA
                                                                                   santoshkangane.blogspot.in
                                                             www.linkedin.com/pub/santosh-kangane/1b/78b/6b

   kernel.shmall = 2097152
   kernel.sem = 250 32000 100 128
   fs.file-max = 6553600
   net.ipv4.ip_local_port_range = 1024 65000
   net.core.rmem_default = 4194304
   net.core.wmem_default = 262144
   net.core.wmem_max= 262144
   net.core.rmem_max = 4194304
   Issue the command to reload kernel parameter:
   $ sysctl –p

8) Added the following lines to the /etc/security/limits.conf file:

           oracle soft nofile 131072
           oracle hard nofile 131072
           oracle soft nproc 131072
           oracle hard nproc 131072
           oracle soft core unlimited
           oracle hard core unlimited
           oracle soft memlock 3500000
           oracle hard memlock 3500000
           # Recommended stack hard limit 32MB for oracle installations
           # oracle hard stack 32768
           grid soft nofile 131072
           grid hard nofile 131072
           grid soft nproc 131072
           grid hard nproc 131072
           grid soft core unlimited
           grid hard core unlimited
           grid soft memlock 3500000
           grid hard memlock 3500000
           # Recommended stack hard limit 32MB for grid installations
           # grid hard stack 32768

9) Install Oracleasm, oracleasmlib and oracleasm-support for ASM instance creation
    1. Download Oracle ASM from (http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5-
        084877.html) and installation compatible to your kernel version.
    2. For my RHE Linux Kernel version: 2.6.18-8.el5 I have used following libraries
        oracleasm-2.6.18-8.el5-2.0.4-1.el5.x86_64.rpm
        oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.x86_64.rpm
        oracleasmlib-2.0.4-1.el5.x86_64.rpm
        oracleasm-support-2.1.7-1.el5.x86_64.rpm

       [root@PTS0009 Redhat 5]# rpm -ivh oracleasm-2.6.18-8.el5-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18-
       8.el5xen-2.0.4-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-
       1.el5.x86_64.rpm
       oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm
       warning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
       Preparing... ########################################### [100%]
       1:oracleasm-support ########################################### [ 33%]
© Santosh Kangane – Oracle DBA
                                                                                   santoshkangane.blogspot.in
                                                             www.linkedin.com/pub/santosh-kangane/1b/78b/6b

      2:oracleasm-2.6.18-8.el5 ########################################### [ 67%]
      3:oracleasmlib ########################################### [100%]
      [root@PTS0009 Redhat 5]# rpm -qa | grep oracleasm
      oracleasm-2.6.18-8.el5-2.0.4-1.el5
      oracleasm-support-2.1.7-1.el5
      oracleasmlib-2.0.4-1.el5
10) SAN Storage setup as shown in PPT
   Device name not persistent after reboot of RAC nodes:

  I have seen that the iscsi device names are changed after reboot of RAC nodes. For e.g, device /dev/sda1
  now becomes /dev/sdb1 after reboot. This behavior has caused very serious issues for the OCR and Vote
  disks as well as the disks formatted with ocfs2 devices. They don't get mounted automatically because they
  are not persistent after reboot. A utility called "devlabel" that are developed by Dell Inc and it is available to
  download free from Dell's Official Website. This utility creates the symlink to the device names by
  considering physical devices' UUID. So, even after the reboot, the UUID for any devices stays at it is and so
  the symlink that you create using devlabel always points to the UUID of the device.

      1) Create Symlinks
         [root@PTS0006 Libs]# rpm -ivhU devlabel-0.48.03-10.x86_64.rpm
         warning: devlabel-0.48.03-10.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 025e513b
         Preparing... ########################################### [100%]
         1:devlabel ########################################### [100%]
         [root@PTS0006 Libs]#
         [root@PTS0006 Libs]# ls -l /dev/sd*
         brw-r----- 1 root disk 8, 0 Aug 9 16:57 /dev/sda
         brw-r----- 1 root disk 8, 1 Aug 9 16:57 /dev/sda1
         brw-r----- 1 root disk 8, 16 Aug 9 16:57 /dev/sdb
         brw-r----- 1 root disk 8, 17 Aug 9 16:58 /dev/sdb1
         brw-r----- 1 root disk 8, 32 Aug 9 16:55 /dev/sdc
         brw-r----- 1 root disk 8, 33 Aug 9 16:55 /dev/sdc1
         [root@PTS0006 Libs]# devlabel add -d /dev/sda1 -s /dev/ocr
         SYMLINK: /dev/ocr -> /dev/sda1
         Added /dev/ocr to /etc/sysconfig/devlabel
         [root@PTS0006 Libs]# devlabel add -d /dev/sdb1 -s /dev/oradata
         SYMLINK: /dev/oradata -> /dev/sdb1
         Added /dev/oradata to /etc/sysconfig/devlabel
         [root@PTS0006 Libs]# devlabel add -d /dev/sdc1 -s /dev/ocfs2
         [root@PTS0006 Libs]# cat /etc/sysconfig/devlabel
         # devlabel configuration file
         #
         # This file should generally not be edited by hand.
         # Instead, use the /sbin/devlabel program to make changes.
         # devlabel by Gary Lerhaupt <gary_lerhaupt@dell.com>
         #
         # format: <SYMLINK><DEVICE><UUID>
         # or format: <RAWDEVICE><DEVICE><UUID>
         /dev/ocr /dev/sda1 S83.1:49455400000000006c756e30000000000000000000000000IETVIRTUAL-
         DISKsector32
© Santosh Kangane – Oracle DBA
                                                                                santoshkangane.blogspot.in
                                                          www.linkedin.com/pub/santosh-kangane/1b/78b/6b

           /dev/oradata /dev/sdb1
           S83.1:49455400000000006c756e31000000000000000000000000IETVIRTUAL-DISKsector32-
           118425599
        2) Update the /etc/rc.local files (All RAC nodes):
           After reboot of RAC nodes, the devlabel does not get started automatically so add the reload
           command in /etc/rc.local
           [root@PTS0006 Libs]# devlabel reload
           SYMLINK: /dev/ocr -> /dev/sda1
           SYMLINK: /dev/oradata -> /dev/sdb1
           [root@PTS0006 Libs]# vi /etc/rc.local
           #!/bin/sh
           #
           # This script will be executed *after* all the other init scripts.
           # You can put your own initialization stuff in here if you don't
           # want to do the full Sys V style init stuff.
           touch /var/lock/subsys/local
           service iscsi restart
           devlabel reload
           echo "Just to check if all Ethernet are up"
           ifup eth0
           ifup eth1
Steps for Oracle RAC:
 1) Create group: dba, oinstall, asmadmin, asmdba, asmoper on all the nodes for Oracle software and ASM
 2) Create users: Oracle (For oracle software owner) and grid (for oracle cluster owner) as follows:
     $ id grid
     uid=501(grid) gid=501(oinstall) groups=501(oinstall),502(asmadmin),503(asmdba),504(asmoper)
     $ id oracle
     uid=500(oracle) gid=501(oinstall) groups=501(oinstall),500(dba),503(asmdba)
 3) Configure Oracle ASM:
     [root@PTS0009]# oracleasm configure
     ORACLEASM_ENABLED=false
     ORACLEASM_UID=
     ORACLEASM_GID=
     ORACLEASM_SCANBOOT=true
     ORACLEASM_SCANORDER=""
     ORACLEASM_SCANEXCLUDE=""
     [root@PTS0009]# oracleasm configure -i
     Configuring the Oracle ASM library driver.
     This will configure the on-boot properties of the Oracle ASM library
     driver. The following questions will determine whether the driver is
     loaded on boot and what permissions it will have. The current values
     will be shown in brackets ('[]'). Hitting <ENTER> without typing an
     answer will keep that current value. Ctrl-C will abort.
     Default user to own the driver interface []: grid
     Default group to own the driver interface []: asmadmin
     Start Oracle ASM library driver on boot (y/n) [n]: y
     Scan for Oracle ASM disks on boot (y/n) [y]: y
     Writing Oracle ASM library driver configuration: done
     [root@PTS0009]# oracleasm configure
     ORACLEASM_ENABLED=true
© Santosh Kangane – Oracle DBA
                                                                              santoshkangane.blogspot.in
                                                        www.linkedin.com/pub/santosh-kangane/1b/78b/6b

    ORACLEASM_UID=grid
    ORACLEASM_GID=asmadmin
    ORACLEASM_SCANBOOT=true
    ORACLEASM_SCANORDER=""
    ORACLEASM_SCANEXCLUDE=""
    [root@PTS0009]#
4) Load Oracle ASM:
    a. Check Current status
         [root@PTS0009]# oracleasm status
         Checking if ASM is loaded: no
         Checking if /dev/oracleasm is mounted: no
    b. Init Oracle ASM
         [root@PTS0009]# oracleasm init
         Creating /dev/oracleasm mount point: /dev/oracleasm
         Loading module "oracleasm": oracleasm
         Mounting ASMlib driver filesystem: /dev/oracleasm
         [root@PTS0009]# oracleasm status
         Checking if ASM is loaded: yes
         Checking if /dev/oracleasm is mounted: yes
         [root@PTS0009]#
    c.Create ASM Disks
         [root@PTS0006 systemfiles]# oracleasm createdisk VOTE1 /dev/sda1
         Writing disk header: done
         Instantiating disk: done
         [root@PTS0006 systemfiles]# oracleasm scandisks
         Reloading disk partitions: done
         Cleaning any stale ASM disks...
         Scanning system for ASM disks...
         [root@PTS0006 systemfiles]# oracleasm listdisks
         VOTE1
         << From Node2>>
         [root@PTS0009 systemfiles]# oracleasm scandisks
         Reloading disk partitions: done
         Cleaning any stale ASM disks...
         Scanning system for ASM disks...
         Instantiating disk "VOTE1"
         [root@PTS0009 systemfiles]# oracleasm listdisks
         VOTE1
         [root@PTS0006 systemfiles]# oracleasm createdisk DATA1 /dev/sdb1
         Writing disk header: done
         Instantiating disk: done
         [root@PTS0006 systemfiles]# oracleasm scandisks
         Reloading disk partitions: done
         Cleaning any stale ASM disks...
         Scanning system for ASM disks...
         [root@PTS0006 systemfiles]# oracleasm listdisks
         DATA1
         VOTE1
         [root@PTS0009 systemfiles]# oracleasm scandisks
         Reloading disk partitions: done
© Santosh Kangane – Oracle DBA
                                                                                    santoshkangane.blogspot.in
                                                              www.linkedin.com/pub/santosh-kangane/1b/78b/6b

         Cleaning any stale ASM disks...
         Scanning system for ASM disks...
         Instantiating disk "DATA1"
         [root@PTS0009 systemfiles]# oracleasm listdisks
         DATA1
         VOTE1




Install Oracle 11R2 Clusterware:
 Log in as grid user and execute runInstaller.sh script. Following are the screen dump to show the details.
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                                                                              santoshkangane.blogspot.in
                                                        www.linkedin.com/pub/santosh-kangane/1b/78b/6b




Add All the nodes and enable SSH connectivity for grid user.
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                                                                              santoshkangane.blogspot.in
                                                        www.linkedin.com/pub/santosh-kangane/1b/78b/6b




During the installation you will be asked to execute orainstRoot.sh and root.sh. Execute these scripts on Local
node first and then on the other nodes.

[root@PTS0009 tmp]# cd /home/systemfiles/
[root@PTS0009 systemfiles]# cd /home/systemfiles/orainventory/
[root@PTS0009 orainventory]# ./orainstRoot.sh
Changing permissions of /home/systemfiles/orainventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /home/systemfiles/orainventory to oinstall.
The execution of the script is complete.
[root@PTS0009 orainventory]# cd ..
[root@PTS0009 systemfiles]# cd grid_home/
[root@PTS0009 grid_home]# ./root.sh
Running Oracle 11g root.sh script...

The following environment variables are set as:
  ORACLE_OWNER= grid
  ORACLE_HOME= /home/systemfiles/grid_home
© Santosh Kangane – Oracle DBA
                                                                                santoshkangane.blogspot.in
                                                          www.linkedin.com/pub/santosh-kangane/1b/78b/6b

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]: y
  Copying dbhome to /usr/local/bin ...
The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]: y
  Copying oraenv to /usr/local/bin ...
The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]: y
  Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2012-08-17 17:02:52: Parsing the host name
2012-08-17 17:02:52: Checking for super user privileges
2012-08-17 17:02:52: User has super user privileges
Using configuration parameter file: /home/systemfiles/grid_home/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
 root wallet
 root wallet cert
 root cert export
 peer wallet
 profile reader wallet
 pa wallet
 peer wallet keys
 pa wallet keys
 peer cert request
 pa cert request
 peer cert
 pa cert
 peer root cert TP
 profile reader root cert TP
 pa root cert TP
 peer pa cert TP
 pa peer cert TP
 profile reader pa cert TP
 profile reader peer cert TP
 peer user cert
 pa user cert
© Santosh Kangane – Oracle DBA
                                                                             santoshkangane.blogspot.in
                                                       www.linkedin.com/pub/santosh-kangane/1b/78b/6b

Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
ADVM/ACFS is not supported on adobe-release-x86_64-1.0-1

CRS-2672: Attempting to start 'ora.gipcd' on 'pts0009'
CRS-2672: Attempting to start 'ora.mdnsd' on 'pts0009'
CRS-2676: Start of 'ora.gipcd' on 'pts0009' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'pts0009'
CRS-2676: Start of 'ora.gpnpd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'pts0009'
CRS-2676: Start of 'ora.cssdmonitor' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'pts0009'
CRS-2672: Attempting to start 'ora.diskmon' on 'pts0009'
CRS-2676: Start of 'ora.diskmon' on 'pts0009' succeeded
CRS-2676: Start of 'ora.cssd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'pts0009'
CRS-2676: Start of 'ora.ctssd' on 'pts0009' succeeded

ASM created and started successfully.

DiskGroup OCRVOTE created successfully.

clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'pts0009'
CRS-2676: Start of 'ora.crsd' on 'pts0009' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 82dd0db8b1f54f76bf79e0a2f1d9fccc.
Successfully replaced voting disk group with +OCRVOTE.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id                  File Name Disk group
-- ----- -----------------         --------- ---------
 1. ONLINE 82dd0db8b1f54f76bf79e0a2f1d9fccc (ORCL:VOTE1) [OCRVOTE]
Located 1 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'pts0009'
CRS-2677: Stop of 'ora.crsd' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'pts0009'
CRS-2677: Stop of 'ora.asm' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'pts0009'
CRS-2677: Stop of 'ora.ctssd' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'pts0009'
© Santosh Kangane – Oracle DBA
                                                                           santoshkangane.blogspot.in
                                                     www.linkedin.com/pub/santosh-kangane/1b/78b/6b

CRS-2677: Stop of 'ora.cssdmonitor' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'pts0009'
CRS-2677: Stop of 'ora.cssd' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'pts0009'
CRS-2677: Stop of 'ora.gpnpd' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'pts0009'
CRS-2677: Stop of 'ora.gipcd' on 'pts0009' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'pts0009'
CRS-2677: Stop of 'ora.mdnsd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.mdnsd' on 'pts0009'
CRS-2676: Start of 'ora.mdnsd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'pts0009'
CRS-2676: Start of 'ora.gipcd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'pts0009'
CRS-2676: Start of 'ora.gpnpd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'pts0009'
CRS-2676: Start of 'ora.cssdmonitor' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'pts0009'
CRS-2672: Attempting to start 'ora.diskmon' on 'pts0009'
CRS-2676: Start of 'ora.diskmon' on 'pts0009' succeeded
CRS-2676: Start of 'ora.cssd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'pts0009'
CRS-2676: Start of 'ora.ctssd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'pts0009'
CRS-2676: Start of 'ora.asm' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'pts0009'
CRS-2676: Start of 'ora.crsd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'pts0009'
CRS-2676: Start of 'ora.evmd' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'pts0009'
CRS-2676: Start of 'ora.asm' on 'pts0009' succeeded
CRS-2672: Attempting to start 'ora.OCRVOTE.dg' on 'pts0009'
CRS-2676: Start of 'ora.OCRVOTE.dg' on 'pts0009' succeeded

pts0009 2012/08/17 17:10:34 /home/systemfiles/grid_home/cdata/pts0009/backup_20120817_171034.olr
Preparing packages for installation...
cvuqdisk-1.0.7-1
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Updating inventory properties for clusterware
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB. Actual 4996 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /home/systemfiles/orainventory
'UpdateNodeList' was successful.
[root@PTS0009 grid_home]#
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                                                                             santoshkangane.blogspot.in
                                                       www.linkedin.com/pub/santosh-kangane/1b/78b/6b




In the end you can verify all the resources:

[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/crsctl check cluster -all
**************************************************************
pts0006:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
pts0009:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/srvctl status asm
ASM is running on pts0006,pts0009

[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/srvctl status asm
ASM is running on pts0006,pts0009
[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/crs_stat -t -v
Name           Type           R/RA F/FT Target State Host
----------------------------------------------------------------------
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE pts0006
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0006
ora....N2.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0009
© Santosh Kangane – Oracle DBA
                                                                             santoshkangane.blogspot.in
                                                       www.linkedin.com/pub/santosh-kangane/1b/78b/6b

ora....N3.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0009
ora.OCRVOTE.dg ora....up.type 0/5 0/ ONLINE ONLINE pts0006
ora.asm       ora.asm.type 0/5 0/ ONLINE ONLINE pts0006
ora.eons      ora.eons.type 0/3 0/ ONLINE ONLINE pts0006
ora.gsd       ora.gsd.type 0/5 0/ OFFLINE OFFLINE
ora....network ora....rk.type 0/5 0/ ONLINE ONLINE pts0006
ora.oc4j      ora.oc4j.type 0/5 0/0 OFFLINE OFFLINE
ora.ons       ora.ons.type 0/3 0/ ONLINE ONLINE pts0009
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE pts0006
ora....06.lsnr application 0/5 0/0 ONLINE ONLINE pts0006
ora....006.gsd application 0/5 0/0 OFFLINE OFFLINE
ora....006.ons application 0/3 0/0 ONLINE UNKNOWN pts0006
ora....006.vip ora....t1.type 0/0 0/0 ONLINE ONLINE pts0006
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE pts0009
ora....09.lsnr application 0/5 0/0 ONLINE ONLINE pts0009
ora....009.gsd application 0/5 0/0 OFFLINE OFFLINE
ora....009.ons application 0/3 0/0 ONLINE ONLINE pts0009
ora....009.vip ora....t1.type 0/0 0/0 ONLINE ONLINE pts0009
ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0006
ora.scan2.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0009
ora.scan3.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0009
[grid@PTS0009 ~]$

If you notice above .gsd and ora.oc4j are offline. But that should be ok as these are
required only for legacy support for oracle 9i.



Now all VIP and SCAN IPs will respond to ping.

[grid@PTS0009 ~]$ ping 10.88.33.27
PING 10.88.33.27 (10.88.33.27) 56(84) bytes of data.
64 bytes from 10.88.33.27: icmp_seq=1 ttl=64 time=1.07 ms
64 bytes from 10.88.33.27: icmp_seq=2 ttl=64 time=0.096 ms
64 bytes from 10.88.33.27: icmp_seq=3 ttl=64 time=0.096 ms

--- 10.88.33.27 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 1998ms
rtt min/avg/max/mdev = 0.096/0.423/1.077/0.462 ms
[grid@PTS0009 ~]$ ping 10.88.33.28
PING 10.88.33.28 (10.88.33.28) 56(84) bytes of data.
64 bytes from 10.88.33.28: icmp_seq=1 ttl=64 time=0.028 ms
64 bytes from 10.88.33.28: icmp_seq=2 ttl=64 time=0.018 ms
64 bytes from 10.88.33.28: icmp_seq=3 ttl=64 time=0.013 ms

--- 10.88.33.28 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 1998ms
rtt min/avg/max/mdev = 0.013/0.019/0.028/0.008 ms
[grid@PTS0009 ~]$ ping 10.88.33.24
PING 10.88.33.24 (10.88.33.24) 56(84) bytes of data.
64 bytes from 10.88.33.24: icmp_seq=1 ttl=64 time=0.025 ms
© Santosh Kangane – Oracle DBA
                                                                                  santoshkangane.blogspot.in
                                                            www.linkedin.com/pub/santosh-kangane/1b/78b/6b

     64 bytes from 10.88.33.24: icmp_seq=2 ttl=64 time=0.015 ms
     64 bytes from 10.88.33.24: icmp_seq=3 ttl=64 time=0.015 ms

     --- 10.88.33.24 ping statistics ---
     3 packets transmitted, 3 received, 0% packet loss, time 1998ms
     rtt min/avg/max/mdev = 0.015/0.018/0.025/0.005 ms
     [grid@PTS0009 ~]$ ping 10.88.33.25
     PING 10.88.33.25 (10.88.33.25) 56(84) bytes of data.
     64 bytes from 10.88.33.25: icmp_seq=1 ttl=64 time=0.022 ms
     64 bytes from 10.88.33.25: icmp_seq=2 ttl=64 time=0.017 ms

     --- 10.88.33.25 ping statistics ---
     2 packets transmitted, 2 received, 0% packet loss, time 1000ms
     rtt min/avg/max/mdev = 0.017/0.019/0.022/0.005 ms
     [grid@PTS0009 ~]$ ping 10.88.33.26
     PING 10.88.33.26 (10.88.33.26) 56(84) bytes of data.
     64 bytes from 10.88.33.26: icmp_seq=1 ttl=64 time=0.770 ms
     64 bytes from 10.88.33.26: icmp_seq=2 ttl=64 time=0.097 ms
     64 bytes from 10.88.33.26: icmp_seq=3 ttl=64 time=0.095 ms

     --- 10.88.33.26 ping statistics ---
     3 packets transmitted, 3 received, 0% packet loss, time 1999ms
     rtt min/avg/max/mdev = 0.095/0.320/0.770/0.318 ms
     [grid@PTS0009 ~]$




Oracle 11gR2 Software installation:
Login as Oracle user and execute runInstaller.sh
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                                                    santoshkangane.blogspot.in
                              www.linkedin.com/pub/santosh-kangane/1b/78b/6b




Creation of ASM disk group:
© Santosh Kangane – Oracle DBA
                                                                    santoshkangane.blogspot.in
                                              www.linkedin.com/pub/santosh-kangane/1b/78b/6b

           Connect as grid user and Invoke the asmca utility under $GRID_HOME/bin to
create these disk groups. The screenshots of this process are as below.
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                                                                     santoshkangane.blogspot.in
                                               www.linkedin.com/pub/santosh-kangane/1b/78b/6b




Creation of Oracle Database instance:
           Login as user oracle and execute dbca
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                                                                       santoshkangane.blogspot.in
                                                 www.linkedin.com/pub/santosh-kangane/1b/78b/6b




To resize the shared memory I referredhttp://www.walkernews.net/2010/05/04/how-to-resize-
devshm-filesystem-in-linux/
But after this ASM instance on 2nd node (PTS0006) went down. And I fought for 3Hrs and found
that its silly simple command!
$/grid_home/bin/srvctl status asm
$/grid_home/bin/srvctl start asm
Here it is …….
You can verify all the recourses by
/grid_home/bin/crsctl status resource –t
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b
© Santosh Kangane – Oracle DBA
                      santoshkangane.blogspot.in
www.linkedin.com/pub/santosh-kangane/1b/78b/6b

Weitere ähnliche Inhalte

Was ist angesagt?

Upgrade 11.2.0.1 gi crs to 11.2.0.2 in linux
Upgrade 11.2.0.1 gi crs to 11.2.0.2 in linuxUpgrade 11.2.0.1 gi crs to 11.2.0.2 in linux
Upgrade 11.2.0.1 gi crs to 11.2.0.2 in linux
maclean liu
 
Schema replication using oracle golden gate 12c
Schema replication using oracle golden gate 12cSchema replication using oracle golden gate 12c
Schema replication using oracle golden gate 12c
uzzal basak
 
Upgrade 11.2.0.1 rac db to 11.2.0.2 in linux
Upgrade 11.2.0.1 rac db to 11.2.0.2 in linuxUpgrade 11.2.0.1 rac db to 11.2.0.2 in linux
Upgrade 11.2.0.1 rac db to 11.2.0.2 in linux
maclean liu
 

Was ist angesagt? (20)

tow nodes Oracle 12c RAC on virtualbox
tow nodes Oracle 12c RAC on virtualboxtow nodes Oracle 12c RAC on virtualbox
tow nodes Oracle 12c RAC on virtualbox
 
11g r2 rac_guide
11g r2 rac_guide11g r2 rac_guide
11g r2 rac_guide
 
Rac questions
Rac questionsRac questions
Rac questions
 
Install oracle11gr2 rhel5
Install oracle11gr2 rhel5Install oracle11gr2 rhel5
Install oracle11gr2 rhel5
 
Oracle WebLogic Server 12c with Docker
Oracle WebLogic Server 12c with DockerOracle WebLogic Server 12c with Docker
Oracle WebLogic Server 12c with Docker
 
Oracle Golden Gate
Oracle Golden GateOracle Golden Gate
Oracle Golden Gate
 
Upgrade 11.2.0.1 gi crs to 11.2.0.2 in linux
Upgrade 11.2.0.1 gi crs to 11.2.0.2 in linuxUpgrade 11.2.0.1 gi crs to 11.2.0.2 in linux
Upgrade 11.2.0.1 gi crs to 11.2.0.2 in linux
 
Installing oracle grid infrastructure and database 12c r1
Installing oracle grid infrastructure and database 12c r1Installing oracle grid infrastructure and database 12c r1
Installing oracle grid infrastructure and database 12c r1
 
12c (12.1) Database installation on Solaris 11(11.2)
12c (12.1) Database  installation on Solaris 11(11.2)12c (12.1) Database  installation on Solaris 11(11.2)
12c (12.1) Database installation on Solaris 11(11.2)
 
Flex Your Database on 12c's Flex ASM and Flex Cluster
Flex Your Database on 12c's Flex ASM and Flex ClusterFlex Your Database on 12c's Flex ASM and Flex Cluster
Flex Your Database on 12c's Flex ASM and Flex Cluster
 
Oracle Database Management Basic 1
Oracle Database Management Basic 1Oracle Database Management Basic 1
Oracle Database Management Basic 1
 
Schema replication using oracle golden gate 12c
Schema replication using oracle golden gate 12cSchema replication using oracle golden gate 12c
Schema replication using oracle golden gate 12c
 
Oracle 11G SCAN: Concepts and Implementation Experience Sharing
Oracle 11G SCAN: Concepts and Implementation Experience SharingOracle 11G SCAN: Concepts and Implementation Experience Sharing
Oracle 11G SCAN: Concepts and Implementation Experience Sharing
 
Upgrade 11.2.0.1 rac db to 11.2.0.2 in linux
Upgrade 11.2.0.1 rac db to 11.2.0.2 in linuxUpgrade 11.2.0.1 rac db to 11.2.0.2 in linux
Upgrade 11.2.0.1 rac db to 11.2.0.2 in linux
 
Jurijs Velikanovs - RAC Attack 101 - How to install 12c RAC on your laptop
Jurijs Velikanovs -  RAC Attack 101 - How to install 12c RAC on your laptop  Jurijs Velikanovs -  RAC Attack 101 - How to install 12c RAC on your laptop
Jurijs Velikanovs - RAC Attack 101 - How to install 12c RAC on your laptop
 
还原Oracle中真实的cache recovery
还原Oracle中真实的cache recovery还原Oracle中真实的cache recovery
还原Oracle中真实的cache recovery
 
RMAN best practices for RAC
RMAN best practices for RACRMAN best practices for RAC
RMAN best practices for RAC
 
Advanced Percona XtraDB Cluster in a nutshell... la suite
Advanced Percona XtraDB Cluster in a nutshell... la suiteAdvanced Percona XtraDB Cluster in a nutshell... la suite
Advanced Percona XtraDB Cluster in a nutshell... la suite
 
10 ways to improve your rman script
10 ways to improve your rman script10 ways to improve your rman script
10 ways to improve your rman script
 
Backup and Restore of database on 2-Node RAC
Backup and Restore of database on 2-Node RACBackup and Restore of database on 2-Node RAC
Backup and Restore of database on 2-Node RAC
 

Andere mochten auch

akanksha bakul foundation
akanksha  bakul foundationakanksha  bakul foundation
akanksha bakul foundation
Amitabh Yadav
 

Andere mochten auch (20)

Ayane - Projector Phone
Ayane - Projector PhoneAyane - Projector Phone
Ayane - Projector Phone
 
1. dml select statement reterive data
1. dml select statement reterive data1. dml select statement reterive data
1. dml select statement reterive data
 
certificate
certificatecertificate
certificate
 
Capacity & Performance Management in Solaris Virtualized Environment
Capacity & Performance Management in Solaris Virtualized EnvironmentCapacity & Performance Management in Solaris Virtualized Environment
Capacity & Performance Management in Solaris Virtualized Environment
 
Managing troubleshooting cluster_360dgrees
Managing troubleshooting cluster_360dgreesManaging troubleshooting cluster_360dgrees
Managing troubleshooting cluster_360dgrees
 
Cost Based Oracle
Cost Based OracleCost Based Oracle
Cost Based Oracle
 
It Works! Presenting DBAL use in real life
It Works! Presenting DBAL use in real lifeIt Works! Presenting DBAL use in real life
It Works! Presenting DBAL use in real life
 
Consumer Behavior of Bihar and Bengal
Consumer Behavior of Bihar and BengalConsumer Behavior of Bihar and Bengal
Consumer Behavior of Bihar and Bengal
 
Exadata Smart Scan - What is so smart about it?
Exadata Smart Scan  - What is so smart about it?Exadata Smart Scan  - What is so smart about it?
Exadata Smart Scan - What is so smart about it?
 
ออราเคิล (Oracle) Statspack (ติดตั้งและใช้งานเบื้องต้น)
ออราเคิล (Oracle) Statspack (ติดตั้งและใช้งานเบื้องต้น)ออราเคิล (Oracle) Statspack (ติดตั้งและใช้งานเบื้องต้น)
ออราเคิล (Oracle) Statspack (ติดตั้งและใช้งานเบื้องต้น)
 
Senior Oracle DBA Responsibilities
Senior Oracle DBA ResponsibilitiesSenior Oracle DBA Responsibilities
Senior Oracle DBA Responsibilities
 
Oracle on linux
Oracle on linuxOracle on linux
Oracle on linux
 
Real-Time Query for Data Guard
Real-Time Query for Data Guard Real-Time Query for Data Guard
Real-Time Query for Data Guard
 
Oracle Query Optimizer - An Introduction
Oracle Query Optimizer - An IntroductionOracle Query Optimizer - An Introduction
Oracle Query Optimizer - An Introduction
 
Oracle Database In-Memory & Multitenant - TROUG Days'16 Istanbul
Oracle Database In-Memory & Multitenant - TROUG Days'16 IstanbulOracle Database In-Memory & Multitenant - TROUG Days'16 Istanbul
Oracle Database In-Memory & Multitenant - TROUG Days'16 Istanbul
 
Oracle Database In-Memory and the Query Optimizer
Oracle Database In-Memory and the Query OptimizerOracle Database In-Memory and the Query Optimizer
Oracle Database In-Memory and the Query Optimizer
 
TarunSharma_CV
TarunSharma_CVTarunSharma_CV
TarunSharma_CV
 
statement_sql
statement_sqlstatement_sql
statement_sql
 
akanksha bakul foundation
akanksha  bakul foundationakanksha  bakul foundation
akanksha bakul foundation
 
How oracle query works (The SQL Optimizers)
How oracle query works (The SQL Optimizers)How oracle query works (The SQL Optimizers)
How oracle query works (The SQL Optimizers)
 

Ähnlich wie Oracle 11g R2 RAC setup on rhel 5.0

图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库
图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库
图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库
maclean liu
 
在Oel5上安装配置oracle gird control 10.2.0.5
在Oel5上安装配置oracle gird control 10.2.0.5在Oel5上安装配置oracle gird control 10.2.0.5
在Oel5上安装配置oracle gird control 10.2.0.5
maclean liu
 
Whitepaper MS SQL Server on Linux
Whitepaper MS SQL Server on LinuxWhitepaper MS SQL Server on Linux
Whitepaper MS SQL Server on Linux
Roger Eisentrager
 
2nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp02
2nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp022nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp02
2nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp02
shaikyunus1980
 
26.1.7 lab snort and firewall rules
26.1.7 lab   snort and firewall rules26.1.7 lab   snort and firewall rules
26.1.7 lab snort and firewall rules
Freddy Buenaño
 

Ähnlich wie Oracle 11g R2 RAC setup on rhel 5.0 (20)

Rac on NFS
Rac on NFSRac on NFS
Rac on NFS
 
图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库
图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库
图文详解安装Net backup 6.5备份恢复oracle 10g rac 数据库
 
Oracle applications r12.2.0 installation on linux
Oracle applications r12.2.0 installation on linuxOracle applications r12.2.0 installation on linux
Oracle applications r12.2.0 installation on linux
 
Step by Step to Install oracle grid 11.2.0.3 on solaris 11.1
Step by Step to Install oracle grid 11.2.0.3 on solaris 11.1Step by Step to Install oracle grid 11.2.0.3 on solaris 11.1
Step by Step to Install oracle grid 11.2.0.3 on solaris 11.1
 
在Oel5上安装配置oracle gird control 10.2.0.5
在Oel5上安装配置oracle gird control 10.2.0.5在Oel5上安装配置oracle gird control 10.2.0.5
在Oel5上安装配置oracle gird control 10.2.0.5
 
Whitepaper MS SQL Server on Linux
Whitepaper MS SQL Server on LinuxWhitepaper MS SQL Server on Linux
Whitepaper MS SQL Server on Linux
 
Shareplex Presentation
Shareplex PresentationShareplex Presentation
Shareplex Presentation
 
Montreal On Rails 5 : Rails deployment using : Nginx, Mongrel, Mongrel_cluste...
Montreal On Rails 5 : Rails deployment using : Nginx, Mongrel, Mongrel_cluste...Montreal On Rails 5 : Rails deployment using : Nginx, Mongrel, Mongrel_cluste...
Montreal On Rails 5 : Rails deployment using : Nginx, Mongrel, Mongrel_cluste...
 
Linux configer
Linux configerLinux configer
Linux configer
 
Enterprise manager cloud control 12c(12.1) &agent安装图文指南
Enterprise manager cloud control 12c(12.1) &agent安装图文指南Enterprise manager cloud control 12c(12.1) &agent安装图文指南
Enterprise manager cloud control 12c(12.1) &agent安装图文指南
 
Data Guard on EBS R12 DB 10g
Data Guard on EBS R12 DB 10gData Guard on EBS R12 DB 10g
Data Guard on EBS R12 DB 10g
 
Docker 1.11 Presentation
Docker 1.11 PresentationDocker 1.11 Presentation
Docker 1.11 Presentation
 
Dockerizing the Hard Services: Neutron and Nova
Dockerizing the Hard Services: Neutron and NovaDockerizing the Hard Services: Neutron and Nova
Dockerizing the Hard Services: Neutron and Nova
 
RAC 12c
RAC 12cRAC 12c
RAC 12c
 
2nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp02
2nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp022nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp02
2nodesoracle12craconyourlaptopvirtualboxstepbystepguide1 0-130627143310-phpapp02
 
Multiple instances on linux
Multiple instances on linuxMultiple instances on linux
Multiple instances on linux
 
Sharded cluster tutorial
Sharded cluster tutorialSharded cluster tutorial
Sharded cluster tutorial
 
MongoDB - Sharded Cluster Tutorial
MongoDB - Sharded Cluster TutorialMongoDB - Sharded Cluster Tutorial
MongoDB - Sharded Cluster Tutorial
 
MongoDB – Sharded cluster tutorial - Percona Europe 2017
MongoDB – Sharded cluster tutorial - Percona Europe 2017MongoDB – Sharded cluster tutorial - Percona Europe 2017
MongoDB – Sharded cluster tutorial - Percona Europe 2017
 
26.1.7 lab snort and firewall rules
26.1.7 lab   snort and firewall rules26.1.7 lab   snort and firewall rules
26.1.7 lab snort and firewall rules
 

Kürzlich hochgeladen

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 

Oracle 11g R2 RAC setup on rhel 5.0

  • 1. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Oracle 11g R2 Real Application Cluster Implementation on RHEL 5.0 Please download the Presentation from http://www.slideshare.net/slideshow/embed_code/14108797 I have added all concepts in this ppt. Specification: 1) 2 Node RAC setup 2) OS: Each Node machine with Red Hat Enterprise Linux Server release 5 (x86_64 bit, Kernel: 2.6.18-8.el5) 3) Storage server: 73 GB, Ubuntu 12.04 (x86_64 bit) 4) Oracle 11gR2 Database 5) Oracle 11gR2 Grid Infrastructure. Pre-Installation: 1) All the nodes should have same OS and Kernel version and bits (x86 or x86_64) For Linux use $uname –a command, it should show same output on all the nodes. 2) Each of the servers should have 2 NIC cards - Where group of 2 (one from each machine) should have same name(say eth0/eth1) and IP subnet Mask Ex: 1) Each of the machines has eth0 as Ethernet card number and IP on subnet say 10.88.33.X (Public Network) 2) Each of the machines has eth1 as Ethernet card number and IP on subnet say 10.88.32.X (Private Network for interconnects) - Both of these groups on different VLANs as above. all can co-exist on the same Physical switch; that should not be an issue 3) Configure VIP by adding entries in /etc/hosts file (VIPs must be from same subnet as that of Public IPs) 4) Stop ntpd service: Linux syncs the system time using NTP protocol. In RAC oracle has cluster time sync service built in. if ntpd service is up then oracle will use it else oracle will create cluster synchronization service; It’s recommended that we should use oracle cluster sync service. So will disable the ntpd service on all the nodes: [root@PTS0009 ~]# service ntpd stop ntpd is stopped [root@PTS0009 ~]# chkconfig ntpd off [root@PTS0009 ~]# chkconfig --list ntpd ntpd 0:off 1:off 2:off 3:off 4:off 5:off 6:off [root@PTS0009 ~]# chkconfig ntpd --del [root@PTS0009 ~]# mv /etc/ntp.conf /etc/ntp.conf.org [root@PTS0009 ~]# mv /var/run/ntpd.pid /var/run/ntpd.pid.org 5) Configure SCAN (Single Client Access Name:http://www.oracle.com/technetwork/products/clustering/overview/scan-129069.pdf) I have DNS setup in my network so I will use the same. If you don’t have DNS setup you can hardcode these IP addresses under /etc/hosts file. SCAN using DNS: 1) Add Scan entry on DNS server with 3 IP addresses for same host. Enable Round Robin on DNS (Demo: http://www.oraclemasters.in/?p=1296#dns) Ex: ORARAC-SCAN: 10.88.33.24
  • 2. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b ORARAC-SCAN: 10.88.33.25 ORARAC-SCAN: 10.88.33.26 2) Once the entry is added in DNS test it from Local Client as root@PTS0009:~# nslookup orarac-scan Server: 10.77.224.101 Address: 10.77.224.101#53 Name: orarac-scan Address: 10.88.33.26 Name: orarac-scan Address: 10.88.33.24 Name: orarac-scan Address: 10.88.33.25 If you execute this command multiple times, you will notice that the list of IP addresses is varying in Round robin fashion. If not then ask your DNS admin to enable round robin on server. 3) These above 3 IP addresses are Virtual IPs. So your Ping should fail for each of them till the time we install Grid clusterware. << Execute following setups 6-9 on all the nodes >> 6) make sure each of the nodes has following Packages Installed: Oracle Software Prerequisites Install required packages: binutils-2.17.50.0.6 compat-libstdc++-33-3.2.3 elfutils-libelf-0.125 elfutils-libelf-devel-0.125 elfutils-libelf-devel-static-0.125 gcc-4.1.2 gcc-c++-4.1.2 glibc-2.5-24 glibc-common-2.5 glibc-devel-2.5 glibc-headers-2.5 kernel-headers-2.6.18 ksh-20060214 libaio-0.3.106 libaio-devel-0.3.106 libgcc-4.1.2 libgomp-4.1.2 libstdc++-4.1.2 libstdc++-devel-4.1.2 make-3.81 numactl-devel-0.9.8.i386 sysstat-7.0.2 unixODBC-2.2.11 unixODBC-devel-2.2.11 iscsi-initiator-utils-6.2.0.868-0.7.el5<-- For iscsi based SAN configuration 7) Modify the kernel parameter file Login as root and appended the following entries in /etc/sysctl.conf file.: kernel.shmmax = 2147483648 kernel.shmmni = 4096
  • 3. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b kernel.shmall = 2097152 kernel.sem = 250 32000 100 128 fs.file-max = 6553600 net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 4194304 net.core.wmem_default = 262144 net.core.wmem_max= 262144 net.core.rmem_max = 4194304 Issue the command to reload kernel parameter: $ sysctl –p 8) Added the following lines to the /etc/security/limits.conf file: oracle soft nofile 131072 oracle hard nofile 131072 oracle soft nproc 131072 oracle hard nproc 131072 oracle soft core unlimited oracle hard core unlimited oracle soft memlock 3500000 oracle hard memlock 3500000 # Recommended stack hard limit 32MB for oracle installations # oracle hard stack 32768 grid soft nofile 131072 grid hard nofile 131072 grid soft nproc 131072 grid hard nproc 131072 grid soft core unlimited grid hard core unlimited grid soft memlock 3500000 grid hard memlock 3500000 # Recommended stack hard limit 32MB for grid installations # grid hard stack 32768 9) Install Oracleasm, oracleasmlib and oracleasm-support for ASM instance creation 1. Download Oracle ASM from (http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5- 084877.html) and installation compatible to your kernel version. 2. For my RHE Linux Kernel version: 2.6.18-8.el5 I have used following libraries oracleasm-2.6.18-8.el5-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm [root@PTS0009 Redhat 5]# rpm -ivh oracleasm-2.6.18-8.el5-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18- 8.el5xen-2.0.4-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7- 1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm warning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159 Preparing... ########################################### [100%] 1:oracleasm-support ########################################### [ 33%]
  • 4. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b 2:oracleasm-2.6.18-8.el5 ########################################### [ 67%] 3:oracleasmlib ########################################### [100%] [root@PTS0009 Redhat 5]# rpm -qa | grep oracleasm oracleasm-2.6.18-8.el5-2.0.4-1.el5 oracleasm-support-2.1.7-1.el5 oracleasmlib-2.0.4-1.el5 10) SAN Storage setup as shown in PPT Device name not persistent after reboot of RAC nodes: I have seen that the iscsi device names are changed after reboot of RAC nodes. For e.g, device /dev/sda1 now becomes /dev/sdb1 after reboot. This behavior has caused very serious issues for the OCR and Vote disks as well as the disks formatted with ocfs2 devices. They don't get mounted automatically because they are not persistent after reboot. A utility called "devlabel" that are developed by Dell Inc and it is available to download free from Dell's Official Website. This utility creates the symlink to the device names by considering physical devices' UUID. So, even after the reboot, the UUID for any devices stays at it is and so the symlink that you create using devlabel always points to the UUID of the device. 1) Create Symlinks [root@PTS0006 Libs]# rpm -ivhU devlabel-0.48.03-10.x86_64.rpm warning: devlabel-0.48.03-10.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 025e513b Preparing... ########################################### [100%] 1:devlabel ########################################### [100%] [root@PTS0006 Libs]# [root@PTS0006 Libs]# ls -l /dev/sd* brw-r----- 1 root disk 8, 0 Aug 9 16:57 /dev/sda brw-r----- 1 root disk 8, 1 Aug 9 16:57 /dev/sda1 brw-r----- 1 root disk 8, 16 Aug 9 16:57 /dev/sdb brw-r----- 1 root disk 8, 17 Aug 9 16:58 /dev/sdb1 brw-r----- 1 root disk 8, 32 Aug 9 16:55 /dev/sdc brw-r----- 1 root disk 8, 33 Aug 9 16:55 /dev/sdc1 [root@PTS0006 Libs]# devlabel add -d /dev/sda1 -s /dev/ocr SYMLINK: /dev/ocr -> /dev/sda1 Added /dev/ocr to /etc/sysconfig/devlabel [root@PTS0006 Libs]# devlabel add -d /dev/sdb1 -s /dev/oradata SYMLINK: /dev/oradata -> /dev/sdb1 Added /dev/oradata to /etc/sysconfig/devlabel [root@PTS0006 Libs]# devlabel add -d /dev/sdc1 -s /dev/ocfs2 [root@PTS0006 Libs]# cat /etc/sysconfig/devlabel # devlabel configuration file # # This file should generally not be edited by hand. # Instead, use the /sbin/devlabel program to make changes. # devlabel by Gary Lerhaupt <gary_lerhaupt@dell.com> # # format: <SYMLINK><DEVICE><UUID> # or format: <RAWDEVICE><DEVICE><UUID> /dev/ocr /dev/sda1 S83.1:49455400000000006c756e30000000000000000000000000IETVIRTUAL- DISKsector32
  • 5. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b /dev/oradata /dev/sdb1 S83.1:49455400000000006c756e31000000000000000000000000IETVIRTUAL-DISKsector32- 118425599 2) Update the /etc/rc.local files (All RAC nodes): After reboot of RAC nodes, the devlabel does not get started automatically so add the reload command in /etc/rc.local [root@PTS0006 Libs]# devlabel reload SYMLINK: /dev/ocr -> /dev/sda1 SYMLINK: /dev/oradata -> /dev/sdb1 [root@PTS0006 Libs]# vi /etc/rc.local #!/bin/sh # # This script will be executed *after* all the other init scripts. # You can put your own initialization stuff in here if you don't # want to do the full Sys V style init stuff. touch /var/lock/subsys/local service iscsi restart devlabel reload echo "Just to check if all Ethernet are up" ifup eth0 ifup eth1 Steps for Oracle RAC: 1) Create group: dba, oinstall, asmadmin, asmdba, asmoper on all the nodes for Oracle software and ASM 2) Create users: Oracle (For oracle software owner) and grid (for oracle cluster owner) as follows: $ id grid uid=501(grid) gid=501(oinstall) groups=501(oinstall),502(asmadmin),503(asmdba),504(asmoper) $ id oracle uid=500(oracle) gid=501(oinstall) groups=501(oinstall),500(dba),503(asmdba) 3) Configure Oracle ASM: [root@PTS0009]# oracleasm configure ORACLEASM_ENABLED=false ORACLEASM_UID= ORACLEASM_GID= ORACLEASM_SCANBOOT=true ORACLEASM_SCANORDER="" ORACLEASM_SCANEXCLUDE="" [root@PTS0009]# oracleasm configure -i Configuring the Oracle ASM library driver. This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current values will be shown in brackets ('[]'). Hitting <ENTER> without typing an answer will keep that current value. Ctrl-C will abort. Default user to own the driver interface []: grid Default group to own the driver interface []: asmadmin Start Oracle ASM library driver on boot (y/n) [n]: y Scan for Oracle ASM disks on boot (y/n) [y]: y Writing Oracle ASM library driver configuration: done [root@PTS0009]# oracleasm configure ORACLEASM_ENABLED=true
  • 6. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b ORACLEASM_UID=grid ORACLEASM_GID=asmadmin ORACLEASM_SCANBOOT=true ORACLEASM_SCANORDER="" ORACLEASM_SCANEXCLUDE="" [root@PTS0009]# 4) Load Oracle ASM: a. Check Current status [root@PTS0009]# oracleasm status Checking if ASM is loaded: no Checking if /dev/oracleasm is mounted: no b. Init Oracle ASM [root@PTS0009]# oracleasm init Creating /dev/oracleasm mount point: /dev/oracleasm Loading module "oracleasm": oracleasm Mounting ASMlib driver filesystem: /dev/oracleasm [root@PTS0009]# oracleasm status Checking if ASM is loaded: yes Checking if /dev/oracleasm is mounted: yes [root@PTS0009]# c.Create ASM Disks [root@PTS0006 systemfiles]# oracleasm createdisk VOTE1 /dev/sda1 Writing disk header: done Instantiating disk: done [root@PTS0006 systemfiles]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... [root@PTS0006 systemfiles]# oracleasm listdisks VOTE1 << From Node2>> [root@PTS0009 systemfiles]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... Instantiating disk "VOTE1" [root@PTS0009 systemfiles]# oracleasm listdisks VOTE1 [root@PTS0006 systemfiles]# oracleasm createdisk DATA1 /dev/sdb1 Writing disk header: done Instantiating disk: done [root@PTS0006 systemfiles]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... [root@PTS0006 systemfiles]# oracleasm listdisks DATA1 VOTE1 [root@PTS0009 systemfiles]# oracleasm scandisks Reloading disk partitions: done
  • 7. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Cleaning any stale ASM disks... Scanning system for ASM disks... Instantiating disk "DATA1" [root@PTS0009 systemfiles]# oracleasm listdisks DATA1 VOTE1 Install Oracle 11R2 Clusterware: Log in as grid user and execute runInstaller.sh script. Following are the screen dump to show the details.
  • 8. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 9. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Add All the nodes and enable SSH connectivity for grid user.
  • 10. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 11. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 12. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 13. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 14. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 15. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 16. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 17. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b During the installation you will be asked to execute orainstRoot.sh and root.sh. Execute these scripts on Local node first and then on the other nodes. [root@PTS0009 tmp]# cd /home/systemfiles/ [root@PTS0009 systemfiles]# cd /home/systemfiles/orainventory/ [root@PTS0009 orainventory]# ./orainstRoot.sh Changing permissions of /home/systemfiles/orainventory. Adding read,write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /home/systemfiles/orainventory to oinstall. The execution of the script is complete. [root@PTS0009 orainventory]# cd .. [root@PTS0009 systemfiles]# cd grid_home/ [root@PTS0009 grid_home]# ./root.sh Running Oracle 11g root.sh script... The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /home/systemfiles/grid_home
  • 18. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying dbhome to /usr/local/bin ... The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying oraenv to /usr/local/bin ... The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2012-08-17 17:02:52: Parsing the host name 2012-08-17 17:02:52: Checking for super user privileges 2012-08-17 17:02:52: User has super user privileges Using configuration parameter file: /home/systemfiles/grid_home/crs/install/crsconfig_params Creating trace directory LOCAL ADD MODE Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert
  • 19. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Adding daemon to inittab CRS-4123: Oracle High Availability Services has been started. ohasd is starting ADVM/ACFS is not supported on adobe-release-x86_64-1.0-1 CRS-2672: Attempting to start 'ora.gipcd' on 'pts0009' CRS-2672: Attempting to start 'ora.mdnsd' on 'pts0009' CRS-2676: Start of 'ora.gipcd' on 'pts0009' succeeded CRS-2676: Start of 'ora.mdnsd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'pts0009' CRS-2676: Start of 'ora.gpnpd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'pts0009' CRS-2676: Start of 'ora.cssdmonitor' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'pts0009' CRS-2672: Attempting to start 'ora.diskmon' on 'pts0009' CRS-2676: Start of 'ora.diskmon' on 'pts0009' succeeded CRS-2676: Start of 'ora.cssd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'pts0009' CRS-2676: Start of 'ora.ctssd' on 'pts0009' succeeded ASM created and started successfully. DiskGroup OCRVOTE created successfully. clscfg: -install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. CRS-2672: Attempting to start 'ora.crsd' on 'pts0009' CRS-2676: Start of 'ora.crsd' on 'pts0009' succeeded CRS-4256: Updating the profile Successful addition of voting disk 82dd0db8b1f54f76bf79e0a2f1d9fccc. Successfully replaced voting disk group with +OCRVOTE. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 82dd0db8b1f54f76bf79e0a2f1d9fccc (ORCL:VOTE1) [OCRVOTE] Located 1 voting disk(s). CRS-2673: Attempting to stop 'ora.crsd' on 'pts0009' CRS-2677: Stop of 'ora.crsd' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'pts0009' CRS-2677: Stop of 'ora.asm' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'pts0009' CRS-2677: Stop of 'ora.ctssd' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'pts0009'
  • 20. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b CRS-2677: Stop of 'ora.cssdmonitor' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'pts0009' CRS-2677: Stop of 'ora.cssd' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'pts0009' CRS-2677: Stop of 'ora.gpnpd' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'pts0009' CRS-2677: Stop of 'ora.gipcd' on 'pts0009' succeeded CRS-2673: Attempting to stop 'ora.mdnsd' on 'pts0009' CRS-2677: Stop of 'ora.mdnsd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.mdnsd' on 'pts0009' CRS-2676: Start of 'ora.mdnsd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'pts0009' CRS-2676: Start of 'ora.gipcd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'pts0009' CRS-2676: Start of 'ora.gpnpd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'pts0009' CRS-2676: Start of 'ora.cssdmonitor' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'pts0009' CRS-2672: Attempting to start 'ora.diskmon' on 'pts0009' CRS-2676: Start of 'ora.diskmon' on 'pts0009' succeeded CRS-2676: Start of 'ora.cssd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'pts0009' CRS-2676: Start of 'ora.ctssd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.asm' on 'pts0009' CRS-2676: Start of 'ora.asm' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'pts0009' CRS-2676: Start of 'ora.crsd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'pts0009' CRS-2676: Start of 'ora.evmd' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.asm' on 'pts0009' CRS-2676: Start of 'ora.asm' on 'pts0009' succeeded CRS-2672: Attempting to start 'ora.OCRVOTE.dg' on 'pts0009' CRS-2676: Start of 'ora.OCRVOTE.dg' on 'pts0009' succeeded pts0009 2012/08/17 17:10:34 /home/systemfiles/grid_home/cdata/pts0009/backup_20120817_171034.olr Preparing packages for installation... cvuqdisk-1.0.7-1 Configure Oracle Grid Infrastructure for a Cluster ... succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer... Checking swap space: must be greater than 500 MB. Actual 4996 MB Passed The inventory pointer is located at /etc/oraInst.loc The inventory is located at /home/systemfiles/orainventory 'UpdateNodeList' was successful. [root@PTS0009 grid_home]#
  • 21. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 22. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b In the end you can verify all the resources: [grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/crsctl check cluster -all ************************************************************** pts0006: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** pts0009: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** [grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/srvctl status asm ASM is running on pts0006,pts0009 [grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/srvctl status asm ASM is running on pts0006,pts0009 [grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/crs_stat -t -v Name Type R/RA F/FT Target State Host ---------------------------------------------------------------------- ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE pts0006 ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0006 ora....N2.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0009
  • 23. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b ora....N3.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0009 ora.OCRVOTE.dg ora....up.type 0/5 0/ ONLINE ONLINE pts0006 ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE pts0006 ora.eons ora.eons.type 0/3 0/ ONLINE ONLINE pts0006 ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE ora....network ora....rk.type 0/5 0/ ONLINE ONLINE pts0006 ora.oc4j ora.oc4j.type 0/5 0/0 OFFLINE OFFLINE ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE pts0009 ora....SM2.asm application 0/5 0/0 ONLINE ONLINE pts0006 ora....06.lsnr application 0/5 0/0 ONLINE ONLINE pts0006 ora....006.gsd application 0/5 0/0 OFFLINE OFFLINE ora....006.ons application 0/3 0/0 ONLINE UNKNOWN pts0006 ora....006.vip ora....t1.type 0/0 0/0 ONLINE ONLINE pts0006 ora....SM1.asm application 0/5 0/0 ONLINE ONLINE pts0009 ora....09.lsnr application 0/5 0/0 ONLINE ONLINE pts0009 ora....009.gsd application 0/5 0/0 OFFLINE OFFLINE ora....009.ons application 0/3 0/0 ONLINE ONLINE pts0009 ora....009.vip ora....t1.type 0/0 0/0 ONLINE ONLINE pts0009 ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0006 ora.scan2.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0009 ora.scan3.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0009 [grid@PTS0009 ~]$ If you notice above .gsd and ora.oc4j are offline. But that should be ok as these are required only for legacy support for oracle 9i. Now all VIP and SCAN IPs will respond to ping. [grid@PTS0009 ~]$ ping 10.88.33.27 PING 10.88.33.27 (10.88.33.27) 56(84) bytes of data. 64 bytes from 10.88.33.27: icmp_seq=1 ttl=64 time=1.07 ms 64 bytes from 10.88.33.27: icmp_seq=2 ttl=64 time=0.096 ms 64 bytes from 10.88.33.27: icmp_seq=3 ttl=64 time=0.096 ms --- 10.88.33.27 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1998ms rtt min/avg/max/mdev = 0.096/0.423/1.077/0.462 ms [grid@PTS0009 ~]$ ping 10.88.33.28 PING 10.88.33.28 (10.88.33.28) 56(84) bytes of data. 64 bytes from 10.88.33.28: icmp_seq=1 ttl=64 time=0.028 ms 64 bytes from 10.88.33.28: icmp_seq=2 ttl=64 time=0.018 ms 64 bytes from 10.88.33.28: icmp_seq=3 ttl=64 time=0.013 ms --- 10.88.33.28 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1998ms rtt min/avg/max/mdev = 0.013/0.019/0.028/0.008 ms [grid@PTS0009 ~]$ ping 10.88.33.24 PING 10.88.33.24 (10.88.33.24) 56(84) bytes of data. 64 bytes from 10.88.33.24: icmp_seq=1 ttl=64 time=0.025 ms
  • 24. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b 64 bytes from 10.88.33.24: icmp_seq=2 ttl=64 time=0.015 ms 64 bytes from 10.88.33.24: icmp_seq=3 ttl=64 time=0.015 ms --- 10.88.33.24 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1998ms rtt min/avg/max/mdev = 0.015/0.018/0.025/0.005 ms [grid@PTS0009 ~]$ ping 10.88.33.25 PING 10.88.33.25 (10.88.33.25) 56(84) bytes of data. 64 bytes from 10.88.33.25: icmp_seq=1 ttl=64 time=0.022 ms 64 bytes from 10.88.33.25: icmp_seq=2 ttl=64 time=0.017 ms --- 10.88.33.25 ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1000ms rtt min/avg/max/mdev = 0.017/0.019/0.022/0.005 ms [grid@PTS0009 ~]$ ping 10.88.33.26 PING 10.88.33.26 (10.88.33.26) 56(84) bytes of data. 64 bytes from 10.88.33.26: icmp_seq=1 ttl=64 time=0.770 ms 64 bytes from 10.88.33.26: icmp_seq=2 ttl=64 time=0.097 ms 64 bytes from 10.88.33.26: icmp_seq=3 ttl=64 time=0.095 ms --- 10.88.33.26 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1999ms rtt min/avg/max/mdev = 0.095/0.320/0.770/0.318 ms [grid@PTS0009 ~]$ Oracle 11gR2 Software installation: Login as Oracle user and execute runInstaller.sh
  • 25. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 26. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 27. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 28. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 29. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 30. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 31. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 32. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 33. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 34. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Creation of ASM disk group:
  • 35. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Connect as grid user and Invoke the asmca utility under $GRID_HOME/bin to create these disk groups. The screenshots of this process are as below.
  • 36. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 37. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 38. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Creation of Oracle Database instance: Login as user oracle and execute dbca
  • 39. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 40. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 41. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 42. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 43. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 44. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 45. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 46. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 47. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b To resize the shared memory I referredhttp://www.walkernews.net/2010/05/04/how-to-resize- devshm-filesystem-in-linux/ But after this ASM instance on 2nd node (PTS0006) went down. And I fought for 3Hrs and found that its silly simple command! $/grid_home/bin/srvctl status asm $/grid_home/bin/srvctl start asm Here it is ……. You can verify all the recourses by /grid_home/bin/crsctl status resource –t
  • 48. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 49. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 50. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 51. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 52. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 53. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b
  • 54. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b