UNIX SHELL IN DBA EVERYDAY

UNIX SHELL IN DBA
EVERYDAY
:~> ps -ef | grep pmon | grep -v grep

WHAT IS UNIX?
Dance bar in Ashdod, Israel

DO NOT DANCE
•

examples is not tested on production

•

one size does not ﬁts all

•

before copy and paste, check manual

•

afterwards check manual

UNIX SHELL IN DBA
EVERYDAY
• how

to get shell

• echo $SHELL

• how to roll shell

• examples

• real life

• resources

SHELL IS SEXY!
#

who | grep -i blonde | date; cd ~; unzip; touch;
strip; ﬁnger; mount; gasp; yes; uptime; umount;
sleep

SHELL IS SEXY!
•
•
•
•
•
•
•
•
•
#

who - show who is logged on

grep - print lines matching a pattern

mount - mount a filesystem

touch - change file timestamps

strip - discard symbols from object files

finger - user information lookup program

umount - unmount a filesystem

gasp - a preprocessor for assembly programs

yes - output a string repeatedly until killed
who | grep -i blonde | date; cd ~; unzip; touch; strip; finger; mount; gasp;
yes; uptime; umount; sleep

WHY ME?
•

read founded and existing scripts

•

automate systems or databases

•

manual or scheduled tasks from shell side

•

monitoring

•

backups

•

multiple databases tasks

CLIENTS

•

PuTTY

http://www.chiark.greenend.org.uk/~sgtatham/putty/

•

KiTTY

http://www.9bis.net/kitty/

•

SuperPutty

https://code.google.com/p/superputty/

•

SecureCRT
http://www.vandyke.com/products/securecrt/

http://en.wikipedia.org/wiki/Comparison_of_SSH_clients

SHELL
•

sh - Bourne shell

•

ksh - Korn shell

•

bash - Bourne-Again shell

•

csh - C shell

•

tcsh, zsh, rc, es (10+)
http://en.wikipedia.org/wiki/Unix_shell

SHELL
Job control
Aliases
Shell functions
Command history
Command line editing
Vi Command line editing
Emacs Command line editing
User name look up
Login/Logout watching
Filename completion
Username completion
Hostname completion
History completion
Builtin artithmetic evaluation
Can follow symbolic links invisibly
Periodic command execution
Custom Prompt (easily)
Underlying Syntax
Freely Available
Can cope with large argument lists
Has non-interactive startup file
Has non-login startup file
Has anonymous functions
List Variables
Full signal trap handling
Local variables
Exceptions

sh
N
N
Y(1)
N
N
N
N
N
N
N
N
N
N
N
N
N
N
sh
N
Y
N
N
N
N
Y
N
N

csh
Y
Y
N
Y
N
N
N
Y
N
Y(1)
Y(2)
Y(2)
N
Y
N
N
N
csh
N
N
Y
Y
N
Y
N
N
N

ksh
Y
Y
Y
Y
Y
Y
Y
Y
N
Y
Y
Y
N
Y
Y
N
Y
sh
N(4)
Y
Y(5)
Y(5)
N
Y
Y
Y
N

bash
Y
Y
Y
Y
Y
Y
Y
Y
N
Y
Y
Y
Y
Y
Y
N
Y
sh
Y
Y
Y(5)
Y
N
N
Y
Y
N

tcsh
Y
Y
N
Y
Y
Y(3)
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
csh
Y
Y
Y
Y
N
Y
N
N
N

zsh
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
sh
Y
Y
Y
Y
N
Y
Y
Y
N

rc
N
N
Y
L
L
L
L
L
F
L
L
L
L
N
N
N
Y
rc
Y
Y
N
N
Y
Y
Y
Y
N

es
N
N
Y
L
L
L
L
L
F
L
L
L
L
N
N
N
Y
rc
Y
Y
N
N
Y
Y
Y
Y
Y

KSH vs. BASH
$ typeset -l lowercase_only

$ lowercase_only="WiBbLe"

$ echo $lowercase_only

wibble

lowercase_only=$(echo "WiBbLe" | tr "[:upper:]" "[:lower:]")

KSH vs. BASH
let a=b+c
a=$(( b+c ))

KSH vs. BASH
$ echo wibble | read variable

$ echo $variable

wibble

$
bash-3.1$ echo wibble | read variable

bash-3.1$ echo $variable

!

bash-3.1$

KSH vs. BASH
•
•
•
•
•
•
•

bash is much easier to set a prompt that displays the current directory

ksh has associative arrays and bash doesn’t

ksh handles loop syntax a bit better

bash handles getting exit codes from pipes in a cleaner way

ksh has the print command which is way better than the echo command

bash has tab completions

ksh has the syntax cd old new which replaces old with new in your
directory and cd over there

!

pwd - /foo/bar/barfoo/one/bar/bar/foo/bar

cd to /foo/bar/barfoo/two/bar/bar/foo/bar

ksh - cd one two

bash - cd ../../../../../two/bar/bar/foo/bar

SHEBANG
•

#!/bin/ksh

•

special comment for interpreter

•

no bang, script run in current shell

•

shell may be on different hosts in different
locations

PROCESS RUN
•

cmd1 && cmd2 - run cmd1; if it returns 0 (success), run cmd2

•

cmd1 || cmd2 - run cmd1; if it returns non-zero, run cmd2

•

cmd1 & cmd2 - run cmd1 and also cmd2

•

(ls -1) - run the command "ls -1" in a sub shell

•

cmd1 | cmd2 - run cmd1 and output as input to cmd2

REDIRECTION
•

command > outfile - redirect output to file

•

command >> outfile - redirect output and append to file

•

command 2> outfile - redirect STDERR

•

command &> outfile - redirect STDOUT and STDERR

•

tee - redirect STDOUT to file and STDOUT

IF
•
•
•
•
•
•
•
•
•
•

[ -a FILE ]

True if FILE exists.

[ -d FILE ]

True if FILE exists and is a directory.

[ -h FILE ]

True if FILE exists and is a symbolic link.

[ -s FILE ]

True if FILE exists and has a size greater than zero.

[ -r FILE ]

True if FILE exists and is readable.

[ -w FILE ]

True if FILE exists and is writable.

[ -x FILE ]

True if FILE exists and is executable.

[ -O FILE ]

True if FILE exists and is owned by the effective user ID.

[ -G FILE ]

True if FILE exists and is owned by the effective group ID.

[ -L FILE ]

True if FILE exists and is a symbolic link.

IF
•
•
•
•
•
•
•

[ -z STRING ]

True of the length if "STRING" is zero.

[ -n STRING ]

True if the length of "STRING" is non-zero.

[ STRING1 == STRING2 ]

True if the strings are equal.

[ STRING1 != STRING2 ]

True if the strings are not equal.

[ STRING1 < STRING2 ]

True if "STRING1" sorts before
"STRING2" lexicographically in the current locale.

[ STRING1 > STRING2 ]

True if "STRING1" sorts after
"STRING2" lexicographically in the current locale.

[ ARG1 OP ARG2 ]

"OP" is one of -eq, -ne, -lt, -le, -gt or -ge.

IF
•

[ ! EXPR ]

True if EXPR is false.

•

[ EXPR1 -a EXPR2 ]

True if both EXPR1 and
EXPR2 are true.

•

[ EXPR1 -o EXPR2 ]

True if either EXPR1 or
EXPR2 is true.

IF
if [ -f alert_ORCL.log ]; then

echo "alert_ORCL.log exists."

fi
if [ "$STATUS" == "PRIMARY" ]; then

echo "Database status - ${STATUS}"

else

echo "Database not in correct mode (${STATUS})"

exit 0;

fi
if [ "$num_of_beer" -gt "3" -a "$num_of_beer" -lt "5" ]; then

echo "You've worked hard enough for today."

fi

FOR WHILE
•

for loop
for FILE in udump/*.trc

do

tkprof $FILE $FILE.out sort=exeela,fchela,prsela

done

•

while loop
COUNTER=0

while [ $COUNTER -lt 10 ]; do

echo The counter is $COUNTER

let COUNTER=COUNTER+1

done

INPUT
•

get data from user
stty -echo

echo -n “Please enter sys password: "

read pw

stty echo
cont=n

echo -n "Do you really want to continue? (y/n) "

read cont

if [ "$cont" != "y" ]; then

echo "Quitting..."

exit

ﬁ

OPEN PORTS
echo "Scanning TCP ports..."

for p in {1..1023}

do

(echo >/dev/tcp/localhost/$p) >/dev/null 2>&1 && echo "$p open"

done

TOOLSET
•

grep - searching for text pattern

•

awk - script language for text-processing

•

ps - information on running processes

•

find - searching for files

•

sed - stream editor for filtering and transforming text

•

watch - execute a program periodically

•

wc - counting lines/chars

•

cat - join files
http://en.wikipedia.org/wiki/List_of_Unix_programs

GREP
•

more alert_PROD.log | grep ORA-

•

grep -r ORA- admin/*

•

grep -f badORA.txt alert_PROD.log
badORA.txt
ORA-00600

ORA-1653

ORA-00257

AWK
•

awk '{pattern + action}' {ﬁlenames}

•

more /etc/passwd | grep oracle | awk -F: '{print $3}'

•

cat /etc/oratab | awk -F: '{if ($1=="ORCL") print $2 }'

•

AWK one liners
http://www.catonmat.net/blog/awk-one-liners-explained-part-one/

awk '1; { print "" }'
awk 'BEGIN { ORS="nn" }; 1'
awk '{ print } { print "" }'

ONE LINERS
•

http://www.pement.org/awk/awk1line.txt

# delete trailing whitespace (spaces, tabs) from end of each line
awk '{sub(/[ t]+$/, "")};1'

!!
# change "scarlet" or "ruby" or "puce" to "red"

awk '{gsub(/scarlet|ruby|puce/, "red")}; 1'

!
! # print any line where ﬁeld #5 is equal to "abc123"

awk '$5 == "abc123"'

•

http://sed.sourceforge.net/sed1line.txt

http://www.cheat-sheets.org/saved-copy/awk_quickref.pdf

PROCESS KILLING
•

ps -ef | grep LOCAL=NO | awk '{print "kill -9 " $2}' | sh

!

•

ps -ef | grep LOCAL=NO | awk '{print $2}' | xargs kill -9

!

•

killall oracle

!

WATCH
•

watch -tn 0.2 'ps -o cmd -C zabbix_server -C zabbix_agentd'

ALIAS
# alias

name=value

# alias name='command'

# alias name='command arg1 arg2'

# alias name='/path/to/script'

ALIAS
•
•
•
•
•
•
•
•

alias ..='cd ..'

alias ...='cd ../..'

alias rm='rm -i’

alias mv="mv -iv"

alias grep="grep -i”

alias mkdir='mkdir -pv’

alias df='df -H'

alias du='du -ch'

ALIAS
•

alias mount='mount |column -t’

/dev/sda1
proc
sysfs
none
none
none
udev
devpts

!

!

•

on
on
on
on
on
on
on
on

/
/proc
/sys
/sys/fs/fuse/connections
/sys/kernel/debug
/sys/kernel/security
/dev
/dev/pts

type
type
type
type
type
type
type
type

ext4
proc
sysfs
fusectl
debugfs
securityfs
devtmpfs
devpts

(rw,errors=remount-ro)
(rw,noexec,nosuid,nodev)
(rw,noexec,nosuid,nodev)
(rw)
(rw)
(rw)
(rw,mode=0755)
(rw,noexec,nosuid,gid=5,mode=0620)

alias path='echo -e ${PATH//:/n}'
/usr/local/sbin
/usr/local/bin
/usr/sbin
/usr/bin
/sbin
/bin
/usr/games

ALIAS
•

alias ports='netstat -tulanp’
Proto Recv-Q Send-Q Local Address
tcp
0
0 127.0.0.1:11211
tcp
0
0 0.0.0.0:80
tcp
0
0 0.0.0.0:55255
tcp
0
0 0.0.0.0:8000
tcp
0
0 127.0.0.1:3306
tcp
0
0 136.169.15.197:80
tcp
0
0 136.169.15.197:80
tcp
0
0 136.169.15.197:80
tcp
0
416 136.169.15.197:55255
tcp6
0
0 :::4949
tcp6
0
0 :::55255
tcp6
0
0 :::25565
udp
0
0 127.0.0.1:11211
udp
0
0 0.0.0.0:68

Foreign Address
0.0.0.0:*
0.0.0.0:*
0.0.0.0:*
0.0.0.0:*
0.0.0.0:*
210.97.192.220:55544
180.76.6.213:35700
180.76.5.189:29922
87.110.183.173:24426
:::*
:::*
:::*
0.0.0.0:*
0.0.0.0:*

State
LISTEN
LISTEN
LISTEN
LISTEN
LISTEN
TIME_WAIT
TIME_WAIT
TIME_WAIT
ESTABLISHED
LISTEN
LISTEN
LISTEN

PID/Program name

15500/java

-

ALIAS
•

alias last="ﬁnd . -type f -print0 | xargs -0 stat -c'%Y
:%y %12s %n' | sort -nr | cut -d: -f2- | head"
2013-12-10
2013-12-08
2013-12-05
2013-10-31
2013-08-21
2013-08-20
2013-08-04
2013-01-14
2013-01-13
2012-11-14

16:53:07.000000000
13:02:26.000000000
18:23:23.000000000
16:51:20.000000000
12:58:51.000000000
16:01:42.000000000
12:47:09.000000000
08:18:13.000000000
12:46:18.000000000
10:13:49.000000000

+0200
+0200
+0200
+0200
+0300
+0300
+0300
+0200
+0200
+0200

31750
35
17962
6630
273
432
111891750
163
69632
105

./.bash_history
./.lesshst
./.viminfo
./.ssh/known_hosts
./pwd
./.vim/.netrwhist
./vegetarisms.sql.zip
./.mysql_history
./skriesim_2013.xls
./Scripts/ezermala.sh

ALIAS
•

alias cpp=“rsync --progress -ravz”

•

alias most='du -hsx * | sort -rh | head -10’

•

alias usage='du -ch 2> /dev/null |tail -1’

•

alias untar='tar -zxvf ’

•

alias nocomment='grep -Ev '''^(#|$)''''

ALIAS
bu() {

cp $@ $@.backup-`date +%y%m%d`;

echo "`date +%Y-%m-%d` backed up $PWD/$@"
>> ~/.backups.log;

}

alias backup=bu

ALIAS
# alias
# unalias

name

# unalias -a
# name

BONUS ALIAS
doskey.mac
ls=dir $* /o/w

cat=type $*

rm=del $*

lsl=dir $* /o/p

quit=exit
doskey /macroﬁle=doskey.mac

BRACE
•

cp admin/ORCL/pfile/initORCL.ora{,.bak}

!

•

cp admin/ORCL/pfile/initORCL.ora admin/
ORCL/pfile/initORCL.ora.bak

•

ls *.{trc,log}

SUDO !!
Run last command from history

SPY
history | awk '{print $2}' | sort | uniq -c | sort -n | tail
7
9
9
12
19
20
22
85
109
185

ps
exit
rm
more
sqlplus
vi
pwd
cd
df
ls

SPACE USAGE
•

du

•

find . -type f -print0 | xargs -0 du | sort -n | tail -10 | cut
-f2 | xargs -I{} du -sh {}

•

find . -type d -print0 | xargs -0 du | sort -n | tail -10 | cut
-f2 | xargs -I{} du -sh {}

•

find . -type d -exec du -sk {} ; | sort -n -k 1

SPACE USAGE
# sh get_largest_files.sh /root 10

!

[SIZE (BYTES)]

[% OF DISK] [OWNER]

[LAST MODIFIED ON]

[FILE]

913608
73164
38772
22455
4890
170
385
23
175
134

0%
0%
0%
0%
0%
0%
0%
0%
0%
0%

2012-08-25
2012-09-18
2012-08-02
2012-09-17
2012-08-25
2012-09-03
2012-09-07
2012-08-25
2012-08-25
2012-08-25

/root/test.h.gch
/root/mem.log
/root/install.log
/root/.bash_history
/root/a.out
/root/userinfo.sh
/root/test.sh
/root/test.h
/root/test.c.good
/root/test.c

!

!

root
root
root
root
root
root
root
root
root
root

Total disk size: 23792652288 Bytes
Total size occupied by these files: 1053776 Bytes

!

17:33:33
11:06:02
15:17:39
21:09:15
17:33:33
20:10:44
01:02:02
16:58:19
17:04:46
17:32:57

[ 0% of Total Disc Space

]

*** Note: 0% represents less than 1% ***

http://www.thegeekscope.com/linux-script-to-ﬁnd-largest-ﬁles/

LOAD GENERATION
•

cat /dev/urandom > md5sum &

•

dd if=/dev/zero of=/dev/null

•

while true; do /bin/true; done

•

yes > /dev/null &

fulload() {
dd if=/dev/zero of=/dev/null |
dd if=/dev/zero of=/dev/null & };
fulload; read; killall dd

!

•

dd if=/dev/random of=/tmp/largeﬁle bs=1024 count=4000000

LOAD GENERATION
•

stress --cpu 2 --timeout 60
http://linuxdrops.com/how-to-produce-high-cpu-load-memory-io-or-stress-test-a-linux-server/

#!/bin/bash

duration=120 # seconds

instances=4 # cpus

endtime=$(($(date +%s) + $duration))

for ((i=0; i<instances; i++))

do

while (($(date +%s) < $endtime)); do :; done &

done

FORK BOMB

:(){ :|:& };:
bomb() {

bomb | bomb &

};

bomb
http://en.wikipedia.org/wiki/Fork_bomb

say() {
echo $1 | tee -a oraup_stat.txt
}

!

up_db() {
say ">>>>>>>> ORACLE_SID=$ORACLE_SID, celju augshaa..."
sqlplus "/ as sysdba" <<EOF | tee -a oraup_stat.txt
startup
exit
EOF
}

!

if [ ! -f $ORACLE_HOME/bin/oracle ]; then
say "Nav uzstadita ORACLE_HOME."
exit
else
say "ORACLE_HOME=$ORACLE_HOME"
fi

!

if [ $# -eq 0 ]; then
say ">>> Nav noraditi parametri"
die()
fi

!

while [ $# -ne 0 ]; do
export ORACLE_SID=$1
up_db
done

TEST ENV
Ir paceltas sekojoshas datubaazes:
======================================================================================================================
DB SID
Memory
ORACLE_HOME and Product Version
Actual Database Version
---------------------------------------------------------------------------------------------------------------------APVDIG
1029 M /export/home/oracle/product/10.2.0
10.2.0.4.0 64-bit
10.2.0.4.0 64-bit
ARHTEST
8.1.7.4.0 32-bit
8.1.7.4.0 32-bit
EBRTEST
1895 M /export/home/oracle/product/11.2.0.
11.2.0.2.0 64-bit
11.2.0.2.0 64-bit
ECRMUAT
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
IDM
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
MBPTEST
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
PRO11
11.2.0.2.0 64-bit
11.2.0.2.0 64-bit
RMSTEST
10.2.0.4.0 64-bit
10.2.0.4.0 64-bit
ROSMET11
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
SMTEST
183 M /export/home/oracle/product/9.2.0.1
9.2.0.8.0 64-bit
9.2.0.8.0 64-bit
SYMDW
9.2.0.8.0 64-bit
9.2.0.8.0 64-bit
SYMIBM
9.2.0.8.0 64-bit
9.2.0.8.0 64-bit
SYMUAT
9.2.0.8.0 64-bit
9.2.0.8.0 64-bit
TPENS11
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
TPENSNEW
11.1.0.7.0 64-bit
11.1.0.7.0 64-bit
TRISD
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
UFTEST
10.2.0.4.0 64-bit
10.2.0.4.0 64-bit
VOIS11T
11.2.0.3.0 64-bit
11.2.0.3.0 64-bit
======================================================================================================================
Kopaa DB: 19
26472 M

_run_sql() {
selekts=`sqlplus "/ as sysdba"<<endsql
set head off;
set serveroutput on;
declare
x number;
i number;
n number;
comp varchar2(255);
vers varchar2(255);
c varchar2(1000);
begin
select count(*) into x from dba_views where view_name = 'DBA_REGISTRY' and rownum = 1;
if x = 0 then -- versijas zem 9.0.0.0.0
c := 'select product, version from product_component_version where product
like ''Oracle%Enterprise Edition%'' or product like ''Oracle%Server%''';
else -- versijas virs 9.0.0.0.0
c := 'select comp_name, version from dba_registry where comp_name
like ''Oracle%Catalog Views%''';
end if;
i := dbms_sql.open_cursor;
dbms_sql.parse(i, c, dbms_sql.native);
dbms_sql.define_column(i, 1, comp, 255);
dbms_sql.define_column(i, 2, vers, 255);
n := dbms_sql.execute(i);
if dbms_sql.fetch_rows(i) > 0 then
dbms_sql.column_value(i, 1, comp);
dbms_sql.column_value(i, 2, vers);
dbms_output.put_line('>>>'||comp||' '||vers||'<<<');
end if;
dbms_sql.close_cursor(i);
end;
/
select '>>>'||length(addr)*4||'<<<' from v$process where ROWNUM = 1;
exit
endsql`
echo $selekts
}

for pmonproc in `ps -ef -o pid,args | grep pmon | grep -v grep | grep -v sed |
sed 's/(.*) ora_pmon_(.*)/1 2/' | sort -k 2`;
do

!

orastr=`_run_sql`
orver=ècho $orastr | sed 's/.*Release ([^ ]*) .*/1/1'`
orabinv=`file $env_orahome/bin/oracle | sed 's/.*ELF (.*)-bit .*/1/'`
typeset -L35 env_orahome
typeset -R11 orver
typeset -R11 prodshortver

!

echo "$dbsid

$mem2 M $env_orahome

$orver $orabinv-bitc"

prodver=ècho $orastr | perl -ne 's/.*?>>>(.*?)<<<.*/1/ && print'`
prodshortver=ècho $prodver | sed 's/.* ([^ ]*)/1/'`
prodbytes=ècho $orastr | perl -ne 's/.*>>>(.*?)<<<.*/1/ && print'`
vermat=ècho $prodshortver | awk '{if ($0 == $orver) {print 0} else {print 1}}'`
echo "
$prodshortver $prodbytes-bit"

!
!

if [ $vermat -ne 0 -o $prodbytes -ne $orabinv ]; the
echo " ^ ^ ^ ^ ^ ^ !!!!!!! NESAKRIIT VERSIJAS !!!!!!! ^ ^ ^ ^ ^ ^"
fi

done

!

!

env_orahome=`pargs -e "$pid" | grep "ORACLE_HOME=" | awk '{print $2}' | sed 's/.*=(.*)/1/'`
env_ldlib=`pargs -e "$pid" | grep "LD_LIBRARY_PATH" | awk '{print $2}' | sed 's/.*=(.*)/1/'`
env_path=`pargs -e "$pid" | grep ^PATH= | awk '{print $2}' | sed 's/.*=(.*)/1/'`
env_orabase=`pargs -e "$pid" | grep "ORACLE_BASE=" | awk '{print $2}' | sed 's/.*=(.*)/1/'`
env_orasid=`pargs -e "$pid" | grep "ORACLE_SID=" | awk '{print $2}' | sed 's/.*=(.*)/1/'`
env_nlsl=`pargs -e "$pid" | grep "NLS_LANG=" | awk '{print $2}' | sed 's/.*=(.*)/1/'`

mem=`pmap "$pid" 2>/dev/null | tail -1 | awk '{ print $2 }'`
mem2=ècho $mem | awk '{split($0,a,"K"); print a[1]}'`
mem2=èxpr $mem2 / 1024`
memtot=èxpr $memtot + $mem2`
if [ "$env_path" -eq "" ]; then
env_path="/usr/bin:/etc:/usr/ccs/bin/:/usr/local/bin:/usr/usb:.:"$env_orahome/bin

fi
PATH="$env_path"
LD_LIBRARY_PATH="$env_ldlib"
ORACLE_BASE="$env_orabase"
ORACLE_HOME="$env_orahome"
ORACLE_SID="$env_orasid"
NLS_LANG="$env_nlsl"
export PATH LD_LIBRARY_PATH ORACLE_BASE ORACLE_HOME ORACLE_SID NLS_LANG

oracle@test-dbs>pargs -e 9298
9298:
ora_pmon_IDM
envp[0]: SKGP_SPAWN_DIAG_PRE_EXEC_TS=
envp[1]: SKGP_HIDDEN_ARGS=
envp[2]: SKGP_SPAWN_DIAG_POST_FORK_TS=
envp[3]: SKGP_SPAWN_DIAG_PRE_FORK_TS=
envp[4]: ORACLE_SPAWNED_PROCESS=1
envp[5]: MANPATH=/usr/share/man:/usr/local/share/man/:/opt/local/share/man/
envp[6]: TERM=vt100
envp[7]: SHELL=/bin/bash
envp[8]: NLS_LANG=AMERICAN_AMERICA.AL32UTF8
envp[9]: ODBC_HOME=/export/home/oracle/odbc64
envp[10]: USER=oracle
envp[11]: LD_LIBRARY_PATH=/export/home/oracle/odbc64/lib:/export/home/oracle/
product/11.2.0.3/lib:/usr/lib:/usr/openwin/lib:/usr/local/lib:/usr/dt/lib
envp[12]: ORACLE_SID=IDM
envp[13]: ORACLE_BASE=/export/home/oracle
envp[14]: TNS_ADMIN=/export/home/oracle/product/11.2.0.3/network/admin
envp[15]: PATH=
envp[16]: PWD=/export/home/oracle/admin/IDM/pfile
envp[17]: EDITOR=vi
envp[18]: PS1=u@h>
envp[19]: SHLVL=1
envp[20]: HOME=/export/home/oracle
envp[21]: ODBCINI=/export/home/oracle/odbc64/odbc.ini
envp[22]: DISPLAY=test-dbs:10.0
envp[23]: ORACLE_HOME=/export/home/oracle/product/11.2.0.3
envp[24]: _=/export/home/oracle/product/11.2.0.3/bin/sqlplus
envp[25]: OLDPWD=/export/home/oracle/admin/IDM
envp[26]: ORA_NET2_DESC=8,1

TOPP
PID USERNAME SIZE
RSS STATE PRI NICE
TIME
3587 oracle
6522M 6518M cpu6
1
0
0:00:14
2011 oracle
495M 479M sleep
59
0
0:01:42
15441 oracle
1501M 1483M sleep
49
0
0:16:26
18128 oracle
6504M 6500M sleep
5
0
1:51:00
27174 oracle
1500M 1483M sleep
48
0
0:01:21
3255 oracle
6510M 6507M sleep
32
0
0:00:02
20861 oracle
399M 392M sleep
57
0 34:05:31
product/9.2.0.1/bin/tnslsnr NET9 -inherit
2953 oracle
1500M 1482M sleep
26
0
0:00:13
3591 oracle
6504M 6500M sleep
52
0
0:00:00
2014 oracle
446M 417M sleep
59
0
0:00:44
2010 oracle
444M 426M sleep
1
0
0:01:44
29354 oracle
1502M 1480M sleep
1
0
8:17:49
2012 oracle
441M 425M sleep
1
0
0:01:11
3522 oracle
4904M 4900M sleep
55
0
0:00:00
3821 oracle
855M 625M sleep
59
0
0:00:00
8178 oracle
1898M 1879M sleep
56
0
0:23:22
8222 oracle
1900M 1881M sleep
59
0
3:50:20
3819 oracle
856M 626M sleep
59
0
0:00:00
3777 oracle
1899M 1883M sleep
53
0
0:00:00
10501 oracle
6508M 6503M sleep
1
0
0:06:01
3769 oracle
1899M 1883M sleep
52
0
0:00:00
3767 oracle
1899M 1883M sleep
52
0
0:00:00
3761 oracle
1899M 1883M sleep
53
0
0:00:00
3743 oracle
1899M 1883M sleep
54
0
0:00:00
3771 oracle
1899M 1883M sleep
53
0
0:00:00
3787 oracle
1899M 1883M sleep
54
0
0:00:00
3589 oracle
6503M 6500M sleep
59
0
0:00:00
3789 oracle
1899M 1883M sleep
54
0
0:00:00
3813 oracle
1899M 1883M sleep
55
0
0:00:00
3824 oracle
432M 416M sleep
58
0
0:00:00
Total: 689 processes, 9160 lwps, load averages: 1.63,

CPU
4.9%
1.7%
1.3%
1.1%
0.5%
0.2%
0.1%

PROCESS/NLWP
oracle/1 3587
oracle/71 2011
oracle/1 15441
oracle/1 18128
oracle/1 27174
oracle/1 23255
tnslsnr/1 20861

:15 ora_j002_SYMUAT
:42 oracleRMSTEST (LOCAL=NO)
:26 oracleECRMUAT (LOCAL=NO)
:00 oracleSYMUAT (LOCAL=NO)
:22 oracleECRMUAT (LOCAL=NO)
:42 ora_dia0_PRO11
:31 /export/home/oracle/

0.1% oracle/1 2953 :13 oracleECRMUAT (LOCAL=NO)
0.1% oracle/1 3591 :00 ora_j004_SYMUAT
0.1% oracle/15 2014 :44 ora_lgwr_RMSTEST
0.1% oracle/258 2010 :44 ora_dbw0_RMSTEST
0.1% oracle/1 29354 :49 ora_dia0_ECRMUAT
0.0% oracle/258 2012 :11 ora_dbw1_RMSTEST
0.0% oracle/1 3522 :01 ora_j002_SYMIBM
0.0% oracle/1 3821 :00 ora_j001_IDM
0.0% oracle/1 8178 :22 ora_psp0_EBRTEST
0.0% oracle/1 8222 :21 ora_dia0_EBRTEST
0.0% oracle/1 3819 :00 ora_j000_IDM
0.0% oracle/1 3777 :00 ora_p019_EBRTEST
0.0% oracle/1 10501 :02 oracleSYMUAT (LOCAL=NO)
0.0% oracle/1 3589 :00 ora_j003_SYMUAT
0.0% oracle/1 3824 :00 ora_j000_RMSTEST
1.37, 1.29

#!/usr/bin/perl

!

$bg = $ARGV[0];

!

$pid_list = '';
if ($bg ne '') {
foreach (split(/n/,`ps -ef | grep $bg | grep -v grep`))
{
@top=split(/s+/," ".$_);
$pid_list = $pid_list.$top[2].",";
print $_."n";
}
}
if ($pid_list ne '') {$pid_list = " -p $pid_list";}

!

while (1 eq 1) {
system("clear");
$pid="";
foreach (split(/n/,`prstat -n 30 $pid_list 1 1`))
{
@top=split(/s+/," ".$_);
$ps_line ="";$ps="";
if ($pid eq "PID")
{
@ps = split(/n/,`ps -ef | grep $top[1] | grep -v grep`);
$ps_line = substr($ps[0],9,6)." ".substr($ps[0],47,length($ps[0]));
} else
{
$pid=$top[1];
}
print $_." ".$ps_line."n";

}

}
`sleep 10`;

ALERT.LOG
•

alert.log smart error check

Mon Aug 19 17:36:13 2013
Errors in file /export/home/oracle/admin/ORCL/bdump/symuat_j003_20936.trc:
ORA-12012: error on auto execute of job 4469813
ORA-20777: Kïûda -20777 ORA-20777: Kïûda 100 ORA-01403: no data foundprocedûrâ 0
KK_FG_RMSACCT_UNprocedûrâ 0 RP_AB_RMSACCT_UN
ORA-06512: at "MASTER.ERROR_REG", line 70
ORA-06512: at "MASTER.RP_AB_RMSACCT_UN", line 292
ORA-06512: at line 1

•

adrci

ADR Home = /u01/app/oracle/product/11.1.0/db_1/log/diag/rdbms/orclbi/orclbi:
*****************************************************************************
INCIDENT_ID
PROBLEM_KEY
CREATE_TIME
----------------- ------------------------- --------------------------------3808
ORA 603
2007-06-18 21:35:49.322161 -07:00
3807
ORA 600 [4137]
2007-06-18 21:35:47.862114 -07:00
3805
ORA 600 [4136]
2007-06-18 21:35:25.012579 -07:00
3804
ORA 1578
2007-06-18 21:35:08.483156 -07:00
4 rows fetched

DB BACKUP
•

RMAN backup

•

one script

•

ﬂexible conﬁguration

# datu bazes statusa noskaidrosana
STATUS_SQL="select DATABASE_ROLE FROM v$database;nexitn"
STATUS=`echo $STATUS_SQL | sqlplus -S / as sysdba | tail -2| head -1`
!
echo $STATUS
!
if [ "$STATUS" == "PRIMARY" ]; then
echo "Database status - ${STATUS}"
else
echo "Database not in correct mode (${STATUS})"
exit 0;
fi

#
# backup konfiguracija
#

!

# --------------------------------------------------------------------------# Ikdienas backup
#
FULL - pilnais backup (incremental 0)
#
INCR - inkrementals backup (incremental 1)

!

IKDIENAS_BACKUP.1=INCR
IKDIENAS_BACKUP.0=FULL

!
!

# --------------------------------------------------------------------------# Papildus backup. Tiek noteikts pec datuma (yyyy.mm.dd)
#
MONTH - izpildit backup menesea lentaas
#
QUART - izpildit backup kvartala lentaas
#
YEAR - izpildit backup gada lentaas

!

PAPILDUS_BACKUP.2012.05.31=MONTH
PAPILDUS_BACKUP.2012.06.30=QUART
PAPILDUS_BACKUP.2012.09.29=QUART
PAPILDUS_BACKUP.2012.10.18=FULL
PAPILDUS_BACKUP.2012.10.19=FULL

# check for business backup required

PAPILDUS_BACKUP=`cat ${BACKUP_CFG} | grep -v "#" | grep "PAPILDUS_BACKUP.${D_DATE}" | awk
'BEGIN {FS="="} {print $2} '`
IKDIENAS_BACKUP=`cat ${BACKUP_CFG} | grep -v "#" | grep "IKDIENAS_BACKUP.${D_WEEK_DAY}" |
awk 'BEGIN {FS="="} {print $2} '`

!

BACKUP_TIME=28;

!

if [ "${PAPILDUS_BACKUP}" = "MONTH" ] ; then
# start business backup
BACKUP_TIME=120;
BACKUP_TAPE=tdpo_monthly.opt
BACKUP_LEVEL=0;
BACKUP_TAG=${PAPILDUS_BACKUP}` date '+%Y%m' `
#
elif [ "${IKDIENAS_BACKUP}" = "INCR" ] ; then
BACKUP_TIME=28;
BACKUP_TAPE=tdpo.opt
PAPILDUS_BACKUP=INCR
BACKUP_LEVEL=1;
BACKUP_TAG=${PAPILDUS_BACKUP}` date '+%Y%m%d' `
#
elif [ "${IKDIENAS_BACKUP}" = "FULL" ] ; then
BACKUP_TIME=28;
BACKUP_TAPE=tdpo.opt
PAPILDUS_BACKUP=FULL
BACKUP_LEVEL=0;
BACKUP_TAG=${PAPILDUS_BACKUP}` date '+%Y%m%d' `
#
fi

cat > $RUNCMD <<!
connect target /;

!

# Parameters set section
CONFIGURE ENCRYPTION FOR DATABASE OFF;
CONFIGURE RETENTION POLICY TO RECOVERY WINDOW OF 28 DAYS;
CONFIGURE CONTROLFILE AUTOBACKUP ON;
CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE 'sbt_tape' TO 'online_ctl_
%F.ctl';
CONFIGURE CHANNEL DEVICE TYPE 'sbt_tape' PARMS 'ENV=(TDPO_OPTFILE=/usr/tivoli/tsm/
client/oracle/bin64/${BACKUP_TAPE})' FORMAT 'backup_df_%t_%s_%p_%c' MAXPIECESIZE 100G;
CONFIGURE DEVICE TYPE 'sbt_tape' PARALLELISM 2 BACKUP TYPE TO BACKUPSET;
CONFIGURE DEFAULT DEVICE TYPE TO SBT;
CONFIGURE ARCHIVELOG DELETION POLICY TO SHIPPED TO ALL STANDBY;

!

run {
set duplex 1;
backup incremental level ${BACKUP_LEVEL} database tag '${BACKUP_TAG}' KEEP UNTIL TIME
'sysdate + ${BACKUP_TIME}' LOGS;
backup current controlfile;
backup spfile format 'spfile_%d_%s_%T_dbid%I.ora' tag 'spfile ${BACKUP_TAG}';
backup as compressed backupset archivelog all delete input filesperset=20;
}
!

!

#
${ORACLE_HOME}/bin/rman msgno cmdfile=${RUNCMD} log=${RMANLOG} 1>>${RUNLOG} 2>&1

# log apvienosans un parsesana
cat ${RMANLOG} | sed 's/^RMAN-[0-9][0-9][0-9][0-9][0-9]:.//g' >> ${RUNLOG}
cat ${RMANLOG_DEL} | sed 's/^RMAN-[0-9][0-9][0-9][0-9][0-9]:.//g' >> ${RUNLOG}
cat ${RMANLOG_CTRL} | sed 's/^RMAN-[0-9][0-9][0-9][0-9][0-9]:.//g' >> ${RUNLOG}

!
!

# ORA- kludu pievienosana log faila sakumaa
grep ORA- ${RUNLOG} > /tmp/ora_errors.log
cat /tmp/ora_errors.log ${RUNLOG} > /tmp/tempfile ; mv /tmp/tempfile ${RUNLOG}

!
!

cat ${RUNLOG} | ${MAILER} -s "BACKUP at `date` on ${ORACLE_SID} DONE `head -1 /tmp/
ora_errors.log`" $MAILTO

HA WORKAROUND
•

AIX hardware

•

Oracle Database on ASM

•

Oracle DataGuard + Observer

•

Full HA tests

•

Service Request + AIX support

HA WORKAROUND
!

•

database is PHYSICAL STANDBY (RULE_1)

•

if dgmgrl show conﬁguration hang (RULE_2)

•

has errors "DMON: Database ora is still
working on the task." (RULE_3)

•

manual failover

#setup home
. /home/oracle/oracleDB.sh
!

RUN_NODE=secondary
RUN_CHECK_NODE=primary
RUN_SLEEP=10
LOG_SLEEP=60
LOG_TAIL=10
RUN_HOME=/home/oracle/local/dg

echo "RULE 1 check"
!

STATUS_SQL="select DATABASE_ROLE FROM v$database;
nexitn"
STATUS=`echo $STATUS_SQL | sqlplus -S / as sysdba |
tail -2| head -1`
!

if [ "$STATUS" == "PHYSICAL STANDBY" ]; then
echo "tOK"
echo "tDatabase status - ${STATUS}"
else
echo "tDatabase not correct mode (${STATUS})"
exit 0;
fi

DG_STATUS.SH
#!/bin/sh
!

#setup dgmgrl home
. /home/oracle/oracleDB.sh
!

# start check configuration
dgmgrl <<EOL
connect sys/master;
show configuration verbose;
EOL

echo "RULE 2 check"
!
NOW=`date`
echo "tCheck time - ${NOW}"
echo "tSleep time - ${RUN_SLEEP} sec"
echo "tSleeping..."
sh $RUN_HOME/DG_status.sh > /dev/null 2>&1 &
sleep $RUN_SLEEP
!
NOW=`date`
!
PROCESS=`ps -ef | grep DG_status.sh | grep -v grep`
PROCESS_COUNT=`ps -ef | grep DG_status.sh | grep -v grep | wc -l`
!
echo "tProcess count - ${PROCESS_COUNT}"
!
if [ $PROCESS_COUNT != 0 ]; then
echo "tOK"
echo "t${PROCESS}"
else
echo "tDG configuration check run normaly";
exit 0
fi

echo "RULE 3 check"

!

sleep $LOG_SLEEP

!

NOW=`date`

!

# DG log faila atrasanas vietas noskaidrosana
DIAG_DEST_SQL="select value from v$parameter where name='diagnostic_dest';nexitn"
DIAG_DEST=`echo $DIAG_DEST_SQL | sqlplus -S / as sysdba | tail -2| head -1`
DGLOG_FILE="${DIAG_DEST}/diag/rdbms/${RUN_NODE}/${RUN_NODE}/trace/drc${RUN_NODE}.log"
DGLOG_ERROR="DMON: Database ${RUN_CHECK_NODE} is still working on the task.”

!

if [ -f $DGLOG_FILE ]; then
echo "tDGLOG_FILE=${DGLOG_FILE}"
echo "tDGLOG_ERROR='${DGLOG_ERROR}'"
echo "tLOG_TAIL=${LOG_TAIL}"
else
echo "DG log file don't exists - ${DGLOG_FILE} (diagnostic_dest=${DIAG_DEST})"
exit 0
fi

!

LINE=`tail -${LOG_TAIL} ${DGLOG_FILE} | grep "${DGLOG_ERROR}"`
LINE_COUNT=`tail -${LOG_TAIL} ${DGLOG_FILE} | grep "${DGLOG_ERROR}" | wc -l`

!

if [ $LINE_COUNT != 0 ]; then
echo "tOK"
echo "tLINE_COUNT=${LINE_COUNT}"
echo "t${LINE}"
else
echo "tNO errors in log file";
exit 0
fi

FAILOVER
# te jataisa ir failover
dgmgrl <<EOL
connect sys/master;
failover to ${RUN_NODE}
EOL

MYSELF
•

Signis Vāvere

•

AS SEB banka

•

database analyst

•

http://lv.linkedin.com/in/signis

HAVE YOURSELF A MERRY
LITTLE CHRISTMAS
SQL> set pagesize 0
SQL> set head off
SQL> with Mx as (select 60 as MaxWidth from dual)
select decode
( sign(floor(MaxWidth /2)-rownum)
, 1
, lpad( ' ', floor(MaxWidth /2)(rownum-1)) || rpad( '*', 2*(rownum-1)+1, ' *')
, lpad( '* * *', floor(MaxWidth/2)+3)
)
from all_tables ,Mx
where rownum < floor(MaxWidth /2) + 6;

*

!

* *
* * *
* * * *
* * * * *
* * * * * *
* * * * * * *
* * * * * * * *
* * * * * * * * *
* * * * * * * * * *
* * * * * * * * * * *
* * * * * * * * * * * *
* * * * * * * * * * * * *
* * * * * * * * * * * * * *
* * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * * * * * * *
* * * * * * * * * * * * * * * * * * * * * * * * * * * * *
* * *
* * *
* * *
* * *
* * *
* * *

35 rows selected.

UNIX SHELL IN DBA EVERYDAY

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (17)

Ähnlich wie UNIX SHELL IN DBA EVERYDAY

Ähnlich wie UNIX SHELL IN DBA EVERYDAY (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

UNIX SHELL IN DBA EVERYDAY