ORACLE 10G RAC+LINUX+ASM安裝

ORACLE 10G RAC+LINUX+ASM安裝

1 軟件準備

10201_database_linux_x86_64.cpio è ORACLE 10.2.0.1軟件

10201_clusterware_linux_x86_64.cpio.gz èORACLE 10.2.0.1 集羣軟件

p8202632_10205_Linux-x86-64.zip è ORACLE 10.2.0.5升級包

2 系統環境準備

主機名	IP地址	操做系統
rac1	eth0 public  172.44.2.18 eth1 private 172.44.4.18 vip 172.44.2.180	centos 5.8 x86_64
rac2	eth0 public  172.44.2.22 eth1 private 172.44.4.22 vip 172.44.2.220	centos 5.8 x86_64

3 安裝

3.1 安裝前提說明

本次安裝是在ESXI5.5上基於Centos5.8安裝ORACLE 10G RAC+ASM。

3.1.1 ESXI配置共享磁盤

1. 在ESXI中的虛擬機上新增5塊磁盤，1塊用做OCR,一塊用做VOTE，其餘的用做數據盤。而且新的SCSI總線共享策略要設置爲虛擬。磁盤必須選擇厚置備模式。

3.2 安裝數據庫軟件依賴包

使用安裝鏡像做爲本地yum源，安裝ORACLE所需依賴包

yum -y install binutils compat-libstdc++-33 elfutils-libelf elfutils-libelf-devel elfutils-libelf-devel-static gcc gcc-c++ glibc glibc-common glibc-devel glibc-headers kernel-headers ksh libaio libaio-devel libgcc libgomp libstdc++ libstdc++-devel make sysstat unixODBC unixODBC-devel libXp

3.3 配置內核參數

# vim /etc/sysctl.conf

kernel.shmall = 17179869184

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

fs.file-max = 65536

net.ipv4.ip_local_port_range = 1024 65000

net.core.rmem_default = 1048576

net.core.rmem_max = 1048576

net.core.wmem_default = 262144

net.core.wmem_max = 262144

# sysctl -p

3.4 配置用戶limit

vim /etc/security/limits.conf

oracle soft nproc 2047

oracle hard nproc 16384

oracle soft nofile 1024

oracle hard nofile 65536

3.5 配置/etc/pam.d/login

# vim /etc/pam.d/login

session required pam_limits.so

3.6 配置雙機時間同步

# /usr/sbin/ntpdate 172.44.3.101 && /sbin/hwclock –w

# crontab -e

* * * * * (/usr/sbin/ntpdate 172.44.3.101 && /sbin/hwclock -w) &> /dev/null

# vim /etc/modprobe.conf

options hangcheck-timer hangcheck_tick=30 hangcheck_margin=180

# modprobe -v hangcheck-timer

3.7 建立用戶和屬組

# groupadd -g 1000 oinstall

# groupadd -g 1001 dba

# useradd -g oinstall -G dba oracle

3.8 配置/etc/hosts

# vim /etc/hosts

## 添加如下信息

172.44.2.18 rac1

172.44.2.22 rac2

172.44.4.18 rac1priv

172.44.4.22 rac2priv

172.44.2.180 rac1vip

172.44.2.220 rac2vip

3.9 配置雙機ssh互信

在節點1上執行

[root@rac1 ~]# su - oracle

[oracle@rac1 ~]$ /usr/bin/ssh-keygen -t rsa

Generating public/private rsa key pair.

Enter file in which to save the key (/home/oracle/.ssh/id_rsa):

Created directory '/home/oracle/.ssh'.

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in /home/oracle/.ssh/id_rsa.

Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.

The key fingerprint is:

f1:e5:45:34:68:d5:93:d6:af:bf:ee:d4:d8:dd:e5:97 oracle@rac1

在節點2上執行

[root@rac2 ~]# su - oracle

[oracle@rac2 ~]$ /usr/bin/ssh-keygen -t rsa

Generating public/private rsa key pair.

Enter file in which to save the key (/home/oracle/.ssh/id_rsa):

Created directory '/home/oracle/.ssh'.

Enter passphrase (empty for no passphrase):

Enter same passphrase again:

Your identification has been saved in /home/oracle/.ssh/id_rsa.

Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.

The key fingerprint is:

e2:ce:11:97:04:d7:05:33:56:c6:aa:0c:89:c8:1c:c2 oracle@rac2

[oracle@rac2 ~]$

在節點1,2上執行

[oracle@rac2 ~]$ cd .ssh/

[oracle@rac2 .ssh]$ cat id_rsa.pub > authorized_keys

[oracle@rac2 .ssh]$ vim authorized_keys

把節點1 authorized_keys文件的內容拷貝到節點2的authorized_keys文件中，把節點2 authorized_keys文件中的內容拷貝到節點1中。

[oracle@rac2 .ssh]$ vim authorized_keys

ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4+8rN3x69Exzx5Y+8POGESZUGS2vew8iHgXRhEk1yI4vquENFmxZinTRsx+tlp2i7fpsIjgkPTqG4Z5UL4E6RYKSeOFJa9qy1VdfQnH6oO0A8fr0qaSrwqy3VzwsV6pFU5Rd0l+y/P7aMCrrWbIqboWdiuAj9ge14jRygY+ip/MwcVPgoXwx5HBzb7Ig7R73mEHAmAXPjoa8PabZmrvBKYt3o0hDAqUlURRV/hA1UPMJOnLP7gfZHEF3g4PiYux8rLIiMZGVSpXFpk8H9yvXqqhJPW780K4Qp15MLRwJW8kMMqDl/pRwwvfNZkgd8ZCtSiAnshtxGWk/VvnauEqI9w== oracle@rac2

ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA0JKof7JLP1/P2Yk0RbflGGihNArnRYt1dOSDgdllNULAEyA0X8I7IKV4rwkqXZkfEwirYKCtkdeOg56S/qddbpOa

kJ1ibOHmrcavhfYeIyK6/fPon1TuJESuTdWcvk3H8XYergVTtWKmWoHs6xzL+Ms1dIUeywfg/7liWxprTpuyTW6kUB4Y7ilcxumVTKkUGs1oLWCN7xJbGKUV+yzo

pGeDApK2IhdSKZeDzSJCeeagGNzh+K9r6tuoLdY/w5ahvQc8Rw9EKO2+Kv1P+lvEIhE6qsxTotJRQsO+hLVYT/U1dCMLjXkL0hm0C6ARsAh5s91xovxkmQ5Bc62s

vHnFGQ== oracle@rac1

測試雙機ssh互信，在節點1，2上分別執行

[oracle@rac2 ~]$ ssh rac1

Last login: Wed Jan 18 17:53:09 2017 from rac1priv

[oracle@rac1 ~]$ exit

logout

Connection to rac1 closed.

[oracle@rac2 ~]$ ssh rac2

The authenticity of host 'rac2 (172.44.2.22)' can't be established.

RSA key fingerprint is 01:bc:86:0e:77:04:41:9d:1d:ee:7d:ff:12:bb:8b:88.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'rac2,172.44.2.22' (RSA) to the list of known hosts.

[oracle@rac2 ~]$ exit

logout

Connection to rac2 closed.

[oracle@rac2 ~]$ ssh rac1priv

The authenticity of host 'rac1priv (172.44.4.18)' can't be established.

RSA key fingerprint is 01:bc:86:0e:77:04:41:9d:1d:ee:7d:ff:12:bb:8b:88.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'rac1priv,172.44.4.18' (RSA) to the list of known hosts.

Last login: Wed Jan 18 17:54:06 2017 from rac2

[oracle@rac1 ~]$ exit

logout

Connection to rac1priv closed.

[oracle@rac2 ~]$ ssh rac2priv

The authenticity of host 'rac2priv (172.44.4.22)' can't be established.

RSA key fingerprint is 01:bc:86:0e:77:04:41:9d:1d:ee:7d:ff:12:bb:8b:88.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'rac2priv,172.44.4.22' (RSA) to the list of known hosts.

Last login: Wed Jan 18 17:54:13 2017 from rac2

[oracle@rac2 ~]$

3.10 配置oracle用戶環境變量

在節點1上

[oracle@rac1 ~]$ vim .bash_profile

# .bash_profile

 

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

 

# User specific environment and startup programs

 

PATH=$PATH:$HOME/bin

 

export PATH

 

ORACLE_BASE=/u01/app/oracle

export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs

export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1

export ORACLE_SID=test1

export PATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:.

 

alias sqlplus='rlwrap sqlplus' # oracle sqlpls

alias rman='rlwrap rman' # oracle rman

alias ggsci='rlwrap ggsci' # oracle goldengate

stty erase ^h

export NLS_LANG=AMERICAN_AMERICA.UTF8

export NLS_DATE_FORMAT='yyyymmdd hh24:mi:ss'

在節點2上

[oracle@rac2 ~]$ vim .bash_profile

# .bash_profile

 

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

 

# User specific environment and startup programs

 

PATH=$PATH:$HOME/bin

 

ORACLE_BASE=/u01/app/oracle

export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs

export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1

export ORACLE_SID=test2

export PATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:.

 

alias sqlplus='rlwrap sqlplus' # oracle sqlpls

alias rman='rlwrap rman' # oracle rman

alias ggsci='rlwrap ggsci' # oracle goldengate

stty erase ^h

export NLS_LANG=AMERICAN_AMERICA.UTF8

export NLS_DATE_FORMAT='yyyymmdd hh24:mi:ss'

 

export PATH

3.11 配置共享磁盤

在節點1上對磁盤進行分區

[root@rac1 network-scripts]# fdisk -l

 

Disk /dev/sda: 32.2 GB, 32212254720 bytes

255 heads, 63 sectors/track, 3916 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

/dev/sda1 * 1 13 104391 83 Linux

/dev/sda2 14 1057 8385930 82 Linux swap / Solaris

/dev/sda3 1058 3916 22964917+ 8e Linux LVM

 

Disk /dev/sdb: 524 MB, 524288000 bytes

64 heads, 32 sectors/track, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

 

Disk /dev/sdb doesn't contain a valid partition table

 

Disk /dev/sdc: 524 MB, 524288000 bytes

64 heads, 32 sectors/track, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

 

Disk /dev/sdc doesn't contain a valid partition table

 

Disk /dev/sdd: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Disk /dev/sdd doesn't contain a valid partition table

 

Disk /dev/sde: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Disk /dev/sde doesn't contain a valid partition table

 

Disk /dev/sdf: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Disk /dev/sdf doesn't contain a valid partition table

[root@rac1 network-scripts]# df -h

Filesystem Size Used Avail Use% Mounted on

/dev/mapper/VolGroup00-LogVol00

22G 2.8G 18G 14% /

/dev/sda1 99M 13M 81M 14% /boot

tmpfs 2.0G 0 2.0G 0% /dev/shm

/dev/hdc 4.3G 4.3G 0 100% /mnt

[root@rac1 network-scripts]# fdisk /dev/sdb

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

 

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4):

Value out of range.

Partition number (1-4):

Value out of range.

Partition number (1-4): 1

First cylinder (1-500, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-500, default 500):

Using default value 500

 

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

 

WARNING: Re-reading the partition table failed with error 16: Device or resource busy.

The kernel still uses the old table.

The new table will be used at the next reboot.

Syncing disks.

[root@rac1 network-scripts]# fdisk /dev/sdc

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

 

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-500, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-500, default 500):

Using default value 500

 

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

 

WARNING: Re-reading the partition table failed with error 16: Device or resource busy.

The kernel still uses the old table.

The new table will be used at the next reboot.

Syncing disks.

[root@rac1 network-scripts]# fdisk /dev/sdd

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

 

 

The number of cylinders for this disk is set to 1305.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-1305, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-1305, default 1305):

Using default value 1305

 

Command (m for help):

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

 

WARNING: Re-reading the partition table failed with error 16: Device or resource busy.

The kernel still uses the old table.

The new table will be used at the next reboot.

Syncing disks.

[root@rac1 network-scripts]# fdisk /dev/sde

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

 

 

The number of cylinders for this disk is set to 1305.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-1305, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-1305, default 1305):

Using default value 1305

 

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

 

WARNING: Re-reading the partition table failed with error 16: Device or resource busy.

The kernel still uses the old table.

The new table will be used at the next reboot.

Syncing disks.

[root@rac1 network-scripts]# fdisk /dev/sdf

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

 

 

The number of cylinders for this disk is set to 1305.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-1305, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-1305, default 1305):

Using default value 1305

 

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

 

WARNING: Re-reading the partition table failed with error 16: Device or resource busy.

The kernel still uses the old table.

The new table will be used at the next reboot.

Syncing disks.

# partprobe

[root@rac1 network-scripts]# fdisk -l

 

Disk /dev/sda: 32.2 GB, 32212254720 bytes

255 heads, 63 sectors/track, 3916 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

/dev/sda1 * 1 13 104391 83 Linux

/dev/sda2 14 1057 8385930 82 Linux swap / Solaris

/dev/sda3 1058 3916 22964917+ 8e Linux LVM

 

Disk /dev/sdb: 524 MB, 524288000 bytes

64 heads, 32 sectors/track, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

 

Device Boot Start End Blocks Id System

/dev/sdb1 1 500 511984 83 Linux

 

Disk /dev/sdc: 524 MB, 524288000 bytes

64 heads, 32 sectors/track, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

 

Device Boot Start End Blocks Id System

/dev/sdc1 1 500 511984 83 Linux

 

Disk /dev/sdd: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

/dev/sdd1 1 1305 10482381 83 Linux

 

Disk /dev/sde: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

/dev/sde1 1 1305 10482381 83 Linux

 

Disk /dev/sdf: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

/dev/sdf1 1 1305 10482381 83 Linux

[root@rac1 network-scripts]#

在節點1,2上執行

[root@rac1 network-scripts]# vim /etc/udev/rules.d/60-raw.rules

ACTION=="add", KERNEL=="sdc3",RUN+="/bin/raw /dev/raw/raw6 %N"

# Enter raw device bindings here.

#

# An example would be:

# ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N"

# to bind /dev/raw/raw1 to /dev/sda, or

# ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"

# to bind /dev/raw/raw2 to the device with major 8, minor 1.

ACTION=="add", KERNEL=="sdb1",RUN+="/bin/raw /dev/raw/raw1 %N"

ACTION=="add", KERNEL=="sdc1",RUN+="/bin/raw /dev/raw/raw2 %N"

ACTION=="add", KERNEL=="sdd1",RUN+="/bin/raw /dev/raw/raw3 %N"

ACTION=="add", KERNEL=="sde1",RUN+="/bin/raw /dev/raw/raw4 %N"

ACTION=="add", KERNEL=="sdf1",RUN+="/bin/raw /dev/raw/raw5 %N"

ACTION=="add",KERNEL=="raw[1-5]", OWNER="oracle", GROUP="oinstall", MODE="660"

[root@rac1 network-scripts]# start_udev

Starting udev: [ OK ]

[root@rac1 network-scripts]# raw

raw raw2tiff

[root@rac1 network-scripts]# raw

raw raw2tiff

[root@rac1 network-scripts]# raw -qa

/dev/raw/raw1: bound to major 8, minor 17

/dev/raw/raw2: bound to major 8, minor 33

/dev/raw/raw3: bound to major 8, minor 49

/dev/raw/raw4: bound to major 8, minor 65

/dev/raw/raw5: bound to major 8, minor 81

[root@rac1 network-scripts]#

3.12 建立安裝路徑

在節點1,2上執行

# mkdir -p /u01/app/oracle/product/10.2.0/crs

# mkdir -p /u01/app/oracle/product/10.2.0/db_1

# mkdir -p /u01/oradata

# chown -R oracle.oinstall /u01

# chown -R oracle.oinstall /u01

3.13 解壓ORACLE 集羣軟件安裝包

在安裝ORACLE數據庫軟件前，須要先安裝ORACLE clusterware集羣軟件

[root@rac1 src]# cpio -idcmv < 10201_clusterware_linux_x86_64.cpio

3.14 安裝clusterware集羣軟件

1. 在節點1,2上執行

# /usr/local/src/clusterware/rootpre/rootpre.sh

2. $ ./runInstaller –ignoreSysPrereq

3. 選擇crs路徑，注意別選擇了dbms的

4. 檢查安裝要求

5. 輸入另外一個節點的信息

6. 確認兩個節點的信息無誤，選擇下一步

7. 修改網卡用途

 

8． 選擇OCR路徑

9. 選擇Voting Disk

10. 開始安裝

11. 安裝進度條

 

12. 使用root在兩個節點上執行腳本

在節點1 上執行

[root@rac1 ~]# /home/oracle/oraInventory/orainstRoot.sh

在節點2上執行

[root@rac2 ~]# /home/oracle/oraInventory/orainstRoot.sh

Changing permissions of /home/oracle/oraInventory to 770.

Changing groupname of /home/oracle/oraInventory to oinstall.

The execution of the script is complete

[root@rac2 ~]#

上節點1上執行

[root@rac1 ~]# /u01/app/oracle/product/10.2.0/crs/root.sh

WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root

WARNING: directory '/u01/app/oracle/product' is not owned by root

WARNING: directory '/u01/app/oracle' is not owned by root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Checking to see if Oracle CRS stack is already configured

/etc/oracle does not exist. Creating it now.

 

Setting the permissions on OCR backup directory

Setting up NS directories

Oracle Cluster Registry configuration upgraded successfully

WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root

WARNING: directory '/u01/app/oracle/product' is not owned by root

WARNING: directory '/u01/app/oracle' is not owned by root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Successfully accumulated necessary OCR keys.

Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.

node <nodenumber>: <nodename> <private interconnect name> <hostname>

node 1: rac1 rac1priv rac1

node 2: rac2 rac2priv rac2

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

Now formatting voting device: /dev/raw/raw2

Format of 1 voting devices complete.

Startup will be queued to init within 90 seconds.

Adding daemons to inittab

Expecting the CRS daemons to be up within 600 seconds.

CSS is active on these nodes.

rac1

CSS is inactive on these nodes.

rac2

Local node checking complete.

Run root.sh on remaining nodes to start CRS daemons.

[root@rac1 ~]#

在節點2上執行，出現報錯

[root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/root.sh

WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root

WARNING: directory '/u01/app/oracle/product' is not owned by root

WARNING: directory '/u01/app/oracle' is not owned by root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Checking to see if Oracle CRS stack is already configured

/etc/oracle does not exist. Creating it now.

 

Setting the permissions on OCR backup directory

Setting up NS directories

Oracle Cluster Registry configuration upgraded successfully

WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root

WARNING: directory '/u01/app/oracle/product' is not owned by root

WARNING: directory '/u01/app/oracle' is not owned by root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

Successfully accumulated necessary OCR keys.

Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.

node <nodenumber>: <nodename> <private interconnect name> <hostname>

node 1: rac1 rac1priv rac1

node 2: rac2 rac2priv rac2

clscfg: Arguments check out successfully.

 

NO KEYS WERE WRITTEN. Supply -force parameter to override.

-force is destructive and will destroy any previous cluster

configuration.

Oracle Cluster Registry for cluster has already been initialized

Startup will be queued to init within 90 seconds.

Adding daemons to inittab

Expecting the CRS daemons to be up within 600 seconds.

CSS is active on these nodes.

rac1

rac2

CSS is active on all nodes.

Waiting for the Oracle CRSD and EVMD to start

Oracle CRS stack installed and running under init(1M)

Running vipca(silent) for configuring nodeapps

/u01/app/oracle/product/10.2.0/crs/jdk/jre//bin/java: error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory

[root@rac2 ~]#

備註：若是不但願看到報錯，能夠先執行下面的vipca操做以及oifcfg操做後，再執行該腳本

在節點1上執行

$ cd /u01/app/oracle/product/10.2.0/crs/bin

$ vim vipca

在文件中添加unset LD_ASSUME_KERNEL，以下圖所示

在節點1上執行

[root@rac1 bin]# ./oifcfg setif -global eth0/172.44.2.0:public

[root@rac1 bin]# ./oifcfg setif -global eth1/172.44.4.0:cluster_interconnect

[root@rac1 bin]# ./oifcfg getif

eth0 172.44.2.0 global public

eth1 172.44.4.0 global cluster_interconnect

[root@rac1 bin]#

在節點1上執行

# cd /u01/app/oracle/product/10.2.0/crs/bin

# ./vipca

選擇NEXT

2． 選擇下一步

 

3. 輸入兩個節點的VIP信息

4. 確認兩個節點的VIP信息無誤

5. 等待安裝完成

6. 這時候返回以前安裝的界面，點擊OK

7. 若是配置有問題的話，點擊OK以後，後面會出現報錯。

8. 安裝完成。

3.15 安裝數據庫軟件

在節點1上執行

/usr/local/src/database/runInstaller

1. 選擇下一步

1. 選擇安裝企業版

1. 注意這是是DB HOME

1. 選擇兩個節點

1. 檢查經過以後，選擇下一步

1. 選擇只安裝軟件

1. 選擇安裝

1. 在兩個節點上執行腳本

[root@rac1 bin]# /u01/app/oracle/product/10.2.0/db_1/root.sh

Running Oracle10 root.sh script...

 

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Copying dbhome to /usr/local/bin ...

Copying oraenv to /usr/local/bin ...

Copying coraenv to /usr/local/bin ...

 

 

Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

 

[root@rac1 bin]#

[root@rac2 ~]# /u01/app/oracle/product/10.2.0/db_1/root.sh

Running Oracle10 root.sh script...

 

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Copying dbhome to /usr/local/bin ...

Copying oraenv to /usr/local/bin ...

Copying coraenv to /usr/local/bin ...

 

 

Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

 

[root@rac2 ~]#

安裝完成。

3.16 安裝監聽

在節點1上執行

$ netca

2. 選擇集羣配置

3. 選擇兩個節點

4. 選擇下一步

5. 選擇下一步

6. 選擇下一步

7. 選擇下一步

8. 選擇下一步

9. 選擇下一步

10 . 完成配置。

3.17 建庫

1. 在節點1上執行

$ dbca

2. 選擇下一步

3. 選擇建立數據庫

4. 選擇兩個節點

5. 選擇下一步

6. 輸入數據庫名稱

7. 選擇下一步

8. 配置密碼

9. 使用ASM

10. 配置ASM參數

11. 配置ASM 磁盤

12. 配置ASM

13. 選擇數據文件存放路徑

 

14. 選擇下一步

15. 選擇下一步

16. 選擇下一步

17. 配置數據庫字符集

18. 選擇下一步

19. 選擇下一步

20. 選擇Finish

21. 選擇OK ，開始安裝

22. 安裝完成

[oracle@rac1 ~]$ crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

ora.test.db application ONLINE ONLINE rac1

ora....t1.inst application ONLINE ONLINE rac1

ora....t2.inst application ONLINE ONLINE rac2

3.18 升級CRS

在節點1執行

# unzip p8202632_10205_Linux-x86-64.zip

# cd Disk1/

1. 選擇下一步

2. 選擇下一步

3. 選擇下一步

4. 檢查經過後，選擇下一步

5. 選擇安裝，安裝完成以後，在節點1,2執行如下語句

[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl stop crs

Stopping resources.

Successfully stopped CRS resources

Stopping CSSD.

Shutting down CSS daemon.

Shutdown request successfully issued.

[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/crs/install/root102.sh

Creating pre-patch directory for saving pre-patch clusterware files

Completed patching clusterware files to /u01/app/oracle/product/10.2.0/crs

Relinking some shared libraries.

Relinking of patched files is complete.

WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root

WARNING: directory '/u01/app/oracle/product' is not owned by root

WARNING: directory '/u01/app/oracle' is not owned by root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Preparing to recopy patched init and RC scripts.

Recopying init and RC scripts.

Startup will be queued to init within 30 seconds.

Starting up the CRS daemons.

Waiting for the patched CRS daemons to start.

This may take a while on some systems.

.

10205 patch successfully applied.

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

Successfully deleted 1 values from OCR.

Successfully deleted 1 keys from OCR.

Successfully accumulated necessary OCR keys.

Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.

node <nodenumber>: <nodename> <private interconnect name> <hostname>

node 1: rac1 rac1priv rac1

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

clscfg -upgrade completed successfully

Creating '/u01/app/oracle/product/10.2.0/crs/install/paramfile.crs' with data used for CRS configuration

Setting CRS configuration values in /u01/app/oracle/product/10.2.0/crs/install/paramfile.crs

[root@rac1 Disk1]#

[root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl stop crs

Stopping resources.

Successfully stopped CRS resources

Stopping CSSD.

Shutting down CSS daemon.

Shutdown request successfully issued.

[root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/install/root102.sh

Creating pre-patch directory for saving pre-patch clusterware files

Completed patching clusterware files to /u01/app/oracle/product/10.2.0/crs

Relinking some shared libraries.

Relinking of patched files is complete.

WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root

WARNING: directory '/u01/app/oracle/product' is not owned by root

WARNING: directory '/u01/app/oracle' is not owned by root

WARNING: directory '/u01/app' is not owned by root

WARNING: directory '/u01' is not owned by root

Preparing to recopy patched init and RC scripts.

Recopying init and RC scripts.

Startup will be queued to init within 30 seconds.

Starting up the CRS daemons.

Waiting for the patched CRS daemons to start.

This may take a while on some systems.

.

10205 patch successfully applied.

clscfg: EXISTING configuration version 3 detected.

clscfg: version 3 is 10G Release 2.

Successfully deleted 1 values from OCR.

Successfully deleted 1 keys from OCR.

Successfully accumulated necessary OCR keys.

Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.

node <nodenumber>: <nodename> <private interconnect name> <hostname>

node 2: rac2 rac2priv rac2

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

clscfg -upgrade completed successfully

Creating '/u01/app/oracle/product/10.2.0/crs/install/paramfile.crs' with data used for CRS configuration

Setting CRS configuration values in /u01/app/oracle/product/10.2.0/crs/install/paramfile.crs

[root@rac2 ~]#

查詢CRS版本

[oracle@rac2 ~]$ crsctl query crs softwareversion

CRS software version on node [rac2] is [10.2.0.5.0]

3.19 升級數據庫軟件

升級數據庫軟件必須先中止數據庫

在節點1，2上執行

# /u01/app/oracle/product/10.2.0/crs/bin/crsctl stop crs

1. 選擇下一步

2. 選擇DB HOME

3. 選擇下一步

4. 選擇下一步

5. 選擇下一步

6. 選擇下一步

7. 選擇安裝

8. 在節點1,2上執行

[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/db_1/root.sh

Running Oracle 10g root.sh script...

 

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

 

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

 

[root@rac1 Disk1]#

[root@rac2 ~]# /u01/app/oracle/product/10.2.0/db_1/root.sh

Running Oracle 10g root.sh script...

 

The following environment variables are set as:

ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

 

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

 

[root@rac2 ~]#

9. 安裝完成。

在節點1,2上執行

[root@rac1 Disk1]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl start crs

Attempting to start CRS stack

The CRS stack will be started shortly

[root@rac1 Disk1]#

[root@rac2 ~]# /u01/app/oracle/product/10.2.0/crs/bin/crsctl start crs

Attempting to start CRS stack

The CRS stack will be started shortly

[root@rac2 ~]#

[oracle@rac1 ~]$ crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application ONLINE ONLINE rac1

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip application ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application ONLINE ONLINE rac2

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip application ONLINE ONLINE rac2

ora.test.db application ONLINE OFFLINE

ora....t1.inst application ONLINE OFFLINE

ora....t2.inst application ONLINE OFFLINE

[oracle@rac1 ~]$

能夠看出，在升級庫以前，數據庫是起不來的。

3.20 升級數據庫

在節點1上執行

[oracle@rac1 ~]$ cd /u01/app/oracle/product/10.2.0/db_1/dbs/

[oracle@rac1 dbs]$ ls

ab_+ASM1.dat hc_+ASM1.dat hc_test1.dat init+ASM1.ora initdw.ora init.ora inittest1.ora orapw+ASM1 orapwtest1

[oracle@rac1 dbs]$ ll

total 56

-rw-rw---- 1 oracle oinstall 1559 Jan 19 21:08 ab_+ASM1.dat

-rw-rw---- 1 oracle oinstall 1552 Jan 19 21:09 hc_+ASM1.dat

-rw-rw---- 1 oracle oinstall 1552 Jan 19 21:10 hc_test1.dat

lrwxrwxrwx 1 oracle oinstall 61 Jan 18 21:20 init+ASM1.ora -> /u01/app/oracle/product/10.2.0/db_1/admin/+ASM/pfile/init.ora

-rw-r--r-- 1 oracle oinstall 12920 May 3 2001 initdw.ora

-rw-r----- 1 oracle oinstall 8385 Sep 11 1998 init.ora

-rw-r----- 1 oracle oinstall 37 Jan 18 21:38 inittest1.ora

-rw-r----- 1 oracle oinstall 1536 Jan 18 21:20 orapw+ASM1

-rw-r----- 1 oracle oinstall 1536 Jan 18 21:26 orapwtest1

[oracle@rac1 dbs]$ more inittest1.ora

SPFILE='+DATADG/test/spfiletest.ora'

[oracle@rac1 dbs]$

在節點1，2上，使用sqlplus登陸實例

[oracle@rac1 dbs]$ !sql

sqlplus "/as sysdba"

 

SQL*Plus: Release 10.2.0.5.0 - Production on Thu Jan 19 21:19:46 2017

 

Copyright (c) 1982, 2010, Oracle. All Rights Reserved.

 

Connected to an idle instance.

 

SQL> create pfile='/tmp/pfile.txt' from spfile='+DATADG/test/spfiletest.ora';

 

File created.

 

SQL>

在節點1,2上，修改/tmp/pfile.txt，將*.cluster_database=true修改成*.cluster_database=false

在節點1，2上，以升級的方式打開數據庫

[oracle@rac1 dbs]$ !sql

sqlplus "/as sysdba"

 

SQL*Plus: Release 10.2.0.5.0 - Production on Thu Jan 19 21:22:40 2017

 

Copyright (c) 1982, 2010, Oracle. All Rights Reserved.

 

Connected to an idle instance.

 

SQL> startup upgrade pfile='/tmp/pfile.txt';

ORACLE instance started.

 

Total System Global Area 1224736768 bytes

Fixed Size 2095896 bytes

Variable Size 335545576 bytes

Database Buffers 872415232 bytes

Redo Buffers 14680064 bytes

Database mounted.

Database opened.

SQL>@?/rdbms/admin/catupgrd.sql

升級以後須要先關閉數據庫，再啓動

SQL> shutdown immediate;

Database closed.

Database dismounted.

ORACLE instance shut down.

SQL>startup;

ORACLE instance started.

 

Total System Global Area 1224736768 bytes

Fixed Size 2095896 bytes

Variable Size 335545576 bytes

Database Buffers 872415232 bytes

Redo Buffers 14680064 bytes

Database mounted.

Database

4 數據庫卸載