Vmware+Sphere+ESXI5.0+使用虚拟文件共享安装RHEL5 - x64+Oracle11gR2 - x64+RAC

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Vmware Vsphere ESXI5.0环境下RHEL5.5_x64 搭建oracle 11.2.0.1_x64及升级11.2.0.3.5

RAC文档

2013-01-21

详细安装步骤

1

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

目录

一、规划........................................................................................................................................... 3 二、Vmware Vsphere配置两台虚拟主机 ...................................................................................... 3 三、安装准备（两节点操作） ....................................................................................................... 9 四、创建ASK DISK ........................................................................................................................ 13 五、clusterware安装 .................................................................................................................. 15 六、安装Database数据库软件 ................................................................................................... 38 七、使用DBCA建库 ....................................................................................................................... 48 八、 查看集群状态 ..................................................................................................................... 61 九、安装新11.2.0.3的grid frastructure ............................................................................ 64

(一) 备份并停止110201的数据库 ............................................................................... 64 (二) 安装第2套GRID的方法 ....................................................................................... 65 十、安装11.2.0.3 database及建库 ......................................................................................... 68 十一、升级GRID至11.2.0.3.5 .................................................................................................. 69 十二、升级DATABASE PSU11.2.0.3.5 ........................................................................................ 73 十三、使用DBCA建和原库一致的数据库[30分钟] .................................................................. 78 十四、导入原数据库并测试业务 ................................................................................................. 79 十五、退回11.2.0.1版本 ........................................................................................................... 79 十六、再切回11.2.0.3版本 ....................................................................................................... 81 附录：相关脚本 ............................................................................................................................. 82

2

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

一、规划

主机名 公共网卡及IP 私有网卡及IP 虚拟网卡及IP SCAN IP 节点1 rac1 eth0/10.228.13.88/rac1 节点2 rac2 eth0/10.228.13.89/rac2 eth1/192.168.123.88/rac1-priv eth1/192.168.123.89/rac2-priv 192.168.1.110/rac1-vip 192.168.1.111/rac2-vip 10.228.13.112/rac-scan 二、Vmware Vsphere配置两台虚拟主机

1. 配置2台RAC虚拟机配置如下：

内存 网卡 硬盘空间 共享磁盘空间

节点1 节点2 4G 4G 2个 2个 20G(存放安装文件) 15G 10G（2个虚拟共享虚拟磁盘分区(/dev/sdb、/dev/sdc） 2. 连接虚拟机服务器(这里为10.228.13.67)，创建共享磁盘：

# cd /vmfs/volumes/datastore1 # mkdir sharelqs

# vmkfstools -d eagerzeroedthick -a lsilogic -c 5G rac01.vmdk # vmkfstools -d eagerzeroedthick -a lsilogic -c 5G rac02.vmdk /vmfs/volumes/4f72f9c7-e902920c-c903-00e081d96b5d/sharelqs # pwd /vmfs/volumes/datastore1/sharelqs

/vmfs/volumes/4f72f9c7-e902920c-c903-00e081d96b5d/sharelqs # ls -l

-rw------- 1 root root 5242880000 Jan 13 07:57 rac01-flat.vmdk -rw------- 1 root root 488 Jan 16 05:30 rac01.vmdk -rw------- 1 root root 5242880000 Jan 13 07:58 rac02-flat.vmdk

3

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

-rw------- 1 root root 488 Jan 16 05:34 rac02.vmdk

如果是Vmware Workstation,则命令语法如下：

D:\\Program Files\\Vmware\\vmware-vdiskmanager.exe -a lsilogic -c -s 100MB -t 2 rac01.vmdk 3. 关闭2台虚拟机，并在rac11.vmx和rac12.vmx配置文件分别增加如下虚

拟磁盘配置：

disk.locking=\diskLib.dataCacheMaxSize = \diskLib.dataCacheMaxReadAheadSize = \

diskLib.DataCacheMinReadAheadSize = \diskLib.dataCachePageSize = \diskLib.maxUnsyncedWrites = \scsi1.present = \scsi1:0.present = \scsi1.sharedBus = \scsi1.virtualDev = \scsi1:0.fileName =

\01.vmdk\

scsi1:0.mode = \scsi1:0.deviceType = \scsi2.present = \scsi2:0.present = \scsi2.sharedBus = \scsi2.virtualDev = \scsi2:0.fileName =

\02.vmdk\

scsi2:0.mode = \scsi2:0.deviceType = \numvcpus = \cpuid.coresPerSocket = %unity.wasCapable = \scsi1:0.redo = \

scsi2:0.redo = \scsi1.pciSlotNumber = \scsi2.pciSlotNumber = \

4. 分别登陆2台虚拟机按安装规划设置IP

[root@rac1 ~]# ifconfig -a

eth0 Link encap:Ethernet HWaddr 00:0C:29:BC:EE:3C inet addr:10.228.13.88 Bcast:10.228.13.127 Mask:255.255.255.192

4

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

inet6 addr: fe80::20c:29ff:febc:ee3c/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:444 errors:0 dropped:0 overruns:0 frame:0 TX packets:257 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000

RX bytes:40056 (39.1 KiB) TX bytes:32935 (32.1 KiB)

eth1 Link encap:Ethernet HWaddr 00:0C:29:BC:EE:46 inet addr:192.168.123.88 Bcast:192.168.123.255 Mask:255.255.255.0

inet6 addr: fe80::20c:29ff:febc:ee46/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:172 errors:0 dropped:0 overruns:0 frame:0 TX packets:43 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000

RX bytes:15078 (14.7 KiB) TX bytes:6206 (6.0 KiB) 【注意: vip及scan地址是不能配置的，也不能存在此IP，在crs安装后自动绑定到public网卡上！】 5. 确认共享盘能在2边节点看到

[root@rac1 ~]# fdisk -l

Disk /dev/sda: 21.4 GB, 21474836480 bytes 255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 2610 20860402+ 8e Linux LVM

Disk /dev/sdb: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Disk /dev/sdc: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

[root@rac2 ~]# fdisk -l

5

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Disk /dev/sda: 21.4 GB, 21474836480 bytes 255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 2610 20860402+ 8e Linux LVM

Disk /dev/sdb: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Disk /dev/sdc: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System 6. 在节点1执行分区(每个磁盘分1个主分区即可!)，并确保另1个节点能

看到

[root@rac1 ~]# fdisk /dev/sdb

Command (m for help): n Command action e extended

p primary partition (1-4) p

Partition number (1-4): 1

First cylinder (1-637, default 1): Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-637, default 637): Using default value 637

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table. Syncing disks.

[root@rac1 ~]# fdisk /dev/sdc

Command (m for help): n Command action

6

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

e extended

p primary partition (1-4) p

Partition number (1-4): 1

First cylinder (1-637, default 1): Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-637, default 637): Using default value 637

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table. Syncing disks.

[root@rac1 ~]# fdisk -l

Disk /dev/sda: 21.4 GB, 21474836480 bytes 255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 2610 20860402+ 8e Linux LVM

Disk /dev/sdb: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sdb1 1 637 5116671 83 Linux

Disk /dev/sdc: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sdc1 1 637 5116671 83 Linux

[root@rac2 ~]# fdisk -l

Disk /dev/sda: 21.4 GB, 21474836480 bytes 255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

7

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Device Boot Start End Blocks Id System /dev/sda1 * 1 13 104391 83 Linux /dev/sda2 14 2610 20860402+ 8e Linux LVM

Disk /dev/sdb: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sdb1 1 637 5116671 83 Linux

Disk /dev/sdc: 5242 MB, 5242880000 bytes 255 heads, 63 sectors/track, 637 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System /dev/sdc1 1 637 5116671 83 Linux

7. 为操作方便，2个节点都安装vmware tools:

8

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

三、安装准备（两节点操作）

1、 验证包 # From Oracle Linux 5 DVD cd /media/cdrom/Server rpm -Uvh binutils-2.* rpm -Uvh compat-libstdc++-33* rpm -Uvh elfutils-libelf-0.* rpm -Uvh elfutils-libelf-devel-* rpm -Uvh gcc-4.* rpm -Uvh gcc-c++-4.* rpm -Uvh glibc-2.* rpm -Uvh glibc-common-2.* rpm -Uvh glibc-devel-2.* rpm -Uvh glibc-headers-2.* rpm -Uvh ksh-2* rpm -Uvh libaio-0.* rpm -Uvh libaio-devel-0.* rpm -Uvh libgcc-4.* rpm -Uvh libstdc++-4.* rpm -Uvh libstdc++-devel-4.* rpm -Uvh make-3.* rpm -Uvh sysstat-7.* rpm -Uvh unixODBC-2.* rpm -Uvh unixODBC-devel-2.* 2、 2、配置内核参数(如果默认值更大就不改)

# vi /etc/sysctl.conf kernel.shmall = 2097152

kernel.shmmax = 536870912 --512*1024*1024（内存的一半） kernel.shmmni = 4096

kernel.sem = 250 32000 100 128 fs.file-max = 65536

net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 262144 net.core.rmem_max = 262144 net.core.wmem_default = 262144 net.core.wmem_max = 262144

9

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

# vi /etc/security/limits.conf grid oft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536

oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 # vi /etc/profile

if [ $USER = \ if [ $SHELL = \ ulimit -p 16384 ulimit -n 65536 else

ulimit -u 16384 -n 65536 fi

umask 022 fi

如果记录不存在，增加如下记录到文件\

session required pam_limits.so

3、 3、/etc/hosts设置 # vi /etc/hosts

# Do not remove the following line, or various programs # that require network functionality will fail.

127.0.0.1 localhost.localdomain localhost ::1 localhost6.localdomain6 localhost6 # rac1

10.228.13.88 rac1 10.228.13.110 rac1-vip 192.168.123.88 rac1-priv #rac2

10.228.13.89 rac2 10.228.13.111 rac2-vip 192.168.123.89 rac2-priv 10.228.13.112 rac-scan

4、 创建用户及组 groupadd -g 1000 oinstall 10

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

groupadd -g 1200 dba groupadd -g 1203 asmadmin groupadd -g 1201 asmdba groupadd -g 1202 asmoper useradd -u 1100 -g oinstall -G dba,asmdba -d /home/oracle oracle passwd oracle 创建目录： mkdir -p /u01/app/11.2.0/grid mkdir -p /u01/app/oracle/product/11.2.0/db_1 useradd -u 1200 -g oinstall -G asmadmin,asmdba,asmoper -d /home/grid grid passwd grid chown -R oracle:oinstall /u01 chown -R grid:oinstall /u01 chown -R oracle:oinstall /u01/app/oracle chmod -R 775 /u01/ 5、 配置时钟同步(可以使用vmware-tools的同步功能)

11

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

# crontab –e MAILTO=\

*/3 * * * * /usr/sbin/ntpdate 192.168.1.1

6、 附加设置 Vi /etc/fstab

--扩大内存映像，决定了memory_target的最大值 mount -t tmpfs shmfs -o size=1500m /dev/shm [root@rac2 Server]# df -h

Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup00-LogVol00

35G 3.4G 30G 11% / /dev/sda1 99M 13M 82M 14% /boot tmpfs 1006M 0 1006M 0% /dev/shm /dev/hdc 3.4G 3.4G 0 100% /media/Enterprise Linux dvd 20100405

[root@rac2 Server]# umount /dev/shm [root@rac2 Server]# mount /dev/shm [root@rac2 Server]# df -h

Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup00-LogVol00

35G 3.4G 30G 11% / /dev/sda1 99M 13M 82M 14% /boot /dev/hdc 3.4G 3.4G 0 100% /media/Enterprise Linux dvd 20100405

tmpfs 1.5G 0 1.5G 0% /dev/shm 安装crs检查需要的cvuqdisk包 [root@rac1 ~]# cd /media/Oracle11gR2.3_x6/grid/rpm/ [root@rac1 rpm]# ls cvuqdisk-1.0.9-1.rpm [root@rac1 rpm]# rpm -Uvh cvuqdisk* Preparing... ########################################### [100%] Using default group oinstall to install package 1:cvuqdisk ########################################### [100%] 编辑 \禁用SELINUX 标志 SELINUX=disabled 配置NTP时间同步服务器. 禁用NTP服务器 12

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

# service ntpd stop Shutting down ntpd: [ OK ] # chkconfig ntpd off # mv /etc/ntp.conf /etc/ntp.conf.orig # rm /var/run/ntpd.pid 如果你需要使用NTP服务，编辑 \OPTIONS=\重启NTP. # service ntpd restart 四、创建ASK DISK

检查内核 uname -rm 2.6.18-164.el5 x86_64 # 从OTN下载对应的程序包: ? ? ? oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.3-1.el5.x86_64.rpm oracleasm-2.6.18-164.el5-2.0.5-1.el5.x86_64.rpm 其他版本： http://www.oracle.com/technetwork/server-storage/linux/asmlib/index-101839.html Install the packages using the following command. [root@rac1 ~]# cd asmlib [root@rac1 asmlib]# ls oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18-238.el5-2.0.5-1.el5.x86_64.rpm oracleasm-support-2.1.3-1.el5.x86_64.rpm [root@rac1 asmlib]# rpm -ivh *.rpm warning: oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159 Preparing... ########################################### [100%] 1:oracleasm-support ########################################### [ 25%] 13

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

2:oracleasm-2.6.18-238.el########################################### [ 50%] 3:oracleasm-2.6.18-194.el########################################### [ 75%] 4:oracleasmlib ########################################### [100%] [root@rac1 asmlib]# uname -s -a Linux rac1 2.6.18-194.el5 #1 SMP Mon Mar 29 22:10:29 EDT 2010 x86_64 x86_64 x86_64 GNU/Linux [root@rac1 asmlib]# rpm -e oracleasm-2.6.18-238.el error: package oracleasm-2.6.18-238.el is not installed [root@rac1 asmlib]# rpm -qa|grep oracleasm oracleasm-support-2.1.3-1.el5 oracleasmlib-2.0.4-1.el5 oracleasm-2.6.18-194.el5-2.0.5-1.el5 oracleasm-2.6.18-238.el5-2.0.5-1.el5 [root@rac1 asmlib]# rpm -e oracleasm-2.6.18-238 error: package oracleasm-2.6.18-238 is not installed [root@rac1 asmlib]# rpm -e oracleasm-2.6.18-238.el5 [root@rac1 asmlib]# rpm -qa|grep asm oracleasm-support-2.1.3-1.el5 oracleasmlib-2.0.4-1.el5 oracleasm-2.6.18-194.el5-2.0.5-1.el5 配置ASMLib # oracleasm configure -i Configuring the Oracle ASM library driver. This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current values will be shown in brackets ('[]'). Hitting without typing an answer will keep that current value. Ctrl-C will abort. Default user to own the driver interface []: grid Default group to own the driver interface []: asmadmin Start Oracle ASM library driver on boot (y/n) [n]: y Scan for Oracle ASM disks on boot (y/n) [y]: Writing Oracle ASM library driver configuration: done # 14

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

#配置ASM磁盘搜索串： ORACLEASM_SCANORDER=\#配置被排除的非ASM磁盘（如本地盘） ORACLEASM_SCANEXCLUDE=\装载内核模块. # /usr/sbin/oracleasm init Loading module \Mounting ASMlib driver filesystem: /dev/oracleasm # 如果上述命令有错，可以联网检测asmlib的版本(需要internet连接). # /usr/sbin/oracleasm update-driver 标志2个共享磁盘(1个节点上执行！). --本次ACFS磁盘未添加，仅作说明！ [root@rac1 ~]# /usr/sbin/oracleasm createdisk DISK1 /dev/sdb1 Writing disk header: done Instantiating disk: done [root@rac1 ~]# /usr/sbin/oracleasm createdisk DISK2/dev/sdc1 Writing disk header: done Instantiating disk: done [root@rac1 ~]# oracleasm listdisks DISK1 DISK2 --在另1个节点使用 \命令查找ASM磁盘 --！！必须节点2不重启看到磁盘才是正确的，否则共享磁盘配置有问题，CRS安装后执行root.sh会出问题的！！-- [root@rac2 asmlib]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... Instantiating disk \Instantiating disk \ [root@rac2 asmlib]# oracleasm listdisks DISK1 DISK2 五、clusterware安装

重启两个服务器后，在节点1以grid用户登录到图形界面下：

15

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

编辑/home/grid/.bash_profile文件： #for grid ORACLE_HOSTNAME=rac1; export ORACLE_HOSTNAME ORACLE_UNQNAME=rac; export ORACLE_UNQNAME ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE ORACLE_HOME=/u01/app/11.2.0/grid; export ORACLE_HOME ORACLE_SID=+ASM1; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM BASE_PATH=/usr/sbin:$PATH; export BASE_PATH PATH=$ORACLE_HOME/bin:$BASE_PATH; export PATH LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH 编辑/home/oracle/.bash_profile文件： #for oracle ORACLE_HOSTNAME=rac1; export ORACLE_HOSTNAME ORACLE_UNQNAME=rac; export ORACLE_UNQNAME ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1; export ORACLE_HOME ORACLE_SID=rac1; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM BASE_PATH=/usr/sbin:$PATH; export BASE_PATH PATH=$ORACLE_HOME/bin:$BASE_PATH; export PATH LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export CLASSPATH ***2号实例对应把rac1改成rac2,ASM1改成ASM2*** 以grid用户登录： 解压grid安装文件： [grid@rac1 ~]$ ls -l total 1029236 -rw-r--r-- 1 root root 1052897657 Jan 21 17:59 linux.x64_11gR2_grid.zip [grid@rac1 ~]$ unzip linux.x64_11gR2_grid.zip > unzip.log [grid@rac1 ~]$ grep error unzip.log inflating: grid/doc/rac.112/e10717/crserror_alert.htm inflating: grid/doc/rac.112/e10718/apperror.htm 16

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

[grid@rac1 ~]$ 启动Xmanager的Passive终端： [oracle@rac1 grid]$ export DISPLAY=10.229.182.169:0.0 [grid@rac1 ~]$ cd grid [grid@rac1 grid]$ ls doc install response rpm runcluvfy.sh runInstaller sshsetup stage welcome.html [grid@rac1 grid]$ ./runInstaller Starting Oracle Universal Installer... Checking Temp space: must be greater than 120 MB. Actual 8299 MB Passed Checking swap space: must be greater than 150 MB. Actual 2015 MB Passed Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed Preparing to launch Oracle Universal Installer from /tmp/OraInstall2013-01-21_06-12-03PM. Please wait ... 选择 \选项单击 \按钮. 选择 \并单击\按钮. 17

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

在\屏,单击\按钮.

录入第2个集群节点的详细信息并单击 \按钮.

18

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

单击 \按钮并为\用户指定密码. 单击 \按钮来配置SSH连通性, \按钮来测试是否成功.

19

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

单击 \network interfaces...\按钮并检查public、private网络是否指定正确.如果全部确认正常，单击\按钮及前一屏的\按钮.

输入 \作为软件目录及\Storage Manager\作为集群注册存储类型. 设置ASM口令并单击\按钮.

--口令要求Oracle强度—(8位+大小些+数字): Oracle2012，也可以强制使用简单口令。

20

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

【组名要和oracleasm configure –i指定的组名一致，否则可能会出现权限问题！】 冗余方式选择 \选择适当的磁盘并单击 \按钮.

21

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

【这里可能会出现候选磁盘不能出来的问题，按如下方法排查： 1、/dev/oracleasm/disks的磁盘是否是grid.asmadmin属主

2、11.2.0.1的配置文件是/etc/sysconfig/oracleasm-_dev_oracleasm，11.2.0.3会多1个/etc/sysconfig/oracleasm文件！

3、如果权限不对，最好重新配置ASM DISK:

oracleasm deletedisk DISK1 oracleasm deletedisk DISK2 oracleasm scandisks(2边节点) 4、重新配置asmlib并建磁盘:

oracleasm configure -i oracleasm init

service oracleasm restart

oracleasm createdisk DISK1 /dev/sdb1 oracleasm createdisk DISK2 /dev/sdc1 oracleasm scandisks

5、最后还有问题就删除oracleasm的2个rpm包并重装！

等待先决条件检查完成.如果你有任何问题, 要么修复、要么选择\并单击\按钮.

(1)可以使用脚本做FIXUP

22

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

[root@rac2 ~]# cd /tmp/CVU_11.2.0.3.0_oracle/ [root@rac2 CVU_11.2.0.3.0_oracle]# ls

alert_log_file_size_analyzer.sh check_non_routable_network_interconnect.sh css_disk_timeout.sh hangcheck_tick.sh

bdump_dest_trace_analyzer.sh checkportavail.sh css_misscount.sh hangchecktimer.sh

checkcorefile.sh checkramfs.sh css_reboot_time.sh listener_naming_convention.sh

check_default_gateway.sh check_rp_filter.sh cvuqdisk-1.0.9-1.rpm ora_00600_errors_analyzer.sh

check_disk_asynch_io_linking.sh checksshd.sh exectask ora_07445_errors_analyzer.sh

check_e1000.sh check_tcp_packet_retransmit.sh exectask.sh orarun.sh

checkhugepage.sh check_vip_restart_attempt.sh fixup.enable runfixup.sh

check_jumbo_frames.sh check_vmm.sh fixup.response scratch

checkmemlock.sh common_include.sh getNICSpeed.sh shutdown_hwclock_sync.sh

check_network_packet_reassembly.sh core_dump_dest_analyzer.sh hangcheck_margin.sh

check_network_param.sh css_diagwait.sh hangcheck_reboot.sh

[root@rac2 CVU_11.2.0.3.0_oracle]# sh runfixup.sh

23

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Response file being used is :./fixup.response Enable file being used is :./fixup.enable Log file location: ./orarun.log Setting Kernel Parameters...

The value for shmmni in response file is not greater than value of shmmni for current session. Hence not changing it.

The value for semmsl in response file is not greater than value of semmsl for current session. Hence not changing it.

The value for semmns in response file is not greater than value of semmns for current session. Hence not changing it.

The value for semmni in response file is not greater than value of semmni for current session. Hence not changing it. kernel.sem = 250 32000 100 128 fs.file-max = 6815744

net.ipv4.ip_local_port_range = 9000 65500 net.core.rmem_default = 262144 net.core.wmem_default = 262144 net.core.rmem_max = 4194304 net.core.wmem_max = 1048576 fs.aio-max-nr = 1048576

Installing Package /tmp/CVU_11.2.0.3.0_oracle//cvuqdisk-1.0.9-1.rpm

Preparing... ########################################### [100%] 1:cvuqdisk ########################################### [100%] (2)其它NTP、DNS等可以忽略！

24

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

如果概要信息检查完毕,单击 \按钮.

等待setup任务完成.

25

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

当弹出窗口时,在每个节点顺序执行配置脚本【注意一定不能同时执行！】 #在执行root.sh前需要检查ASM磁盘扫描配置文件，否则2#节点执行时会报错！： vi /etc/sysconfig/oracleasm # ORACLEASM_SCANORDER: Matching patterns to order disk scanning #扫描的ASM磁盘设备号规则 ORACLEASM_SCANORDER=\ #需要排除的本地磁盘设备号规则 # ORACLEASM_SCANEXCLUDE: Matching patterns to exclude disks from scan ORACLEASM_SCANEXCLUDE=\ # cd /u01/app/oraInventory # ./orainstRoot.sh Changing permissions of /u01/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /u01/app/oraInventory to oinstall. The execution of the script is complete. # 26

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

注意：在第2个节点可能会报如下错误：

CRS-2672: Attempting to start 'ora.cssd' on 'rac2' CRS-2672: Attempting to start 'ora.diskmon' on 'rac2' CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded

未能创建磁盘组DATA, 返回消息如下: ORA-15018: diskgroup cannot be created ORA-15017: diskgroup \

ORA-15003: diskgroup \

Configuration of ASM ... failed

see asmca logs at /u01/app/oracle/cfgtoollogs/asmca for details Did not succssfully configure and start ASM at

/u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 6763. /u01/app/11.2.0/grid/perl/bin/perl -I/u01/app/11.2.0/grid/perl/lib

-I/u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/crs/install/rootcrs.pl execution failed

--这个问题是1#节点的ASM信息2#没有看到的原因！

1.检查/dev/sysconfig/oracleasm,看ORACLEASM_SCANORDER，ORACLEASM_SCANEXCLUDE对不对 2.vmx里面的disklib.的参数是否设置了

diskLib.dataCacheMaxSize = \diskLib.dataCacheMaxReadAheadSize = \diskLib.DataCacheMinReadAheadSize = \diskLib.dataCachePageSize = \diskLib.maxUnsyncedWrites = \ *****采用如下方法进行修复：***********

1.如果第2个节点root.sh执行失败（报ASM磁盘组不能创建错误），可以通过如下方法重新配置：

修改ASM磁盘配置文件：/etc/sysconfig/oracleasm (2边节点都要执行): #ASM磁盘设备号

ORACLEASM_SCANORDER=\#排除的本地磁盘设备号

ORACLEASM_SCANEXCLUDE=\

CRS需要重新deconfig配置！ 1.在节点1执行：

[root@rac1 ~]# cd /u01/app/11.2.0/grid/crs/install/

[root@rac1 install]# ./rootcrs.pl -verbose -deconfig -force [root@rac1 install]# su - oracle [oracle@rac1 ~]$ grid_env

27

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

[oracle@rac1 ~]$ ocrcheck

PROT-601: Failed to initialize ocrcheck

PROC-33: Oracle Cluster Registry is not configured Storage layer error [Error opening ocr.loc file. No such file or directory] [2]

2.在节点2执行(最后1个节点deconfig)：

[root@rac2 ~]# cd /u01/app/11.2.0/grid/crs/install/

[root@rac2 install]# ./rootcrs.pl -verbose -deconfig -force -lastnode

3.清除GPNP配置信息：

--注意一定要使用oracle用户执行，否则会报远程COPY的错误！

重新加载oracleasm模块（2边节点）：

重启asmlib驱动 :

# /etc/init.d/oracleasm stop # /etc/init.d/oracleasm start

--rac1:

[oracle@rac1 grid]$ grid_env

[oracle@rac1 grid]$ cd $ORACLE_HOME/gpnp [oracle@rac1 gpnp]$ pwd /u01/app/11.2.0/grid/gpnp [oracle@rac1 gpnp]$ ls

init manifest.txt profiles rac1 wallets [oracle@rac1 gpnp]$ rm -rf *

[oracle@rac1 gpnp]$ mkdir -p profiles/peer wallets/peer wallets/prdr wallets/pa wallets/root --rac2:

[root@rac2 ~]# su - oracle [oracle@rac2 ~]$ grid_env

[oracle@rac2 ~]$ cd $ORACLE_HOME/gpnp [oracle@rac2 gpnp]$ rm -rf *

[oracle@rac2 gpnp]$ mkdir -p profiles/peer wallets/peer wallets/prdr wallets/pa wallets/root

4.重新执行root.sh

vi /etc/sysconfig/oracleasm

# ORACLEASM_SCANORDER: Matching patterns to order disk scanning ORACLEASM_SCANORDER=\

# ORACLEASM_SCANEXCLUDE: Matching patterns to exclude disks from scan

28

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

ORACLEASM_SCANEXCLUDE=\

--rac1：

[root@rac1 11.2.0]# sh /u01/app/11.2.0/grid/root.sh --rac2:

[root@rac2 11.2.0]# sh /u01/app/11.2.0/grid/root.sh

--重启rac1,rac2检查crs能否正常启动！

--注意：集群节点时间不一致会导致服务器自动重启！

**如果有必要可以清除CRS软件的安装： [root@rac1 deinstall]# pwd /u01/app/11.2.0/grid/deinstall [root@rac1 deinstall]# ./deinstall

You must not be logged in as root to run ./deinstall. Log in as Oracle user and rerun ./deinstall. [root@rac1 deinstall]# su - oracle

[oracle@rac1 ~]$ cd /u01/app/11.2.0/grid/deinstall [oracle@rac1 deinstall]$ ./deinstall

Checking for required files and bootstrapping ... Please wait ...

日志的位置 /tmp/deinstall2012-07-02_04-06-19PM/logs/

############ ORACLE DEINSTALL & DECONFIG TOOL START ############

######################### CHECK OPERATION START ######################### ## [开始] 安装检查配置 ##

检查 Oracle 主目录位置是否存在 /u01/app/11.2.0/grid

选定进行卸载的 Oracle 主目录类型为:集群的 Oracle Grid Infrastructure 选定进行卸载的 Oracle 基目录为:/u01/app/oracle 检查主产品清单位置是否存在 /u01/app/oraInventory 检查 Oracle Grid Infrastructure 主目录是否存在 以下节点属于此集群: rac1,rac2

正在检查以下节点上是否有足够的临时空间可用: 'rac1,rac2'

## [结束] 安装检查配置 ##

Traces log file: /tmp/deinstall2012-07-02_04-06-19PM/logs//crsdc.log 输入一个地址或在节点 \上使用的虚拟 IP 的名称[rac1-vip] >

29

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

可以通过在节点 \上运行 \来收集以下信息

输入节点 \上的虚拟 IP \的 IP 网络掩码[255.255.255.0] >

输入虚拟 IP 地址 \处于活动状态的网络接口的名称 >

输入一个地址或在节点 \上使用的虚拟 IP 的名称[rac2-vip] >

可以通过在节点 \上运行 \来收集以下信息

输入节点 \上的虚拟 IP \的 IP 网络掩码[255.255.255.0] >

输入虚拟 IP 地址 \处于活动状态的网络接口的名称 >

输入虚拟 IP 的地址或名称[] >

网络配置检查配置开始

网络取消配置跟踪文件位置:

/tmp/deinstall2012-07-02_04-06-19PM/logs/netdc_check2012-07-02_04-44-08-PM.log

指定要取消配置的所有 RAC 监听程序 (不包括 SCAN 监听程序) [LISTENER_SCAN1]:

网络配置检查配置结束

Asm 检查配置开始

ASM 取消配置跟踪文件位置:

/tmp/deinstall2012-07-02_04-06-19PM/logs/asmcadc_check2012-07-02_04-44-10-PM.log

在此 Oracle 主目录中未检测到 ASM 配置。此 Oracle 主目录 (y|n) 中是否配置了 ASM [n]: 在 Oracle 主目录中未检测到 ASM

######################### CHECK OPERATION END #########################

####################### CHECK OPERATION SUMMARY ####################### Oracle Grid Infrastructure 主目录为:

30

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

将执行 Oracle 主目录卸载的集群节点为:rac1,rac2 选定进行卸载的 Oracle 主目录为:/u01/app/11.2.0/grid Oracle 主目录注册到的产品清单位置为: /u01/app/oraInventory 将取消配置以下 RAC 监听程序: LISTENER_SCAN1 在 Oracle 主目录中未检测到 ASM

是否要继续 (是 - 是, 否 - 否)? [否]: 是 此会话的日志将写入:

'/tmp/deinstall2012-07-02_04-06-19PM/logs/deinstall_deconfig2012-07-02_04-14-11-PM.out'

此会话的任何错误消息都将写入:

'/tmp/deinstall2012-07-02_04-06-19PM/logs/deinstall_deconfig2012-07-02_04-14-11-PM.err'

######################## CLEAN OPERATION START ######################## ASM 取消配置跟踪文件位置:

/tmp/deinstall2012-07-02_04-06-19PM/logs/asmcadc_clean2012-07-02_04-44-20-PM.log ASM 清除配置结束

网络配置清除配置开始

网络取消配置跟踪文件位置:

/tmp/deinstall2012-07-02_04-06-19PM/logs/netdc_clean2012-07-02_04-44-20-PM.log

取消配置 RAC 监听程序: LISTENER_SCAN1

取消配置监听程序: LISTENER_SCAN1 停止监听程序: LISTENER_SCAN1

警告: 无法停止监听程序。 监听程序可能未运行。 监听程序已成功取消配置。

正在取消配置所有节点上的命名方法配置文件... 命名方法配置文件已成功取消配置。

正在取消配置所有节点上的本地网络服务名配置文件... 本地网络服务名配置文件已成功取消配置。

正在取消配置所有节点上的目录使用配置文件... 目录使用配置文件已成功取消配置。

正在取消配置所有节点上的备份文件... 备份文件已成功取消配置。

网络配置已成功清除。

31

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

网络配置清除配置结束

---------------------------------------->

下面的 deconfig 命令可以在所有远程节点上并行执行。在所有远程节点上执行完毕后, 在本地节点上执行该命令。

以 root 用户或管理员身份在节点 \上运行以下命令。

/tmp/deinstall2012-07-02_04-06-19PM/perl/bin/perl -I/tmp/deinstall2012-07-02_04-06-19PM/perl/lib -I/tmp/deinstall2012-07-02_04-06-19PM/crs/install

/tmp/deinstall2012-07-02_04-06-19PM/crs/install/rootcrs.pl -force -deconfig -paramfile

\

以 root 用户或管理员身份在节点 \上运行以下命令。

/tmp/deinstall2012-07-02_04-06-19PM/perl/bin/perl -I/tmp/deinstall2012-07-02_04-06-19PM/perl/lib -I/tmp/deinstall2012-07-02_04-06-19PM/crs/install

/tmp/deinstall2012-07-02_04-06-19PM/crs/install/rootcrs.pl -force -deconfig -paramfile

\-lastnode

完成运行上述命令后按 Enter

<----------------------------------------

===================================================================== 正常的root.sh执行结果如下： --rac1:

[root@rac1 CVU_11.2.0.3.0_oracle]# /u01/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g

The following environment variables are set as: ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of \The contents of \The contents of \

32

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed.

Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Creating trace directory

User ignored Prerequisites during installation OLR initialization - successful root wallet root wallet cert root cert export peer wallet

profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert

peer root cert TP

profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP

profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert

Adding Clusterware entries to inittab

CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1' CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1' CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1' CRS-2672: Attempting to start 'ora.gipcd' on 'rac1' CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac1' CRS-2672: Attempting to start 'ora.diskmon' on 'rac1' CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

33

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

已成功创建并启动 ASM。

已成功创建磁盘组DATA。

clscfg: -install mode specified

Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful.

CRS-4256: Updating the profile

Successful addition of voting disk 03239acdd4594fbabf0959a1fd7e8262. Successfully replaced voting disk group with +DATA. CRS-4256: Updating the profile

CRS-4266: Voting file(s) successfully replaced

## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 03239acdd4594fbabf0959a1fd7e8262 (ORCL:DISK1) [DATA] Located 1 voting disk(s).

CRS-2672: Attempting to start 'ora.asm' on 'rac1' CRS-2676: Start of 'ora.asm' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.DATA.dg' on 'rac1' CRS-2676: Start of 'ora.DATA.dg' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.registry.acfs' on 'rac1' CRS-2676: Start of 'ora.registry.acfs' on 'rac1' succeeded Configure Oracle Grid Infrastructure for a Cluster ... succeeded

--rac2：

[root@rac2 CVU_11.2.0.3.0_oracle]# /u01/app/11.2.0/grid/root.sh Performing root user operation for Oracle 11g

The following environment variables are set as: ORACLE_OWNER= oracle

ORACLE_HOME= /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of \The contents of \The contents of \

Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script.

34

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Now product-specific root actions will be performed.

Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Creating trace directory

User ignored Prerequisites during installation OLR initialization - successful Adding Clusterware entries to inittab

CRS-4402: CSS 守护程序已在独占模式下启动, 但在节点 rac1 (编号为 1) 上发现活动 CSS 守护程序, 因此正在终止

An active cluster was found during exclusive startup, restarting to join the cluster Configure Oracle Grid Infrastructure for a Cluster ... succeeded [oracle@rac2 ~]$ crs_stat -t

Name Type Target State Host ------------------------------------------------------------ ora.DATA.dg ora....up.type ONLINE ONLINE rac1 ora....N1.lsnr ora....er.type ONLINE ONLINE rac1 ora.asm ora.asm.type ONLINE ONLINE rac1 ora.cvu ora.cvu.type ONLINE ONLINE rac1 ora.gsd ora.gsd.type OFFLINE OFFLINE ora....network ora....rk.type ONLINE ONLINE rac1 ora.oc4j ora.oc4j.type ONLINE ONLINE rac1 ora.ons ora.ons.type ONLINE ONLINE rac1 ora....SM1.asm application ONLINE ONLINE rac1 ora.rac1.gsd application OFFLINE OFFLINE ora.rac1.ons application ONLINE ONLINE rac1 ora.rac1.vip ora....t1.type ONLINE ONLINE rac1 ora....SM2.asm application ONLINE ONLINE rac2 ora.rac2.gsd application OFFLINE OFFLINE ora.rac2.ons application ONLINE ONLINE rac2 ora.rac2.vip ora....t1.type ONLINE ONLINE rac2 ora....ry.acfs ora....fs.type ONLINE ONLINE rac1 ora.scan1.vip ora....ip.type ONLINE ONLINE rac1

======================================================================

一旦脚本运行成功，返回“执行脚本”窗口，点击“确定” 等待配置向导完成处理.

35

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

在集群检查阶段可能会报SCAN有关的错误：

INFO: Checking name resolution setup for \

36

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

INFO: ERROR:

INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name \INFO: ERROR:

INFO: PRVF-4657 : Name resolution setup check for \(IP address: 10.228.13.112) failed INFO: ERROR:

INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name \INFO: Verification of SCAN VIP and Listener setup failed INFO: OCR detected on ASM. Running ACFS Integrity checks...

INFO: Starting check to see if ASM is running on all cluster nodes... INFO: ASM Running check passed. ASM is running on all cluster nodes

INFO: Starting Disk Groups check to see if at least one Disk Group configured... INFO: Disk Group Check passed. At least one Disk Group configured INFO: Task ACFS Integrity check passed

INFO: Checking Oracle Cluster Voting Disk configuration... INFO: Oracle Cluster Voting Disk configuration check passed INFO: User \INFO: Checking if Clusterware is installed on all nodes... INFO: Check of Clusterware install passed

INFO: Checking if CTSS Resource is running on all nodes... INFO: CTSS resource check passed

INFO: Querying CTSS for time offset on all nodes... INFO: Query of CTSS for time offset passed INFO: Check CTSS state started...

INFO: CTSS is in Observer state. Switching over to clock synchronization checks using NTP

INFO: Starting Clock synchronization checks using Network Time Protocol(NTP)... INFO: NTP Configuration file check started... INFO: ERROR:

INFO: PRVF-5402 : Warning: Could not find NTP configuration file \on node \

INFO: PRVF-5405 : The NTP configuration file \does not exist on all nodes INFO: rac1

INFO: Checking daemon liveness... INFO: Liveness check failed for \INFO: Check failed on nodes: INFO: rac2,rac1

INFO: PRVF-5415 : Check to see if NTP daemon is running failed INFO: Clock synchronization check using Network Time Protocol(NTP) failed INFO: PRVF-9652 : Cluster Time Synchronization Services check failed INFO: Post-check for cluster services setup was unsuccessful on all the nodes. INFO: WARNING:

INFO: Completed Plugin named: Oracle Cluster Verification Utility 37

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

请确保只有这几个错误，可以安全地忽略. grid infrastructure安装完成！ 【做一次2边节点的重启已确认CRS能正常启动！】 六、安装Database数据库软件

使用asmca配置用于数据库及archivelog的ASM DISKGROUP

【如果空间足够，也可以直接使用CRS中的DG，但建议分开为好！】

38

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

39

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

安装数据库软件

确保 \都处于启动状态.

先解压linux.x64_11gR2_database_1of2.zip、linux.x64_11gR2_database_2of2.zip到$HOME/database目录 cd database ./runInstaller [oracle@rac1 ~]$ export DISPLAY=10.229.182.169:0.0 [oracle@rac1 ~]$ cd database/ [oracle@rac1 database]$ ./runInstaller Starting Oracle Universal Installer... Checking Temp space: must be greater than 120 MB. Actual 18375 MB Passed Checking swap space: must be greater than 150 MB. Actual 2015 MB Passed Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed 40

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

Preparing to launch Oracle Universal Installer from /tmp/OraInstall2013-01-22_03-53-15PM. Please wait ... 选中\选项并单击\按钮. 41

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

选中\选项并单击\按钮.

确保所有节点被选中并单击\按钮.

42

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

选中\选项并单击\按钮.

43

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

输入 \作为软件目录.存储类型设置为\Storage Manager\

输入RAC数据库名称，本例中为”ora11g”.

****DBA密码:oracle****

等待先决条件检查完成. 如果存在问题，要么修复他们，要么选中\复选框并单击\按钮.

44

SI实验指南：Vmware Sphere ESXI5.0 使用虚拟文件共享安装

RHEL5_x64+Oracle11gR2_x64 RAC

如果检查摘要信息无误，单击\按钮.

等待安装过程完成.

45

本文来源：https://www.bwwdw.com/article/jvio.html