Oracle 12.2 RAC on RedHat 7.3 Best Practice Documentation

# 專案需求建多套RAC，為減低管理成本，故建立一個統一的 12.2 RAC的模板。希望我的模板可以

# 幫助 Oracle 12.2 RAC on RedHat 7.3 這個應用場景的同學，文件已經透過業務驗證，可放心使用。

# 但僅僅適合我司業務，如您適用生產系統產生的任何風險概不負責，請謹慎。

# 12.2 RAC模板包含內容如下：安裝RAC/升級Opatch並打補丁/安裝RAC後最佳化

# 由於篇幅過長，附上目錄，便於同學們的學習。
目錄
Oracle 12cR2 RAC on Linux 最佳實踐文件3
1.Oracle RAC安裝規劃3
a)RAC物理架構圖3
b)軟體環境規劃3
c)使用者組與檔案系統規劃3
d)網路規劃4
e)儲存規劃4
2.Oracle RAC所有叢集節點準備5
a)硬體檢驗5
1.作業系統基礎環境檢驗5
2.雙網路卡繫結6
b)軟體檢驗7
c)作業系統配置與最佳化8
1.作業系統rpm包需求8
2.作業系統建立軟體安裝組及使用者(oracle,grid)11
3.作業系統建立軟體安裝目錄12
4.作業系統核心引數最佳化14
5.作業系統記憶體最佳化16
6.作業系統共享記憶體最佳化17
7.作業系統軟體安裝使用者環境變數(oracle,grid)18
8.作業系統使用者(oracle,grid)硬性限制最佳化22
9.作業系統關閉防火牆和selinux24
10.作業系統安裝軟體使用者(oracle,grid)互信配置25
11.作業系統使用/etc/hosts解析36
12.作業系統時間同步配置NTP38
3.Oracle RAC 共享儲存準備38
a)使用udev持久化磁碟許可權38
b)powerpath多路徑軟體聚合LUN成一條路徑供系統使用40
c)設定Disk I/O Scheduler on Linux45
4.GI安裝46
a)cvuqdisk包需要所有節點均安裝46
b)GI軟體包直接解壓到GI的$ORACLE_HOME下46
c)升級Opatch47
d)GI補丁升級與GI圖形安裝47
5.RDBMS 軟體安裝66
a)DB軟體使用oracle使用者圖形安裝66
b)升級Opatch73
c)DB補丁升級74
6.ASMCA建立磁碟組75
7.DBCA建立資料庫79
8.RAC最佳化90
a)安全90
1.使用者密碼策略最佳化(可根據安全策略自行建立)90
2.最佳化低端版本的客戶端無法登入12c高版本資料庫問題(所有節點配置)90
b)例項最佳化90
1.process程式數最佳化90
2.例項本地程式併發最佳化90
3.避免大量library cache lock導致使用者不能登入的情況90
4.DBLINK使用insert最佳化91
5.12.2 RAC 避免DataPump匯入出現大量'Library Cache Lock' (Cycle)91
6.增加 db_files91
c)系統最佳化91
1.大頁使用最佳化91
9．附表93

1. Oracle RAC安裝規劃

a) RAC物理架構圖

b) 軟體環境規劃

軟體：

GI 軟體：linuxx64_12201_grid_home.zip

DB 軟體：linuxx64_12201_database.zip

GI 補丁：p29301687_122010_Linux-x86-64.zip

DB 補丁：p29314339_122010_Linux-x86-64.zip

Opatch 補丁：p6880880_122010_Linux-x86-64.zip

rpm包：compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm

資料庫版本：

12.2.0.1.19

作業系統：

64bit Redhat 7.3

c) 使用者組與檔案系統規劃

使用者組和檔案系統配置

軟體使用者主組輔助組 ORACLE_BASE ORACLE_HOME

GI grid oinstall dba,asmadmin,asmdba,asmoper,racdba /oracle/app/grid /oracle/app/12.2.0/grid

DB oracle oinstall dba,oper,asmdba, asmadmin,racdba,backupdba,dgdba,kmdba /oracle/app/oracle $ORACLE_BASE/product/12.2.0/db_1

d) 網路規劃

1. 優先雙網路卡繫結原則

2. 優先私有網路萬兆網路卡原則

3. 避免使用169.254.*.* 地址原則

/etc/hosts列表如下

名稱對應網路卡 IP 用途

bmcdb1 bond0 10.151.115.71 public

bmcdb1-vip 10.151.115.73 VIP

bmcdb1-priv bond1 192.155.1.171 private

bmcdb2 bond0 10.151.115.72 public

bmcdb2-vip 10.151.115.74 VIP

bmcdb2-priv bond1 192.155.1.172 private

scan-bmcdb 10.151.115.75 scan-ip

e) 儲存規劃

1. 設定disk I/O schedulers為Deadline

# echo deadline > /sys/block/${ASM_DISK}/queue/scheduler

2. 繫結儲存LUN屬性,保證系統重啟屬性不變

3. ASM規劃表

ASM規劃表

磁碟組名分割槽屬主許可權單個LUN大小冗餘總容量

OCR emcpowera grid:asmadmin 660 18G

emcpowerb grid:asmadmin 660 18G Normal 54G

emcpowerc grid:asmadmin 660 18G

DATA emcpowere grid:asmadmin 660 200G External 200G

FRA emcpowerf grid:asmadmin 660 100G External 100G

OCR 磁碟組：儲存CRS資訊及Voting disk等資訊

DATA磁碟組：儲存資料檔案、控制檔案

FRA磁碟組：儲存節點的歸檔檔案

2. Oracle RAC所有叢集節點準備

a) 硬體檢驗

1. 作業系統基礎環境檢驗

# 作業系統發行版

cat /etc/redhat-release

# 核心版本

uname -a

# Memory total

grep MemTotal /proc/meminfo

# SWAP Total

grep SwapTotal /proc/meminfo

# tmp目錄大小

df -h /tmp

# 當前記憶體和swap使用狀態

free -g

# 共享記憶體大小

df -h /dev/shm

# CPU 型號,物理個數,核數,邏輯個數

cat /proc/cpuinfo | grep name | cut -f2 -d: | uniq -c

cat /proc/cpuinfo| grep "physical id"| sort| uniq| wc -l

cat /proc/cpuinfo| grep "cpu cores"| uniq

cat /proc/cpuinfo| grep "processor"| wc -l

# 節點資訊收集省略

2. 雙網路卡繫結

# 雙網路卡繫結採用主備模式,雙節點保持Bond模式一置,並持續ping,拔物理線進行測試

[oracle@bmcdb1 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-bond0_slave_1

HWADDR=E4:43:4B:72:F7:0C

TYPE=Ethernet

NAME="bond0 slave 1"

UUID=53c72c58-f724-4d50-b27c-71cf218d24ec

DEVICE=em1

>

MASTER=bond0

SLAVE=yes

[oracle@bmcdb1 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-bond0_slave_2

HWADDR=E4:43:4B:72:F7:0D

TYPE=Ethernet

NAME="bond0 slave 2"

UUID=af3db5d3-323c-411f-8070-f5083f8cffbc

DEVICE=em2

>

MASTER=bond0

SLAVE=yes

[oracle@bmcdb1 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-Bond_connection_1

DEVICE=bond0

BONDING_OPTS="miimon=1 updelay=0 downdelay=0 mode=active-backup"

TYPE=Bond

BONDING_MASTER=yes

BOOTPROTO=none

IPADDR=10.151.115.71

PREFIX=24

GATEWAY=10.151.115.1

DNS1=10.156.84.62

DEFROUTE=yes

IPV4_FAILURE_FATAL=no

IPV6INIT=yes

IPV6_AUTOCONF=yes

IPV6_DEFROUTE=yes

IPV6_PEERDNS=yes

IPV6_PEERROUTES=yes

IPV6_FAILURE_FATAL=no

IPV6_PRIVACY=no

IPV6_ADDR_GEN_MODE=stable-privacy

NAME="Bond connection 1"

UUID=3d289bb5-e405-4674-a7b3-5abc21fea392

>

b) 軟體檢驗

GI 軟體：linuxx64_12201_grid_home.zip

DB 軟體：linuxx64_12201_database.zip

GI 補丁：p29301687_122010_Linux-x86-64.zip

DB 補丁：p29314339_122010_Linux-x86-64.zip

Opatch 補丁：p6880880_122010_Linux-x86-64.zip

EMC powerpath 軟體：EMCPower.LINUX-6.3.0.01.00-001.RHEL7.x86_64.rpm

作業系統RPM包：作業系統映象或光碟

c) 作業系統配置與最佳化

1. 作業系統rpm包需求

# 作業系統最低要求

bc

binutils-2.23.52.0.1-12.el7 (x86_64)

compat-libcap1-1.10-3.el7 (x86_64)

compat-libstdc++-33-3.2.3-71.el7 (i686)

compat-libstdc++-33-3.2.3-71.el7 (x86_64)

glibc-2.17-36.el7 (i686)

glibc-2.17-36.el7 (x86_64)

glibc-devel-2.17-36.el7 (i686)

glibc-devel-2.17-36.el7 (x86_64)

ksh

libaio-0.3.109-9.el7 (i686)

libaio-0.3.109-9.el7 (x86_64)

libaio-devel-0.3.109-9.el7 (i686)

libaio-devel-0.3.109-9.el7 (x86_64)

libgcc-4.8.2-3.el7 (i686)

libgcc-4.8.2-3.el7 (x86_64)

libstdc++-4.8.2-3.el7 (i686)

libstdc++-4.8.2-3.el7 (x86_64)

libstdc++-devel-4.8.2-3.el7 (i686)

libstdc++-devel-4.8.2-3.el7 (x86_64)

libxcb-1.9-5.el7 (i686)

libxcb-1.9-5.el7 (x86_64)

libX11-1.6.0-2.1.el7 (i686)

libX11-1.6.0-2.1.el7 (x86_64)

libXau-1.0.8-2.1.el7 (i686)

libXau-1.0.8-2.1.el7 (x86_64)

libXi-1.7.2-1.el7 (i686)

libXi-1.7.2-1.el7 (x86_64)

libXtst-1.2.2-1.el7 (i686)

libXtst-1.2.2-1.el7 (x86_64)

libXrender (i686)

libXrender (x86_64)

libXrender-devel (i686)

libXrender-devel (x86_64)

make-3.82-19.el7 (x86_64)

net-tools-2.0-0.17.20131004git.el7 (x86_64) (for Oracle RAC and Oracle Clusterware)

nfs-utils-1.3.0-0.21.el7.x86_64 (for Oracle ACFS)

smartmontools-6.2-4.el7 (x86_64)

sysstat-10.1.5-1.el7 (x86_64)

1.1 rpm包檢驗

# 檢驗系統缺少的rpm包並列印出來

for i in \

bc binutils compat-libcap1 compat-libstdc++-33 glibc glibc-devel ksh libaio libaio-devel \

libgcc libstdc++ libstdc++-devel libxcb libX11 libXau libXi libXtst libXrender libXrender-devel gcc-c++ \

make net-tools nfs-utils smartmontools sysstat

do

rpm -q $i &>/dev/null || F="$F $i"

done ;echo $F;unset F

1.2 yum批次安裝軟體包

# yum批次安裝rpm包,安裝具體過程省略

yum install bc binutils compat-libcap1 compat-libstdc++ glibc glibc-devel ksh libaio libaio-devel \

libgcc gcc libstdc++ libstdc++-devel libxcb libX11 libXau libXi libXtst libXrender libXrender-devel \

make net-tools nfs-utils smartmontools sysstat gcc-c++

# yum配置

# 解壓tar包在當前目錄

tar -xvf media.tar

# 更名原有的repo

mv /etc/yum.repos.d/redhat.repo /etc/yum.repos.d/redhat.repo_bk

# 建立新本地的repo

vi /etc/yum.repos.d/redhat7.repo

[redhat7.repo]

name=local

baseurl=file:///soft/media

gpgcheck=0

enabled=1

# 清除快取,檢視軟體庫,更新後設資料快取,檢視yum的包

yum clean all #Remove cached data

yum repolist #Display the configured software repositories

yum makecache #Generate the metadata cache

yum list #List a package or groups of packages

1.3 rpm包再次檢驗

# 還是使用上面的指令碼,直到無軟體包輸出為止

2. 作業系統建立軟體安裝組及使用者(oracle,grid)

groupadd --gid 54321 oinstall

groupadd --gid 54322 dba

groupadd --gid 54323 asmdba

groupadd --gid 54324 asmoper

groupadd --gid 54325 asmadmin

groupadd --gid 54326 oper

groupadd --gid 54327 backupdba

groupadd --gid 54328 dgdba

groupadd --gid 54329 kmdba

groupadd --gid 54330 racdba

useradd --uid 54321 --gid oinstall --groups dba,oper,asmdba,asmadmin,racdba,backupdba,dgdba,kmdba oracle

passwd oracle

useradd --uid 54322 --gid oinstall --groups dba,asmadmin,asmdba,asmoper,racdba grid

passwd grid

3. 作業系統建立軟體安裝目錄

vi /etc/oraInst.loc

inventory_loc=/oracle/app/oraInventory

inst_group=oinstall

# Create the Oracle Inventory Directory

# To create the Oracle Inventory directory, enter the following commands as the root user:

mkdir -p /oracle/app/oraInventory

chown -R grid:oinstall /oracle/app/oraInventory

chmod -R 775 /oracle/app/oraInventory

# Creating the Grid Infrastructure Base Directory

mkdir -p /oracle/app/grid

chown -R grid:oinstall /oracle/app/grid

chmod -R 775 /oracle/app/grid

# Creating the Oracle Grid Infrastructure Home Directory

mkdir -p /oracle/app/12.2.0/grid

chown -R grid:oinstall /oracle/app/12.2.0/grid

chmod -R 775 /oracle/app/12.2.0/grid

# Creating the Oracle Base Directory

mkdir -p /oracle/app/oracle

mkdir -p /oracle/app/oracle/cfgtoollogs

# needed to ensure that dbca is able to run after the rdbms installation.

chown -R oracle:oinstall /oracle/app/oracle

chmod -R 775 /oracle/app/oracle

# Creating the Oracle RDBMS Home Directory

mkdir -p /oracle/app/oracle/product/12.2.0/db_1

chown -R oracle:oinstall /oracle/app/oracle/product/12.2.0/db_1

chmod -R 775 /oracle/app/oracle/product/12.2.0/db_1

4. 作業系統核心引數最佳化

# 記憶體為128G,設定kernel.shmmax=70G,SGA=50G and PGA=10G

# kernel.shmmni該引數是系統共享記憶體段最大個數

# kernel.shmmax該引數是一個程式共享記憶體段最大尺度

# SHMMAX應略大於SGA尺寸

# kernel.shmall該引數是共享記憶體總量(解釋有誤，請看下一條)

# kernel.shmall該引數是共享記憶體頁面的總數

# kernel.shmall大於shmmax/PAGE_SIZE

cat /etc/sysctl.conf

kernel.shmmni = 4096

kernel.shmmax = 75161927680

kernel.shmall = 18350080

kernel.sem = 250 32000 100 128

fs.file-max = 7553600

net.ipv4.ip_local_port_range = 9000 65500

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048576

# 安裝資料庫例項後算出並新增此引數

vm.nr_hugepages = 25026

# 立即生效（root）

/sbin/sysctl -p

#NOTE: https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/5/html/ tuning_and_optimizing_red_hat_enterprise_linux_for_oracle_9i_and_10g_databases/index

#NOTE: The latest information on kernel parameter settings for Linux can be found in My Oracle Support ExtNote:169706.1.#

5. 作業系統記憶體最佳化

# Oracle一直建議關閉Transparent HugePages來最佳化記憶體的使用,

# 故關閉Transparent HugePages

grubby --default-kernel

grubby --args="transparent_hugepage=never" --update-kernel

grubby --info /boot/vmlinuz-3.10.0-514.el7.x86_64 >> /boot/grub2/grub.cfg

cat /sys/kernel/mm/transparent_hugepage/enabled

grep AnonHugePages /proc/meminfo

reboot

# 節點1執行展示結果

[root@bmcdb1 ~]# grubby --default-kernel

/boot/vmlinuz-3.10.0-514.el7.x86_64

[root@bmcdb1 ~]# grubby --args="transparent_hugepage=never" --update-kernel /boot/vmlinuz-3.10.0-514.el7.x86_64

# grubby --info /boot/vmlinuz-3.10.0-514.el7.x86_64 >> /boot/grub2/grub.cfg

cat /boot/grub2/grub.cfg

index=0

kernel=/boot/vmlinuz-3.10.0-514.el7.x86_64

args="ro crashkernel=auto rd.lvm.lv=rhel/root rd.lvm.lv=rhel/swap rhgb quiet.UTF-8 transparent_hugepage=never"

root=/dev/mapper/rhel-root

initrd=/boot/initramfs-3.10.0-514.el7.x86_64.img

title=Red Hat Enterprise Linux Server (3.10.0-514.el7.x86_64) 7.3 (Maipo)

# 確認已關閉 Transparent HugePages

[root@bmcdb1 ~]# cat /sys/kernel/mm/transparent_hugepage/enabled

always madvise [never]

[root@bmcdb1 ~]# grep AnonHugePages /proc/meminfo

AnonHugePages: 0 kB

# reboot 展示結果忽略

6. 作業系統共享記憶體最佳化

# Redhat 7.2以後systemd-logind service引入了新的功能,使用者登出時,刪除所有IPC物件

# 避免使用者中斷時系統刪除共享SGA記憶體,

# 導致ASM和database instance down機,故設定RemoveIPC=no

echo "RemoveIPC=no" >> /etc/systemd/logind.conf

systemctl restart systemd-logind

# ALERT: Setting RemoveIPC=yes on Redhat 7.2 and higher Crashes ASM and Database Instances as Well as Any Application That Uses a Shared Memory Segment (SHM) or Semaphores (SEM) (文件 ID 2081410.1)

# 節點1執行展示結果

[root@bmcdb1 ~]# echo "RemoveIPC=no" >> /etc/systemd/logind.conf

[root@bmcdb1 ~]# cat /etc/systemd/logind.conf

……中間展示忽略……

#RemoveIPC=no

RemoveIPC=no

# 設定共享記憶體

# 透過/etc/fstab設定共享記憶體

[root@bmcdb1 ~]# cat /etc/fstab

#

# /etc/fstab

# Created by anaconda on Tue Jun 25 01:24:22 2019

#

# Accessible filesystems, by reference, are maintained under '/dev/disk'

# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info

#

/dev/mapper/rhel-root / xfs defaults 0 0

UUID=1d01dfb8-026c-464f-9d8a-7bf9ee5079e5 /boot xfs defaults 0 0

UUID=741B-866B /boot/efi vfat umask=0077,shortname=winnt 0 0

/dev/mapper/rhel-swap swap swap defaults 0 0

shm /dev/shm tmpfs defaults,size=80G 0

[root@bmcdb2 home]# cat /etc/fstab

#

# /etc/fstab

# Created by anaconda on Mon Jul 1 19:01:01 2019

#

# Accessible filesystems, by reference, are maintained under '/dev/disk'

# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info

#

/dev/mapper/rhel-root / xfs defaults 0 0

UUID=39a4f14f-aab6-4e71-9424-c4fe0610c7fb /boot xfs defaults 0 0

UUID=7E8A-CC6A /boot/efi vfat umask=0077,shortname=winnt 0 0

/dev/mapper/rhel-swap swap swap defaults 0 0

shm /dev/shm tmpfs defaults,size=80G 0

7. 作業系統軟體安裝使用者環境變數(oracle,grid)

# grid

[grid@Bmcdb1 ~]$ vi .bash_profile

export PS1="[`whoami`@`hostname`:"'$PWD]$'

export JAVA_HOME=/usr/local/java; export JAVA_HOME

export ORACLE_BASE=/oracle/app/grid

export ORACLE_HOME=/oracle/app/12.2.0/grid

export ORACLE_SID=+ASM1

export ORACLE_PATH=/oracle/app/oracle/common/oracle/sql;

export ORACLE_TERM=xterm;

export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS";

export NLS_LANG=american_america.ZHS16GBK ;

export TNS_ADMIN=$ORACLE_HOME/network/admin;

export ORA_NLS11=$ORACLE_HOME/nls/data;

export PATH=$ORACLE_HOME/bin:$PATH

export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib

export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib

export TEMP=/tmp

export TMPDIR=/tmp

umask=022

# oracle

[oracle@Bmcdb1 ~]$ vi .bash_profile

export PS1="[`whoami`@`hostname`:"'$PWD]$'

export JAVA_HOME=/usr/local/java;

export ORACLE_BASE=/oracle/app/oracle

export ORACLE_HOME=$ORACLE_BASE/product/12.2.0/db_1

export ORACLE_SID=bmcdb1;

export ORACLE_UNQNAME=bmcdb;

export ORACLE_PATH=/oracle/app/common/oracle/sql;

export ORACLE_TERM=xterm;

export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS";

export NLS_LANG=american_america.ZHS16GBK ;

export TNS_ADMIN=$ORACLE_HOME/network/admin;

export ORA_NLS11=$ORACLE_HOME/nls/data;

export PATH=$ORACLE_HOME/bin:$PATH

export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib

export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib

export THREADS_FLAG=native;

export TEMP=/tmp

export TMPDIR=/tmp

umask=022

8. 作業系統使用者(oracle,grid)硬性限制最佳化

# 提升使用者硬性限制（Oracle、grid使用者預設的硬性限制不滿足GI安裝和配置）

# limits.conf為PAM模板配置檔案；所以應先配置PAM,即配置如下：

echo "session required pam_limits.so" >> /etc/pam.d/login

# RAC未執行之前,無法實際測量vm.nr_hugepages大小。

# 原則：Number Hugepages * Hugepagesize = minimum Memlock < RAM

cat /etc/security/limits.conf

oracle soft nproc 2047

oracle hard nproc 16384

oracle soft nofile 1024

oracle hard nofile 65536

oracle soft stack 10240

oracle hard stack 32768

oracle soft memlock 134144000

oracle hard memlock 134144000

grid soft nproc 2047

grid hard nproc 16384

grid soft nofile 1024

grid hard nofile 65536

grid soft stack 10240

grid hard stack 32768

#NOTE：What is Memlock and How to Calculate the Values for Memlock (文件 ID 2511230.1)

# shell開始檔案限制提升

cat /etc/profile

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

9. 作業系統關閉防火牆和selinux

# 關閉防火牆

systemctl status firewalld

systemctl start firewalld.service

systemctl stop firewalld.service

systemctl disable firewalld.service

systemctl status firewalld

# 永久關閉selinux

cat /etc/sysconfig/selinux

SELINUX=disabled

10. 作業系統安裝軟體使用者(oracle,grid)互信配置

# 在節點1配置ssh互信,步驟如下：

# 使用root將資料庫軟體複製至/home/oracle/下：

# 此指令碼適合多節點安裝優先使用

# chown oracle:oinstall linuxx64_12201_database.zip

# su - oracle

$ unzip linuxx64_12201_database.zip

$ cd database/sshsetup/

$ ./sshUserSetup.sh -user oracle -hosts "node1 node2" -advanced -noPromptPassphrase

$ ./sshUserSetup.sh -user grid -hosts "node1 node2" -advanced -noPromptPassphrase

# 檢驗互信

# 節點1, bmcdb1上執行檢驗操作

$ ssh bmcdb1 date;ssh bmcdb2 date;ssh bmcdb1priv date;ssh bmcdb2priv date

# 節點2, bmcdb2上執行檢驗操作

$ ssh bmcdb1 date;ssh bmcdb2 date;ssh bmcdb1priv date;ssh bmcdb2priv date

11. 作業系統使用/etc/hosts解析

# /etc/hosts解析地址如下

[oracle@bmcdb1 ~]$ cat /etc/hosts

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

# PUBLIC-IP

10.151.115.61 bmcdb1

10.151.115.62 bmcdb2

# VIP-IP

10.151.115.63 bmcdb1vip

10.151.115.64 bmcdb2vip

# PRIVATE-IP

192.155.1.161 bmcdb1priv

192.155.1.162 bmcdb2priv

# SCAN-IP

10.151.115.65 scanbmcdb

# 優先使用/etc/hosts,故files在dns前

[root@bmcdb1 ~]# cat /etc/nsswitch.conf | grep hosts

# hosts: db files nisplus nis dns

hosts: files dns myhostname

12. 作業系統時間同步配置NTP

# 每十分鐘同步一次時間伺服器,使用crontab定時任務呼叫ntpdate命令同步

檢查系統時間

# date

# 公司內部時間伺服器

[root@bmcdb1 soft]# crontab -l

*/10 * * * * /usr/sbin/ntpdate 10.151.113.73

[root@bmcdb2 ~]# crontab -l

*/10 * * * * /usr/sbin/ntpdate 10.151.113.73

3. Oracle RAC 共享儲存準備

a) powerpath多路徑軟體聚合LUN成一條路徑供系統使用

# powerpath安裝及儲存磁碟分配等工作請安排專業的儲存工程師完成

# 節點1執行展示結果

[root@bmcdb1 ~]# powermt display dev=all

Pseudo name=emcpowera

VPLEX ID=CKM00182201323

Logical device ID=6000144000000010F0127E4709356BC6 [device_Unity0004_New_BmcDB_ocr3_1_vol]

state=alive; policy=ADaptive; queued-IOs=0

==============================================================================

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

### HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================

16 lpfc sdaw CL1-0B active alive 0 0

16 lpfc sdaq CL1-0A active alive 0 0

16 lpfc sdak CL1-08 active alive 0 0

16 lpfc sdae CL1-09 active alive 0 0

15 lpfc sdy CL1-0F active alive 0 0

15 lpfc sds CL1-0E active alive 0 0

15 lpfc sdm CL1-0D active alive 0 0

15 lpfc sdg CL1-0C active alive 0 0

Pseudo name=emcpowerb

VPLEX ID=CKM00182201323

Logical device ID=6000144000000010F0127E4709356BC4 [device_Unity0004_New_BmcDB_ocr2_1_vol]

state=alive; policy=ADaptive; queued-IOs=0

==============================================================================

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

### HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================

16 lpfc sdav CL1-0B active alive 0 0

16 lpfc sdap CL1-0A active alive 0 0

16 lpfc sdaj CL1-08 active alive 0 0

16 lpfc sdad CL1-09 active alive 0 0

15 lpfc sdx CL1-0F active alive 0 0

15 lpfc sdr CL1-0E active alive 0 0

15 lpfc sdl CL1-0D active alive 0 0

15 lpfc sdf CL1-0C active alive 0 0

Pseudo name=emcpowerc

VPLEX ID=CKM00182201323

Logical device ID=6000144000000010F0127E4709356BC2 [device_Unity0004_New_BmcDB_ocr1_1_vol]

state=alive; policy=ADaptive; queued-IOs=0

==============================================================================

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

### HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================

16 lpfc sdau CL1-0B active alive 0 0

16 lpfc sdai CL1-08 active alive 0 0

16 lpfc sdao CL1-0A active alive 0 0

16 lpfc sdac CL1-09 active alive 0 0

15 lpfc sdw CL1-0F active alive 0 0

15 lpfc sdq CL1-0E active alive 0 0

15 lpfc sdk CL1-0D active alive 0 0

15 lpfc sde CL1-0C active alive 0 0

Pseudo name=emcpowerd

VPLEX ID=CKM00182201323

Logical device ID=6000144000000010F0127E4709356BC3 [device_Unity0004_New_BmcDB_dsg_1_vol]

state=alive; policy=ADaptive; queued-IOs=0

==============================================================================

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

### HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================

16 lpfc sdat CL1-0B active alive 0 0

16 lpfc sdan CL1-0A active alive 0 0

16 lpfc sdah CL1-08 active alive 0 0

16 lpfc sdab CL1-09 active alive 0 0

15 lpfc sdv CL1-0F active alive 0 0

15 lpfc sdp CL1-0E active alive 0 0

15 lpfc sdj CL1-0D active alive 0 0

15 lpfc sdd CL1-0C active alive 0 0

Pseudo name=emcpowere

VPLEX ID=CKM00182201323

Logical device ID=6000144000000010F0127E4709356BC7 [device_Unity0004_New_BmcDB_data1_1_vol]

state=alive; policy=ADaptive; queued-IOs=0

==============================================================================

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

### HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================

16 lpfc sdas CL1-0B active alive 0 0

16 lpfc sdam CL1-0A active alive 0 0

16 lpfc sdag CL1-08 active alive 0 0

16 lpfc sdaa CL1-09 active alive 0 0

15 lpfc sdu CL1-0F active alive 0 0

15 lpfc sdo CL1-0E active alive 0 0

15 lpfc sdi CL1-0D active alive 0 0

15 lpfc sdc CL1-0C active alive 0 0

Pseudo name=emcpowerf

VPLEX ID=CKM00182201323

Logical device ID=6000144000000010F0127E4709356BC5 [device_Unity0004_New_BmcDB_arch1_1_vol]

state=alive; policy=ADaptive; queued-IOs=0

==============================================================================

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

### HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================

16 lpfc sdaf CL1-08 active alive 0 0

16 lpfc sdar CL1-0B active alive 0 0

16 lpfc sdal CL1-0A active alive 0 0

16 lpfc sdz CL1-09 active alive 0 0

15 lpfc sdt CL1-0F active alive 0 0

15 lpfc sdn CL1-0E active alive 0 0

15 lpfc sdh CL1-0D active alive 0 0

15 lpfc sdb CL1-0C active alive 0 0

b) 使用udev持久化磁碟許可權

# NOTE:How To Set Device Name Using UDEV on OL 7.X (文件 ID 2056427.1)

# 編輯rules規則檔案

# 注意：rules檔案中uuid區別大小寫,

# 故要注意scsi_id -g -u -d $devnode 的輸出結果。

KERNEL=="sd*[!0-9]", ENV{DEVTYPE}=="disk", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode", RESULT=="36000144000000010f0127e4709356bc5", RUN+="/bin/sh -c 'mknod /dev/asmarchdisk1 b $major $minor; chown grid:asmadmin /dev/asmarchdisk1; chmod 0660 /dev/asmarchdisk1'"
KERNEL=="sd*[!0-9]", ENV{DEVTYPE}=="disk", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode", RESULT=="36000144000000010f0127e4709356bc7", RUN+="/bin/sh -c 'mknod /dev/asmdatadisk1 b $major $minor; chown grid:asmadmin /dev/asmdatadisk1; chmod 0660 /dev/asmdatadisk1'"
KERNEL=="sd*[!0-9]", ENV{DEVTYPE}=="disk", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode", RESULT=="36000144000000010f0127e4709356bc2", RUN+="/bin/sh -c 'mknod /dev/asmocrdisk1 b $major $minor; chown grid:asmadmin /dev/asmocrdisk1; chmod 0660 /dev/asmocrdisk1'"
KERNEL=="sd*[!0-9]", ENV{DEVTYPE}=="disk", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode", RESULT=="36000144000000010f0127e4709356bc4", RUN+="/bin/sh -c 'mknod /dev/asmocrdisk2 b $major $minor; chown grid:asmadmin /dev/asmocrdisk2; chmod 0660 /dev/asmocrdisk2'"
KERNEL=="sd*[!0-9]", ENV{DEVTYPE}=="disk", SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode", RESULT=="36000144000000010f0127e4709356bc6", RUN+="/bin/sh -c 'mknod /dev/asmocrdisk3 b $major $minor; chown grid:asmadmin /dev/asmocrdisk3; chmod 0660 /dev/asmocrdisk3'"

# 啟動Udev

/sbin/udevadm trigger --type=devices --action=change

# 檢視磁碟

[root@pcmdb1 rpm]# /sbin/udevadm trigger --type=devices --action=change

[root@pcmdb1 rpm]# ls -l /dev/asm*

brw-rw---- 1 grid asmadmin 8, 16 Nov 24 15:19 /dev/asmarchdisk

brw-rw---- 1 grid asmadmin 8, 32 Nov 24 15:19 /dev/asmdatadisk

brw-rw---- 1 grid asmadmin 8, 48 Nov 24 15:19 /dev/asmocrdisk1

brw-rw---- 1 grid asmadmin 8, 64 Nov 24 15:19 /dev/asmocrdisk2

brw-rw---- 1 grid asmadmin 8, 80 Nov 24 15:19 /dev/asmocrdisk3

c) 設定Disk I/O Scheduler on Linux

# 設定I/0 scheduler為[deadline]狀態,共享使用

echo deadline > /sys/block/${ASM_DISK}/queue/scheduler

# 節點1執行展示結果,檢視當前scheduler狀態是否為[deadline]

[root@bmcdb1 ~]# cat /sys/block/emcpowera/queue/scheduler

noop [deadline] cfq

[root@bmcdb1 ~]# cat /sys/block/emcpowerb/queue/scheduler

noop [deadline] cfq

[root@bmcdb1 ~]# cat /sys/block/emcpowerc/queue/scheduler

noop [deadline] cfq

[root@bmcdb1 ~]# cat /sys/block/emcpowerd/queue/scheduler

noop [deadline] cfq

[root@bmcdb1 ~]# cat /sys/block/emcpowere/queue/scheduler

noop [deadline] cfq

[root@bmcdb1 ~]# cat /sys/block/emcpowerf/queue/scheduler

noop [deadline] cfq

4. GI安裝

a) cvuqdisk包需要所有節點均安裝

[root@bmcdb1 rpm]# ls

cvuqdisk-1.0.10-1.rpm

[root@bmcdb1 rpm]# pwd

/home/oracle/database/rpm

[root@bmcdb1 rpm]# rpm -ivh cvuqdisk-1.0.10-1.rpm

Preparing... ################################# [100%]

Updating / installing...

1:cvuqdisk-1.0.10-1 ################################# [100%]

[root@bmcdb1 rpm]# scp cvuqdisk-1.0.10-1.rpm root@bmcdb2:/home/oracle

The authenticity of host 'bmcdb2 (10.151.115.72)' can't be established.

ECDSA key fingerprint is e5:25:bb:51:c6:da:76:25:1d:4a:59:a8:e4:6d:92:ef.

Are you sure you want to continue connecting (yes/no) yes

Warning: Permanently added 'bmcdb2' (ECDSA) to the list of known hosts.

root@bmcdb2's password:

cvuqdisk-1.0.10-1.rpm

[root@bmcdb2 rules.d]# cd /home/oracle

You have new mail in /var/spool/mail/root

[root@bmcdb2 oracle]# ls

cvuqdisk-1.0.10-1.rpm

[root@bmcdb2 oracle]# pwd

/home/oracle

[root@bmcdb2 oracle]# rpm -ivh cvuqdisk-1.0.10-1.rpm

Preparing... ################################# [100%]

Updating / installing...

1:cvuqdisk-1.0.10-1 ################################# [100%]

b) GI軟體包直接解壓到GI的$ORACLE_HOME下

su - grid

unzip -d $ORACLE_HOME /soft/linuxx64_12201_grid_home.zip

# 安裝過程省略

# runcluvfy.sh檢驗系統環境（先解壓GI包,後才有runcluvfy.sh指令碼）

./runcluvfy.sh stage -pre crsinst -n bmcdb1,bmcdb2 -verbose

# 過程省略

c) 升級Opatch

# 用新的Opatch直接覆蓋原有舊的Opatch

# 修改執行許可權

[root@bmcdb1 soft]# chmod 775 p6880880_122010_Linux-x86-64.zip

[grid@bmcdb1:/home/grid]$unzip -d /oracle/app/12.2.0/grid/ /soft/p6880880_122010_Linux-x86-64.zip

Archive: /soft/p6880880_122010_Linux-x86-64.zip

inflating: /oracle/app/12.2.0/grid/OPatch/emdpatch.pl

replace /oracle/app/12.2.0/grid/OPatch/oplan/oplan [y]es, [n]o, [A]ll, [N]one, [r]ename: A

# 過程省略

d) GI補丁升級與GI圖形安裝

# 修改補丁執行許可權

[root@bmcdb1 12.2.0.1_grid_2019aprpatch]# chmod a+x p29301687_122010_Linux-x86-64.zip

[root@bmcdb1 12.2.0.1_grid_2019aprpatch]# ls -l p29301687_122010_Linux-x86-64.zip

-rwxr-xr-x 1 root root 1736326653 Jul 18 15:02 p29301687_122010_Linux-x86-64.zip

# 建立補丁安裝目錄

[grid@bmcdb1:/oracle/app/12.2.0/grid]$mkdir -p /oracle/app/12.2.0/grid/gridpsu

# 解壓補丁

[grid@bmcdb1:/oracle/app/12.2.0/grid]$unzip -d /oracle/app/12.2.0/grid/gridpsu  /soft/12.2.0.1_grid_2019aprpatch/p29301687_122010_Linux-x86-64.zip

# 應用補丁並安裝GI

/usr/bin/xauth: file /home/grid/.Xauthority does not exist

[grid@bmcdb1:/home/grid]$export DISPLAY=10.156.84.215:0.0

[grid@bmcdb1:/home/grid]$xclock

Warning: Missing charsets in String to FontSet conversion

# 使用grid使用者補丁和GI圖形安裝

[grid@bmcdb1:/oracle/app/12.2.0/grid]$./gridSetup.sh -applyPSU /oracle/app/12.2.0/grid/gridpsu/29301687

...圖形介面安裝省略...

root執行root.sh指令碼

# 節點1執行root.sh指令碼記錄(共19步)

...雙節點需都執行成功，具體步驟省略...

GI安裝成功

# GI安裝成功後,服務狀態如下：

[grid@bmcdb1:/home/grid]$crsctl stat res -t

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.OCR.dg

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.LISTENER.lsnr

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.net1.network

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.ons

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.proxy_advm

OFFLINE OFFLINE bmcdb1 STABLE

OFFLINE OFFLINE bmcdb2 STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE bmcdb1 STABLE

ora.MGMTLSNR

1 OFFLINE OFFLINE STABLE

ora.asm

1 ONLINE ONLINE bmcdb1 Started,STABLE

2 ONLINE ONLINE bmcdb2 Started,STABLE

3 OFFLINE OFFLINE STABLE

ora.cvu

1 ONLINE ONLINE bmcdb1 STABLE

ora.bmcdb1.vip

1 ONLINE ONLINE bmcdb1 STABLE

ora.bmcdb2.vip

1 ONLINE ONLINE bmcdb2 STABLE

ora.qosmserver

1 ONLINE ONLINE bmcdb1 STABLE

ora.scan1.vip

1 ONLINE ONLINE bmcdb1 STABLE

--------------------------------------------------------------------------------

檢驗補丁情況

# 節點1執行opatch檢驗補丁情況,節點2執行結果忽略。雙節點結果相同

[grid@bmcdb1:/oracle/app/12.2.0/grid/OPatch]$./opatch lsinventory

Oracle Interim Patch Installer version 12.2.0.1.17

Oracle Home : /oracle/app/12.2.0/grid

Central Inventory : /oracle/app/oraInventory

from : /oracle/app/12.2.0/grid/oraInst.loc

OPatch version : 12.2.0.1.17

OUI version : 12.2.0.1.4

Log file location : /oracle/app/12.2.0/grid/cfgtoollogs/opatch/opatch2019-08-05_16-56-31PM_1.log

Lsinventory Output file location : /oracle/app/12.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2019-08-05_16-56-31PM.txt

--------------------------------------------------------------------------------

Local Machine Information::

Hostname: bmcdb1

ARU platform id: 226

ARU platform description:: Linux x86-64

Installed Top-level Products (1):

Oracle Grid Infrastructure 12c 12.2.0.1.0

There are 1 products installed in this Oracle Home.

Interim patches (5) :

Patch 26839277 : applied on Mon Aug 05 13:48:23 CST 2019

Unique Patch ID: 21578760

Patch description: "DBWLM RELEASE UPDATE 12.2.0.1.0(ID:170913) (26839277)"

Created on 21 Sep 2017, 03:13:10 hrs PST8PDT

Bugs fixed:

26584906

Patch 29314339 : applied on Mon Aug 05 13:48:16 CST 2019

Unique Patch ID: 22821655

Patch description: "Database Apr 2019 Release Update : 12.2.0.1.190416 (29314339)"

Created on 24 Mar 2019, 03:28:52 hrs PST8PDT

Bugs fixed:

26362155, 28023399, 25741955, 25873336, 26966616, 27097854, 28617631

……中間省略修改的bug號……

28951382, 28960211, 28987439, 28991884, 28993590, 29027694, 29189889

29250230

Patch 28566910 : applied on Mon Aug 05 13:47:53 CST 2019

Unique Patch ID: 22413436

Patch description: "TOMCAT RELEASE UPDATE 12.2.0.1.0(ID:180802.1448.S) (28566910)"

Created on 28 Aug 2018, 23:01:25 hrs PST8PDT

Bugs fixed:

25728967, 26934551, 28402313

Patch 29314424 : applied on Mon Aug 05 13:47:47 CST 2019

Unique Patch ID: 22724570

Patch description: "OCW APR 2019 RELEASE UPDATE 12.2.0.1.190416 (29314424)"

Created on 7 Mar 2019, 02:44:34 hrs PST8PDT

Bugs fixed:

12816839, 13250991, 18701017, 20559126, 20674742, 21477269, 21679331

……中間省略修改的bug號……

28747282, 28805158, 28871945, 28887933, 28901519, 28915251, 28969877

28973538, 29400176

Patch 29301676 : applied on Mon Aug 05 13:47:12 CST 2019

Unique Patch ID: 22720406

Patch description: "ACFS APR 2019 RELEASE UPDATE 12.2.0.1.190416 (29301676)"

Created on 3 Feb 2019, 15:55:16 hrs PST8PDT

Bugs fixed:

21129279, 22591010, 23152694, 23181299, 23625427, 24285969, 24346777

……中間省略修改的bug號…… 29031452, 29054666

--------------------------------------------------------------------------------

OPatch succeeded.

5. RDBMS 軟體安裝

a) DB軟體使用oracle使用者圖形安裝

# 使用xmanger呼叫圖形介面,並使用xclock測試

[oracle@bmcdb1:/home/oracle]$export DISPLAY=10.156.84.72:0.0

[oracle@bmcdb1:/home/oracle]$xclock

[oracle@bmcdb1:/home/oracle/database]$./runInstaller

Starting Oracle Universal Installer...

Checking Temp space: must be greater than 500 MB. Actual 1035804 MB Passed

Checking swap space: must be greater than 150 MB. Actual 65535 MB Passed

Checking monitor: must be configured to display at least 256 colors. Actual 16777216 Passed

Preparing to launch Oracle Universal Installer from /tmp/OraInstall2019-08-06_09-30-49AM. Please wait ...[oracle@bmcdb1:/home/oracle/database]$

...圖形介面安裝省略...

Root執行root.sh指令碼(雙節點需執行成功)

Db軟體安裝成功

b) 升級Opatch

#　Opatch解壓到$ORACLE_HOME下直接覆蓋舊的Opatch

[oracle@bmcdb1:/oracle/app/oracle/product/12.2.0/db_1]$unzip -d /oracle/app/oracle/product/12.2.0/db_1/ /soft/p6880880_122010_Linux-x86-64.zip

………過程省略

[oracle@bmcdb2:/oracle/app/oracle/product/12.2.0/db_1]$unzip -d /oracle/app/oracle/product/12.2.0/db_1/ /home/oracle/p6880880_122010_Linux-x86-64.zip

Archive: /home/oracle/p6880880_122010_Linux-x86-64.zip

inflating: /oracle/app/oracle/product/12.2.0/db_1/OPatch/emdpatch.pl

replace /oracle/app/oracle/product/12.2.0/db_1/OPatch/oplan/oplan [y]es, [n]o, [A]ll, [N]one, [r]ename: A

………過程省略

c) DB補丁升級

# 建立補丁目錄,並解壓軟體,應用軟體,datapatch -verbose載入修改後的SQL檔案進資料庫(dbca建庫後)

# 節點1升級後,軟體cp到節點2繼續升級

＃節點１執行展示結果

[oracle@bmcdb1:/oracle/app/oracle/product/12.2.0/db_1]$mkdir -p /oracle/app/oracle/product/12.2.0/db_1/dbpsu

[oracle@bmcdb1:/oracle/app/oracle/product/12.2.0/db_1]$unzip -d /oracle/app/oracle/product/12.2.0/db_1/dbpsu /soft/12.2.0.1_db_2019aprpatch/p29314339_122010_Linux-x86-64.zip

[oracle@bmcdb1:/oracle/app/oracle/product/12.2.0/db_1/OPatch]$./opatch apply /oracle/app/oracle/product/12.2.0/db_1/dbpsu/29314339/

[oracle@bmcdb1:/oracle/app/oracle/product/12.2.0/db_1/OPatch]$./opatch lsinventory

Oracle Interim Patch Installer version 12.2.0.1.17

Oracle Home : /oracle/app/oracle/product/12.2.0/db_1

Central Inventory : /oracle/app/oraInventory

from : /oracle/app/oracle/product/12.2.0/db_1/oraInst.loc

OPatch version : 12.2.0.1.17

OUI version : 12.2.0.1.4

Log file location : /oracle/app/oracle/product/12.2.0/db_1/cfgtoollogs/opatch/opatch2019-08-06_10-33-46AM_1.log

Lsinventory Output file location : /oracle/app/oracle/product/12.2.0/db_1/cfgtoollogs/opatch/lsinv/lsinventory2019-08-06_10-33-46AM.txt

--------------------------------------------------------------------------------

Local Machine Information::

Hostname: bmcdb1

ARU platform id: 226

ARU platform description:: Linux x86-64

Installed Top-level Products (1):

Oracle Database 12c 12.2.0.1.0

There are 1 products installed in this Oracle Home.

Interim patches (1) :

Patch 29314339 : applied on Tue Aug 06 10:32:10 CST 2019

Unique Patch ID: 22821655

Patch description: "Database Apr 2019 Release Update : 12.2.0.1.190416 (29314339)"

Created on 24 Mar 2019, 03:28:52 hrs PST8PDT

Bugs fixed:

26362155, 28023399, 25741955, 25873336, 26966616, 27097854, 28617631

………中間修復的BUG號省略………

29250230

--------------------------------------------------------------------------------

OPatch succeeded.

＃節點２執行展示結果

[oracle@bmcdb2:/oracle/app/oracle/product/12.2.0/db_1]$mkdir -p /oracle/app/oracle/product/12.2.0/db_1/dbpsu

[oracle@bmcdb2:/oracle/app/oracle/product/12.2.0/db_1]$unzip -d /oracle/app/oracle/product/12.2.0/db_1/dbpsu /home/oracle/p29314339_122010_Linux-x86-64.zip

[oracle@bmcdb2:/oracle/app/oracle/product/12.2.0/db_1/OPatch]$./opatch apply /oracle/app/oracle/product/12.2.0/db_1/dbpsu/29314339/

[oracle@bmcdb2:/oracle/app/oracle/product/12.2.0/db_1/OPatch]$./opatch lsinventory

Oracle Interim Patch Installer version 12.2.0.1.17

Oracle Home : /oracle/app/oracle/product/12.2.0/db_1

Central Inventory : /oracle/app/oraInventory

from : /oracle/app/oracle/product/12.2.0/db_1/oraInst.loc

OPatch version : 12.2.0.1.17

OUI version : 12.2.0.1.4

Log file location : /oracle/app/oracle/product/12.2.0/db_1/cfgtoollogs/opatch/opatch2019-08-06_10-45-39AM_1.log

Lsinventory Output file location : /oracle/app/oracle/product/12.2.0/db_1/cfgtoollogs/opatch/lsinv/lsinventory2019-08-06_10-45-39AM.txt

--------------------------------------------------------------------------------

Local Machine Information::

Hostname: bmcdb2

ARU platform id: 226

ARU platform description:: Linux x86-64

Installed Top-level Products (1):

Oracle Database 12c 12.2.0.1.0

There are 1 products installed in this Oracle Home.

Interim patches (1) :

Patch 29314339 : applied on Tue Aug 06 10:45:07 CST 2019

Unique Patch ID: 22821655

Patch description: "Database Apr 2019 Release Update : 12.2.0.1.190416 (29314339)"

Created on 24 Mar 2019, 03:28:52 hrs PST8PDT

Bugs fixed:

26362155, 28023399, 25741955, 25873336, 26966616, 27097854, 28617631

………中間修復的BUG號省略………

29250230

--------------------------------------------------------------------------------

OPatch succeeded.

6. ASMCA建立磁碟組

[grid@bmcdb1:/home/grid]$export DISPLAY=10.156.84.72:0.0

[grid@bmcdb1:/home/grid]$xclock

[grid@bmcdb1:/home/grid]$asmca

...圖形介面安裝省略...

＃磁碟組檢驗

[grid@bmcdb1:/home/grid]$asmcmd

ASMCMD> lsdg

State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name

MOUNTED EXTERN N 512 512 4096 4194304 204800 204668 0 204668 0 N DATA/

MOUNTED EXTERN N 512 512 4096 4194304 51200 51068 0 51068 0 N FRA/

MOUNTED NORMAL N 512 512 4096 4194304 92160 91244 30720 30262 0 Y OCR/

[grid@bmcdb2:/home/grid]$asmcmd lsdg

State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name

MOUNTED EXTERN N 512 512 4096 4194304 204800 204668 0 204668 0 N DATA/

MOUNTED EXTERN N 512 512 4096 4194304 51200 51068 0 51068 0 N FRA/

MOUNTED NORMAL N 512 512 4096 4194304 92160 91244 30720 30262 0 Y OCR/

7. DBCA建立資料庫

[oracle@bmcdb1:/home/oracle/database]$export DISPLAY=10.156.84.72:0.0

[oracle@bmcdb1:/home/oracle/database]$xclock

Warning: Missing charsets in String to FontSet conversion

[oracle@bmcdb1:/home/oracle/database]$dbca

...圖形介面安裝省略...

資料庫安裝後服務狀態展示如下：

[grid@bmcdb1:/home/grid]$crsctl stat res -t

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.DATA.dg

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.FRA.dg

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.LISTENER.lsnr

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.OCR.dg

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.net1.network

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.ons

ONLINE ONLINE bmcdb1 STABLE

ONLINE ONLINE bmcdb2 STABLE

ora.proxy_advm

OFFLINE OFFLINE bmcdb1 STABLE

OFFLINE OFFLINE bmcdb2 STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE bmcdb1 STABLE

ora.MGMTLSNR

1 OFFLINE OFFLINE STABLE

ora.asm

1 ONLINE ONLINE bmcdb1 Started,STABLE

2 ONLINE ONLINE bmcdb2 Started,STABLE

3 OFFLINE OFFLINE STABLE

ora.cvu

1 ONLINE ONLINE bmcdb1 STABLE

ora.bmcdb.db

1 ONLINE ONLINE bmcdb1 Open,HOME=/oracle/ap

p/oracle/product/12.

2.0/db_1,STABLE

2 ONLINE ONLINE bmcdb2 Open,HOME=/oracle/ap

p/oracle/product/12.

2.0/db_1,STABLE

ora.bmcdb1.vip

1 ONLINE ONLINE bmcdb1 STABLE

ora.bmcdb2.vip

1 ONLINE ONLINE bmcdb2 STABLE

ora.qosmserver

1 ONLINE ONLINE bmcdb1 STABLE

ora.scan1.vip

1 ONLINE ONLINE bmcdb1 STABLE

--------------------------------------------------------------------------------

# 將修改後的SQL檔案載入到資料庫中

[oracle@bmcdb2:/oracle/app/oracle/product/12.2.0/db_1/OPatch]$./datapatch -verbose

SQL Patching tool version 12.2.0.1.0 Production on Tue Aug 6 16:00:02 2019

Log file for this invocation: /oracle/app/oracle/cfgtoollogs/sqlpatch/sqlpatch_106582_2019_08_06_16_00_02/sqlpatch_invocation.log

Connecting to database...OK

Bootstrapping registry and package to current versions...done

Determining current state...done

Current state of SQL patches:

Bundle series DBRU:

ID 190416 in the binary registry and ID 190416 in the SQL registry

Adding patches to installation queue and performing prereq checks...

Installation queue:

Nothing to roll back

Nothing to apply

SQL Patching tool complete on Tue Aug 6 16:00:36 2019

SQL> set lines 500 pages 500

SQL> col description for a75

SQL> col action_time for a35

SQL> col action for a10

SQL> col comments for a50

SQL> col VERSION for a25

SQL> col NAMESPACE for a20

SQL> col BUNDLE_SERIES for a20

SQL> select * from registry$history;

ACTION_TIME ACTION NAMESPACE VERSION ID COMMENTS BUNDLE_SERIES

----------------------------------- ---------- -------------------- ------------------------- ---------- -------------------------------------------------- --------------------

BOOTSTRAP DATAPATCH 12.2.0.1 RDBMS_12.2.0.1.0DBAPR2019RU_LINUX.X64_190227

SQL> select patch_id,version,action,status,action_time,description from dba_registry_sqlpatch;

PATCH_ID VERSION ACTION STATUS ACTION_TIME DESCRIPTION

---------- ------------------------- ---------- ------------------------- ----------------------------------- ---------------------------------------------------------------------------

29314339 12.2.0.1 APPLY SUCCESS 06-AUG-19 01.29.26.913398 PM DATABASE APR 2019 RELEASE UPDATE 12.2.0.1.190416

8. RAC最佳化

1.安全

1.1 使用者密碼策略最佳化(可根據安全策略自行建立)

# FAILED_LOGIN_ATTEMPTS=>登入錯誤次數限制

# PASSWORD_LIFE_TIME =>密碼有效期限制

ALTER PROFILE DEFAULT LIMIT FAILED_LOGIN_ATTEMPTS 30;

ALTER PROFILE DEFAULT LIMIT PASSWORD_LIFE_TIME UNLIMITED;

1.2 最佳化低端版本的客戶端無法登入12c高版本資料庫問題(所有節點配置)

[grid@bmcdb1:/oracle/app/12.2.0/grid/network/admin]$cat sqlnet.ora

NAMES.DIRECTORY_PATH= (TNSNAMES, EZCONNECT)

SQLNET.ALLOWED_LOGON_VERSION=8

# MOS文件 ID 2296947.1

2.例項最佳化

2.1 process程式數最佳化

# 作業系統使用者程式數和所有後臺程式最大值。

# 例如：locks\job queue processes\parallel execution processes

alter system set processes=2000 sid='*' scope=spfile;

2.2 例項本地程式併發最佳化

# 實現程式級別本地化併發處理，最佳化節點間通宵成本負載大的問題。

# PARALLEL_FORCE_LOCAL該引數預設是False。

alter system set parallel_force_local=true sid='*';

2.3 避免大量library cache lock導致使用者不能登入的情況

# 關閉資料庫當中使用者持續輸入錯誤密碼導致大量library cache lock

alter system set event ="28401 TRACE NAME CONTEXT FOREVER, LEVEL 1" sid='*' scope=spfile;

2.4 DBLINK使用insert最佳化

# 高版本資料庫dblink插入低版本資料庫，insert語法最後一個bind不是varchar2時，# 報錯ORA-01483或者ORA-01461

# 參考：OCI Application Fails With ORA-01483/ORA-01461 When Inserting VARCHAR2 Field From 12.2/18c Database Using Database Link To Lower Database Version. (文件 ID 2309285.1)

alter system set "_qkslvc_extended_bind_sz"=0 sid='*';

2.5 12.2 RAC 避免DataPump匯入出現大量'Library Cache Lock' (Cycle)

# datapump時parallel>1可能觸發BUG，引起大量'Library Cache Lock' (Cycle)問題

parallel = 1 執行後設資料匯入（預設值）。

2.6 增加 db_files

# How to change the DB_FILES parameter in RAC (文件 ID 1636681.1)

alter system set db_files=500 sid='*' scope=spfile;

srvctl stop database -d bmcdb

srvctl start database -d bmcdb

# MAXDATAFILES為自動擴充套件，oracle 8 版本以後

3.系統最佳化

3.1 大頁使用最佳化

所有例項使用hugepages_settings.sh指令碼計算vm.nr_hugepages值,停止所有例項後，將計算出的vm.nr_hugepages = 25026 新增至/etc/sysctl.conf，並設定立即生效 sysctl -p

# 參考：Oracle Linux: Shell Script to Calculate Values Recommended Linux HugePages / HugeTLB Configuration (文件 ID 401749.1)

[root@bmcdb1 ~]# sh hugepages_settings.sh

This script is provided by Doc ID 401749.1 from My Oracle Support

() where it is intended to compute values for

the recommended HugePages/HugeTLB configuration for the current shared

memory segments on Oracle Linux. Before proceeding with the execution please note following:

* For ASM instance, it needs to configure ASMM instead of AMM.

* The 'pga_aggregate_target' is outside the SGA and

you should accommodate this while calculating SGA size.

* In case you changes the DB SGA size,

as the new SGA will not fit in the previous HugePages configuration,

it had better disable the whole HugePages,

start the DB with new SGA size and run the script again.

And make sure that:

* Oracle Database instance(s) are up and running

* Oracle Database 11g Automatic Memory Management (AMM) is not setup

(See Doc ID 749851.1)

* The shared memory segments can be listed by command:

# ipcs -m

Press Enter to proceed...

Recommended setting: vm.nr_hugepages = 25026

[root@bmcdb1 ~]# grep HugePages /proc/meminfo

AnonHugePages: 0 kB

HugePages_Total: 0

HugePages_Free: 0

HugePages_Rsvd: 0

HugePages_Surp: 0

[root@bmcdb1 ~]# sysctl -p

……

vm.nr_hugepages = 25026

[root@bmcdb1 ~]# grep HugePages /proc/meminfo

AnonHugePages: 0 kB

HugePages_Total: 25026

HugePages_Free: 25026

HugePages_Rsvd: 0

HugePages_Surp: 0

# 大頁已經生效

9．附表

1.NOTE：Deploying Oracle RAC Database 12c Release 2 on Red Hat Enterprise Linux 7

2.手動完全刪除GI

How to completely remove 11.2 and 12.1 Grid Infrastructure, CRS and/or Oracle Restart - IBM: Linux on System z (文件 ID 1413787.1)

3.如何(Deconfigure)解除配置/(Reconfigure)重新配置（重建 OCR）或解除安裝 GI (文件 ID 2016852.1)

########################################################################################

QQ：14040928 E-mail：dbadoudou@163.com

本文連結： http://blog.itpub.net/26442936/viewspace-2654393/

########################################################################################

Oracle 12.2 RAC on Linux Best Practice Documentation

相關文章