RAC19c搭建-centos7+openfiler+multipath+udev

hellohf123發表於2021-09-25

 

1.環境:centos7.9

          openfiler

          oracle19c

rac11g搭建參考  http://blog.itpub.net/70004783/viewspace-2792218/

 

2.1 IP 規劃

Hostname

Host-alias

type

ip

interface

rac1

rac1

Public ip

10.8.98.103

Eth0

rac1-vip

rac1-vip

Virtual ip

10.8.98.105

Eth0:1

rac1-priv

rac1-priv

Private ip

192.168.1.103

Eth1






rac2

rac2

Public ip

10.8.98.104

Eth0

rac2-vip

rac2-vip

Virtual ip

10.8.98.106

Eth0:1

rac2-priv

rac2-priv

Private ip

192.168.1.104

Eth1






cluster-scan

cluster-scan

scan ip

10.8.98.107

Eth0






openfiler

openfiler


10.8.98.100

Eth0




10.8.98.101

Eth1


倆節點hosts檔案修改

[root@rac1 ~]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
#public ip eth0
10.8.98.103         rac1
10.8.98.104         rac2
#priv ip eth1
192.168.1.103     rac1-priv
192.168.1.104     rac2-priv
#vip ip
10.8.98.105         rac1-vip
10.8.98.106         rac2-vip
#scan ip
10.8.98.107         cluster-scan

 

2.2 目錄規劃

Grid infrastructure

Oracle database

HOME=/home/oracle

HOME=/home/oracle

ORACLE_BASE=/u01/app/grid

ORACLE_BASE=/u01/app/oracle

ORACLE_HOME=/u01/app/19c/grid

ORACLE_HOME=/u01/app/oracle/product/19c/db_1

 

 

2.3 ORACLE SID

db_name

prod

Node 1 instance sid

prod1

Node 2 instance sid

prod2


 


2.4 儲存規劃

儲存LUN (分割槽)規劃原則(生產環境)

1.        資料檔案和歸檔檔案底層屬於不同的raid 組,屬於不通的DG( 磁碟組)

2.        線上日誌檔案同一組中不同成員分別儲存在兩個DG

3.        控制檔案不同成員分別儲存在兩個DG

4.        Ocr votedisk 存放在資料之外單獨的ASM 磁碟組

 

ASM 磁碟劃分

Rac  節點

Lun name

Asm  磁碟名稱 /alias

Size

ASM  磁碟組名稱

冗餘型別

Rac1


asmocrvote1

1G

OCRDG

High/normal


asmocrvote2

1G


asmocrvote3

1G


asmdata01

20G

DATADG

external


asmdata02

20G


asmarch01

10G

FRADG

external


asmmgmt01

30G

MGMTDG

external







Rac2


asmocrvote1

1G

SYSTEMDG

High/normal


asmocrvote2

1G


asmocrvote3

1G


asmdata01

20G

DATADG

external


asmdata02

20G


asmarch01

10G

FRADG

external


asmmgmt01

30G

MGMTDG

external


我這邊時搭建的測試環境,生產環境可自己調整
 

 

openfile的搭建參考 http://blog.itpub.net/70004783/viewspace-2791487/

本地yum源的搭建參考 http://blog.itpub.net/70004783/viewspace-2789438/ 

 

安裝需要的軟體列表

yum install -y bc
yum install -y compat-libcap1*
yum install -y compat-libcap*
yum install -y binutils 
yum install -y compat-libstdc++-33 
yum install -y elfutils-libelf 
yum install -y elfutils-libelf-devel 
yum install -y gcc 
yum install -y gcc-c++ 
yum install -y glibc-2.5 
yum install -y glibc-common 
yum install -y glibc-devel 
yum install -y glibc-headers 
yum install -y ksh libaio 
yum install -y libaio-devel 
yum install -y libgcc 
yum install -y libstdc++ 
yum install -y libstdc++-devel 
yum install -y make 
yum install -y sysstat 
yum install -y unixODBC 
yum install -y unixODBC-devel
yum install -y binutils*
yum install -y compat-libstdc*
yum install -y elfutils-libelf*
yum install -y gcc*
yum install -y glibc*
yum install -y ksh*
yum install -y libaio*
yum install -y libgcc*
yum install -y libstdc*
yum install -y make*
yum install -y sysstat*
yum install -y libXp*
yum install -y glibc-kernheaders
yum install -y net-tools-*


2.1   建立使用者組,使用者和目錄

在兩個節點增加使用者與組:

/usr/sbin/groupadd -g 501 oinstall
/usr/sbin/groupadd -g 502 dba
/usr/sbin/groupadd -g 503 oper
/usr/sbin/groupadd -g 504 asmadmin
/usr/sbin/groupadd -g 505 asmoper
/usr/sbin/groupadd -g 506 asmdba
/usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle
/usr/sbin/useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid


 

修改使用者密碼:

passwd grid

passwd oracle

登陸測試(必須做),分別用oracle,grid使用者透過ssh登入,按提示修改密碼


目錄

mkdir -p /u01/app/19c/grid
mkdir -p /u01/app/grid
mkdir -p /u01/app/oraInventory
chown -R grid:oinstall /u01
  
mkdir  -p /u01/app/oracle
mkdir -p /u01/app/oracle/product/19c/db_1
chown   -R  oracle:oinstall    /u01/app/oracle
  
chmod -R 775 /u01

 

2.修改作業系統引數2節點

修改/etc/security/limits.conf檔案,增加內容如下:

vi /etc/security/limits.conf

#ORACLE SETTING
grid  soft    nproc   2047 
grid  hard    nproc   16384
grid  soft    nofile  1024
grid  hard    nofile  65536
grid  soft   stack    10240
grid  hard   stack    32768
oracle soft    nproc   2047
oracle hard    nproc   16384
oracle soft    nofile  1024
oracle hard    nofile  65536
oracle soft   stack    10240
oracle hard   stack    32768
oracle   hard   memlock    6291456
oracle   soft   memlock    6291456

 

3.禁用SELINUX

vi /etc/selinux/config      修改下面

SELINUX=disabled

 

4.關閉防火牆

systemctl stop firewalld
systemctl disable firewalld



禁用NTP

systemctl stop chronyd
systemctl disable chronyd
mv  /etc/chrony.conf   /etc/chrony.conf.bak



禁用avahi

systemctl stop avahi-daemon.socket
systemctl stop avahi-daemon.service
systemctl disable avahi-daemon.socket
systemctl disable avahi-daemon.service


5、修改/etc/pam.d/login檔案

vi /etc/pam.d/login  新增如下

新增以下
#oracle setting add
session required /lib/security/pam_limits.so
session required pam_limits.so


6、修改sysctl.conf配置檔案

 vi /etc/sysctl.conf    新增如下

#oracle setting add
kernel.shmmax = 277495689510912
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586
fs.file-max = 6815744
kernel.shmall = 67747971072
net.ipv4.tcp_max_tw_buckets = 6000
net.ipv4.ip_local_port_range = 9000 65500
net.ipv4.tcp_tw_recycle = 0
net.ipv4.tcp_tw_reuse = 1
#net.core.somaxconn = 262144
net.core.netdev_max_backlog = 262144
net.ipv4.tcp_max_orphans = 262144
net.ipv4.tcp_max_syn_backlog = 262144
net.ipv4.tcp_synack_retries = 2
net.ipv4.tcp_syn_retries = 1
net.ipv4.tcp_fin_timeout = 1
net.ipv4.tcp_keepalive_time = 30
net.ipv4.tcp_keepalive_probes = 6
net.ipv4.tcp_keepalive_intvl = 5
net.ipv4.tcp_timestamps = 0
fs.aio-max-nr = 1048576
net.ipv4.conf.all.rp_filter = 2
net.ipv4.conf.default.rp_filter = 2

讓配置生效:

sysctl -p



8.配置grid和oracle使用者的環境變數

節點1 配置grid

[grid@rac1:/home/grid]$cat .bash_profile 
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH
PS1="[`whoami`@`hostname`:"'$PWD]$'
export PS1
umask 022
alias sqlplus="rlwrap sqlplus"
export TMP=/tmp
export
export TMPDIR=$TMP
export ORACLE_HOSTNAME=rac1
ORACLE_SID=+ASM1; export ORACLE_SID
ORACLE_TERM=xterm; export ORACLE_TERM
ORACLE_BASE=/u01/app/grid; export ORACLE_BASE
ORACLE_HOME=/u01/app/19c/grid; export ORACLE_HOME
NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT
PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/bin; export PATH
THREADS_FLAG=native; export THREADS_FLAG
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
        if [ $SHELL = "/bin/ksh" ]; then
            ulimit -p 16384
              ulimit -n 65536
  else
   ulimit -u 16384 -n 65536
      fi
    umask 022
fi
[grid@rac1:/home/grid]$


節點2 一樣,只需要更改以下2行

export ORACLE_HOSTNAME=rac2
ORACLE_SID=+ASM2; export ORACLE_SID


節點1配置oracle

[oracle@rac1:/home/oracle]$cat .bash_profile 
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/.local/bin:$HOME/bin
export PATH
PS1="[`whoami`@`hostname`:"'$PWD]$'
alias sqlplus="rlwrap sqlplus"
alias rman="rlwrap rman"
export PS1
export TMP=/tmp
export
export TMPDIR=$TMP
export ORACLE_HOSTNAME=rac1
export ORACLE_UNQNAME=prodpri
ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE
ORACLE_HOME=$ORACLE_BASE/product/19c/db_1; export ORACLE_HOME
ORACLE_SID=prod1; export ORACLE_SID
ORACLE_TERM=xterm; export ORACLE_TERM
NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT
NLS_LANG=AMERICAN_AMERICA.ZHS16GBK;export NLS_LANG
PATH=.:$PATH:$HOME/bin:$ORACLE_BASE/product/19c/db_1/bin:$ORACLE_HOME/bin; export PATH
THREADS_FLAG=native; export THREADS_FLAG
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
        if [ $SHELL = "/bin/ksh" ]; then
            ulimit -p 16384
              ulimit -n 65536
  else
   ulimit -u 16384 -n 65536
      fi
    umask 022
fi


節點2一樣,需要更改2行

export ORACLE_HOSTNAME=rac2
ORACLE_SID=prod2; export ORACLE_SID


9.  安裝配置iscsi

yum install iscsi-initiator-utils* -y 
檢查是否開機啟動
systemctl list-unit-files | grep iscsi
如果不是,則這樣設定
systemctl enable iscsid.service
systemctl enable iscsi.service


啟動iscsi服務

systemctl restart iscsi
systemctl restart iscsid
發現儲存上的iscsi目標
iscsiadm -m discovery -t st -p 10.8.98.100:3260
登陸目標
iscsiadm -m node --loginall=all


察看iscsi資訊,是不是2條鏈路


iscsiadm -m session

[root@rac1 ~]# iscsiadm -m session
tcp: [1] 10.8.98.100:3260,1 iqn.2006-01.com.openfiler:tsn.c97222275d9c (non-flash)
tcp: [2] 10.8.98.101:3260,1 iqn.2006-01.com.openfiler:tsn.c97222275d9c (non-flash)
[root@rac1 ~]#


ls -l /dev/disk/by-path/


因為我們是手動發現的iscsi,所以如果重啟則會消失,所以將iscsi目標寫入iscsi配置檔案中

vi /etc/iscsi/initiatorname.iscsi 

InitiatorName= iqn.2006-01.com.openfiler:tsn.c97222275d9c


重啟iscsi服務

systemctl restart iscsi
systemctl restart iscsid


重新整理新增加iscsi 儲存目標

iscsiadm -m session -R

察看iscsi通道

cat /proc/scsi/scsi

刪除/登出target連線

iscsiadm -m node --logoutall=all


10.安裝多路徑

yum install device-mapper*

檢查device-mapper有沒有安裝

rpm -qa | grep device-mapper

安裝未安裝的rpm包


設定maltipath開機啟動

[root@rac1 ntp]# systemctl list-unit-files | grep multipath

multipathd.service                            enabled 


把multipath模組加入核心

modprobe dm-multipath

modprobe dm-round-robin


/sbin/mpathconf -help

/sbin/mpathconf --enable



啟動服務

systemctl restart multipathd

配置multipath -ll

[root@rac1 ~]# multipath -ll
mpathe (14f504e46494c45526e494c786a632d69584c502d6e6c4e44) dm-6 OPNFILER,VIRTUAL-DISK    
size=20G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:4 sdk 8:160 active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:4 sdj 8:144 active ready running
mpathd (14f504e46494c45526c4c31396b682d344342732d7149316d) dm-5 OPNFILER,VIRTUAL-DISK    
size=20G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:3 sdi 8:128 active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:3 sdh 8:112 active ready running
mpathc (14f504e46494c45524562586d37472d656533512d4463437a) dm-4 OPNFILER,VIRTUAL-DISK    
size=1.0G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:2 sdg 8:96  active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:2 sdf 8:80  active ready running
mpathb (14f504e46494c45524e32653170322d6a7743732d566b394f) dm-3 OPNFILER,VIRTUAL-DISK    
size=1.0G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:1 sde 8:64  active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:1 sdd 8:48  active ready running
mpatha (14f504e46494c455278764265447a2d306571342d57524461) dm-2 OPNFILER,VIRTUAL-DISK    
size=1.0G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:0 sdc 8:32  active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:0 sdb 8:16  active ready running
mpathh (14f504e46494c45526d474e7946522d576f5a782d6d33756b) dm-9 OPNFILER,VIRTUAL-DISK    
size=10G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:7 sdp 8:240 active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:7 sdq 65:0  active ready running
mpathg (14f504e46494c455278336e304d762d36574b782d7a675463) dm-8 OPNFILER,VIRTUAL-DISK    
size=30G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:6 sdn 8:208 active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:6 sdo 8:224 active ready running
mpathf (14f504e46494c4552306e664a52432d4c3564582d75473136) dm-7 OPNFILER,VIRTUAL-DISK    
size=20G features='0' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=1 status=active
| `- 3:0:0:5 sdl 8:176 active ready running
`-+- policy='service-time 0' prio=1 status=enabled
  `- 4:0:0:5 sdm 8:192 active ready running
[root@rac1 ~]#


根據上面的磁碟大小以及wwid號

統計以及規劃如下

14f504e46494c455278764265447a2d306571342d57524461  1g asmvote01
14f504e46494c45524e32653170322d6a7743732d566b394f  1g asmvote02
14f504e46494c45524562586d37472d656533512d4463437a  1g asmvote03
14f504e46494c45526c4c31396b682d344342732d7149316d  20g asmdata01
14f504e46494c45526e494c786a632d69584c502d6e6c4e44  20g asmdata02
14f504e46494c4552306e664a52432d4c3564582d75473136  20g asmdata03
14f504e46494c455278336e304d762d36574b782d7a675463  30g asmmgmt01
14f504e46494c45526d474e7946522d576f5a782d6d33756b  10g asmfra01

還有兩個命令可以查詢uuid

multipath -v3 

more /etc/multipath/wwids 

根據以上得到的資料修改多路徑的配置檔案


備份配置檔案模板

[root@rac1 ~]# cp /etc/multipath.conf /etc/multipath.conf.bak2021

根據上面的規劃,改後的配置檔案如下

cat  /etc/multipath.conf

defaults {
        user_friendly_names yes
        find_multipaths yes
}
blacklist {
       devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
        devnode "^hd[a-z]"
#我這裡sda是本地硬碟,所以加黑名單
         devnode "^sda"
}
multipaths {
        multipath {
                wwid                 14f504e46494c455278764265447a2d306571342d57524461
                alias                   asmvote01
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
        multipath {
                wwid                 14f504e46494c45524e32653170322d6a7743732d566b394f
                alias                   asmvote02
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
        multipath {
                wwid                 14f504e46494c45524562586d37472d656533512d4463437a
                alias                   asmvote03
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
        multipath {
                wwid                 14f504e46494c45526c4c31396b682d344342732d7149316d
                alias                   asmdata01
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
        multipath {
                wwid                 14f504e46494c45526e494c786a632d69584c502d6e6c4e44
                alias                    asmdata02
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
	multipath {
                wwid                 14f504e46494c4552306e664a52432d4c3564582d75473136
                alias                    asmdata03
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
	multipath {
                wwid                 14f504e46494c455278336e304d762d36574b782d7a675463
                alias                   asmmgmt01
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
        multipath {
                wwid                 14f504e46494c45526d474e7946522d576f5a782d6d33756b
                alias                   asmfra01
                path_grouping_policy    multibus
                path_selector           "round-robin 0"
                failback                immediate
        }
}
devices {
       device {
               vendor                  "openfiler  "
               product                 "virtual disk"
               path_grouping_policy    multibus
               path_checker            readsector0
               path_selector           "round-robin 0"
               hardware_handler        "0"
       }
}


節點2同理




刪除現有多路徑

multipath -F

格式化多路徑

multipath -v2

啟動服務

systemctl restart multipathd

倆節點

multipath -ll

[root@rac1 ~]# multipath -ll
asmmgmt01 (14f504e46494c455278336e304d762d36574b782d7a675463) dm-8 OPNFILER,VIRTUAL-DISK    
size=30G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:6 sdn 8:208 active ready running
  `- 4:0:0:6 sdo 8:224 active ready running
asmdata03 (14f504e46494c4552306e664a52432d4c3564582d75473136) dm-7 OPNFILER,VIRTUAL-DISK    
size=20G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:5 sdl 8:176 active ready running
  `- 4:0:0:5 sdm 8:192 active ready running
asmdata02 (14f504e46494c45526e494c786a632d69584c502d6e6c4e44) dm-6 OPNFILER,VIRTUAL-DISK    
size=20G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:4 sdk 8:160 active ready running
  `- 4:0:0:4 sdj 8:144 active ready running
asmvote03 (14f504e46494c45524562586d37472d656533512d4463437a) dm-4 OPNFILER,VIRTUAL-DISK    
size=1.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:2 sdg 8:96  active ready running
  `- 4:0:0:2 sdf 8:80  active ready running
asmdata01 (14f504e46494c45526c4c31396b682d344342732d7149316d) dm-5 OPNFILER,VIRTUAL-DISK    
size=20G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:3 sdi 8:128 active ready running
  `- 4:0:0:3 sdh 8:112 active ready running
asmvote02 (14f504e46494c45524e32653170322d6a7743732d566b394f) dm-3 OPNFILER,VIRTUAL-DISK    
size=1.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:1 sde 8:64  active ready running
  `- 4:0:0:1 sdd 8:48  active ready running
asmvote01 (14f504e46494c455278764265447a2d306571342d57524461) dm-2 OPNFILER,VIRTUAL-DISK    
size=1.0G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:0 sdc 8:32  active ready running
  `- 4:0:0:0 sdb 8:16  active ready running
asmfra01 (14f504e46494c45526d474e7946522d576f5a782d6d33756b) dm-9 OPNFILER,VIRTUAL-DISK    
size=10G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
  |- 3:0:0:7 sdp 8:240 active ready running
  `- 4:0:0:7 sdq 65:0  active ready running
[root@rac1 ~]#



11.配置udev

cd /usr/share/doc/device-mapper-1.02.170/

cp 12-dm-permissions.rules /etc/udev/rules.d/

[root@rac1 ~]# vi /etc/udev/rules.d/12-dm-permissions.rules

在最後新增如下

# OWNER:="root", GROUP:="root", MODE:="660"
LABEL="dm_end"
ENV{DM_NAME}=="asmvote01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmvote02", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmvote03", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmdata01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmdata02", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmdata03", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmmgmt01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmfra01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"


啟動udev

[root@rac1 rules.d]#  /sbin/udevadm trigger --type=devices --action=change

檢查是否正確

[root@rac1 device-mapper-1.02.170]# ll /dev/dm* 
brw-rw----. 1 root disk     253, 0 Sep 24 16:32 /dev/dm-0
brw-rw----. 1 root disk     253, 1 Sep 24 16:32 /dev/dm-1
brw-rw----. 1 grid asmadmin 253, 2 Sep 24 16:32 /dev/dm-2
brw-rw----. 1 grid asmadmin 253, 3 Sep 24 16:32 /dev/dm-3
brw-rw----. 1 grid asmadmin 253, 4 Sep 24 16:32 /dev/dm-4
brw-rw----. 1 grid asmadmin 253, 5 Sep 24 16:32 /dev/dm-5
brw-rw----. 1 grid asmadmin 253, 6 Sep 24 16:32 /dev/dm-6
brw-rw----. 1 grid asmadmin 253, 7 Sep 24 16:32 /dev/dm-7
brw-rw----. 1 grid asmadmin 253, 8 Sep 24 16:32 /dev/dm-8
brw-rw----. 1 grid asmadmin 253, 9 Sep 24 16:32 /dev/dm-9


不重啟,重新應用udev規則

/sbin/udevadm control --reload-rules && udevadm trigger



2節點重啟系統,檢查如上則可以了



12.安裝叢集軟體,建立asm磁碟組,安裝oracle軟體,dbca建庫(只擷取重要步驟)

[root@rac1 ~] # yum install tigervnc*
[grid@rac1: /home/grid ]$vncserver


LINUX.X64_193000_grid_home.zip 檔案放到grid的ORACLE_HOME 目錄(注意是grid使用者的),並解壓


[grid@rac1 grid]$ pwd
/u01/app/19c/grid
[grid@rac1 grid]$ ./gridSetup.sh


找到cvuqdisk包在rac倆節點安裝。

dns解析的問題,可以忽略

注意:指令碼執行順序,rac1執行第一個指令碼,rac2執行第一個指令碼,然後rac1執行第二個,rac2執行第二個


asmca圖形化介面建立asm磁碟組


將oracle安裝包放到oracle使用者的$ORACLE_HOME目錄下解壓,並圖形安裝(僅安裝軟體)



oracle使用者dbca圖形化建庫



13、確認rac安裝ok

root使用者環境變數新增grid的home目錄/u01/app/19c/grid/bin

[root@rac1 ~]# cat .bash_profile 
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
        . ~/.bashrc
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/bin:/u01/app/19c/grid/bin
export PATH
[root@rac1 ~]#
[root@rac1 ~]# crsctl status resource -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.chad
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.net1.network
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
ora.ons
               ONLINE  ONLINE       rac1                     STABLE
               ONLINE  ONLINE       rac2                     STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.DATADG.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.FRADG.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       rac1                     STABLE
ora.MGMTDG.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       rac1                     169.254.25.123 192.1
                                                             68.1.103,STABLE
ora.OCRDG.dg(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     Started,STABLE
      2        ONLINE  ONLINE       rac2                     Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       rac1                     STABLE
      2        ONLINE  ONLINE       rac2                     STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       rac1                     STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       rac1                     Open,STABLE
ora.prod.db
      1        ONLINE  ONLINE       rac1                     Open,HOME=/u01/app/o
                                                             racle/product/19c/db
                                                             _1,STABLE
      2        ONLINE  ONLINE       rac2                     Open,HOME=/u01/app/o
                                                             racle/product/19c/db
                                                             _1,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       rac1                     STABLE
ora.rac1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
ora.rac2.vip
      1        ONLINE  ONLINE       rac2                     STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       rac1                     STABLE
--------------------------------------------------------------------------------
[root@rac1 ~]#

RAC19c搭建-centos7+openfiler+multipath+udev

覺得對你有幫助給點個贊吧,歡迎裝載。


來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/70004783/viewspace-2791938/,如需轉載,請註明出處,否則將追究法律責任。