Linux中兩塊device的minor number相同而造成RAC不能啟動的問題
Oracle Linux 7.1在安裝Oracle 12.2 Grid軟體在執行root.sh指令碼時,當第一個節點執行成功後,在第二個節點執行出現如下錯誤
[root@cs2 /]# ./u01/app/product/12.2.0/crs/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/product/12.2.0/crs Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ... Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /u01/app/product/12.2.0/crs/crs/install/crsconfig_params The log of current session can be found at: /u01/app/grid/crsdata/cs2/crsconfig/rootcrs_cs2_2018-03-09_04-33-22PM.log 2018/03/09 16:34:23 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2018/03/09 16:34:23 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:34:54 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:34:54 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2018/03/09 16:35:03 CLSRSC-363: User ignored prerequisites during installation 2018/03/09 16:35:03 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2018/03/09 16:35:05 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2018/03/09 16:35:06 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2018/03/09 16:35:10 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2018/03/09 16:35:12 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2018/03/09 16:35:13 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2018/03/09 16:35:16 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2018/03/09 16:35:24 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2018/03/09 16:35:24 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2018/03/09 16:35:26 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2018/03/09 16:35:42 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' 2018/03/09 16:36:42 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2018/03/09 16:38:08 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. 2018/03/09 16:38:37 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2018/03/09 16:38:39 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2' CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. 2018/03/09 16:39:07 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'cs2' CRS-2672: Attempting to start 'ora.evmd' on 'cs2' CRS-2676: Start of 'ora.mdnsd' on 'cs2' succeeded CRS-2676: Start of 'ora.evmd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'cs2' CRS-2676: Start of 'ora.gpnpd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'cs2' CRS-2676: Start of 'ora.gipcd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cs2' CRS-2676: Start of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'cs2' CRS-2672: Attempting to start 'ora.diskmon' on 'cs2' CRS-2676: Start of 'ora.diskmon' on 'cs2' succeeded CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start. CRS-4406: Oracle High Availability Services synchronous start failed. CRS-4000: Command Start failed, or completed with errors. 2018/03/09 16:39:46 CLSRSC-378: Failed to get the configured node role for the local node CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors. 2018/03/09 16:39:48 CLSRSC-117: Failed to start Oracle Clusterware stack Died at /u01/app/product/12.2.0/crs/crs/install/crsinstall.pm line 1494. The command '/u01/app/product/12.2.0/crs/perl/bin/perl -I/u01/app/product/12.2.0/crs/perl/lib -I/u01/app/product/12.2.0/crs/crs/install /u01/app/product/12.2.0/crs/crs/install/rootcrs.pl ' execution failed
出錯了,如是再次執行
[root@cs2 /]# ./u01/app/product/12.2.0/crs/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/product/12.2.0/crs Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /u01/app/product/12.2.0/crs/crs/install/crsconfig_params The log of current session can be found at: /u01/app/grid/crsdata/cs2/crsconfig/rootcrs_cs2_2018-03-09_04-51-03PM.log 2018/03/09 16:51:07 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2018/03/09 16:51:07 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:51:07 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 16:51:08 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2018/03/09 16:51:11 CLSRSC-363: User ignored prerequisites during installation 2018/03/09 16:51:11 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2018/03/09 16:51:12 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2018/03/09 16:51:12 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2018/03/09 16:51:15 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2018/03/09 16:51:17 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2018/03/09 16:51:18 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2018/03/09 16:51:21 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2018/03/09 16:51:22 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2018/03/09 16:52:09 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2018/03/09 16:52:10 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2018/03/09 16:52:26 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' 2018/03/09 16:52:48 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2018/03/09 16:52:51 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. 2018/03/09 16:52:53 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2018/03/09 16:52:55 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2' CRS-2673: Attempting to stop 'ora.mdnsd' on 'cs2' CRS-2673: Attempting to stop 'ora.evmd' on 'cs2' CRS-2673: Attempting to stop 'ora.gpnpd' on 'cs2' CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'cs2' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'cs2' succeeded CRS-2677: Stop of 'ora.evmd' on 'cs2' succeeded CRS-2673: Attempting to stop 'ora.driver.afd' on 'cs2' CRS-2673: Attempting to stop 'ora.gipcd' on 'cs2' CRS-2677: Stop of 'ora.driver.afd' on 'cs2' succeeded CRS-2677: Stop of 'ora.gipcd' on 'cs2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. 2018/03/09 16:53:14 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'cs2' CRS-2672: Attempting to start 'ora.evmd' on 'cs2' CRS-2676: Start of 'ora.mdnsd' on 'cs2' succeeded CRS-2676: Start of 'ora.evmd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'cs2' CRS-2676: Start of 'ora.gpnpd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'cs2' CRS-2676: Start of 'ora.gipcd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cs2' CRS-2676: Start of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'cs2' CRS-2672: Attempting to start 'ora.diskmon' on 'cs2' CRS-2676: Start of 'ora.diskmon' on 'cs2' succeeded CRS-1705: Found 0 configured voting files but 1 voting files are required, terminating to ensure data integrity; details at (:CSSNM00021:) in /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start. CRS-4406: Oracle High Availability Services synchronous start failed. CRS-4000: Command Start failed, or completed with errors. 2018/03/09 16:53:53 CLSRSC-378: Failed to get the configured node role for the local node CRS-4535: Cannot communicate with Cluster Ready Services CRS-4000: Command Status failed, or completed with errors. 2018/03/09 16:53:55 CLSRSC-117: Failed to start Oracle Clusterware stack Died at /u01/app/product/12.2.0/crs/crs/install/crsinstall.pm line 1494. The command '/u01/app/product/12.2.0/crs/perl/bin/perl -I/u01/app/product/12.2.0/crs/perl/lib -I/u01/app/product/12.2.0/crs/crs/install /u01/app/product/12.2.0/crs/crs/install/rootcrs.pl ' execution failed
還是出錯了,但錯誤資訊與第一次執行有所不同了,有以下內容
CRS-1705: Found 0 configured voting files but 1 voting files are required, terminating to ensure data integrity; details at (:CSSNM00021:) in /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc
如果檢視跟蹤檔案/u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc
[root@cs2 ~]# more /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc Trace file /u01/app/grid/diag/crs/cs2/crs/trace/ocssd.trc Oracle Database 12c Clusterware Release 12.2.0.1.0 - Production Copyright 1996, 2016 Oracle. All rights reserved. default:2950017088: 1: clskec:has:CLSU:910 4 args[CLSD00302][mod=clsdadr.c][loc=(:CLSD00302:)][msg=clsdAdrInit: Trace file size and number of segments fetched from environemnt variable: ORA_DAEMON_TRACE_FILE_OPTIONS filesize=52428800,n umsegments=10] CLSB:2950017088: Argument count (argc) for this daemon is 3 CLSB:2950017088: Argument 0 is: /u01/app/product/12.2.0/crs/bin/ocssd.bin CLSB:2950017088: Argument 1 is: CLSB:2950017088: Argument 2 is: OSD2PORTIF 2018-03-09 16:39:26.799 : CSSD:2950017088: (TLM) Starting CSS daemon, version 12.2.0.1.0 with uniqueness value 1520584766 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSD, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDNMC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDGMPC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDGMCC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDBCMC, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CSSDGNS, LogLevel = 2 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSF, LogLevel = 0 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSFA, LogLevel = 3 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = SKGFD, LogLevel = 0 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = GPNP, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSINET, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSNS, LogLevel = 3 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = OCRAPI, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = OCRCLI, LogLevel = 1 2018-03-09 16:39:26.799 : CSSD:2950017088: clsu_load_ENV_levels: Module = CLSCEVT, LogLevel = 0 2018-03-09 16:39:26.803 : CSSD:2950017088: clssscInitGlobalCTX: not in a container CSSD:2950017088: clsugetconf : Configuration type [4]. 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscGetParameterOLR: OLR fetch for parameter auth rep (9) failed with rc 21 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscagStartAgLsnr: Failed to get auth location from OLR, constructing manually 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscagStartAgLsnr: auth location '/u01/app/product/12.2.0/crs/auth/css/' 2018-03-09 16:39:26.809 : CSSD:2950017088: clssscGPNPInit: PERF_TIME Initializing GPNP 2018-03-09 16:39:26.810 : GPNP:2950017088: clsgpnp_Init: HMAC hash type in context is SHA-512 2018-03-09 16:39:26.810 : GPNP:2950017088: clsgpnp_Init: [at clsgpnp0.c:684] '/u01/app/product/12.2.0/crs' in effect as GPnP home base. 2018-03-09 16:39:26.810 : GPNP:2950017088: clsgpnp_Init: [at clsgpnp0.c:750] GPnP pid=29348, cli= GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:init, apitl:0, tstenv:0, devenv:0, envopt:0, flags=3 2018-03-09 16:39:26.815 : GPNP:2950017088: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:403] Using FS Wallet Location : /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.815 : GPNP:2950017088: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:415] Wallet readable. Path: /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.817 : CSSD:2782349056: clssscthrdmain: Starting thread clssscAgListener 2018-03-09 16:39:26.817 : CSSD:2782349056: clsssclsnrsetup: endp 0x6b for ipc://agent_ag_cs2_ 2018-03-09 16:39:26.817 : CSSD:2782349056: clssscagOpenAgentEndp: listening on ipc://agent_ag_cs2_ (0x6b) 2018-03-09 16:39:26.818 : CSSD:2782349056: clsssclsnrsetup: endp 0x7c for ipc://monitor_ag_cs2_ 2018-03-09 16:39:26.818 : CSSD:2782349056: clssscagOpenAgentEndp: listening on ipc://monitor_ag_cs2_ (0x7c) 2018-03-09 16:39:26.818 : CSSD:2782349056: clssscUpdateInitState: Set state to 0x00080000, based on prior state of 0x00000000 and requested change of 0x00080000 2018-03-09 16:39:26.839 : GPNP:2950017088: clsgpnp_profileCallUrlInt: [at clsgpnp.c:2238] get-profile call to url "ipc://GPNPD_cs2" disco "" [f=0 claimed- host: cname: cguid: cli:gpnp p:29348 role: seq: ep: auth: diag:[]] 2018-03-09 16:39:26.839 : default:2950017088: clsvactversion:4: Retrieving Active Version from local storage. 2018-03-09 16:39:26.842 : default:2950017088: clsvactversion:4: Retrieving Active Version from local storage. 2018-03-09 16:39:26.851 : GPNP:2950017088: clsgpnp_profileCallUrlInt: [at clsgpnp.c:2381] Result: (0) CLSGPNP_OK. Successful get-profile CALL to remote "ipc://GPNPD_cs2" disco "" 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscGPNPInit: Successfully initialized GPNP 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: PERF_TIME starting CLSFA for Flex 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: PERF_TIME started CLSFA for Flex 2018-03-09 16:39:26.851 : CSSD:2950017088: Starting CSS daemon in big-clustered mode with a role of hub 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: Environment is production 2018-03-09 16:39:26.851 : CSSD:2950017088: clssscInitGlobalCTX: Core file size limit extended 2018-03-09 16:39:26.852 : CSSD:2950017088: clssscInitGlobalCTX: GIPCHA down 0 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscqueue_init: queue(0xe708a0), max(0) 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x00080002, based on prior state of 0x00080000 and requested change of 0x00000002 2018-03-09 16:39:26.855 : CSSD:2950017088: osdctx->majik=OSD2PORTIF 2018-03-09 16:39:26.855 : CSSD:2950017088: ipmi_ipv4 = () 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscModifyWalletIP: Running as user grid 2018-03-09 16:39:26.855 : CSSD:2950017088: clssscModifyEnvironment: unable to update wallet for IPMI 2018-03-09 16:39:26.857 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00001000, current state 0x00080002, timeout 4294967295 2018-03-09 16:39:26.858 : CLSDMT:2779895552: PID for the Process [29348], connkey CSSD 2018-03-09 16:39:26.858 : CLSDMT:2779895552: ERROR: Empty pid name for proc CSSD 2018-03-09 16:39:26.859 : CSSD:2778318592: clssscthrdmain: Starting thread Alarm 2018-03-09 16:39:26.859 : CSSD:2778318592: clssscAlarmThread: Thread Spawned 2018-03-09 16:39:26.859 : CSSD:2778318592: clssscUpdateInitState: Set state to 0x00081002, based on prior state of 0x00080002 and requested change of 0x00001000 2018-03-09 16:39:26.859 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00001000, current state 0x00081002 2018-03-09 16:39:26.859 : CSSD:2950017088: clssscqueue_init: queue(0xf1c670), max(0) 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscStartActivityThread: Waiting for INIT 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00800000, current state 0x00081002, timeout 4294967295 2018-03-09 16:39:26.860 : CSSD:2776741632: clssscthrdmain: Starting thread clssscActivityThread 2018-03-09 16:39:26.860 : CSSD:2776741632: clssscUpdateInitState: Set state to 0x00881002, based on prior state of 0x00081002 and requested change of 0x00800000 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00800000, current state 0x00881002 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscGetParameterProfile: profile fetch failed for parameter ocrid (4) with return code CLSGPNP_NOT_FOUND(5) 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscmain: OCRID is 0 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscmain: Cluster GUID is 89e968f37e66cf79bf4a5b7353e8e859 2018-03-09 16:39:26.860 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x00881006, based on prior state of 0x00881002 and requested change of 0x00000004 2018-03-09 16:39:26.860 : CSSDBCM:2950017088: clssbcmInitialize: flags(0) 2018-03-09 16:39:26.860 : CSSDBCM:2950017088: clssbcm_SetGlobal: global(0xe69560) 2018-03-09 16:39:26.860 : CSSDBCM:2950017088: clssbcmContext: context pointer(0x7fff90720590), flags(0) 2018-03-09 16:39:26.861 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xe704c0), name(BCCM State), value(1) 2018-03-09 16:39:26.861 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xe664b0), name(BCCM Work State), value(0) 2018-03-09 16:39:26.861 : CSSDBCM:2950017088: clssbcm_NewWorkThread: Spawn status(1) 2018-03-09 16:39:26.862 : CSSD:2775164672: clssscthrdmain: Starting thread BCCM_Worker 2018-03-09 16:39:26.862 : CSSDBCM:2775164672: clssbcm_worker: Spawned with thread(0xe673f0) 2018-03-09 16:39:26.862 : CSSDBCM:2950017088: clssbcmContext: context(0xe6bb30) created 2018-03-09 16:39:26.862 : CSSDBCM:2950017088: clssbcmContext: context pointer(0x7fff90720590), flags(0) 2018-03-09 16:39:26.862 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xd07650), name(BCCM State), value(1) 2018-03-09 16:39:26.863 : CSSDBCM:2950017088: clssbcmNewEvent: event(0xd07790), name(BCCM Work State), value(0) 2018-03-09 16:39:26.863 : CSSDBCM:2950017088: clssbcm_NewWorkThread: Spawn status(1) 2018-03-09 16:39:26.864 : CSSD:2773587712: clssscthrdmain: Starting thread BCCM_Worker 2018-03-09 16:39:26.864 : CSSDBCM:2773587712: clssbcm_worker: Spawned with thread(0xd07a90) 2018-03-09 16:39:26.864 : CSSDBCM:2950017088: clssbcmContext: context(0xd0ecd0) created 2018-03-09 16:39:26.864 : CSSDBCM:2950017088: clssbcmSetGIPCTraceLevel: context(0xe6bb30), trace(2) 2018-03-09 16:39:26.864 : CSSDBCM:2950017088: clssbcmSetGIPCTraceLevel: context(0xd0ecd0), trace(2) 2018-03-09 16:39:26.864 : CSSD:2950017088: clssscmain: PERF_TIME initializing GNS for Flex 2018-03-09 16:39:26.864 : CSSDGNS:2950017088: clssscBQInitialize: Initialized GNS Work queue 2018-03-09 16:39:26.864 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00040000, current state 0x00881006, timeout 4294967295 2018-03-09 16:39:26.865 : CSSD:2772010752: clssscthrdmain: Starting thread GNSWork 2018-03-09 16:39:26.865 : CSSD:2772010752: clssscUpdateInitState: Set state to 0x008c1006, based on prior state of 0x00881006 and requested change of 0x00040000 2018-03-09 16:39:26.866 : CLSNS:2772010752: clsns_SetTraceLevel:trace level set to 1. 2018-03-09 16:39:26.866 : CSSDGNS:2772010752: clssgnsCrsQuery: Querying CRS for resource type "ora.gns.type". 2018-03-09 16:39:26.867 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00040000, current state 0x008c1006 2018-03-09 16:39:26.867 : CSSD:2950017088: clssscmain: PERF_TIME initialized GNS for Flex 2018-03-09 16:39:26.868 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00000400, current state 0x008c1006, timeout 4294967295 2018-03-09 16:39:26.869 : CSSD:2770433792: clssscthrdmain: Starting thread BCNMServer 2018-03-09 16:39:26.869 : CSSD:2770433792: clssbnmsThread: Spawned 2018-03-09 16:39:26.869 : CSSD:2770433792: clssbnmInitBCNMCommon: Initialialization complete for comm ctx(0xd0fbb8) 2018-03-09 16:39:26.869 : CSSD:2770433792: clssscUpdateInitState: Set state to 0x008c1406, based on prior state of 0x008c1006 and requested change of 0x00000400 2018-03-09 16:39:26.869 : CSSD:2770433792: clssscWaitOnInitState: Waiting on requested state 0x00020000, current state 0x008c1406, timeout 4294967295 2018-03-09 16:39:26.871 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00000400, current state 0x008c1406 2018-03-09 16:39:26.872 : CSSD:2950017088: clssscWaitOnInitState: Waiting on requested state 0x00000800, current state 0x008c1406, timeout 4294967295 2018-03-09 16:39:26.873 : CSSD:2768856832: clssscthrdmain: Starting thread BCNMClient 2018-03-09 16:39:26.873 : CSSD:2768856832: clssbnmcThread: Thread Spawned 2018-03-09 16:39:26.873 : CSSD:2768856832: clssbnmInitBCNMCommon: Initialialization complete for comm ctx(0xecc348) 2018-03-09 16:39:26.873 : CSSD:2768856832: clssscUpdateInitState: Set state to 0x008c1c06, based on prior state of 0x008c1406 and requested change of 0x00000800 2018-03-09 16:39:26.874 : CSSDGNS:2772010752: clssgnsCrsQuery: CRS is not ready. Cannot query GNS resource state. 2018-03-09 16:39:26.874 : CLSCEVT:2772010752: clsce_subscribe 0x7f568011b540 filter='^(CRS_RESOURCE_PROFILE_CHANGE|CRS_RESOURCE_STATE_CHANGE),.*?NAME='ora.gns'', flags=0, handler=0x58fa24, arg=0xd082c0 2018-03-09 16:39:26.875 : CSSD:2950017088: clssscWaitOnInitState: returning 1, requested state 0x00000800, current state 0x008c1c06 2018-03-09 16:39:26.876 : CSSD:2950017088: clssscGetParameterOLR: OLR fetch for parameter node number hint (6) failed with rc 21 2018-03-09 16:39:26.886 : CSSD:2950017088: clssgmGMPInitCtx: GMP context init done 2018-03-09 16:39:26.886 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x008c1e06, based on prior state of 0x008c1c06 and requested change of 0x00000200 2018-03-09 16:39:26.887 : CLSCEVT:2772010752: (:CLSCE0022:)clsce_subscribe 0x7f568011b540 successfully subscribed : 0 2018-03-09 16:39:26.888 : CSSD:2764130048: clssscthrdmain: Starting thread GM Peer Lsnr 2018-03-09 16:39:26.888 : CSSD:2764130048: clssgmPeerListener: Spawned for node 2018-03-09 16:39:26.888 : CSSD:2764130048: clssscWaitOnInitState: Waiting on requested state 0x00000001, current state 0x008c1e06, timeout 4294967295 2018-03-09 16:39:26.890 : CSSD:2762553088: clssscthrdmain: Starting thread GMC Req Thrd 2018-03-09 16:39:26.890 : CSSD:2762553088: clssgmGMCRequestThread: Starting 2018-03-09 16:39:26.890 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMPLstnrWorkerThread, thrdnum 1 spawn success 2018-03-09 16:39:26.891 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMPLstnrWorkerThread, thrdnum 2 spawn success 2018-03-09 16:39:26.892 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMPLstnrWorkerThread, thrdnum 3 spawn success 2018-03-09 16:39:26.893 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMCReqWorkerThread, thrdnum 1 spawn success 2018-03-09 16:39:26.893 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMCReqWorkerThread, thrdnum 2 spawn success 2018-03-09 16:39:26.894 : CSSD:2950017088: clsswtStartWrkthrds: Workerthread GMCReqWorkerThread, thrdnum 3 spawn success 2018-03-09 16:39:26.896 : CSSD:2760976128: clssscthrdmain: Starting thread GMPLstnrWorkerThread 2018-03-09 16:39:26.896 : CSSD:2760976128: clssgmPeerWorkerThread: thrdname GMPLstnrWorkerThread, num 35, wrkthrdnum 1 2018-03-09 16:39:26.897 : CSSD:2759399168: clssscthrdmain: Starting thread GMPLstnrWorkerThread 2018-03-09 16:39:26.897 : CSSD:2759399168: clssgmPeerWorkerThread: thrdname GMPLstnrWorkerThread, num 35, wrkthrdnum 2 2018-03-09 16:39:26.897 : CSSD:2757822208: clssscthrdmain: Starting thread GMPLstnrWorkerThread 2018-03-09 16:39:26.898 : CSSD:2757822208: clssgmPeerWorkerThread: thrdname GMPLstnrWorkerThread, num 35, wrkthrdnum 3 2018-03-09 16:39:26.899 : CSSD:2756245248: clssscthrdmain: Starting thread GMCReqWorkerThread 2018-03-09 16:39:26.899 : CSSD:2756245248: clssgmpcGMCReqWorkerThread: thrdname GMCReqWorkerThread, num 36, wrkthrdnum 1 spawned 2018-03-09 16:39:26.899 : CSSD:2754668288: clssscthrdmain: Starting thread GMCReqWorkerThread 2018-03-09 16:39:26.899 : CSSD:2754668288: clssgmpcGMCReqWorkerThread: thrdname GMCReqWorkerThread, num 36, wrkthrdnum 2 spawned 2018-03-09 16:39:26.900 : CSSD:2753091328: clssscthrdmain: Starting thread GMCReqWorkerThread 2018-03-09 16:39:26.900 : CSSD:2753091328: clssgmpcGMCReqWorkerThread: thrdname GMCReqWorkerThread, num 36, wrkthrdnum 3 spawned 2018-03-09 16:39:26.901 : CSSD:2950017088: clssscGetParameterOLR: OLR fetch for parameter auth rep (9) failed with rc 21 2018-03-09 16:39:26.901 : CSSD:2950017088: clssgmceventsub_construct: eventsub(0x13e0610), gmc(0x139adf0), name(Event Subscription Cache) 2018-03-09 16:39:26.901 : CSSD:2950017088: clssgmGMCInitCtx: GMC context init done 2018-03-09 16:39:26.902 : CSSD:2011944704: clssscthrdmain: Starting thread GMClientListener 2018-03-09 16:39:26.902 : CSSD:2011944704: clssgmclientlsnr: Spawned 2018-03-09 16:39:26.902 : CSSD:2011944704: clssscqueue_init: queue(0x7f5658032cd0), max(0) 2018-03-09 16:39:26.902 : CSSD:2011944704: clssscqueue_init: queue(0x7f5658032fd0), max(0) 2018-03-09 16:39:26.903 : CSSD:2011944704: clsssclsnrsetup: endp 0x20a for clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_cs2_)(GIPCID=00000000-00000000-29348)) 2018-03-09 16:39:26.903 : CSSD:2011944704: clssgmclientlsnr: listening on clsc://(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_cs2_)(GIPCID=00000000-00000000-29348)) 2018-03-09 16:39:26.903 : CSSD:2011944704: clssgmceventsub_construct: eventsub(0x7f565805a340), gmc(0x139adf0), name(Event Subscription Cache) 2018-03-09 16:39:26.903 : CSSD:2011944704: clssscWaitOnInitState: Waiting on requested state 0x00000001, current state 0x008c1e06, timeout 4294967295 2018-03-09 16:39:26.905 : CSSD:2010367744: clssscthrdmain: Starting thread GMDeathCheck 2018-03-09 16:39:26.905 : CSSD:2010367744: clssgmDeathChkThread: Spawned 2018-03-09 16:39:26.907 : CSSD:2008790784: clssscthrdmain: Starting thread GMPResponse 2018-03-09 16:39:26.907 : CSSD:2950017088: clssscUpdateInitState: Set state to 0x008c1e46, based on prior state of 0x008c1e06 and requested change of 0x00000040 2018-03-09 16:39:26.908 : CSSD:2950017088: clssscGetParameterProfile: buffer passed for parameter ASM discovery (3) is too short, required 25, passed 20 2018-03-09 16:39:26.908 : CSSD:2950017088: clssnmReadDiscoveryProfile: voting file discovery string(/dev/sd*,/dev/asm*,AFD:*) 2018-03-09 16:39:26.908 : CSSD:2950017088: clssnkInit: NK generic layer initializing. 2018-03-09 16:39:26.909 : CSSD:2007213824: clssscthrdmain: Starting thread clssnmvDDiscThread 2018-03-09 16:39:26.910 : GPNP:2007213824: clsgpnp_Init: HMAC hash type in context is SHA-512 2018-03-09 16:39:26.910 : GPNP:2007213824: clsgpnp_Init: [at clsgpnp0.c:684] '/u01/app/product/12.2.0/crs' in effect as GPnP home base. 2018-03-09 16:39:26.910 : GPNP:2007213824: clsgpnp_Init: [at clsgpnp0.c:750] GPnP pid=29348, cli=clsuGpnpg GPNP comp tracelevel=1, depcomp tracelevel=0, tlsrc:init, apitl:0, tstenv:0, devenv:0, envopt:0, flags=2003 2018-03-09 16:39:26.915 : GPNP:2007213824: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:403] Using FS Wallet Location : /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.915 : GPNP:2007213824: clsgpnpkwf_initwfloc: [at clsgpnpkwf.c:415] Wallet readable. Path: /u01/app/product/12.2.0/crs/gpnp/cs2/wallets/peer/ 2018-03-09 16:39:26.940 : CLSF:2007213824: Allocated CLSF context 2018-03-09 16:39:26.940 : CSSD:2007213824: clssnmvDDiscThread: using discovery string /dev/sd*,/dev/asm*,AFD:* for initial discovery 2018-03-09 16:39:26.940 : SKGFD:2007213824: Discovery with str:/dev/sd*,/dev/asm*,AFD:*: 2018-03-09 16:39:26.940 : SKGFD:2007213824: UFS discovery with :/dev/sd*: 2018-03-09 16:39:26.940 : SKGFD:2007213824: Execute glob on the string /dev/sd* 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sda2 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sda1 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdc 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdb 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdf 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sde 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sdd 2018-03-09 16:39:26.940 : SKGFD:2007213824: running stat on disk:/dev/sda 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagSelect: endpoint(0x85) authenticated with user(root) 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcessInitialMsg: Handshake successful with agent 1 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcAgReq: got a successful connection 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcAgReq: Sending initdata 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcessInitialMsg: notify agent 1 that it is active 2018-03-09 16:39:27.128 : CSSD:2782349056: clssscagProcessInitialMsg: connection from agent 1, endp 0x85 - agents joined 0 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagSelect: endpoint(0x74) authenticated with user(root) 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcessInitialMsg: Handshake successful with agent 0 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcAgReq: got a successful connection 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcAgReq: Sending initdata 2018-03-09 16:39:27.718 : CSSD:2782349056: clssscagProcessInitialMsg: connection from agent 0, endp 0x74 - agents joined 0 2018-03-09 16:39:27.868 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:28.868 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:29.868 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sda: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sda 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdd: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdd 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sde: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sde 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdf: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdf 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdb: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdb 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sdc: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sdc 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sda1: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sda1 2018-03-09 16:39:30.689 : SKGFD:2007213824: Fetching UFS disk :/dev/sda2: 2018-03-09 16:39:30.689 : CLSF:2007213824: Ignoring 0-byte file /dev/sda2 2018-03-09 16:39:30.689 : SKGFD:2007213824: OSS discovery with :/dev/sd*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: Discovery with asmlib :ASM:AFD Library - Generic , version 3 (KABI_V3): str :/dev/sd*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: Discovery advancing to nxt string :/dev/asm*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: UFS discovery with :/dev/asm*: 2018-03-09 16:39:30.690 : SKGFD:2007213824: Execute glob on the string /dev/asm* 2018-03-09 16:39:30.690 : SKGFD:2007213824: running stat on disk:/dev/asm 2018-03-09 16:39:30.690 : SKGFD:2007213824: running stat on disk:/dev/asmdisk05 2018-03-09 16:39:30.692 : SKGFD:2007213824: running stat on disk:/dev/asmdisk04 2018-03-09 16:39:30.693 : SKGFD:2007213824: running stat on disk:/dev/asmdisk03 2018-03-09 16:39:30.707 : SKGFD:2007213824: running stat on disk:/dev/asmdisk02 2018-03-09 16:39:30.729 : SKGFD:2007213824: running stat on disk:/dev/asmdisk01 2018-03-09 16:39:30.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:31.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:32.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:33.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:34.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk01: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk02: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk03: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk04: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asmdisk05: 2018-03-09 16:39:35.163 : SKGFD:2007213824: Fetching UFS disk :/dev/asm: 2018-03-09 16:39:35.163 : CLSF:2007213824: Ignoring 0-byte file /dev/asm 2018-03-09 16:39:35.163 : SKGFD:2007213824: OSS discovery with :/dev/asm*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: Discovery with asmlib :ASM:AFD Library - Generic , version 3 (KABI_V3): str :/dev/asm*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: Discovery advancing to nxt string :AFD:*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: UFS discovery with :AFD:*: 2018-03-09 16:39:35.164 : SKGFD:2007213824: Execute glob on the string /u01/app/product/12.2.0/crs/dbs/AFD:* 2018-03-09 16:39:35.869 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:36.870 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:37.870 : CSSD:2778318592: clsssc_CLSFAInit_CB: System not ready for CLSFA initialization 2018-03-09 16:39:38.691 : SKGFD:2007213824: OSS discovery with :AFD:*: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Discovery with asmlib :ASM:AFD Library - Generic , version 3 (KABI_V3): str :AFD:*: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Fetching asmlib disk :AFD:CRS2: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Handle 0x7f5644337dc0 from lib :UFS:: for disk :/dev/asmdisk01: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Handle 0x7f5644338d00 from lib :UFS:: for disk :/dev/asmdisk02: 2018-03-09 16:39:38.692 : SKGFD:2007213824: Handle 0x7f5644339c40 from lib :UFS:: for disk :/dev/asmdisk03: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Handle 0x7f564433ab80 from lib :UFS:: for disk :/dev/asmdisk04: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Handle 0x7f564433bc50 from lib :UFS:: for disk :/dev/asmdisk05: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Handle 0x7f564433cd20 from lib :ASM:AFD Library - Generic , version 3 (KABI_V3): for disk :AFD:CRS2: 2018-03-09 16:39:38.693 : CLSF:2007213824: Warning: Voting disk: /dev/asmdisk01 is Hard mounted 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f5644337dc0 for disk :/dev/asmdisk01: 2018-03-09 16:39:38.693 : CLSF:2007213824: Warning: Voting disk: /dev/asmdisk02 is Hard mounted 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f5644338d00 for disk :/dev/asmdisk02: 2018-03-09 16:39:38.693 : CLSF:2007213824: Read header of dev:/dev/asmdisk03:none: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f5644339c40 for disk :/dev/asmdisk03: 2018-03-09 16:39:38.693 : CLSF:2007213824: Read header of dev:/dev/asmdisk04:none: 2018-03-09 16:39:38.693 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f564433ab80 for disk :/dev/asmdisk04: 2018-03-09 16:39:38.702 : CLSF:2007213824: Read header of dev:/dev/asmdisk05:none: 2018-03-09 16:39:38.702 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f564433bc50 for disk :/dev/asmdisk05: 2018-03-09 16:39:38.702 : SKGFD:2007213824: Lib :ASM:AFD Library - Generic , version 3 (KABI_V3): closing handle 0x7f564433cd20 for disk :AFD:CRS2: 2018-03-09 16:39:38.702 : CSSD:2007213824: clssnmvDiskVerify: discovered a potential voting file 2018-03-09 16:39:38.702 : SKGFD:2007213824: Handle 0x7f564432fec0 from lib :UFS:: for disk :/dev/asmdisk01: 2018-03-09 16:39:38.702 : CLSF:2007213824: Opened hdl:0x7f564432e790 for dev:/dev/asmdisk01: 2018-03-09 16:39:38.702 : CSSD:2007213824: clssnmvDiskCreate: name /dev/asmdisk01 blocksz 512 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskCreate: siteid during discovery = 00000000000000000000000000000000 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskVerify: Successful discovery for disk /dev/asmdisk01, UID 750a78e1-ae984fcd-bfb4dbf4-4d337a77, SID 00112233-44556677-8899aabb- ccddeeff, Pending CIN 0:1520582274:0, Committed CIN 0 :1520582274:0 2018-03-09 16:39:38.711 : CLSF:2007213824: Closing handle:0x7f564432e790 2018-03-09 16:39:38.711 : SKGFD:2007213824: Lib :UFS:: closing handle 0x7f564432fec0 for disk :/dev/asmdisk01: 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskVerify: discovered a potential voting file 2018-03-09 16:39:38.711 : SKGFD:2007213824: Handle 0x7f564432fec0 from lib :UFS:: for disk :/dev/asmdisk02: 2018-03-09 16:39:38.711 : CLSF:2007213824: Opened hdl:0x7f564432e790 for dev:/dev/asmdisk02: 2018-03-09 16:39:38.711 : CSSD:2007213824: clssnmvDiskCreate: name /dev/asmdisk02 blocksz 512 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmvDiskCreate: siteid during discovery = 00000000000000000000000000000000 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmFindVF: found VF by vdin in the discovered queue 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmFindVF: Duplicate voting file found in the queue of previously discovered disks queued(/dev/asmdisk01|[750a78e1-ae984fcd-bfb4dbf4- 4d337a77]), found(/dev/asmdisk02|[750a78e1-ae984fcd-bfb4dbf4-4d337a77]), is not corrupted 2018-03-09 16:39:38.712 : CLSF:2007213824: Resolved (/dev/asmdisk01,/dev/asmdisk02) to NONE 2018-03-09 16:39:38.712 : CSSD:2007213824: clssnmvDiskCreate: Found a duplicate voting file /dev/asmdisk01 in the discovery queue which appears to be the same physical device as the newly discovered disk /dev/asmdisk02. Rejecting bot h these files 2018-03-09 16:39:38.712 : default:2007213824: clssnmvDiskCreate:destroy_vdisk->vdisk: dump of 0x0x7f56443d3760, len 10616
發現CRS磁碟組中磁碟/dev/asmdisk01中的voting file有一份重複的副本出現在/dev/asmdisk02磁碟中,因此拒絕了這些檔案。
CSSD:2007213824: clssnmvDiskCreate: Found a duplicate voting file /dev/asmdisk01 in the discovery queue which appears to be the same physical device as the newly discovered disk /dev/asmdisk02. Rejecting both these files
如是在節點cs2上檢視這兩塊磁碟,可以看到 /dev/asmdisk01與/dev/asmdisk02的minor number都顯示為32,而cs1上的/dev/asmdisk01的minor number是16,/dev/asmdisk02的minor number為32
[root@cs2 /]# ls -lrt /dev/asm* brw-rw---- 1 grid asmadmin 8, 32 Mar 9 12:21 /dev/asmdisk01 brw-rw---- 1 grid asmadmin 8, 32 Mar 9 12:23 /dev/asmdisk02 brw-rw---- 1 grid asmadmin 8, 48 Mar 9 12:23 /dev/asmdisk03 brw-rw---- 1 grid asmadmin 8, 64 Mar 9 12:23 /dev/asmdisk04 brw-rw---- 1 grid asmadmin 8, 80 Mar 9 12:23 /dev/asmdisk05 [root@cs1 /]# ls -lrt /dev/asm* brw-rw---- 1 grid asmadmin 8, 48 Mar 9 12:23 /dev/asmdisk03 brw-rw---- 1 grid asmadmin 8, 64 Mar 9 12:23 /dev/asmdisk04 brw-rw---- 1 grid asmadmin 8, 80 Mar 9 12:23 /dev/asmdisk05 brw-rw---- 1 grid asmadmin 8, 32 Mar 9 15:57 /dev/asmdisk02 brw-rw---- 1 grid asmadmin 8, 16 Mar 9 15:57 /dev/asmdisk01
如果手動刪除這些用來建立asm磁碟組的塊裝置
[root@cs2 /]# /bin/rm /dev/asmdisk01 [root@cs2 /]# /bin/rm /dev/asmdisk02 [root@cs2 /]# /bin/rm /dev/asmdisk023 [root@cs2 /]# /bin/rm /dev/asmdisk03 [root@cs2 /]# /bin/rm /dev/asmdisk04 [root@cs2 /]# /bin/rm /dev/asmdisk05 [root@cs2 /]# ls -lrt /dev/asm* total 0
重新建立這些塊裝置
[root@cs2 /]# /sbin/udevadm trigger --type=devices --action=change [root@cs2 /]# ls -lrt /dev/asm* brw-rw---- 1 grid asmadmin 8, 16 Mar 9 17:37 /dev/asmdisk01 brw-rw---- 1 grid asmadmin 8, 32 Mar 9 17:37 /dev/asmdisk02 brw-rw---- 1 grid asmadmin 8, 64 Mar 9 17:37 /dev/asmdisk04 brw-rw---- 1 grid asmadmin 8, 80 Mar 9 17:37 /dev/asmdisk05 brw-rw---- 1 grid asmadmin 8, 48 Mar 9 17:37 /dev/asmdisk03 /dev/asm: total 0
再次重新執行root.sh指令碼就可以執行成功
[root@cs2 /]# ./u01/app/product/12.2.0/crs/root.sh Performing root user operation. The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/product/12.2.0/crs Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Relinking oracle with rac_on option Using configuration parameter file: /u01/app/product/12.2.0/crs/crs/install/crsconfig_params The log of current session can be found at: /u01/app/grid/crsdata/cs2/crsconfig/rootcrs_cs2_2018-03-09_05-37-57PM.log 2018/03/09 17:38:01 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'. 2018/03/09 17:38:01 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 17:38:01 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2018/03/09 17:38:02 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'. 2018/03/09 17:38:05 CLSRSC-363: User ignored prerequisites during installation 2018/03/09 17:38:05 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'. 2018/03/09 17:38:06 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'. 2018/03/09 17:38:06 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'. 2018/03/09 17:38:09 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'. 2018/03/09 17:38:11 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'. 2018/03/09 17:38:12 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'. 2018/03/09 17:38:15 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'. 2018/03/09 17:38:16 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'. 2018/03/09 17:39:03 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'. 2018/03/09 17:39:04 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'. 2018/03/09 17:39:06 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'. 2018/03/09 17:39:08 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'. 2018/03/09 17:39:11 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'. 2018/03/09 17:39:12 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'. CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2' CRS-2673: Attempting to stop 'ora.driver.afd' on 'cs2' CRS-2673: Attempting to stop 'ora.gpnpd' on 'cs2' CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2' CRS-2673: Attempting to stop 'ora.gipcd' on 'cs2' CRS-2673: Attempting to stop 'ora.evmd' on 'cs2' CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'cs2' CRS-2673: Attempting to stop 'ora.mdnsd' on 'cs2' CRS-2677: Stop of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2677: Stop of 'ora.driver.afd' on 'cs2' succeeded CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'cs2' succeeded CRS-2677: Stop of 'ora.evmd' on 'cs2' succeeded CRS-2677: Stop of 'ora.gipcd' on 'cs2' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'cs2' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed CRS-4133: Oracle High Availability Services has been stopped. 2018/03/09 17:39:17 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.evmd' on 'cs2' CRS-2672: Attempting to start 'ora.mdnsd' on 'cs2' CRS-2676: Start of 'ora.mdnsd' on 'cs2' succeeded CRS-2676: Start of 'ora.evmd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'cs2' CRS-2676: Start of 'ora.gpnpd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'cs2' CRS-2676: Start of 'ora.gipcd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cs2' CRS-2676: Start of 'ora.cssdmonitor' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'cs2' CRS-2672: Attempting to start 'ora.diskmon' on 'cs2' CRS-2676: Start of 'ora.diskmon' on 'cs2' succeeded CRS-2676: Start of 'ora.cssd' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'cs2' CRS-2672: Attempting to start 'ora.ctssd' on 'cs2' CRS-2676: Start of 'ora.ctssd' on 'cs2' succeeded CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.asm' on 'cs2' CRS-2676: Start of 'ora.asm' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.storage' on 'cs2' CRS-2676: Start of 'ora.storage' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.crf' on 'cs2' CRS-2676: Start of 'ora.crf' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'cs2' CRS-2676: Start of 'ora.crsd' on 'cs2' succeeded CRS-6017: Processing resource auto-start for servers: cs2 CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'cs1' CRS-2672: Attempting to start 'ora.net1.network' on 'cs2' CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'cs2' CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'cs1' succeeded CRS-2676: Start of 'ora.net1.network' on 'cs2' succeeded CRS-2673: Attempting to stop 'ora.scan1.vip' on 'cs1' CRS-2672: Attempting to start 'ora.ons' on 'cs2' CRS-2677: Stop of 'ora.scan1.vip' on 'cs1' succeeded CRS-2672: Attempting to start 'ora.scan1.vip' on 'cs2' CRS-2676: Start of 'ora.scan1.vip' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'cs2' CRS-2676: Start of 'ora.ons' on 'cs2' succeeded CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'cs2' succeeded CRS-2672: Attempting to start 'ora.asm' on 'cs2' CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'cs2' succeeded CRS-2676: Start of 'ora.asm' on 'cs2' succeeded CRS-6016: Resource auto-start has completed for server cs2 CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources CRS-4123: Oracle High Availability Services has been started. 2018/03/09 17:42:11 CLSRSC-343: Successfully started Oracle Clusterware stack 2018/03/09 17:42:11 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'. 2018/03/09 17:42:24 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'. 2018/03/09 17:43:16 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
到此這個問題就修復了
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/26015009/viewspace-2151731/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- Oracle RAC 一個節點不能自動啟動 怪問題Oracle
- ORA-15055: unable to connect to ASM instance 造成 RAC的db不能啟動ASM
- asp.net中asp_wp.exe不能啟動的問題ASP.NET
- RAC之srvctl 命令不能用的問題
- 私有IP丟失造成Oracle 12C RAC叢集節點不能啟動Oracle
- 處理Oracle 11gR2 RAC資料庫資源不能自動啟動的問題Oracle資料庫
- 【轉】ohasd不能正常啟動:ioctl操作:npohasd的問題
- 關於兩組相同的radio同步問題
- 處理Oracle 11gR2 RAC資料庫資源不能自動啟動的問題 (轉)Oracle資料庫
- 什麼原因造成資料庫不能自動啟動!資料庫
- 遠端服務不能啟動問題的解決方法
- 相同 App 同步迭代中的測試問題APP
- recyclebin造成的問題分析
- 解決兩相同資料庫資料同步的問題 (轉)資料庫
- Xamarin中Unsupported major.minor version 52.0問題解決
- 兩塊磁碟,oralce執行慢的問題
- 關於字串中取相同的字元問題(小學題)字串字元
- oracle 10g rac vip 服務啟動不了的問題Oracle 10g
- Lazarus在Loongarch的loongxin mate系統不能開啟對話方塊問題
- rabbitmq的啟動問題MQ
- rac中database啟動方式的設定Database
- 推薦系統中的冷啟動問題和探索利用問題
- 解決Win8啟動兩遍才能開機的問題
- rac節點無法啟動ORA-29702的問題及分析
- oracle rac 單個例項不能生成awr報告的問題Oracle
- Oracle 指定別名"A" or"a"造成的問題Oracle
- 解決linux不能上外網的問題Linux
- ORACLE RAC TO RAC DG搭建過程中可能遇到的問題Oracle
- number型別的顯示問題型別
- oracle 10g rac資料庫不能自動啟動Oracle 10g資料庫
- u-boot不接串列埠不能啟動kernel問題boot串列埠
- oracle 10g crs 不能啟動問題解決案例Oracle 10g
- Oracle 11gR1 RAC安裝過程中遇到的問題:LINUX系統版本的問題OracleLinux
- oracle兩節點RAC,由於gipc導致某節點crs無法啟動問題分析Oracle
- RAC連線中TNSNAMES需注意的問題
- RAC中修改系統時間的問題
- linux7上安裝RAC的問題Linux
- 輸入兩個長度相同的字串,比較兩個數在相同位置的字元是否相同字串字元