私有IP丢失造成Oracle 12C RAC集群节点不能启动
某生产环境Oracle Linux 7.1,Oracle 12C RAC显示节点1的集群资源没有启动,信息如下:
[grid@cs2 ~]$ crsctl stat res -t--------------------------------------------------------------------------------Name Target State Server State details --------------------------------------------------------------------------------Local Resources--------------------------------------------------------------------------------ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE cs2 STABLEora.CRS.dg ONLINE ONLINE cs2 STABLEora.DATA.dg ONLINE ONLINE cs2 STABLEora.LISTENER.lsnr ONLINE ONLINE cs2 STABLEora.chad ONLINE OFFLINE cs2 STABLEora.net1.network ONLINE ONLINE cs2 STABLEora.ons ONLINE OFFLINE cs2 STABLEora.proxy_advm OFFLINE OFFLINE cs2 STABLE--------------------------------------------------------------------------------Cluster Resources--------------------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE cs2 STABLEora.LISTENER_SCAN2.lsnr 1 ONLINE ONLINE cs2 STABLEora.LISTENER_SCAN3.lsnr 1 ONLINE ONLINE cs2 STABLEora.MGMTLSNR 1 ONLINE ONLINE cs2 169.254.255.92 88.88 .88.191,STABLEora.asm 1 ONLINE OFFLINE STABLE 2 ONLINE ONLINE cs2 Started,STABLE 3 OFFLINE OFFLINE STABLEora.cs.db 1 ONLINE OFFLINE STABLE 2 ONLINE OFFLINE Instance Shutdown,ST ABLEora.cs1.vip 1 ONLINE INTERMEDIATE cs2 FAILED OVER,STABLEora.cs2.vip 1 ONLINE ONLINE cs2 STABLEora.cvu 1 ONLINE ONLINE cs2 STABLEora.gns 1 ONLINE OFFLINE STABLEora.gns.vip 1 ONLINE OFFLINE STABLEora.mgmtdb 1 ONLINE OFFLINE Instance Shutdown,ST ABLEora.qosmserver 1 ONLINE ONLINE cs2 STABLEora.scan1.vip 1 ONLINE ONLINE cs2 STABLEora.scan2.vip 1 ONLINE ONLINE cs2 STABLEora.scan3.vip 1 ONLINE ONLINE cs2 STABLE--------------------------------------------------------------------------------
如果查看节点1上的alert.log文件,信息如下:
[root@cs1 soft]# tail -100 /u01/app/grid/diag/crs/cs1/crs/trace/alert.log2020-01-14 20:45:50.226 [CVUD(2366CRS-10051: CVU found following errors with Clusterware setup : PRVE-3191 :(DESCRIPTION = (LOAD_BALANCE=on) (ADDRESS = (PROTOCOL = TCP)(HOST = cs-cluster-scan.cs-cluster.jy.net)(PORT = 1521)) (CONNECT_DATA =(SERVER = DEDICATED)(SERVICE_NAME = cs)))Listener refused the connection with the following error:ORA-12514, TNS:listener does not currently know of service requested in connect descriptor 2020-02-17 14:49:28.563 [ORAROOTAGENT(15500)]CRS-5822: Agent '/u01/app/product/12.2.0/crs/bin/orarootagent_root' disconnected from server. Details at (:CRSAGF00117:) {0:5:63832} in /u01/app/grid/diag/crs/cs1/crs/trace/crsd_orarootagent_root.trc.2020-02-17 14:49:28.584 [ORAAGENT(15466)]CRS-5822: Agent '/u01/app/product/12.2.0/crs/bin/oraagent_grid' disconnected from server. Details at (:CRSAGF00117:) {0:1:36} in /u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trc.2020-02-17 14:49:29.607 [GPNPD(3293)]CRS-2329: GPNPD on node cs1 shut down. 2020-02-17 14:49:30.123 [OSYSMOND(6077)]CRS-8504: Oracle Clusterware OSYSMOND process with operating system process ID 6077 is exiting2020-02-17 14:49:31.377 [MDNSD(3254)]CRS-5602: mDNS service stopping by request.2020-02-17 14:49:31.747 [MDNSD(3254)]CRS-8504: Oracle Clusterware MDNSD process with operating system process ID 3254 is exiting2020-02-17 14:49:46.650 [OCTSSD(5883)]CRS-2405: The Cluster Time Synchronization Service on host cs1 is shutdown by user2020-02-17 14:49:46.651 [OCTSSD(5883)]CRS-8504: Oracle Clusterware OCTSSD process with operating system process ID 5883 is exiting2020-02-17 14:49:47.651 [OCSSD(3616)]CRS-1603: CSSD on node cs1 has been shut down.2020-02-17 14:49:47.958 [OCSSD(3616)]CRS-1660: The CSS daemon shutdown has completed2020-02-17 14:49:47.959 [OCSSD(3616)]CRS-8504: Oracle Clusterware OCSSD process with operating system process ID 3616 is exiting2020-02-17 14:49:49.726 [ORAAGENT(3235)]CRS-5822: Agent '/u01/app/product/12.2.0/crs/bin/oraagent_grid' disconnected from server. Details at (:CRSAGF00117:) {0:9:818} in /u01/app/grid/diag/crs/cs1/crs/trace/ohasd_oraagent_grid.trc.2020-02-17 14:49:49.727 [ORAROOTAGENT(3029)]CRS-5822: Agent '/u01/app/product/12.2.0/crs/bin/orarootagent_root' disconnected from server. Details at (:CRSAGF00117:) {0:1:21} in /u01/app/grid/diag/crs/cs1/crs/trace/ohasd_orarootagent_root.trc.
根据上面的错误信息提示查看crsd_oraagent_grid.trc跟踪文件:
[root@cs1 ~]# more /u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trcTrace file /u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid.trcOracle Database 12c Clusterware Release 12.2.0.1.0 - Production Copyright 1996, 2016 Oracle. All rights reserved.*** TRACE CONTINUED FROM FILE /u01/app/grid/diag/crs/cs1/crs/trace/crsd_oraagent_grid_910.trc ***2020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::regEndpoint 110 reset regEndPointDone:02020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] generateEndPointStrings:generate endpoints2020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.129 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] generateEndPointStrings:No IP matching the subnet 88.88.88.02020-02-17 14:39:22.130 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] Ocr Context init default level 18146295362020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] Agent::getDeploymentPlatformId return 2020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::generateEndPoints 000 entry {nonPriv2020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::generateEndPoints 000 entry { lsnrResName: endpAttr:TCP:1526 type:42020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::generateEndPoints 040 Listener ResName:2020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::removeDuplicates 2020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::generateEndPoints 999 exit nonPriv}2020-02-17 14:39:22.133 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] LsnrAgent::regEndpoint 200 endpStrings empty2020-02-17 14:39:22.134 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] AsmLsnrAgent::init2020-02-17 14:39:22.154 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.154 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.154 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.154 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] VendorType=02020-02-17 14:39:22.154 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] Cannot find an IP address matching the subnet 88.88.88.02020-02-17 14:39:22.154 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] Ocr Context init default level 18146295362020-02-17 14:39:22.157 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] Agent::getDeploymentPlatformId return 2020-02-17 14:39:22.158 : CLSCEVT:2462013184: (:CLSCE0028:)clsce_unsubscribe 0x7f725c004510 successfully unsubscribed : 9748332020-02-17 14:39:22.158 : USRTHRD:2462013184: {0:1:18} WorkerThread::removeWorker total workers: 22020-02-17 14:39:22.158 : USRTHRD:2462013184: {0:1:18} Worker::schedule adding worker 'ReconnSub-LsnrAgentSub-ASMNET1LSNR_ASM' to thread 'ReconnectingSubscribers'2020-02-17 14:39:22.158 : USRTHRD:2462013184: {0:1:18} WorkerThread::addWorker total workers: 32020-02-17 14:39:22.158 :CLSDYNAM:2462013184: [ora.ASMNET1LSNR_ASM.lsnr]{0:1:18} [check] Skipping CSS Initialization for rebootless recovery2020-02-17 14:39:22.159 : CLSCEVT:2478823168: clsce_subscribe 0x7f72600d06b0 filter='(^CRS_RESOURCE_PROFILE_CHANGE.*RESOURCE_CLASS='(scan_vip|vip)')|(^CRS_RESOURCE_PROFILE_CHANGE.*TYPE='ora\.network\.type')', flags=1, handler=0xc6ad0c, arg=0x7f726016de10
从上面的错误信息中可以找到Cannot find an IP address matching the subnet 88.88.88.0,这说明私有IP丢失了。
如是查看网络IP地址
节点2私有IP正常
[grid@cs2 ~]$ ifconfig -aens160: flags=4163 mtu 1500 inet 10.13.13.191 netmask 255.255.255.0 broadcast 10.13.13.255 inet6 fe80::250:56ff:fea0:92af prefixlen 64 scopeid 0x20 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet) RX packets 127560233 bytes 10186683662 (9.4 GiB) RX errors 0 dropped 353 overruns 0 frame 0 TX packets 18954431 bytes 1554204413 (1.4 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens160:1: flags=4163 mtu 1500 inet 10.13.13.130 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet)ens160:2: flags=4163 mtu 1500 inet 10.13.13.147 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet)ens160:3: flags=4163 mtu 1500 inet 10.13.13.141 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet)ens160:4: flags=4163 mtu 1500 inet 10.13.13.138 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet)ens160:5: flags=4163 mtu 1500 inet 10.13.13.137 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet)ens160:6: flags=4163 mtu 1500 inet 10.13.13.136 netmask 255.255.255.0 broadcast 10.13.13.255 ether 00:50:56:a0:92:af txqueuelen 1000 (Ethernet)ens192: flags=4163 mtu 1500 inet 88.88.88.191 netmask 255.255.255.0 broadcast 88.88.88.255 inet6 fe80::250:56ff:fea0:a05c prefixlen 64 scopeid 0x20 ether 00:50:56:a0:a0:5c txqueuelen 1000 (Ethernet) RX packets 294716840 bytes 215309349272 (200.5 GiB) RX errors 0 dropped 355 overruns 0 frame 0 TX packets 63703465 bytes 363393728693 (338.4 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens192:1: flags=4163 mtu 1500 inet 169.254.255.92 netmask 255.255.0.0 broadcast 169.254.255.255 ether 00:50:56:a0:a0:5c txqueuelen 1000 (Ethernet)lo: flags=73 mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 90029207 bytes 223833448058 (208.4 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 90029207 bytes 223833448058 (208.4 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0: flags=4099 mtu 1500 inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0-nic: flags=4098 mtu 1500 ether 52:54:00:d0:6e:0b txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0[grid@cs2 ~]$ cat /etc/hosts127.0.0.1 localhost10.13.13.190 cs110.13.13.191 cs2#10.13.13.192 cs1-vip.jy.net cs1-vip#10.13.13.193 cs2-vip.jy.net cs2-vip88.88.88.190 cs1-priv.jy.net cs1-priv88.88.88.191 cs2-priv.jy.net cs2-priv10.13.13.141 cs-cluster-scan 10.13.13.142 cs-cluster-scan 10.13.13.143 cs-cluster-scan
节点1的私有IP丢失
[root@cs1 ~]# ifconfig -aens160: flags=4163 mtu 1500 inet 10.13.13.190 netmask 255.255.255.0 broadcast 10.13.13.255 inet6 fe80::250:56ff:fea0:4e69 prefixlen 64 scopeid 0x20 inet6 2018::2 prefixlen 64 scopeid 0x0 ether 00:50:56:a0:4e:69 txqueuelen 1000 (Ethernet) RX packets 53266410 bytes 3937179306 (3.6 GiB) RX errors 0 dropped 143 overruns 0 frame 0 TX packets 2988621 bytes 284679938 (271.4 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens192: flags=4163 mtu 1500 inet6 fe80::250:56ff:fea0:17dc prefixlen 64 scopeid 0x20 ether 00:50:56:a0:17:dc txqueuelen 1000 (Ethernet) RX packets 70361859 bytes 5602168856 (5.2 GiB) RX errors 0 dropped 141 overruns 0 frame 0 TX packets 24902418 bytes 195063342601 (181.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0lo: flags=73 mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 30235303 bytes 10958756943 (10.2 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 30235303 bytes 10958756943 (10.2 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0: flags=4099 mtu 1500 inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0-nic: flags=4098 mtu 1500 ether 52:54:00:d0:6e:0b txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
设置私有IP
[root@cs1 network-scripts]# cat ifcfg-Ethernet_connection_ens192TYPE=EthernetBOOTPROTO=noneDEFROUTE=yesIPV4_FAILURE_FATAL=noIPV6INIT=noNAME=ens192UUID=8ec45d90-c1fb-4924-84a0-72f58fc9b82fDEVICE=ens192ONBOOT=yesIPADDR=88.88.88.190PREFIX=24NETMASK=255.255.255.0[root@cs1 network-scripts]# ifconfig -aens160: flags=4163 mtu 1500 inet 10.138.130.190 netmask 255.255.255.0 broadcast 10.138.130.255 inet6 fe80::250:56ff:fea0:4e69 prefixlen 64 scopeid 0x20 inet6 2018::2 prefixlen 64 scopeid 0x0 ether 00:50:56:a0:4e:69 txqueuelen 1000 (Ethernet) RX packets 53277081 bytes 3937945677 (3.6 GiB) RX errors 0 dropped 143 overruns 0 frame 0 TX packets 2989099 bytes 284806540 (271.6 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0ens192: flags=4163 mtu 1500 inet 88.88.88.190 netmask 255.255.255.0 broadcast 88.88.88.255 inet6 fe80::250:56ff:fea0:17dc prefixlen 64 scopeid 0x20 ether 00:50:56:a0:17:dc txqueuelen 1000 (Ethernet) RX packets 70371906 bytes 5602881459 (5.2 GiB) RX errors 0 dropped 141 overruns 0 frame 0 TX packets 24902428 bytes 195063343317 (181.6 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0lo: flags=73 mtu 65536 inet 127.0.0.1 netmask 255.0.0.0 inet6 ::1 prefixlen 128 scopeid 0x10 loop txqueuelen 0 (Local Loopback) RX packets 30236949 bytes 10959017396 (10.2 GiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 30236949 bytes 10959017396 (10.2 GiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0: flags=4099 mtu 1500 inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255 ether 52:54:00:d0:6e:0b txqueuelen 0 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0virbr0-nic: flags=4098 mtu 1500 ether 52:54:00:d0:6e:0b txqueuelen 500 (Ethernet) RX packets 0 bytes 0 (0.0 B) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 0 bytes 0 (0.0 B) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@cs1 ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'cs2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'cs2'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'cs2'
CRS-2673: Attempting to stop 'ora.crf' on 'cs2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'cs2'
CRS-2673: Attempting to stop 'ora.evmd' on 'cs2'
CRS-2673: Attempting to stop 'ora.asm' on 'cs2'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'cs2'
CRS-2677: Stop of 'ora.drivers.acfs' on 'cs2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'cs2' succeeded
CRS-2677: Stop of 'ora.crf' on 'cs2' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'cs2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'cs2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'cs2' succeeded
CRS-2677: Stop of 'ora.asm' on 'cs2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'cs2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'cs2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'cs2'
CRS-2677: Stop of 'ora.cssd' on 'cs2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'cs2'
CRS-2673: Attempting to stop 'ora.driver.afd' on 'cs2'
CRS-2677: Stop of 'ora.driver.afd' on 'cs2' succeeded
CRS-2677: Stop of 'ora.gipcd' on 'cs2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'cs2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@cs1 ~]# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
手动启动节点1的集群软件
[root@cs1 ~]# crsctl stat res -t--------------------------------------------------------------------------------Name Target State Server State details --------------------------------------------------------------------------------Local Resources--------------------------------------------------------------------------------ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.CRS.dg ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.DATA.dg ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.DN.dg OFFLINE OFFLINE cs1 STABLE OFFLINE OFFLINE cs2 STABLEora.LISTENER.lsnr ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.chad ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.net1.network ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.ons ONLINE ONLINE cs1 STABLE ONLINE ONLINE cs2 STABLEora.proxy_advm OFFLINE OFFLINE cs1 STABLE OFFLINE OFFLINE cs2 STABLE--------------------------------------------------------------------------------Cluster Resources--------------------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE cs1 STABLEora.LISTENER_SCAN2.lsnr 1 ONLINE ONLINE cs2 STABLEora.LISTENER_SCAN3.lsnr 1 ONLINE ONLINE cs1 STABLEora.MGMTLSNR 1 ONLINE ONLINE cs1 169.254.207.24 88.88 .88.190,STABLEora.asm 1 ONLINE ONLINE cs1 Started,STABLE 2 ONLINE ONLINE cs2 Started,STABLE 3 OFFLINE OFFLINE STABLEora.cs.db 1 ONLINE ONLINE cs1 Open,HOME=/u01/app/o racle/product/12.2.0 /db,STABLE 2 ONLINE ONLINE cs2 Open,HOME=/u01/app/o racle/product/12.2.0 /db,STABLEora.cs1.vip 1 ONLINE ONLINE cs1 STABLEora.cs2.vip 1 ONLINE ONLINE cs2 STABLEora.cvu 1 ONLINE ONLINE cs1 STABLEora.gns 1 ONLINE ONLINE cs2 STABLEora.gns.vip 1 ONLINE ONLINE cs2 STABLEora.mgmtdb 1 ONLINE OFFLINE cs1 Open,STABLEora.qosmserver 1 ONLINE ONLINE cs1 STABLEora.scan1.vip 1 ONLINE ONLINE cs1 STABLEora.scan2.vip 1 ONLINE ONLINE cs2 STABLEora.scan3.vip 1 ONLINE ONLINE cs1 STABLE--------------------------------------------------------------------------------
到此恢复正常状态。