First of all, let me show you the installation log:
[root@node2 tmp]# /u01/app/11.2.0/grid/OPatch/opatch auto 28813878 -ocmrf /u01/ocm.rsp Executing /u01/app/11.2.0/grid/perl/bin/perl /u01/app/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir . -patchn 28813878 -ocmrf /u01/ocm.rsp -paramfile /u01/app/11.2.0/grid/crs/install/crsconfig_params This is the main log file: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2019-02-18_09-14-41.log This file will show your detected configuration and all the steps that opatchauto attempted to do on your system: /u01/app/11.2.0/grid/cfgtoollogs/opatchauto2019-02-18_09-14-41.report.log 2019-02-18 09:14:41: Starting Clusterware Patch Setup Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Stopping RAC /u01/app/oracle/product/11.2.0/dbhome_1 ... Stopped RAC /u01/app/oracle/product/11.2.0/dbhome_1 successfully patch ./28813878/28729234/custom/server/28729234 apply successful for home /u01/app/oracle/product/11.2.0/dbhome_1 patch ./28813878/28729262 apply successful for home /u01/app/oracle/product/11.2.0/dbhome_1 Starting RAC /u01/app/oracle/product/11.2.0/dbhome_1 ... Started RAC /u01/app/oracle/product/11.2.0/dbhome_1 successfully opatch auto succeeded.
Perfect! Right? No any error, and even the message said 'succeeded'.
When I got almost the same log the third time, I knew there was something wrong as I could not find the related log of the GI home.
(Note: below logs are from both customer system and my own test machines so they are mixed. Sorry)
And the result could be confirmed easily:
[grid@rac11g1 ~]$ $ORACLE_HOME/OPatch/opatch lsinventory Oracle Interim Patch Installer version 11.2.0.3.20 Copyright (c) 2019, Oracle Corporation. All rights reserved. Oracle Home : /oracle/app/cluster/11.2.0 Central Inventory : /oracle/app/oraInventory from : /oracle/app/cluster/11.2.0/oraInst.loc OPatch version : 11.2.0.3.20 OUI version : 11.2.0.4.0 Log file location : /oracle/app/cluster/11.2.0/cfgtoollogs/opatch/opatch2019-02-21_12-11-30PM_1.log Lsinventory Output file location : /oracle/app/cluster/11.2.0/cfgtoollogs/opatch/lsinv/lsinventory2019-02-21_12-11-30PM.txt -------------------------------------------------------------------------------- Local Machine Information:: Hostname: rac11g1.dbcloudsvc.com ARU platform id: 226 ARU platform description:: Linux x86-64 Installed Top-level Products (1): Oracle Grid Infrastructure 11g 11.2.0.4.0 There are 1 products installed in this Oracle Home. There are no Interim patches installed in this Oracle Home. -------------------------------------------------------------------------------- OPatch succeeded. [grid@rac11g1 ~]$ exit logout [root@rac11g1 oracle]# su - oracle [oracle@rac11g1 ~]$ $ORACLE_HOME/OPatch/opatch lsinventory Oracle Interim Patch Installer version 11.2.0.3.20 Copyright (c) 2019, Oracle Corporation. All rights reserved. Oracle Home : /oracle/app/oracle/product/11.2.0 Central Inventory : /oracle/app/oraInventory from : /oracle/app/oracle/product/11.2.0/oraInst.loc OPatch version : 11.2.0.3.20 OUI version : 11.2.0.4.0 Log file location : /oracle/app/oracle/product/11.2.0/cfgtoollogs/opatch/opatch2019-02-21_12-12-22PM_1.log Lsinventory Output file location : /oracle/app/oracle/product/11.2.0/cfgtoollogs/opatch/lsinv/lsinventory2019-02-21_12-12-22PM.txt -------------------------------------------------------------------------------- Local Machine Information:: Hostname: rac11g1.dbcloudsvc.com ARU platform id: 226 ARU platform description:: Linux x86-64 Installed Top-level Products (1): Oracle Database 11g 11.2.0.4.0 There are 1 products installed in this Oracle Home. Interim patches (2) : Patch 28729262 : applied on Thu Feb 21 07:05:30 NZDT 2019 Unique Patch ID: 22664181 Patch description: "Database Patch Set Update : 11.2.0.4.190115 (28729262)" Created on 19 Dec 2018, 22:33:21 hrs PST8PDT Sub-patch 28204707; "Database Patch Set Update : 11.2.0.4.181016 (28204707)" Sub-patch 27734982; "Database Patch Set Update : 11.2.0.4.180717 (27734982)" Sub-patch 27338049; "Database Patch Set Update : 11.2.0.4.180417 (27338049)" Sub-patch 26925576; "Database Patch Set Update : 11.2.0.4.180116 (26925576)" Sub-patch 26392168; "Database Patch Set Update : 11.2.0.4.171017 (26392168)" Sub-patch 26609445; "Database Patch Set Update : 11.2.0.4.170814 (26609445)" Sub-patch 25869727; "Database Patch Set Update : 11.2.0.4.170718 (25869727)" Sub-patch 24732075; "Database Patch Set Update : 11.2.0.4.170418 (24732075)" Sub-patch 24006111; "Database Patch Set Update : 11.2.0.4.161018 (24006111)" Sub-patch 23054359; "Database Patch Set Update : 11.2.0.4.160719 (23054359)" Sub-patch 22502456; "Database Patch Set Update : 11.2.0.4.160419 (22502456)" Sub-patch 21948347; "Database Patch Set Update : 11.2.0.4.160119 (21948347)" Sub-patch 21352635; "Database Patch Set Update : 11.2.0.4.8 (21352635)" Sub-patch 20760982; "Database Patch Set Update : 11.2.0.4.7 (20760982)" Sub-patch 20299013; "Database Patch Set Update : 11.2.0.4.6 (20299013)" Sub-patch 19769489; "Database Patch Set Update : 11.2.0.4.5 (19769489)" Sub-patch 19121551; "Database Patch Set Update : 11.2.0.4.4 (19121551)" Sub-patch 18522509; "Database Patch Set Update : 11.2.0.4.3 (18522509)" Sub-patch 18031668; "Database Patch Set Update : 11.2.0.4.2 (18031668)" Sub-patch 17478514; "Database Patch Set Update : 11.2.0.4.1 (17478514)" Bugs fixed: 17184721, 21174504, 21538558, 16091637, 18092127, 17381384, 15979965 20671094, 16731148, 16314254, 13837378, 18441944, 23105538, 17291347
I tried to install it directly on the GI home:
[root@rac11g1 oracle]# /oracle/app/cluster/11.2.0/OPatch/opatch auto 28813878 -oh /oracle/app/cluster/11.2.0 -ocmrf /oracle/ocm.rsp Executing /oracle/app/cluster/11.2.0/perl/bin/perl /oracle/app/cluster/11.2.0/OPatch/crs/patch11203.pl -patchdir . -patchn 28813878 -oh /oracle/app/cluster/11.2.0 -ocmrf /oracle/ocm.rsp -paramfile /oracle/app/cluster/11.2.0/crs/install/crsconfig_params This is the main log file: /oracle/app/cluster/11.2.0/cfgtoollogs/opatchauto2019-02-21_12-18-28.log This file will show your detected configuration and all the steps that opatchauto attempted to do on your system: /oracle/app/cluster/11.2.0/cfgtoollogs/opatchauto2019-02-21_12-18-28.report.log 2019-02-21 12:18:29: Starting Clusterware Patch Setup Using configuration parameter file: /oracle/app/cluster/11.2.0/crs/install/crsconfig_params Stopping CRS... Stopped CRS successfully Error : The opatch Applicable check failed. The patch ./28813878/28729234 is not applicable to /oracle/app/cluster/11.2.0 Error:Patch Applicable check failed for /oracle/app/cluster/11.2.0 Starting CRS... ERROR: Prereq checkApplicable failed. Refer log file for more details. opatch auto failed.
Its better that at least I knew it failed.
Next I continued to install it as GI owner and it worked.
/oracle/app/cluster/11.2.0/perl/bin/perl /oracle/app/cluster/11.2.0/crs/install/rootcrs.pl -unlock /oracle/app/cluster/11.2.0/OPatch/opatch napply -oh /oracle/app/cluster/11.2.0 -ocmrf /oracle/ocm.rsp -local /tmp/28813878/28729245 /oracle/app/cluster/11.2.0/rdbms/install/rootadd_rdbms.sh /oracle/app/cluster/11.2.0/perl/bin/perl /oracle/app/cluster/11.2.0/crs/install/rootcrs.pl -patch
Attached the patch log here: GI_Patch_Log
In RHEL7, we have to use the perl from the GI home or we will get below error:
Can't locate Env.pm in @INC
And now we could make sure it was installed:
[grid@rac11g1 ~]$ /oracle/app/cluster/11.2.0/OPatch/opatch lsinv Oracle Interim Patch Installer version 11.2.0.3.20 Copyright (c) 2019, Oracle Corporation. All rights reserved. Oracle Home : /oracle/app/cluster/11.2.0 Central Inventory : /oracle/app/oraInventory from : /oracle/app/cluster/11.2.0/oraInst.loc OPatch version : 11.2.0.3.20 OUI version : 11.2.0.4.0 Log file location : /oracle/app/cluster/11.2.0/cfgtoollogs/opatch/opatch2019-02-21_13-03-38PM_1.log Lsinventory Output file location : /oracle/app/cluster/11.2.0/cfgtoollogs/opatch/lsinv/lsinventory2019-02-21_13-03-38PM.txt -------------------------------------------------------------------------------- Local Machine Information:: Hostname: rac11g1.dbcloudsvc.com ARU platform id: 226 ARU platform description:: Linux x86-64 Installed Top-level Products (1): Oracle Grid Infrastructure 11g 11.2.0.4.0 There are 1 products installed in this Oracle Home. Interim patches (3) : Patch 28729262 : applied on Thu Feb 21 12:45:36 NZDT 2019 Unique Patch ID: 22664181 Patch description: "Database Patch Set Update : 11.2.0.4.190115 (28729262)" Created on 19 Dec 2018, 22:33:21 hrs PST8PDT Sub-patch 28204707; "Database Patch Set Update : 11.2.0.4.181016 (28204707)" Sub-patch 27734982; "Database Patch Set Update : 11.2.0.4.180717 (27734982)" Sub-patch 27338049; "Database Patch Set Update : 11.2.0.4.180417 (27338049)" Sub-patch 26925576; "Database Patch Set Update : 11.2.0.4.180116 (26925576)" Sub-patch 26392168; "Database Patch Set Update : 11.2.0.4.171017 (26392168)" Sub-patch 26609445; "Database Patch Set Update : 11.2.0.4.170814 (26609445)" Sub-patch 25869727; "Database Patch Set Update : 11.2.0.4.170718 (25869727)" Sub-patch 24732075; "Database Patch Set Update : 11.2.0.4.170418 (24732075)" Sub-patch 24006111; "Database Patch Set Update : 11.2.0.4.161018 (24006111)" Sub-patch 23054359; "Database Patch Set Update : 11.2.0.4.160719 (23054359)" Sub-patch 22502456; "Database Patch Set Update : 11.2.0.4.160419 (22502456)" Sub-patch 21948347; "Database Patch Set Update : 11.2.0.4.160119 (21948347)" Sub-patch 21352635; "Database Patch Set Update : 11.2.0.4.8 (21352635)" Sub-patch 20760982; "Database Patch Set Update : 11.2.0.4.7 (20760982)" Sub-patch 20299013; "Database Patch Set Update : 11.2.0.4.6 (20299013)" Sub-patch 19769489; "Database Patch Set Update : 11.2.0.4.5 (19769489)" Sub-patch 19121551; "Database Patch Set Update : 11.2.0.4.4 (19121551)" Sub-patch 18522509; "Database Patch Set Update : 11.2.0.4.3 (18522509)" Sub-patch 18031668; "Database Patch Set Update : 11.2.0.4.2 (18031668)" Sub-patch 17478514; "Database Patch Set Update : 11.2.0.4.1 (17478514)" Bugs fixed: 17184721, 21174504, 21538558, 16091637, 18092127, 17381384, 15979965