SUN ORACLEWORLD: How to apply patch on EM management agent 12c

How to apply patch on EM management agent 12c

Hello Everyone,

We have OEM 12c for monitoring our exadata environment. We experienced bug for the EM false alarm, so support advised to apply the patch on the EM agent.

BUG 21513052 - Intermittent false alerts report Oracle Virtual Server target as Down

High Level Plan -

The BUG has been fixed at agent side, please apply the Patch 22068912

Please follow readme instructions to apply the patch

To apply patches manually, follow these steps:

1.Run the following command to stop the Management Agent:

$ $ORACLE_HOME/bin/emctl stop agent

2.Maintain a location for storing the contents of the patch ZIP file. In the rest of the document, this location (absolute path) is referred to as <PATCH_TOP_DIR>.

3.Extract the contents of the patch ZIP file to the location you created in Step (1). To do so, run the following command:

$ unzip -d <PATCH_TOP_DIR> p22068912_121010_Generic.zip

4.Navigate to the <PATCH_TOP_DIR>/22068912 directory:

$ cd <PATCH_TOP_DIR>/22068912

5.Run the following commands to install the patch.

export ORACLE_HOME=/u01/oraem12c/agent12c/core/12.1.0.4.0

export PLUGIN_HOME=/u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0

$ORACLE_HOME/OPatch/opatch apply -oh $PLUGIN_HOME

6.Start the Management Agent by running the following command:

$ $ORACLE_HOME/bin/emctl start agent

Actual Implementation –

[oraem12c@examyservdbadm1 tmp]$

[oraem12c@examyservdbadm1 tmp]$ cp p22068912_121010_Generic.zip /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/

[oraem12c@examyservdbadm1 tmp]$

[oraem12c@examyservdbadm1 tmp]$ cd /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ ls -lrt

total 196

-rw-r--r-- 1 oraem12c oinstall 199025 Apr 3 14:02 p22068912_121010_Generic.zip

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ chmod 777 p22068912_121010_Generic.zip

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl status agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

Agent Version : 12.1.0.4.0

OMS Version : 12.1.0.4.0

Protocol Version : 12.1.0.1.0

Agent Home : /u01/oraem12c/agent12c/agent_inst

Agent Log Directory : /u01/oraem12c/agent12c/agent_inst/sysman/log

Agent Binaries : /u01/oraem12c/agent12c/core/12.1.0.4.0

Agent Process ID : 197589

Parent Process ID : 197468

Agent URL : https://examyservdbadm1.cris.co.in:3872/emd/main/

Local Agent URL in NAT : https://examyservdbadm1.cris.co.in:3872/emd/main/

Repository URL : https://tfoisapp1:1159/empbs/upload

Started at : 2017-03-17 13:18:09

Started by user : oraem12c

Operating System : Linux version 2.6.39-400.276.1.el6uek.x86_64 (amd64)

Last Reload : (none)

Last successful upload : 2017-04-03 14:03:14

Last attempted upload : 2017-04-03 14:03:14

Total Megabytes of XML files uploaded so far : 45.09

Number of XML files pending upload : 0

Size of XML files pending upload(MB) : 0

Available disk space on upload filesystem : 90.85%

Collection Status : Collections enabled

Heartbeat Status : Ok

Last attempted heartbeat to OMS : 2017-04-03 14:03:21

Last successful heartbeat to OMS : 2017-04-03 14:03:21

Next scheduled heartbeat to OMS : 2017-04-03 14:04:21

---------------------------------------------------------------

Agent is Running and Ready

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl stop agent

Oracle Enterprise Manager Cloud Control 12c Release 4

Stopping agent ..... stopped.

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl status agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

Agent is Not Running

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ pwd

/u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ unzip -d /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912 p22068912_121010_Generic.zip

Archive: p22068912_121010_Generic.zip

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/etc/

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/etc/config/

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/etc/config/actions.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/etc/config/inventory.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/README.html

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/dmCfgHardware.sh

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/compute_graphite_identifiers.pl

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/nimbula_test_service_post.pl

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/conditionContext.pl

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/dmGvmCfgDetails.sh

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/scripts/dmGvmLoad.sh

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/archives/

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/archives/em-vi-nimbulafetchlet-pojo.jar

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/archives/em-vi-dmfetchlet-pojo.jar

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/archives/em-vi-dmintegrationcore-pojo.jar

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_si_virtual_server.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_si_virtual_platform.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_nimbula_cluster.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_si_virtual_platform_nimbula_metrics.xmlp

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_si_server.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_si_server_nimbula_metrics.xmlp

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_nimbula_site.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/targetType/oracle_si_virtual_server_nimbula_metrics.xmlp

creating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_si_virtual_server.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_si_virtual_platform.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_nimbula_cluster.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_si_virtual_server_nimbula_collection.xmlp

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_si_server.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_si_virtual_server_direct_collection.xmlp

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/files/default_collection/oracle_nimbula_site.xml

inflating: /u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912/README.txt

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ ls -lrt

total 200

drwxr-xr-x 4 oraem12c oinstall 4096 Nov 11 2015 22068912

-rwxrwxrwx 1 oraem12c oinstall 199025 Apr 3 14:02 p22068912_121010_Generic.zip

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ cd 22068912

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ export ORACLE_HOME=/u01/oraem12c/agent12c/core/12.1.0.4.0

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ export PLUGIN_HOME=/u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ cd /u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0

[oraem12c@examyservdbadm1 oracle.sysman.vi.agent.plugin_12.1.0.1.0]$

[oraem12c@examyservdbadm1 oracle.sysman.vi.agent.plugin_12.1.0.1.0]$ ls -lrt

total 56

-rw-r--r-- 1 oraem12c oinstall 4884 Mar 14 2014 plugin_registry.xml.tpl

-rw-r--r-- 1 oraem12c oinstall 4882 May 23 2014 plugin_registry.xml

-rw-r--r-- 1 oraem12c oinstall 2776 May 23 2014 plugin.xml

-rw-r----- 1 oraem12c oinstall 56 Mar 7 2016 oraInst.loc

drwxr-xr-x 2 oraem12c oinstall 4096 Nov 7 16:51 META-INF

drwxr-xr-x 2 oraem12c oinstall 4096 Nov 7 16:51 archives

drwxr-xr-x 2 oraem12c oinstall 4096 Nov 7 16:51 scripts

drwxr-xr-x 4 oraem12c oinstall 4096 Nov 7 16:51 install

drwxr-xr-x 9 oraem12c oinstall 4096 Nov 7 16:51 inventory

drwxr-xr-x 4 oraem12c oinstall 4096 Nov 7 16:51 targetType

drwxr-xr-x 4 oraem12c oinstall 4096 Nov 8 12:06 cfgtoollogs

drwxr-xr-x 3 oraem12c oinstall 4096 Mar 25 10:01 default_collection

[oraem12c@examyservdbadm1 oracle.sysman.vi.agent.plugin_12.1.0.1.0]$

[oraem12c@examyservdbadm1 oracle.sysman.vi.agent.plugin_12.1.0.1.0]$ cd -

/u01/oraem12c/agent12c/core/12.1.0.4.0/OPatch/22068912/22068912

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ echo $PLUGIN_HOME

/u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ which opatch

/usr/bin/which: no opatch in (/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin)

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ $ORACLE_HOME/OPatch/opatch apply -oh $PLUGIN_HOME

Oracle Interim Patch Installer version 11.1.0.10.4

Oracle Home : /u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0

Central Inventory : /u01/app/oraInventory

from : /u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0/oraInst.loc

OPatch version : 11.1.0.10.4

OUI version : 11.1.0.12.0

Log file location : /u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0/cfgtoollogs/opatch/22068912_Apr_03_2017_14_05_54/apply2017-04-03_14-05-54PM_1.log

Applying interim patch '22068912' to OH '/u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0'

Verifying environment and performing prerequisite checks...

All checks passed.

Backing up files...

Patching component oracle.sysman.vi.plugin.agent, 12.1.0.1.0...

Verifying the update...

Patch 22068912 successfully applied

Log file location: /u01/oraem12c/agent12c/plugins/oracle.sysman.vi.agent.plugin_12.1.0.1.0/cfgtoollogs/opatch/22068912_Apr_03_2017_14_05_54/apply2017-04-03_14-05-54PM_1.log

OPatch succeeded.

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl start agent

Oracle Enterprise Manager Cloud Control 12c Release 4

Starting agent .................. started.

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl status agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

Agent Version : 12.1.0.4.0

OMS Version : (unknown)

Protocol Version : 12.1.0.1.0

Agent Home : /u01/oraem12c/agent12c/agent_inst

Agent Log Directory : /u01/oraem12c/agent12c/agent_inst/sysman/log

Agent Binaries : /u01/oraem12c/agent12c/core/12.1.0.4.0

Agent Process ID : 377118

Parent Process ID : 377003

Agent URL : https://examyservdbadm1.cris.co.in:3872/emd/main/

Local Agent URL in NAT : https://examyservdbadm1.cris.co.in:3872/emd/main/

Repository URL : https://tfoisapp1:1159/empbs/upload

Started at : 2017-04-03 14:06:47

Started by user : oraem12c

Operating System : Linux version 2.6.39-400.276.1.el6uek.x86_64 (amd64)

Last Reload : (none)

Last successful upload : (none)

Last attempted upload : (none)

Total Megabytes of XML files uploaded so far : 0

Number of XML files pending upload : 26

Size of XML files pending upload(MB) : 0.05

Available disk space on upload filesystem : 90.85%

Collection Status : Collections enabled

Heartbeat Status : OMS responded illegally [ERROR- Failed to update Target type Metadata]

Last attempted heartbeat to OMS : 2017-04-03 14:07:09

Last successful heartbeat to OMS : (none)

Next scheduled heartbeat to OMS : 2017-04-03 14:07:39

---------------------------------------------------------------

Agent is Running and Ready

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl status agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

Agent Version : 12.1.0.4.0

OMS Version : (unknown)

Protocol Version : 12.1.0.1.0

Agent Home : /u01/oraem12c/agent12c/agent_inst

Agent Log Directory : /u01/oraem12c/agent12c/agent_inst/sysman/log

Agent Binaries : /u01/oraem12c/agent12c/core/12.1.0.4.0

Agent Process ID : 377118

Parent Process ID : 377003

Agent URL : https://examyservdbadm1.cris.co.in:3872/emd/main/

Local Agent URL in NAT : https://examyservdbadm1.cris.co.in:3872/emd/main/

Repository URL : https://tfoisapp1:1159/empbs/upload

Started at : 2017-04-03 14:06:47

Started by user : oraem12c

Operating System : Linux version 2.6.39-400.276.1.el6uek.x86_64 (amd64)

Last Reload : (none)

Last successful upload : (none)

Last attempted upload : (none)

Total Megabytes of XML files uploaded so far : 0

Number of XML files pending upload : 27

Size of XML files pending upload(MB) : 0.05

Available disk space on upload filesystem : 90.85%

Collection Status : Collections enabled

Heartbeat Status : OMS responded illegally [ERROR- Failed to update Target type Metadata]

Last attempted heartbeat to OMS : 2017-04-03 14:07:28

Last successful heartbeat to OMS : (none)

Next scheduled heartbeat to OMS : 2017-04-03 14:07:58

---------------------------------------------------------------

Agent is Running and Ready

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl upload agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

EMD upload error:full upload has failed: uploadXMLFiles skipped :: OMS version not checked yet. If this issue persists check trace files for ping to OMS related errors. (OMS_DOWN)

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl status agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

Agent Version : 12.1.0.4.0

OMS Version : (unknown)

Protocol Version : 12.1.0.1.0

Agent Home : /u01/oraem12c/agent12c/agent_inst

Agent Log Directory : /u01/oraem12c/agent12c/agent_inst/sysman/log

Agent Binaries : /u01/oraem12c/agent12c/core/12.1.0.4.0

Agent Process ID : 377118

Parent Process ID : 377003

Agent URL : https://examyservdbadm1.cris.co.in:3872/emd/main/

Local Agent URL in NAT : https://examyservdbadm1.cris.co.in:3872/emd/main/

Repository URL : https://tfoisapp1:1159/empbs/upload

Started at : 2017-04-03 14:06:47

Started by user : oraem12c

Operating System : Linux version 2.6.39-400.276.1.el6uek.x86_64 (amd64)

Last Reload : (none)

Last successful upload : (none)

Last attempted upload : (none)

Total Megabytes of XML files uploaded so far : 0

Number of XML files pending upload : 33

Size of XML files pending upload(MB) : 0.06

Available disk space on upload filesystem : 90.85%

Collection Status : Collections enabled

Heartbeat Status : OMS responded illegally [ERROR- Failed to update Target type Metadata]

Last attempted heartbeat to OMS : 2017-04-03 14:08:09

Last successful heartbeat to OMS : (none)

Next scheduled heartbeat to OMS : 2017-04-03 14:08:39

---------------------------------------------------------------

Agent is Running and Ready

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$ /u01/oraem12c/agent12c/agent_inst/bin/emctl status agent

Oracle Enterprise Manager Cloud Control 12c Release 4

---------------------------------------------------------------

Agent Version : 12.1.0.4.0

OMS Version : (unknown)

Protocol Version : 12.1.0.1.0

Agent Home : /u01/oraem12c/agent12c/agent_inst

Agent Log Directory : /u01/oraem12c/agent12c/agent_inst/sysman/log

Agent Binaries : /u01/oraem12c/agent12c/core/12.1.0.4.0

Agent Process ID : 377118

Parent Process ID : 377003

Agent URL : https://examyservdbadm1.cris.co.in:3872/emd/main/

Local Agent URL in NAT : https://examyservdbadm1.cris.co.in:3872/emd/main/

Repository URL : https://tfoisapp1:1159/empbs/upload

Started at : 2017-04-03 14:06:47

Started by user : oraem12c

Operating System : Linux version 2.6.39-400.276.1.el6uek.x86_64 (amd64)

Last Reload : (none)

Last successful upload : (none)

Last attempted upload : (none)

Total Megabytes of XML files uploaded so far : 0

Number of XML files pending upload : 40

Size of XML files pending upload(MB) : 0.06

Available disk space on upload filesystem : 90.85%

Collection Status : Collections enabled

Heartbeat Status : OMS responded illegally [ERROR- Failed to update Target type Metadata]

Last attempted heartbeat to OMS : 2017-04-03 14:09:48

Last successful heartbeat to OMS : (none)

Next scheduled heartbeat to OMS : 2017-04-03 14:10:18

---------------------------------------------------------------

Agent is Running and Ready

[oraem12c@examyservdbadm1 22068912]$

[oraem12c@examyservdbadm1 22068912]$

After applying the patch we are unable to push the data to OMS, so we need to rollback the patch.

Please follow below link to check the steps to rollback the patch 22068912.
http://sunoracleworld.blogspot.com/2017/04/how-to-rollback-patch-from-em.html

Heartbeat Status : OMS responded illegally [ERROR- Failed to update Target type
This is known error after applying patch on EM agent, we need to apply pre requisite patch om OMS first, so please follow above steps to rollback EM patch first then apply patch 22135501 on OMS. then again you can apply the patch 22068912 on EM agent again.

Please check below link to check how to apply prerequisite patch on OMS HOME.
http://sunoracleworld.blogspot.com/2017/04/how-to-apply-patch-on-oms-home.html

I hope this exercise will help you.

Thank you!!!!!!!

SUN ORACLEWORLD

Search In The Blog

Tuesday 4 April 2017

How to apply patch on EM management agent 12c

How to apply patch on EM management agent 12c

No comments:

Post a Comment

Contact Me for Remote Support +91-8983023456

Search In The Blog

Tuesday 4 April 2017

How to apply patch on EM management agent 12c

How to apply patch on EM management agent 12c

No comments:

Post a Comment

Contact Me for Remote Support +91-8983023456

Subscribe To