Monitoring Probes status is showing "Pending" on satellite WebUI and it is not getting updated.

Solution Verified - Updated -

Environment

  • Red Hat Network Satellite version 5.3 or earlier

Issue

  • All Monitoring probes on satellite server show probe status as pending and never changes.

Resolution

  • Remove any files from /home/nocpulse/var/ProbeState that are 0 bytes in size, then push the monitoring scout config and restart Satellite services:

    • Go to the Satellite web UI.
    • Go to the Monitoring tab.
    • Click on "Scout Config Push".
    • Select the checkbox next to the scout name "RHN Satellite Monitoring Scout"  then click on "Push Scout Configs".
    • Finally, restart Satellite services:

      # service rhn-satellite restart
      
  • The underlying cause has been resolved as of Satellite version 5.3.RHEA-2009:1434

Root Cause

  • Some of the probe state files in /home/nocpulse/var/ProbeState were truncated to 0 bytes, and monitoring stops processing when it encounters these files.

Diagnostic Steps

  • Review /var/log/nocpulse/kernel-error.log from the Satellite server, and look for the following kinds of errors:

    2010-05-19 13:02:06 Event terminated abnormally
    NOCpulse::Probe::InternalError: Cannot read /home/nocpulse/var/ProbeState/state.3230:   /usr/lib/perl5/site_perl/5.8.5/NOCpulse/Probe/PriorState.pm line 132
            called from /usr/lib/perl5/site_perl/5.8.5/NOCpulse/Probe/PriorState.pm line 179
            called from /usr/lib/perl5/site_perl/5.8.5/NOCpulse/Scheduler/Event/ProbeEvent.pm line 66
            called from /usr/lib/perl5/site_perl/5.8.5/NOCpulse/Scheduler/Event/ProbeEvent.pm line 51
            called from /home/nocpulse/bin/kernel.pl line 297
            called from /home/nocpulse/bin/kernel.pl line 141
    

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.