Automatic Error Log Analysis sending too many emails

Latest response

I am receiving constant notifications from RHEL 6.3 servers :


Automatic Error Log Analysis has detected a problem.

The Service Request Number(s)/Probable Cause(s)
(causes are listed in descending order of probability):

651301

Platform Firmware Miscellaneous, Information Only.

Received EPOW action code reset (no action)

Additional words 2-00000000 3-00000000 4-00000000 5-00000000
6-00000000 7-00000000 8-00000000 9-00000000

Reference: servicelog event number 36, platform log event number 45
Run "/usr/bin/servicelog --query="id=36" " for full details.
This message is logged to /var/log/platform.

I have tried investigating the Automatic Bug Reporting Tool but there aren't any errors in the abrt-db

Can anyone help pinpoint what service sends these notifications and how to acknowledge this one? It was likely caused by some power/generator maintenance we had in the building recently. The server was on during the maintenance but failed over to a backup power unit and these emails started on the same date. (currently up to 1500 emails in a few days.......)

Responses

"Automatic Error Log Analysis" appears to be some third-party software. "servicelog", on the other hand, is part of the distribution (for PowerPC systems only), but it doesn't have a cron job or anything that would send e-mails.

Is this the software in question? http://www-01.ibm.com/support/knowledgecenter/ssw_aix_53/com.ibm.aix.diagnostic/doc/diagunsd/Feature_Diagela.htm%23feature_diagela

I ran across the 'Diagela' in my initial troubleshooting, but i do not see any of the associated directories on the server. Probably because it's primarily an AIX feature and not for RHEL. I'll ask my team about any third party software since I am new to the environment but hopefully someone will comment who has seen this log before.

I would try running "locate -i diagela" to see if there are any executables and related files with this name.

Nothing was found

That's weird. Do the headers of the e-mails contain any clues as to what generates them?

I would enable audit on either the binary or one of the config files for email on your system (enable audit for file access)
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Security_Guide/chap-system_auditing.html

With our Dell systems there is a configurable that we modify to tell it to call another script. Unfortunately I have no experience with your hardware or Diagela

Although the following is focused on AIX, it might provide some insight.
http://www-01.ibm.com/support/knowledgecenter/ssw_aix_53/com.ibm.aix.diagnostic/doc/diagunsd/Feature_Diagela.htm%23feature_diagela

I would try

# egrep -R 'customer_notify|diagela' /etc/ 
# lsof | grep -i diagela

to see if you can find a config file that might indicate what is being called (and possibly a "log level")?

EDIT: this might be a good place to start looking too (not power supply specific, but does talk about diagela)
http://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7ham/scsidiskdriveenclosurelinux.htm?cp=8231-E1C

Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.