Rsyslog stopped working after Ansible Automation Platform 2.4 upgrade/install

Solution Verified - Updated -

Environment

  • Ansible Automation Platform 2.4.

Issue

  • After Ansible Automation Platform 2.4 upgrade/install, the Rsyslog services stopped working and remains stopped.

Resolution

  • Edit the configuration file /etc/supervisord.d/tower.ini and add the user = awx to the startup from awx-rsyslog-configurer.

    # vi /etc/supervisord.d/tower.ini
...
[program:awx-rsyslog-configurer]
command = awx-manage run_rsyslog_configurer
user = awx
...

  • Restart the Ansible Automation Platform services.

    # automation-controller-service restart

Root Cause

  • The service awx-rsyslog-configurer is configured to start with the root user leading to permission denied for the service awx-rsyslogd .
  • The issue has been permanently fixed in AAP setup bundle 2.4-2

Diagnostic Steps

  • Validate the Syslog services from Automation Controller.

    $ supervisorctl status
master-event-listener                    RUNNING   pid 2804418, uptime 0:03:36
tower-processes:awx-callback-receiver    RUNNING   pid 2804420, uptime 0:03:36
tower-processes:awx-daphne               RUNNING   pid 2804422, uptime 0:03:36
tower-processes:awx-dispatcher           RUNNING   pid 2804419, uptime 0:03:36
tower-processes:awx-rsyslog-configurer   RUNNING   pid 2804425, uptime 0:03:36
tower-processes:awx-rsyslogd             BACKOFF   Exited too quickly (process log may have details)
tower-processes:awx-uwsgi                RUNNING   pid 2804421, uptime 0:03:36
tower-processes:awx-ws-heartbeat         RUNNING   pid 2804426, uptime 0:03:36
tower-processes:awx-wsrelay              RUNNING   pid 2804423, uptime 0:03:36

  • Double-check the rsyslog.conf permissions:

    # ls -al /var/lib/awx/rsyslog/rsyslog.conf
-rw-r-----. 1 root root 486 Jun 27 17:39 /var/lib/awx/rsyslog/rsyslog.conf

    Note: If owned by root, the issue is present in your environment.

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments