Ansible Automation Platform EDA controller fails to create project with "Gateway Timeout" Error

Solution Verified - Updated -

Environment

  • Red Hat Ansible Automation Platform 2.5

Issue

  • Ansible Automation Platform 2.5 EDA controller fails to create project with "Gateway Timeout" Error

Resolution

  • Ensure that the Event Driven node can access 6379/tcp port on the Platform Gateway server. i.e. firewalld port 6379/tcp or service redis should be enabled on the Platform gateway instance.

Root Cause

  • The redis connectivity to platform gateway instance from EDA is restricted. Check with internal networking team in order to make this connection happen.

    [root@automationeda ~]# nc -zv <platform_gateway> 6379
Ncat: Version 7.70 ( https://nmap.org/ncat )
Ncat: Connection timed out.

[root@automationeda ~]# telnet <platform_gateway> 6379
Trying 10.xx.xx.xx...
^C

Diagnostic Steps

  • The following error can be observed at /var/log/ansible-automation-platform/eda/default-worker.log at EDA Controller instance:

    Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/django/core/management/__init__.py", line 436, in execute
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    self.fetch_command(subcommand).run_from_argv(self.argv)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/django/core/management/base.py", line 412, in run_from_argv
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    self.execute(*args, **cmd_options)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/django/core/management/base.py", line 458, in execute
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    output = self.handle(*args, **options)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/django_rq/management/commands/rqworker.py", line 123, in handle
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    w = get_worker(*args, **worker_kwargs)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/django_rq/workers.py", line 50, in get_worker
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    return worker_class(
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:           ^^^^^^^^^^^^^
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/aap_eda/core/tasking/__init__.py", line 529, in __init__
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    super().__init__(
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/aap_eda/core/tasking/__init__.py", line 364, in __init__
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    super().__init__(
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/rq/worker.py", line 290, in __init__
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    connection.client_setname(self.name)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/redis/commands/core.py", line 707, in client_setname
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    return self.execute_command("CLIENT SETNAME", name, **kwargs)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:           
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/redis/client.py", line 1266, in execute_command
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    conn = self.connection or pool.get_connection(command_name, **options)
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:                              
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/redis/connection.py", line 1461, in get_connection
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    connection.connect()
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:  File "/usr/lib/python3.11/site-packages/redis/connection.py", line 711, in connect
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]:    raise TimeoutError("Timeout connecting to server")
Feb  4 02:05:51 automationeda automation-eda-controller-worker-0[234013]: redis.exceptions.TimeoutError: Timeout connecting to server

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments