Keystone unable to respond between 2 and 4 o'clock

Issue

• haproxy detect that no keystone serveur was available

• apache say that wsgi is not responding

• We noticed the following in /var/log/containers/httpd/keystone/keystone_wsgi_error_ssl.log:

[Mon Sep 25 02:02:16.666370 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib/python3.6/site-packages/keystone/identity/backends/ldap/common.py", line 1048, in _paged_search_s
[Mon Sep 25 02:02:16.666372 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     rtype, rdata, rmsgid, serverctrls = self.conn.result3(message)
[Mon Sep 25 02:02:16.666379 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib/python3.6/site-packages/keystone/identity/backends/ldap/common.py", line 873, in result3
[Mon Sep 25 02:02:16.666381 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     results = message.connection.result3(message.id, all, timeout)
[Mon Sep 25 02:02:16.666384 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib64/python3.6/site-packages/ldap/ldapobject.py", line 767, in result3
[Mon Sep 25 02:02:16.666388 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     resp_ctrl_classes=resp_ctrl_classes
[Mon Sep 25 02:02:16.666392 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib64/python3.6/site-packages/ldap/ldapobject.py", line 774, in result4
[Mon Sep 25 02:02:16.666394 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     ldap_result = self._ldap_call(self._l.result4,msgid,all,timeout,add_ctrls,add_intermediates,add_extop)
[Mon Sep 25 02:02:16.666397 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib64/python3.6/site-packages/ldap/ldapobject.py", line 340, in _ldap_call
[Mon Sep 25 02:02:16.666399 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     reraise(exc_type, exc_value, exc_traceback)
[Mon Sep 25 02:02:16.666402 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib64/python3.6/site-packages/ldap/compat.py", line 46, in reraise
[Mon Sep 25 02:02:16.666404 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     raise exc_value
[Mon Sep 25 02:02:16.666407 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]   File "/usr/lib64/python3.6/site-packages/ldap/ldapobject.py", line 324, in _ldap_call
[Mon Sep 25 02:02:16.666409 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036]     result = func(*args,**kwargs)
[Mon Sep 25 02:02:16.666437 2023] [wsgi:error] [pid 28] [remote 10.10.10.10:40036] ldap.TIMEOUT


...

[Mon Sep 25 02:28:17.986285 2023] [wsgi:error] [pid 714] (11)Resource temporarily unavailable: [client 10.10.10.10:60426] mod_wsgi (pid=714): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:18.001496 2023] [wsgi:error] [pid 715] (11)Resource temporarily unavailable: [client 10.10.10.10:60436] mod_wsgi (pid=715): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:18.187572 2023] [wsgi:error] [pid 710] (11)Resource temporarily unavailable: [client 10.10.10.10:60450] mod_wsgi (pid=710): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:18.189471 2023] [wsgi:error] [pid 713] (11)Resource temporarily unavailable: [client 10.10.10.10:60452] mod_wsgi (pid=713): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:18.327564 2023] [wsgi:error] [pid 716] (11)Resource temporarily unavailable: [client 10.10.10.11:56874] mod_wsgi (pid=716): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:18.364468 2023] [wsgi:error] [pid 718] (11)Resource temporarily unavailable: [client 10.10.10.11:56878] mod_wsgi (pid=718): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:18.830478 2023] [wsgi:error] [pid 250] (11)Resource temporarily unavailable: [client 10.10.10.11:56890] mod_wsgi (pid=250): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.
[Mon Sep 25 02:28:19.207014 2023] [wsgi:error] [pid 273] (11)Resource temporarily unavailable: [client 10.10.10.10:60464] mod_wsgi (pid=273): Unable to connect to WSGI daemon process 'keystone' on '/var/run/wsgi.8.0.1.sock' after multiple
 attempts as listener backlog limit was exceeded or the socket does not exist.