Satellite 6: A backend service [ Candlepin ] is unreachable

Issue

• Candlepin service fails randomly on the Satellite server. Restarting the service may only fix the issue temporarily.

  # foreman-maintain service status
  / displaying tomcat                                                             
  * tomcat.service - Apache Tomcat Web Application Container
    Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled)
    Active: failed (Result: signal) since Mon 2022-05-23 04:04:43 CDT; 5h 17min ago
   Process: 111183 ExecStart=/usr/libexec/tomcat/server start (code=killed, signal=KILL)
  Main PID: 111183 (code=killed, signal=KILL)
  
  May 17 04:01:23 satellite.example.com server[111183]: WARNING: Method [public void   org.candlepin.model.EntitlementCertificateCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being  intercepted by [com.google.inject.persist.jpa.JpaLocalTxnInterceptor@26aeb092]. This could indicate a bug.  The method may be intercepted twice, or may not be intercepted at all.
  May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.catalina.startup.HostConfig deployDirectory
  May 17 04:01:42 satellite.example.com server[111183]: INFO: Deployment of web application directory /var/lib/tomcat/webapps/candlepin has finished in 27,059 ms
  May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.coyote.AbstractProtocol start
  May 17 04:01:42 satellite.example.com server[111183]: INFO: Starting ProtocolHandler ["http-bio-127.0.0.1-23443"]
  May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.catalina.startup.Catalina start
  May 17 04:01:42 satellite.example.com server[111183]: INFO: Server startup in 27105 ms
  May 23 04:04:43 satellite.example.com systemd[1]: tomcat.service: main process exited, code=killed, status=9/KILL
  May 23 04:04:43 satellite.example.com systemd[1]: Unit tomcat.service entered failed state.
  May 23 04:04:43 satellite.example.com systemd[1]: tomcat.service failed.
  .
  .
  .
  / All services displayed                                              [FAIL]    
  Some services are not running (tomcat)
  Scenario [Status Services] failed.