Satellite 6: A backend service [ Candlepin ] is unreachable
Issue
- Candlepin service fails randomly on the Satellite server
# foreman-maintain service status
/ displaying tomcat
* tomcat.service - Apache Tomcat Web Application Container
Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled)
Active: failed (Result: signal) since Mon 2022-05-23 04:04:43 CDT; 5h 17min ago
Process: 111183 ExecStart=/usr/libexec/tomcat/server start (code=killed, signal=KILL)
Main PID: 111183 (code=killed, signal=KILL)
May 17 04:01:23 satellite.example.com server[111183]: WARNING: Method [public void org.candlepin.model.EntitlementCertificateCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [com.google.inject.persist.jpa.JpaLocalTxnInterceptor@26aeb092]. This could indicate a bug. The method may be intercepted twice, or may not be intercepted at all.
May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.catalina.startup.HostConfig deployDirectory
May 17 04:01:42 satellite.example.com server[111183]: INFO: Deployment of web application directory /var/lib/tomcat/webapps/candlepin has finished in 27,059 ms
May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.coyote.AbstractProtocol start
May 17 04:01:42 satellite.example.com server[111183]: INFO: Starting ProtocolHandler ["http-bio-127.0.0.1-23443"]
May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.catalina.startup.Catalina start
May 17 04:01:42 satellite.example.com server[111183]: INFO: Server startup in 27105 ms
May 23 04:04:43 satellite.example.com systemd[1]: tomcat.service: main process exited, code=killed, status=9/KILL
May 23 04:04:43 satellite.example.com systemd[1]: Unit tomcat.service entered failed state.
May 23 04:04:43 satellite.example.com systemd[1]: tomcat.service failed.
.
.
.
/ All services displayed [FAIL]
Some services are not running (tomcat)
Scenario [Status Services] failed.
Environment
- Red Hat Satellite 6.9
- Red Hat Satellite 6.10
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.