Satellite 6: A backend service [ Candlepin ] is unreachable

Solution Verified - Updated -

Issue

  • Candlepin service fails randomly on the Satellite server
# foreman-maintain service status
/ displaying tomcat                                                             
* tomcat.service - Apache Tomcat Web Application Container
   Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled)
   Active: failed (Result: signal) since Mon 2022-05-23 04:04:43 CDT; 5h 17min ago
  Process: 111183 ExecStart=/usr/libexec/tomcat/server start (code=killed, signal=KILL)
 Main PID: 111183 (code=killed, signal=KILL)

May 17 04:01:23 satellite.example.com server[111183]: WARNING: Method [public void org.candlepin.model.EntitlementCertificateCurator.delete(org.candlepin.model.Persisted)] is synthetic and is being intercepted by [com.google.inject.persist.jpa.JpaLocalTxnInterceptor@26aeb092]. This could indicate a bug.  The method may be intercepted twice, or may not be intercepted at all.
May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.catalina.startup.HostConfig deployDirectory
May 17 04:01:42 satellite.example.com server[111183]: INFO: Deployment of web application directory /var/lib/tomcat/webapps/candlepin has finished in 27,059 ms
May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.coyote.AbstractProtocol start
May 17 04:01:42 satellite.example.com server[111183]: INFO: Starting ProtocolHandler ["http-bio-127.0.0.1-23443"]
May 17 04:01:42 satellite.example.com server[111183]: May 17, 2022 4:01:42 AM org.apache.catalina.startup.Catalina start
May 17 04:01:42 satellite.example.com server[111183]: INFO: Server startup in 27105 ms
May 23 04:04:43 satellite.example.com systemd[1]: tomcat.service: main process exited, code=killed, status=9/KILL
May 23 04:04:43 satellite.example.com systemd[1]: Unit tomcat.service entered failed state.
May 23 04:04:43 satellite.example.com systemd[1]: tomcat.service failed.
.
.
.
/ All services displayed                                              [FAIL]    
Some services are not running (tomcat)
Scenario [Status Services] failed.

Environment

  • Red Hat Satellite 6.9
  • Red Hat Satellite 6.10

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content