A mod_cluster worker has -1 load factor although JBoss is sending postive load in its STATUS MCMPs

Solution Verified - Updated -

Issue

  • We restart httpd and start seeing 503s at random for requests to some nodes.
  • The request looks to be failing because the balancer's workers have -1 load. We checked the STATUS requests and JBoss is sending positive load through MCMP and the STATUS requests succeed with a 200.
  • We note that pings are failing to some other destination not served by mod_cluster in the midst of the STATUS handling:
[Thu Aug 08 03:03:33 2013] [debug] mod_manager.c(1442): manager_trans STATUS (/)
[Thu Aug 08 03:03:33 2013] [debug] mod_manager.c(1957): manager_handler STATUS (/) processing: "JVMRoute=node1&Load=91"
[Thu Aug 08 03:03:33 2013] [debug] proxy_util.c(2011): proxy: http: has acquired connection for (www.nonmodclustersite.com)
[Thu Aug 08 03:03:33 2013] [debug] proxy_util.c(2067): proxy: connecting http://www.nonmodclustersite.com:80/ to www.nonmodclustersite.com:80
[Thu Aug 08 03:03:33 2013] [debug] proxy_util.c(2193): proxy: connected http://www.nonmodclustersite.com:80/ to www.nonmodclustersite.com:80
[Thu Aug 08 03:03:33 2013] [debug] proxy_util.c(2444): proxy: http: fam 2 socket created to connect to www.nonmodclustersite.com
[Thu Aug 08 03:03:33 2013] [error] (111)Connection refused: proxy: http: attempt to connect to 127.0.0.1:80 (www.nonmodclustersite.com) failed
[Thu Aug 08 03:03:33 2013] [error] ap_proxy_connect_backend disabling worker for (www.nonmodclustersite.com
[Thu Aug 08 03:03:33 2013] [debug] mod_proxy_cluster.c(1422): proxy_cluster_try_pingpong: can't connect to backend
[Thu Aug 08 03:03:33 2013] [debug] proxy_util.c(2029): proxy: http: has released connection for (www.nonmodclustersite.com)
[Thu Aug 08 03:03:33 2013] [debug] mod_proxy_cluster.c(1496): proxy_cluster_isup: pingpong failed
[Thu Aug 08 03:03:33 2013] [debug] mod_manager.c(1998): manager_handler STATUS  OK
  • The ping appears to be failing to some other proxy destination we have configured:
ProxyPass /app balancer://mycluster/app stickysessions=JSESSIONID|jsessionid nofailover=On
ProxyPass /other http://www.nonmodclustersite.com/other

Environment

  • JBoss Enterprise Application Platform (EAP) 5.1.2
  • JBoss Enterprise Web Server (EWS)
    • Apache httpd
  • mod_cluster 1.0.10.GA_CP02

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content