Elasticsearch pod runs after install but service unavailable due to missing PVC on glusterfs

Solution Verified - Updated -

Issue

  • After installation, the logging components come online but Elasticsearch isn't available. Side effects could include curator restarts:

    # oc get pods
    NAME                                      READY     STATUS    RESTARTS   AGE
    logging-curator-1-kp7mm                   1/1       Running   5          9m
    logging-es-data-master-9orxtgi1-3-8x6wf   2/2       Running   0          4m
    
    # oc logs logging-curator-1-kp7mm
    Was not able to connect to Elasticearch at logging-es:9200 within 60 attempts
    
  • In addition, the container log indicates problems with Elasticsearch starting:

    # oc logs -c elasticsearch logging-es-data-master-9orxtgi1-3-8x6wf
    ...
    Contacting elasticsearch cluster 'elasticsearch' and wait for YELLOW clusterstate ...
    ERR: Timed out while waiting for a green or yellow cluster state.
       * Try running sgadmin.sh with -icl and -nhnv (If thats works you need to check your clustername as well as hostnames in your SSL certificates)
    0
    [2018-04-06 12:36:35,671][WARN ][container.run            ] Error seeding the searchguard ACL index... retrying in 10 seconds - 0 retries so far
    [2018-04-06 12:36:35,671][WARN ][container.run            ] Seeding will continue to fail until the cluster status is YELLOW
    [2018-04-06 12:36:35,793][INFO ][container.run            ] Remaining red indices: 1
    ...
    

Environment

OpenShift Container Platform 3.9

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content