Openshift 4.4 elasticsearch-cdm container status is CrashLoopBackOff. what should i do?

Latest response

there was an error building elasticsearch operator in Disconnected Openshift 4.4 environment. EFK stack is configured through operator.

The kibana and the fluid pod appeared normally on the openshift-logging namespace.
However, the elastixsearch container does not appear in the containers in the elasticsearch-cdm pod

oc get nodes

[root@bastion ~]# oc get nodes
NAME                           STATUS   ROLES    AGE   VERSION
infra-1.redhat2.cccr.local     Ready    infra    12d   v1.17.1+20ba474
infra-2.redhat2.cccr.local     Ready    infra    14d   v1.17.1+20ba474
master-1.redhat2.cccr.local    Ready    master   14d   v1.17.1+20ba474
master-2.redhat2.cccr.local    Ready    master   14d   v1.17.1+20ba474
master-3.redhat2.cccr.local    Ready    master   14d   v1.17.1+20ba474
router.redhat2.cccr.local      Ready    router   14d   v1.17.1+20ba474
service-1.redhat2.cccr.local   Ready    worker   14d   v1.17.1+20ba474
service-2.redhat2.cccr.local   Ready    worker   14d   v1.17.1+20ba474

oc get pods -n openshift-logging
Here is main problem. Container does not made.

NAME                                            READY   STATUS             RESTARTS   AGE
cluster-logging-operator-6f958b4644-rl66q       1/1     Running            0          17m
elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8   1/2     CrashLoopBackOff   9          25m
fluentd-7bwk7                                   1/1     Running            0          126m
fluentd-dmdt7                                   1/1     Running            0          126m
fluentd-fbwfj                                   1/1     Running            0          126m
fluentd-g8mdr                                   1/1     Running            0          126m
fluentd-h8zt4                                   1/1     Running            0          126m
fluentd-hft8t                                   1/1     Running            0          126m
fluentd-m5bqn                                   1/1     Running            0          126m
fluentd-ttg66                                   1/1     Running            0          126m
kibana-855896dbcb-pcz7t                         2/2     Running            0          126m

oc get csv -A

[root@bastion ~]# oc get csv -A
NAMESPACE                                               NAME                                           DISPLAY                  VERSION                 REPLACES   PHASE
default                                                 elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
kube-node-lease                                         elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
kube-public                                             elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
kube-system                                             elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
logs                                                    elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-apiserver-operator                            elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-apiserver                                     elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-authentication-operator                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-authentication                                elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-cloud-credential-operator                     elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-cluster-machine-approver                      elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-cluster-node-tuning-operator                  elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-cluster-samples-operator                      elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-cluster-storage-operator                      elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-cluster-version                               elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-config-managed                                elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-config                                        elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-console-operator                              elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-console                                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-controller-manager-operator                   elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-controller-manager                            elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-dns-operator                                  elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-dns                                           elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-etcd-operator                                 elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-etcd                                          elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-image-registry                                elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-infra                                         elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-ingress-operator                              elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-ingress                                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-insights                                      elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kni-infra                                     elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-apiserver-operator                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-apiserver                                elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-controller-manager-operator              elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-controller-manager                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-scheduler-operator                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-scheduler                                elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-storage-version-migrator-operator        elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-kube-storage-version-migrator                 elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-logging                                       clusterlogging.4.4.0-202009161309.p0           Cluster Logging          4.4.0-202009161309.p0              Succeeded
openshift-logging                                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-machine-api                                   elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-machine-config-operator                       elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-marketplace                                   elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-monitoring                                    elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-multus                                        elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-network-operator                              elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-node                                          elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-openstack-infra                               elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-operator-lifecycle-manager                    elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-operator-lifecycle-manager                    packageserver                                  Package Server           0.14.2                             Succeeded
openshift-operators-redhat                              elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-operators                                     elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-ovirt-infra                                   elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-sdn                                           elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-service-ca-operator                           elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-service-ca                                    elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-service-catalog-apiserver-operator            elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-service-catalog-controller-manager-operator   elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-user-workload-monitoring                      elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift-vsphere-infra                                 elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded
openshift                                               elasticsearch-operator.4.4.0-202009161309.p0   Elasticsearch Operator   4.4.0-202009161309.p0              Succeeded

oc describe pods -n openshift-logging elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8

[root@bastion ~]# oc describe pods -n openshift-logging elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8
Name:         elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8
Namespace:    openshift-logging
Priority:     0
Node:         infra-1.redhat2.cccr.local/10.10.10.14
Start Time:   Thu, 08 Oct 2020 11:59:22 +0000
Labels:       cluster-name=elasticsearch
              component=elasticsearch
              es-node-client=true
              es-node-data=true
              es-node-master=true
              node-name=elasticsearch-cdm-5w0ajql9-1
              pod-template-hash=5f59bbdd67
              tuned.openshift.io/elasticsearch=true
Annotations:  k8s.v1.cni.cncf.io/networks-status:
                [{
                    "name": "openshift-sdn",
                    "interface": "eth0",
                    "ips": [
                        "10.1.7.21"
                    ],
                    "dns": {},
                    "default-route": [
                        "10.1.7.1"
                    ]
                }]
              openshift.io/scc: restricted
Status:       Running
IP:           10.1.7.21
IPs:
  IP:           10.1.7.21
Controlled By:  ReplicaSet/elasticsearch-cdm-5w0ajql9-1-5f59bbdd67
Containers:
  elasticsearch:
    Container ID:   cri-o://6600e54d852ca0b5890fc1a13cfbe47c1b02566379a1444f804bf4c8f9b52b42
    Image:          bastion.redhat2.cccr.local:5000/openshift4/ose-logging-elasticsearch5@sha256:b6689627201fb7f370caa96c5961150b37aff16bc8c3b77ad7b61c68ccb541a9
    Image ID:       bastion.redhat2.cccr.local:5000/openshift4/ose-logging-elasticsearch5@sha256:304982bc9616c0589fc680c2900977cafc5aa0acebfbf2e6c3a154d31e57d4af
    Ports:          9300/TCP, 9200/TCP
    Host Ports:     0/TCP, 0/TCP
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Thu, 08 Oct 2020 12:31:59 +0000
      Finished:     Thu, 08 Oct 2020 12:32:05 +0000
    Ready:          False
    Restart Count:  11
    Limits:
      memory:  1Gi
    Requests:
      cpu:      500m
      memory:   1Gi
    Readiness:  exec [/usr/share/elasticsearch/probe/readiness.sh] delay=10s timeout=30s period=5s #success=1 #failure=3
    Environment:
      DC_NAME:                  elasticsearch-cdm-5w0ajql9-1
      NAMESPACE:                openshift-logging (v1:metadata.namespace)
      POD_IP:                    (v1:status.podIP)
      KUBERNETES_MASTER:        https://kubernetes.default.svc
      KUBERNETES_TRUST_CERT:    true
      SERVICE_DNS:              elasticsearch-cluster
      CLUSTER_NAME:             elasticsearch
      INSTANCE_RAM:             1Gi
      HEAP_DUMP_LOCATION:       /elasticsearch/persistent/heapdump.hprof
      RECOVER_AFTER_TIME:       5m
      READINESS_PROBE_TIMEOUT:  30
      POD_LABEL:                cluster=elasticsearch
      IS_MASTER:                true
      HAS_DATA:                 true
    Mounts:
      /elasticsearch/persistent from elasticsearch-storage (rw)
      /etc/openshift/elasticsearch/secret from certificates (rw)
      /usr/share/java/elasticsearch/config from elasticsearch-config (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from elasticsearch-token-qchdq (ro)
  proxy:
    Container ID:  cri-o://5b11992c86c799c030e0d87fb874ac885645577af621fc6445d295e400702627
    Image:         bastion.redhat2.cccr.local:5000/openshift4/ose-oauth-proxy@sha256:1f8a1818480230eb6f2b9c46e330cbc270771530c8d68e71ca882706c5d33ca1
    Image ID:      bastion.redhat2.cccr.local:5000/openshift4/ose-oauth-proxy@sha256:1f8a1818480230eb6f2b9c46e330cbc270771530c8d68e71ca882706c5d33ca1
    Port:          60000/TCP
    Host Port:     0/TCP
    Args:
      --http-address=:4180
      --https-address=:60000
      --provider=openshift
      --upstream=https://localhost:9200
      --tls-cert=/etc/proxy/secrets/tls.crt
      --tls-key=/etc/proxy/secrets/tls.key
      --upstream-ca=/etc/proxy/elasticsearch/admin-ca
      --openshift-service-account=elasticsearch
      -openshift-sar={"resource": "namespaces", "verb": "get"}
      -openshift-delegate-urls={"/": {"resource": "namespaces", "verb": "get"}}
      --pass-user-bearer-token
      --cookie-secret=azKcNOOytpg3u95pp8ZP3w==
    State:          Running
      Started:      Thu, 08 Oct 2020 11:59:26 +0000
    Ready:          True
    Restart Count:  0
    Limits:
      memory:  64Mi
    Requests:
      cpu:        100m
      memory:     64Mi
    Environment:  <none>
    Mounts:
      /etc/proxy/elasticsearch from certificates (rw)
      /etc/proxy/secrets from elasticsearch-metrics (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from elasticsearch-token-qchdq (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  elasticsearch-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      elasticsearch
    Optional:  false
  elasticsearch-storage:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  elasticsearch-elasticsearch-cdm-5w0ajql9-1
    ReadOnly:   false
  certificates:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  elasticsearch
    Optional:    false
  elasticsearch-metrics:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  elasticsearch-metrics
    Optional:    false
  elasticsearch-token-qchdq:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  elasticsearch-token-qchdq
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  kubernetes.io/os=linux
                 node-role.kubernetes.io/infra=
Tolerations:     node.kubernetes.io/disk-pressure:NoSchedule
                 node.kubernetes.io/memory-pressure:NoSchedule
                 node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type     Reason     Age                    From                                 Message
  ----     ------     ----                   ----                                 -------
  Normal   Scheduled  <unknown>              default-scheduler                    Successfully assigned openshift-logging/elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8 to infra-1.redhat2.cccr.local
  Normal   Pulled     33m                    kubelet, infra-1.redhat2.cccr.local  Container image "bastion.redhat2.cccr.local:5000/openshift4/ose-oauth-proxy@sha256:1f8a1818480230eb6f2b9c46e330cbc270771530c8d68e71ca882706c5d33ca1" already present on machine
  Normal   Created    33m                    kubelet, infra-1.redhat2.cccr.local  Created container proxy
  Normal   Started    33m                    kubelet, infra-1.redhat2.cccr.local  Started container proxy
  Normal   Pulled     31m (x5 over 33m)      kubelet, infra-1.redhat2.cccr.local  Container image "bastion.redhat2.cccr.local:5000/openshift4/ose-logging-elasticsearch5@sha256:b6689627201fb7f370caa96c5961150b37aff16bc8c3b77ad7b61c68ccb541a9" already present on machine
  Normal   Created    31m (x5 over 33m)      kubelet, infra-1.redhat2.cccr.local  Created container elasticsearch
  Normal   Started    31m (x5 over 33m)      kubelet, infra-1.redhat2.cccr.local  Started container elasticsearch
  Warning  BackOff    3m33s (x133 over 33m)  kubelet, infra-1.redhat2.cccr.local  Back-off restarting failed container

oc logs -n openshift-logging elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8 elasticsearch

oc logs -n openshift-logging elasticsearch-cdm-5w0ajql9-1-5f59bbdd67-2w7m8 elasticsearch


.. ( omission )
..
..
..

2020-10-08 12:32:04,721 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@1b7cc17c] unable to create manager for [/elasticsearch/persistent/elasticsearch/logs/elasticsearch_index_indexing_slowlog.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@35d019a3[pattern=/elasticsearch/persistent/elasticsearch/logs/elasticsearch_index_indexing_slowlog-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c] %marker%.-10000m%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@1b7cc17c] unable to create manager for [/elasticsearch/persistent/elasticsearch/logs/elasticsearch_index_indexing_slowlog.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@35d019a3[pattern=/elasticsearch/persistent/elasticsearch/logs/elasticsearch_index_indexing_slowlog-%d{yyyy-MM-dd}.log, append=true, bufferedIO=true, bufferSize=8192, policy=CompositeTriggeringPolicy(policies=[TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true)]), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d{ISO8601}][%-5p][%-25c] %marker%.-10000m%n, filePermissions=null, fileOwner=null]]
    at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:115)
    at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:114)
    at org.apache.logging.log4j.core.appender.rolling.RollingFileManager.getFileManager(RollingFileManager.java:188)
    at org.apache.logging.log4j.core.appender.RollingFileAppender$Builder.build(RollingFileAppender.java:145)
    at org.apache.logging.log4j.core.appender.RollingFileAppender$Builder.build(RollingFileAppender.java:61)
    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:123)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:959)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:899)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:891)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:514)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:238)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:250)
    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:547)
    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:263)
    at org.elasticsearch.common.logging.LogConfigurator.configure(LogConfigurator.java:166)
    at org.elasticsearch.common.logging.LogConfigurator.configure(LogConfigurator.java:122)
    at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:307)
    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132)
    at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123)
    at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70)
    at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134)
    at org.elasticsearch.cli.Command.main(Command.java:90)
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91)
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84)

2020-10-08 12:32:04,723 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingFileAppender
    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.findFactoryMethod(PluginBuilder.java:235)
    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:135)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:959)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:899)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:891)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:514)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:238)
    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:250)
    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:547)
    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:263)
    at org.elasticsearch.common.logging.LogConfigurator.configure(LogConfigurator.java:166)
    at org.elasticsearch.common.logging.LogConfigurator.configure(LogConfigurator.java:122)
    at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:307)
    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:132)
    at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:123)
    at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:70)
    at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:134)
    at org.elasticsearch.cli.Command.main(Command.java:90)
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91)
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84)

2020-10-08 12:32:04,725 main ERROR Null object returned for RollingFile in Appenders.
2020-10-08 12:32:04,726 main ERROR Null object returned for RollingFile in Appenders.
2020-10-08 12:32:04,727 main ERROR Null object returned for RollingFile in Appenders.
2020-10-08 12:32:04,728 main ERROR Null object returned for RollingFile in Appenders.
2020-10-08 12:32:04,730 main ERROR Unable to locate appender "rolling" for logger config "root"
2020-10-08 12:32:04,730 main ERROR Unable to locate appender "index_indexing_slowlog_rolling" for logger config "index.indexing.slowlog.index"
2020-10-08 12:32:04,731 main ERROR Unable to locate appender "index_search_slowlog_rolling" for logger config "index.search.slowlog"
2020-10-08 12:32:04,732 main ERROR Unable to locate appender "deprecation_rolling" for logger config "org.elasticsearch.deprecation"

I've searched a lot through Google, but I don't know why it's not working.
2020-10-08 11:47:21,184 main ERROR Unable to create file /elasticsearch/persist/elasticsearch/logs/elasticsearch_index_search_slowlog.log java.io.IOException: Could not create directory /elasticsearch/persist/elasticsearch/logs
I don't know if the container isn't created or... Or maybe there's another cause... I'm not sure. Have you ever had a similar problem with me or have you any advice?

Responses

Hi Taehun,

not sure if you still need help with this, but if you do - have you opened a case with support?

the pod itself tries to start - but the error causes it to crash. at first glance, it looks like there is an issue with your persistent volume.

if you still have this issue, please open a case with support, and Im sure they can get the issue sorted.

Thanks, Andy