RHOCP 4 の Loki ingesters 0/1

Issue

• logging- loki -ingester または netobserv- loki -ingester Pod は、LokiStack ハッシュリングに古い loki -ingester エントリーが存在するため、初期化できません。

  netobserv-loki-ingester-0                        0/1     Running   0          1d
  

  logging-loki-ingester-0                        0/1     Running   0          1d
  

• Loki-ingester ログには、InvalidBucketState/ring のエラーが表示されます。

  level=error ts=2024-08-14T09:25:53.576834111Z caller=flush.go:143 org_id=infrastructure msg="failed to flush" err="failed to flush chunks: store put chunk: InvalidBucketState: The request is not valid with the current state of the bucket.\n\tstatus code: 409, request id: xxxx-xxxx-xxxx, host id: xxxx-xxxx-xxx, num_chunks: 1, labels: {kubernetes_host=\"example.ocp.com\", log_type=\"infrastructure\"}"
  

  msg="found an existing instance(s) with a problem in the ring, this instance cannot become ready until this problem is resolved. The /ring http endpoint on the distributor (or single binary) provides visibility into the ring." ring=ingester err="instance 10.x.x.x:9095 past heartbeat timeout"
  

• Web コンソールのログセクションに "Too Many Unhealthy Instances In The Ring" と表示され、ログを確認できません。