Fluentd fails with kubernetes-metadata error 404 in RHOCP 4

Issue

• They are visible in the fluentd pods some errors not getting the kubernetes-metadata with error 404 are present:

  $ for pod in $(oc get pods -l component=collector -o name -n openshift-logging);do oc logs $pod -c collector -n openshift-logging|grep  "kubernetes-metadata";done |tail -2
  2023-07-18T23:50:55.889790767Z 2023-07-18 23:50:55 +0000 [error]: [kubernetes-metadata] Exception 'HTTP status code 404, pods "pod1-78fd54d68c-58k7t" not found for GET https://kubernetes.default.svc/api/v1/namespaces/test/pods/pod1-78fd54d68c-58k7t' encountered fetching pod metadata from Kubernetes API v1 endpoint https://kubernetes.default.svc
  2023-07-18T23:54:19.906137335Z 2023-07-18 23:54:19 +0000 [error]: [kubernetes-metadata] Exception 'HTTP status code 404, pods "pod2-78fd54d68c-jgwqp" not found for GET https://kubernetes.default.svc/api/v1/namespaces/test/pods/pod2-78fd54d68c-jgwqp' encountered fetching pod metadata from Kubernetes API v1 endpoint https://kubernetes.default.svc