Unable to upload image on local registry, build fails with errors

Issue

• This might be an intermittent issue where the Jenkins build tries to upload the image to the local registry but the build fails with 500 internal server error and the image registry pod logs show No space left on the device errors.

500 internal server error

error: build error: Failed to push image: error copying layers and metadata from "containers-storage:[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.imagestore=/var/lib/shared]image-registry.openshift-image-registry.svc:5000/xxx/service-number-xxx-xxx:xxx" to "docker://image-registry.openshift-image-registry.svc:5000/sit/service-number-xxx-xxx:xxx": Error writing blob: Error initiating layer upload to /v2/xxx/service-number-xxx-xxx:xxx/blobs/uploads/ in image-registry.openshift-image-registry.svc:5000: received unexpected HTTP status: 500 Internal Server Error
error: the build sit/service-number-xxx-xxx:xxx status is "Failed"

No space left on the device

time="2022-06-06T08:57:38.612471378Z" level=error msg="response completed with error" err.code=unknown err.detail="filesystem: open /registry/docker/registry/v2/repositories/xxx: no space left on device" err.message="unknown error" go.version=go1.16.6 http.request.host="image-registry.openshift-image-registry.svc:5000" http.request.id=xxxx http.request.method=POST http.request.remoteaddr="xxxx" http.request.uri=/v2/dev/***(github.com/containers/image)" http.response.contenttype="application/json; charset=utf-8" http.response.duration=11.813939ms http.response.status=500 http.response.written=259 openshift.auth.user="system:serviceaccount:dev:builder" vars.name=dev/***