Failed to push image: received unexpected HTTP status: 500 Internal Server Error

Solution Verified - Updated -

Issue

These errors are being spotted while uploading an image to the internal registry:

$ podman login -u xxx -p $(oc whoami -t) default-route-openshift-image-registry.apps.xxx.yyy.zzz
Login Succeeded!

$ podman push default-route-openshift-image-registry.apps.xxx.yyy.zzz/project/pod:1.0.1
Getting image source signatures
Copying blob d27d00a62b62 done
Copying blob faf7c252da57 done
Error: Error copying image to the remote destination: Error writing blob: Error initiating layer upload to /v2/clustervalidation/traefik/blobs/uploads/ in default-route-openshift-image-registry.apps.osd01.atradiusnet.com: received unexpected HTTP status: 500 Internal Server Error

After reviewing the registry logs with oc logs <registry_pod_name> this message is found:

level=error msg="error putting into main store: filesystem: mkdir /registry/docker: permission denied" go.version=go1.10.8 http.request.host="image-registry.openshift-image-registry.svc:5000" http.request.id=195989d2-002c-4881-99d6-7d50c84864d8 http.request.method=GET http.request.remoteaddr="10.128.8.69:59728" http.request.uri="/v2/openshift/httpd/manifests/sha256:e67868a558cfe45441e1c326de6d67596fc61b65aa183066fbadfe53c20fb415" http.request.useragent=Go-http-client/1.1 openshift.auth.user="system:serviceaccount:clustervalidation:builder"

Environment

  • OCP 4
  • vSphere UPI Installation
  • A NFS share for the registry

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content