Uploading large image layers fails with "blob upload invalid"

Solution Verified - Updated -

Issue

  • When trying to push a large container image (one layer being roughly 10GB in size) to the OpenShift internal image registry, this fails with the following blob upload invalid error:

    error: build error: Failed to push image: writing blob: uploading layer to https://image-registry.openshift-image-registry.svc:5000/v2/example-build/example/blobs/uploads/9a892c32-138a-4c24-84d5-b238293f06b5?_state=[..]: blob upload invalid
    
  • The image registry logs shows the following error messages:

    time="2023-01-30T14:12:22.315726147Z" level=error msg="upload resumed at wrong offest: 10485760000 != 10738341637" [..]
    time="2023-01-30T14:12:22.338264863Z" level=error msg="response completed with error" err.code="blob upload invalid" err.message="blob upload invalid" [..]
    

Environment

  • Red Hat OpenShift Container Platform (RHOCP) 4.11

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content