PV gets stuck "timeout expired waiting for volumes to attach/mount for pod" on Dedicated

Solution In Progress - Updated -

Issue

  • When we scaled down and up the pods, the pods stopped working. Event logs are below:
FIRSTSEEN   LASTSEEN   COUNT     NAME                   KIND      SUBOBJECT                     REASON       SOURCE                                                        MESSAGE
...
1h        1h        1         mysql-1-094kd         Pod                                                    Scheduled           {default-scheduler }                                          Successfully assigned mysql-1-094kd to <HOST>
1h        1h        4         mysql-1-094kd         Pod                                                    FailedMount         {kubelet <HOST>}   Unable to mount volumes for pod "mysql-1-xxx-xxxx(e2cc2fc6-d85b-11e6-8938-026f2b6a837f)": timeout expired waiting for volumes to attach/mount for pod "mysql-1-094kd"/"xxxxx". list of unattached/unmounted volumes=[mysql-data]
1h        1h        4         mysql-1-094kd         Pod                                                    FailedSync          {kubelet <HOST>}   Error syncing pod, skipping: timeout expired waiting for volumes to attach/mount for pod "mysql-1-094kd"/"xxxx-xxxx". list of unattached/unmounted volumes=[mysql-data]
  • I heard from Red Hat that it was is an issue on OCP 3.3 and should not scale down/up quickly. But when I waited 10 seconds, and then scaled them back from 0 to 1. The issue happened again.

Environment

  • OpenShift Dedicated
    • 3.3

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.