ODF/Ceph reporting clock skews

Solution Verified - Updated -

Issue

  • How to resolve MON clock skew issue in OCS 4.x
  • Ceph OSD node with time sync issue
  • The command ceph -s showing one or more mons are out of time sync

    # ceph -s
      cluster:
        id:     1111111-2222-3333-4444-555556666666
        health: HEALTH_WARN
                clock skew detected on mon.b, mon.c 
    ...
    
  • OSD fails to start with repeating message unable to obtain rotating service keys; retrying

    Jun 24 09:55:38 node-406 conmon[285430]: 2022-06-24 09:55:38.834 7f0a516cddc0 -1 osd.2 17318 unable to obtain rotating service keys; retrying
    Jun 24 09:55:44 node-406 conmon[287350]: 2022-06-24 09:55:44.308 7f2c99f5fdc0 -1 osd.26 17318 unable to obtain rotating service keys; retrying
    Jun 24 09:56:04 node-406 conmon[288107]: 2022-06-24 09:56:04.078 7f8ad797fdc0 -1 osd.14 17318 unable to obtain rotating service keys; retrying
    Jun 24 09:56:06 node-406 conmon[284444]: 2022-06-24 09:56:06.466 7ffb7a2c3dc0 -1 osd.38 17318 unable to obtain rotating service keys; retrying
    Jun 24 09:56:08 node-406 conmon[285430]: 2022-06-24 09:56:08.835 7f0a516cddc0 -1 osd.2 17318 unable to obtain rotating service keys; retrying
    

Environment

Red Hat OpenShift Container Storage (OCS) 4.x
Red Hat OpenShift Cluster Platform (OCP) 4.x
Red Hat Ceph Storage (RHCS) 4.x
Red Hat Ceph Storage (RHCS) 5.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content