ODF: Ceph PGs inconsistent - "osd.0 [ERR] 1.19 shard 0 soid 1:997315a6:::{object name}:head : omap_digest 0xd5da2057 != omap_digest 0x84351b06 from auth oi 1:997315a6".

Solution Verified - Updated -

Issue

Ceph PGs inconsistent - "osd.0 [ERR] 1.19 shard 0 soid 1:997315a6:::{object name}:head : omap_digest 0xd5da2057 != omap_digest 0x84351b06 from auth oi 1:997315a6".

Example:

$ ceph -s
  cluster:
    id:     f38cc2d8-05c8-4e6e-abd5-9169afab1c78
    health: HEALTH_ERR
            68 scrub errors
            Possible data damage: 15 pgs inconsistent
  services:
    mon: 3 daemons, quorum d,e,f (age 3d) [leader: d]
    mgr: a(active, since 3d), standbys: b
    mds: 1/1 daemons up, 1 hot standby
    osd: 3 osds: 3 up (since 3d), 3 in (since 4w)
    rgw: 1 daemon active (1 hosts, 1 zones)
  data:
    volumes: 1/1 healthy
    pools:   12 pools, 169 pgs
    objects: 28.32k objects, 77 GiB
    usage:   233 GiB used, 308 GiB / 541 GiB avail
    pgs:     154 active+clean
             15  active+clean+inconsistent

$ ceph -w | grep 1.19
2026-08-03T13:11:29.515818+0000 osd.0 [ERR] 1.19 shard 0 soid 1:997315a6:::{object name}:head : omap_digest 0xd5da2057 != omap_digest 0x84351b06 from auth oi 1:997315a6:::{object name}:head(1592'280107 osd.2.0:908377 dirty|omap|data_digest|omap_digest s 0 uv 275725 dd ffffffff od 84351b06 alloc_hint [0 0 0])
2026-08-03T13:11:29.515823+0000 osd.0 [ERR] 1.19 shard 1 soid 1:997315a6:::{object name}:head : omap_digest 0xd5da2057 != omap_digest 0x84351b06 from auth oi 1:997315a6:::{object name}:head(1592'280107 osd.2.0:908377 dirty|omap|data_digest|omap_digest s 0 uv 275725 dd ffffffff od 84351b06 alloc_hint [0 0 0])
2026-08-03T13:11:29.515824+0000 osd.0 [ERR] 1.19 shard 2 soid 1:997315a6:::{object name}:head : omap_digest 0xd5da2057 != omap_digest 0x84351b06 from auth oi 1:997315a6:::{object name}:head(1592'280107 osd.2.0:908377 dirty|omap|data_digest|omap_digest s 0 uv 275725 dd ffffffff od 84351b06 alloc_hint [0 0 0])
2026-08-03T13:11:29.515827+0000 osd.0 [ERR] 1.19 soid 1:997315a6:::{object name}:head : failed to pick suitable auth object
2026-08-03T13:11:29.515828+0000 osd.0 [ERR] 1.19 soid 1:997315a6:::{object name}:head : empty auth list
2026-08-03T13:12:20.596293+0000 osd.0 [ERR] 1.19 deep-scrub 3 errors, 0 fixed

Environment

Red Hat OpenShift Container Platform (OCP) 4.21 - 4.22
Red Hat OpenShift Data Foundation (ODF) 4.21 - 4.22
Red Hat Ceph Storage (RHCS) 9
IBM Mainframe (s390x)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content