Ceph: [ERR] OSD_UNREACHABLE: nn osds(s) are not reachable

Solution Verified - Updated -

Issue

[ERR] OSD_UNREACHABLE: nn osds(s) are not reachable.

The system is in an Error state claiming the OSD Public IP Address are not within the range of the public_network Ceph Configuration Setting

Example:

# ceph -s
  cluster:
    id:     [Redacted]
    health: HEALTH_ERR
            8 osds(s) are not reachable

  services:
    mon: 3 daemons, quorum ceph1,ceph3,ceph2 (age 2h)
    mgr: ceph1.cuesmd(active, since 2h), standbys: ceph2.mkfrki, ceph3.kpzzuq
    mds: 1/1 daemons up, 2 standby
    osd: 32 osds: 32 up (since 6m), 32 in (since 3w)

  data:
    volumes: 1/1 healthy
    pools:   8 pools, 2498 pgs
    objects: 649.46M objects, 23 TiB
    usage:   72 TiB used, 21 TiB / 93 TiB avail
    pgs:     2498 active+clean

# ceph health detail 
HEALTH_ERR 8 osds(s) are not reachable
[ERR] OSD_UNREACHABLE: 8 osds(s) are not reachable
    osd.0's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.1's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.2's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.3's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.4's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.5's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.6's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
    osd.7's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet

Environment

Red Hat Ceph Storage (RHCS) 7
Ceph Object Storage Daemon (OSD)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content