Ceph: [ERR] OSD_UNREACHABLE: nn osds(s) are not reachable
Issue
[ERR] OSD_UNREACHABLE: nn osds(s) are not reachable.
The system is in an Error state claiming the OSD Public IP Address are not within the range of the public_network Ceph Configuration Setting
Example:
# ceph -s
cluster:
id: [Redacted]
health: HEALTH_ERR
8 osds(s) are not reachable
services:
mon: 3 daemons, quorum ceph1,ceph3,ceph2 (age 2h)
mgr: ceph1.cuesmd(active, since 2h), standbys: ceph2.mkfrki, ceph3.kpzzuq
mds: 1/1 daemons up, 2 standby
osd: 32 osds: 32 up (since 6m), 32 in (since 3w)
data:
volumes: 1/1 healthy
pools: 8 pools, 2498 pgs
objects: 649.46M objects, 23 TiB
usage: 72 TiB used, 21 TiB / 93 TiB avail
pgs: 2498 active+clean
# ceph health detail
HEALTH_ERR 8 osds(s) are not reachable
[ERR] OSD_UNREACHABLE: 8 osds(s) are not reachable
osd.0's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.1's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.2's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.3's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.4's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.5's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.6's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
osd.7's public address is not in '100.xx.191.136/29,100.xx.159.136/29' subnet
Environment
Red Hat Ceph Storage (RHCS) 7
Ceph Object Storage Daemon (OSD)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.