Ceph monitors are unable to establish quorum, they are stuck in an electing state

Solution Verified - Updated -

Issue

  • Ceph monitors are unable to establish quorum, they are staying in peering state, even when they are able to reach other ones via ping
[root@rhscamon2 log]# ceph daemon mon.rhscamon2 mon_status
{
    "name": "rhscamon2",
    "rank": 1,
    "state": "probing",
    "election_epoch": 0,
    "quorum": [],
    "outside_quorum": [
        "rhscamon2"
    ],
    "extra_probe_peers": [],
    "sync_provider": [],
    "monmap": {
        "epoch": 1,
        "fsid": "xxxxx-ceph-cluster-fsid",
        "modified": "0.000000",
        "created": "0.000000",
        "mons": [
            {
                "rank": 0,
                "name": "rhscamon1",
                "addr": "192.168.66.12:6789\/0"
            },
            {
                "rank": 1,
                "name": "rhscamon2",
                "addr": "192.168.66.251:6789\/0"
            },
            {
                "rank": 2,
                "name": "rhscamon3",
                "addr": "192.168.66.149:6789\/0"
            }
        ]
    }
}
[root@rhscamon2 log]# ceph daemon mon.rhscamon2 quorum_status
{
    "election_epoch": 0,
    "quorum": [],
    "quorum_names": [],
    "quorum_leader_name": "",
    "monmap": {
        "epoch": 1,
        "fsid": "xxxxx-ceph-cluster-fsid",
        "modified": "0.000000",
        "created": "0.000000",
        "mons": [
            {
                "rank": 0,
                "name": "rhscamon1",
                "addr": "192.168.66.12:6789\/0"
            },
            {
                "rank": 1,
                "name": "rhscamon2",
                "addr": "192.168.66.251:6789\/0"
            },
            {
                "rank": 2,
                "name": "rhscamon3",
                "addr": "192.168.66.149:6789\/0"
            }
        ]
    }
}

Environment

  • Red Hat Ceph Storage 1.3.x and 2.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.