Ceph: Newly added OSDs flapping - more than 62 OSDs per node.
Issue
Newly added OSDs flapping - more than 62 OSDs per node.
For customers with extremely large drives and a very small object counts, there could be a valid concern about the size of BlueStore/BlueFS. As a mitigation, a customer may decide to configure 4 OSDs per physical disk. When this is done, 24 physical disks will result in 96 OSDs. The Ceph Firewall configuration can only support 92 OSDs per node. Any OSD beyond 92, will flap due to a lack of open ports.
Environment
Red Hat Ceph Storage (RHCS) 6.x
Red Hat Ceph Storage (RHCS) 7.x
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.