Ceph: Unable to set balancer mode to "upmap" - Ceph-MGR log message "[balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous'"
Issue
Ceph: Unable to set balancer mode to "upmap" - Ceph-MGR log message "[balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous'"
When a Ceph Cluster is upgrade to higher releases, some features can't be enabled. The best example is changing the balancer mode to "upmap
". Also, the following will pollute the Ceph-MGR logs:
Jul 10 03:14:55 ceph-mgr pid:688327 [balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface
ceph-mgr: debug 2024-02-20T08:01:00.163+0000 7f1098f51700 0 [balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface
Because the Balancer is unable to change mode to "upmap", this alert may be observed:
Alertname: CephPGImbalance
Ceph_daemon: osd.10
Description: OSD osd.10 on test.redhat.com deviates by more than 30% from average PG count
--
Summary: PG allocations are not balanced across devices
For OpenStack using Ceph RBD Volumes as a backend, unsupported tunables in Ceph client will cause instances crash. The following log can be observed in the instance's qemu log.
what(): buffer::malformed_input: unsupported bucket algorithm: 5
Confirm minimum client [1]:
# ceph osd dump | grep -B20 stretch_mode_enabled
epoch 15729
fsid 7b3153f8-de15-11e9-83de-e4434b135035
created 2019-09-23T15:57:23.242654+0000
modified 2024-08-01T07:21:52.202013+0000
flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit
crush_version 263
full_ratio 0.95
backfillfull_ratio 0.9
nearfull_ratio 0.85
require_min_compat_client jewel [1]
min_compat_client jewel [1]
require_osd_release quincy
stretch_mode_enabled false
Environment
Red Hat Ceph Storage (RHCS) 4.x
Red Hat Ceph Storage (RHCS) 5.x
Red Hat Ceph Storage (RHCS) 6.x
Red Hat Ceph Storage (RHCS) 7.x
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.