Ceph: Unable to set balancer mode to "upmap" - Ceph-MGR log message "[balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous'"

Solution Verified - Updated -

Issue

Ceph: Unable to set balancer mode to "upmap" - Ceph-MGR log message "[balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous'"

When a Ceph Cluster is upgrade to higher releases, some features can't be enabled. The best example is changing the balancer mode to "upmap". Also, the following will pollute the Ceph-MGR logs:

Jul 10 03:14:55 ceph-mgr pid:688327 [balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface
ceph-mgr: debug 2024-02-20T08:01:00.163+0000 7f1098f51700  0 [balancer ERROR root] execute error: r = -1, detail = min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface

Because the Balancer is unable to change mode to "upmap", this alert may be observed:

Alertname: CephPGImbalance
Ceph_daemon: osd.10
Description: OSD osd.10 on test.redhat.com deviates by more than 30% from average PG count
--
Summary: PG allocations are not balanced across devices

For OpenStack using Ceph RBD Volumes as a backend, unsupported tunables in Ceph client will cause instances crash. The following log can be observed in the instance's qemu log.

  what():  buffer::malformed_input: unsupported bucket algorithm: 5

Confirm minimum client [1]:

# ceph osd dump | grep -B20 stretch_mode_enabled
epoch 15729
fsid 7b3153f8-de15-11e9-83de-e4434b135035
created 2019-09-23T15:57:23.242654+0000
modified 2024-08-01T07:21:52.202013+0000
flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit
crush_version 263
full_ratio 0.95
backfillfull_ratio 0.9
nearfull_ratio 0.85
require_min_compat_client jewel  [1]
min_compat_client jewel  [1]
require_osd_release quincy
stretch_mode_enabled false

Environment

Red Hat Ceph Storage (RHCS) 4.x
Red Hat Ceph Storage (RHCS) 5.x
Red Hat Ceph Storage (RHCS) 6.x
Red Hat Ceph Storage (RHCS) 7.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content