A Ceph cluster shows a status of 'HEALTH_WARN' warning with the message "too many PGs per OSD", why?

Solution Verified - Updated -

Issue

  • An RHCS/Ceph cluster shows a status of 'HEALTH_WARN' warning with the message "too many PGs per OSD", why?

  • This can normally happen in two cases :

    • A perfectly normal RHCS cluster (usually 1.3.x) may see this after adding new pools, or adding more placement groups to existing pools.

    • A healthy RHCS1.2.3 cluster upgraded to RHCS1.3.x, provided the PG density (PG per OSD) was already high before upgrade.

  • A ceph -s should print the cluster health.

# ceph -s
    cluster cccccccc-eeee-eeee-ffff-7aceb97642a0
     health HEALTH_WARN
            too many PGs per OSD (496 > max 300)

Environment

  • Red Hat Ceph Storage 1.3.x
  • Red Hat Ceph Storage 2.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.