A 'ceph -s' output prints "{X} ops are blocked > {Y} sec on OSD.{AB}" . What does this mean?

Solution Verified - Updated -

Issue

  • A 'ceph health detail' and 'ceph status' shows a 'HEALTH_WARN' with {X} ops blocked.

  • 'ceph health detail'

# ceph health detail
HEALTH_WARN 30 requests are blocked > 32 sec; 3 osds have slow requests
30 ops are blocked > 268435 sec
1 ops are blocked > 268435 sec on osd.11
1 ops are blocked > 268435 sec on osd.18
28 ops are blocked > 268435 sec on osd.39
3 osds have slow requests
  • 'ceph status'
# ceph -s
    cluster fe755315-f589-4bbc-aa67-95e0c5d3bf7d
     health HEALTH_WARN
            30 requests are blocked > 32 sec
     monmap e1: 3 mons at {mtnode09-cephmon=10.200.15.162:6789/0,mtnode10-cephmon=10.200.15.163:6789/0,mtnode11-cephmon=10.200.15.164:6789/0}
            election epoch 200, quorum 0,1,2 mtnode09-cephmon,mtnode10-cephmon,mtnode11-cephmon
     osdmap e955: 40 osds: 40 up, 40 in
      pgmap v3192838: 3072 pgs, 3 pools, 2043 GB data, 503 kobjects
            6593 GB used, 30628 GB / 37221 GB avail
                3072 active+clean
  client io 48370 kB/s rd, 8526 kB/s wr, 332 op/s
  • A 'ceph osd tree' shows all the OSDs up and running.

Environment

  • Red Hat Ceph Storage 1.2.3

  • Red Hat Ceph Storage 1.3

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content