udev process stuck

Solution In Progress - Updated -

Issue

  • We see a lot of system-udevd in "D" state:
[root@overcloud-compute-0 ~]# ps auxf | awk '{if($8=="D") print $0;}'
root      478636  0.0  0.0      0     0 ?        D    Nov15   0:00  \_ [systemd-udevd]
root      478645  0.0  0.0  48124  4600 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      480623  0.0  0.0  49312  5624 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      504910  0.0  0.0  73600 29364 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      506948  0.0  0.0  51748  7784 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      508896  0.0  0.0  73600 29372 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      510682  0.0  0.0  53000  9036 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      512657  0.0  0.0  54100 10136 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      514683  0.0  0.0  73600 29396 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      516487  0.0  0.0  54904 10940 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      518414  0.0  0.0  55276 11312 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      520379  0.0  0.0  56104 12140 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      522438  0.0  0.0  73600 29388 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      524576  0.0  0.0  57924 13960 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      526715  0.0  0.0  59400 15436 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      528566  0.0  0.0  60600 16636 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      530723  0.0  0.0  61300 17336 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      532549  0.0  0.0  62692 18728 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      534598  0.0  0.0  63820 19856 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      536526  0.0  0.0  64952 20988 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      538558  0.0  0.0  66160 22196 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      540755  0.0  0.0  73600 29396 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      542760  0.0  0.0  69108 25144 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      544854  0.0  0.0  70264 26300 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      547019  0.0  0.0  71060 27096 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      549157  0.0  0.0  73600 29384 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      550259  0.0  0.0  48940  4976 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      552312  0.0  0.0  53168  9204 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      555414  0.0  0.0  56108 12144 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      557255  0.0  0.0  56676 12712 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      559115  0.0  0.0  73600 29392 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      561037  0.0  0.0  73600 29272 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      562908  0.0  0.0  61552 17588 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      564819  0.0  0.0  63408 19444 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      566783  0.0  0.0  64660 20696 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      568511  0.0  0.0  66596 22632 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      570396  0.0  0.0  69416 25452 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      572146  0.0  0.0  73600 29308 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      573927  0.0  0.0  70904 26940 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      575668  0.0  0.0  48904  4940 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      577679  0.0  0.0  51944  7980 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      579754  0.0  0.0  73600 29592 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      581906  0.0  0.0  52820  8856 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      583856  0.0  0.0  54264 10300 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      585784  0.0  0.0  54780 10816 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      587698  0.0  0.0  50592  6628 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      589441  0.0  0.0  73600 29320 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      591214  0.0  0.0  55916 11952 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      593125  0.0  0.0  59848 15884 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      595020  0.0  0.0  73600 29324 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      596938  0.0  0.0  62948 18984 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      598819  0.0  0.0  65208 21244 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      600772  0.0  0.0  67676 23712 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      602596  0.0  0.0  70772 26808 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      604545  0.0  0.0  73600 29396 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      606372  0.0  0.0  51936  7972 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      608328  0.0  0.0  73600 29592 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      610320  0.0  0.0  54008 10044 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      612285  0.0  0.0  54652 10688 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      614377  0.0  0.0  73600 29592 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      616282  0.0  0.0  57244 13280 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      618248  0.0  0.0  73600 29320 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      620403  0.0  0.0  60468 16504 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      622218  0.0  0.0  64640 20676 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      624247  0.0  0.0  68784 24820 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      626118  0.0  0.0  68216 24252 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      628110  0.0  0.0  73600 29396 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      629986  0.0  0.0  73600 29316 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      631945  0.0  0.0  73600 29396 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      633908  0.0  0.0  55768 11804 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      635969  0.0  0.0  56368 12404 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      637938  0.0  0.0  61792 17828 ?        D    Nov15   0:00  \_ /usr/lib/systemd/systemd-udevd
root      639838  0.0  0.0  62996 19032 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      641732  0.0  0.0  73600 29396 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      643594  0.0  0.0  73600 29308 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      645510  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      647336  0.0  0.0  53168  9204 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      649012  0.0  0.0  52416  8452 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      650686  0.0  0.0  60196 16232 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      652546  0.0  0.0  60728 16764 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      654300  0.0  0.0  67344 23380 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      656119  0.0  0.0  73600 29592 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      658016  0.0  0.0  54180 10216 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      659915  0.0  0.0  55380 11416 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      661891  0.0  0.0  50016  6052 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      663618  0.0  0.0  64392 20428 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      665254  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      666938  0.0  0.0  53504  9540 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      668727  0.0  0.0  55924 11960 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      670644  0.0  0.0  64000 20036 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      672724  0.0  0.0  73600 29592 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      674772  0.0  0.0  55620 11656 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      676962  0.0  0.0  58368 14404 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      678756  0.0  0.0  55280 11316 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      680602  0.0  0.0  73600 29292 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      682452  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      684211  0.0  0.0  52600  8636 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      686084  0.0  0.0  73600 29592 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      687951  0.0  0.0  54948 10984 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      689860  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      691865  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      693700  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      695658  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      697572  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      699403  0.0  0.0  73600 29364 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      701164  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      703128  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      704999  0.0  0.0  73600 29320 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      706877  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      708475  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      710256  0.0  0.0  73600 29172 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      712258  0.0  0.0  73600 29172 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      714119  0.0  0.0  73600 29592 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      715800  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      717500  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      719380  0.0  0.0  73600 29172 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      721162  0.0  0.0  73600 29396 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      723099  0.0  0.0  73600 29320 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      733970  0.0  0.0  55152 11188 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd
root      751633  0.0  0.0  52340  8376 ?        D    Nov16   0:00  \_ /usr/lib/systemd/systemd-udevd

Environment

  • Red Hat Enterprise Linux 7.5 (RHEL)
  • Red Hat OpenStack Platform (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In