Swap File Usage and Priorities

Issue

• We have swap files setup in a priortized/tiered fashion and have seen many instances where lower priority swap files get used before higher priority swap files are full. 

• Here is the output of swapon -s that is an example of what I am talking about.

  Filename                              Type            Size    Used    Priority
  /dev/sdh1                             partition       8428128 0       70
  /dev/sdi1                             partition       5426196 0       70
  /dev/sdj1                             partition       87524   26260   99
  /dev/sdk1                             partition       87524   26296   99
  /dev/sdl1                             partition       300211  12      98
  /dev/sdm1                             partition       300211  12      98
  /dev/sdn1                             partition       192141  0       80