GFS Withdrawn during a re-keying of a LUN

Issue

• The situation happened in a SAN encryption configuration environment.
• Client use IBM Brocade encrypted switches.
• Due to a business requirement, the client is re-keying their disk data, individually, lun by lun.
• They had already re-keyed luns 0 and 1 at some time in the recent past, and were performing the re-key operation on lun 2 (in both systems) when that lun reported fatal metadata errors and GFS withdraw
• It was during the encryption rekey operation that the FS'es on both luns being rekeyed experienced "invalid metadata block" errors on both sites.