ipa-server-upgrade ERROR: Criteria expected to be met by 1 request, got 2

Issue

ipa-server-upgrade fails with the error:

ipaserver.install.server.upgrade: INFO: [Setup PKINIT]
ipalib.install.certmonger: ERROR: Failed to get request: Criteria expected
to be met by 1 request, got 2.
ipaserver.install.ipa_server_upgrade: ERROR: IPA server upgrade failed:
Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually.
ipapython.admintool: DEBUG:   File
"/usr/lib/python2.7/site-packages/ipapython/admintool.py", line 178, in
execute
    return_value = self.run()
  File
"/usr/lib/python2.7/site-packages/ipaserver/install/ipa_server_upgrade.py",
line 56, in run
    raise admintool.ScriptError(str(e))

ipapython.admintool: DEBUG: The ipa-server-upgrade command failed,
exception: ScriptError: Criteria expected to be met by 1 request, got 2.
ipapython.admintool: ERROR: Criteria expected to be met by 1 request, got 2.
ipapython.admintool: ERROR: The ipa-server-upgrade command failed. See
/var/log/ipaupgrade.log for more information