Identity Management upgrade to Red Hat Enterprise Linux 8.4 is failing with ACME error

Issue

When upgrading Identity Management in Red Hat Enterprise Linux 8.3 to the version shipped in Red Hat Enterprise Linux 8.4, the upgrade is failing with the following error in ipaupgrade.log:

2021-05-12T19:19:04Z DEBUG Minimum ACME support not available
2021-05-12T19:19:04Z ERROR IPA server upgrade failed: Inspect /var/log/ipaupgrade.log and run command ipa-server-upgrade manually.
2021-05-12T19:19:04Z DEBUG   File "/usr/lib/python3.6/site-packages/ipapython/admintool.py", line 180, in execute
    return_value = self.run()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/ipa_server_upgrade.py", line 54, in run
    server.upgrade()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py", line 1950, in upgrade
    upgrade_configuration()
  File "/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py", line 1820, in upgrade_configuration
    ca_update_acme_configuration(ca, fqdn)
  File "/usr/lib/python3.6/site-packages/ipaserver/install/server/upgrade.py", line 1536, in ca_update_acme_configuration
    separator='=')
  File "/usr/lib/python3.6/site-packages/ipapython/directivesetter.py", line 186, in get_directive
    with open(filename, "r") as fd:

2021-05-12T19:19:04Z DEBUG The ipa-server-upgrade command failed, exception: FileNotFoundError: [Errno 2] No such file or directory: '/etc/pki/pki-tomcat/acme/issuer.conf'
2021-05-12T19:19:04Z ERROR [Errno 2] No such file or directory: '/etc/pki/pki-tomcat/acme/issuer.conf'
2021-05-12T19:19:04Z ERROR The ipa-server-upgrade command failed. See /var/log/ipaupgrade.log for more information