Unable to launch Job template in Automation Controller?

Solution Verified - Updated -

Environment

  • Ansible Automation Platform 2.1+
  • RHEL 8.x

Issue

  • Ansible playbook is running successfully through command line but is failing on Automation Controller with the following error:
/usr/bin/crun: symbol lookup error: /usr/bin/crun: undefined symbol: criu_feature_check
ERRO[0000] Removing container a485ef32438011d1ae72c0858c95ec58118a01b1d3e97c5eb4faec461c83bad1 from runtime after creation failed
Error: OCI runtime error: crun: /usr/bin/crun: symbol lookup error: /usr/bin/crun: undefined symbol: criu_feature_check

Resolution

  • The package crun-1.7.2-2 adds criu >= 3.17.1 dependency, which is available in RHEL 9.2. Please update the AAP Controller server to RHEL9.2 to avoid this issue.
  • The known workaround reported to fix the solution is to perform the following steps on the Controller node in the mentioned order:
  1. Check the installed version of package crun:
$ sudo dnf list --installed | grep crun
crun.x86_64                                      crun-1.5-1.el9_0                    @rhel-9-for-x86_64-appstream-rpms
  1. Downgrade the crun package to crun-1.4.5-2.el9_0.x86_64
$ sudo dnf downgrade crun-1.4.5-2.el9_0

Note: The above mentioned tasks were performed on RHEL9 server, please use the package version to match the version of the Controller node.

Root Cause

  • The error occurred from crun being updated to crun-1.5-1.el9.x86_64 which requires criu-libs 3.17-4 to function correctly, while the crui-libs remained at 3.15-13.
  • The package crun-1.7.2-2 adds criu >= 3.17.1 dependency, which will become available in RHEL 9.2 (https://errata.engineering.redhat.com/advisory/105856). The issue is not reproducible in RHEL9.2.

Diagnostic Steps

  • Check the dependency of criu package. criu-libs-3.17-4.el9.x86_64 is a direct dependency of crun-1.5-1.el9.x86_64
$ sudo dnf repoquery --deplist crun-1.5-1.el9.x86_64 | grep criu
Last metadata expiration check: 0:51:43 ago on Thu 12 Jan 2023 07:28:48 AM MST.
  dependency: libcriu.so.2()(64bit)
   provider: criu-libs-3.17-4.el9.x86_64
   provider: criu-libs-3.17-4.el9.x86_64
  dependency: libcriu.so.2()(64bit)
   provider: criu-libs-3.17-4.el9.x86_64
   provider: criu-libs-3.17-4.el9.x86_64

However, the installation/upgrade of AAP is not upgrading the criu-libs dependency.

$ sudo dnf list --installed|grep criu
criu.x86_64                                      3.15-13.el9                      @AppStream                                             
criu-libs.x86_64                                 3.15-13.el9                      @AppStream

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments