RHEL 8.7 released (November 9th)
- RHEL 8.7 was released November 9th 2022, this blog shows new features with 8.7 too,
- This is the download location for RHEL 8.7
- We recommend using the latest edition of RHEL. You can certainly use either RHEL 9 as well.
RHEL 8.x life cycle goes to 2029 and [RHEL 9.x life cycle goes to 2032 (scroll down at that link)
Those last two links also mention Extended Update Support.
Regards,
RJ
Responses
Hi all.
I am not an expert user by any account and use RHEL at home as a desktop computer and for playing around on my local network.
I ran yum upgrade today to keep things up to date as I occasionally do.
The upgrade process itself went smoothly from 8.6 to 8.7 on Kernel 4.18.0-425.3.1, but after rebooting I am getting these "BUG: soft lockup" errors.
The computer is unusable until I power cycle and use the previous Kernel, which was 4.18.0-372.32.1.
The only new errors I've noticed under the older Kernel are "Failed to start Performance Metrics Archive Logger" and "Failed to start Performance Metrics Collector Daemon", which are minor compared to being stuck but annoying because they were not there before.
Could someone try to help me with both problems?
Question 1: Have I found a bug in the new Kernel? If not, what can I do to make it work? I think the log below is related.
Nov 10 14:07:50 rhel kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 1-... } 602247 jiffies s: 29 root: 0x2/.
Nov 10 14:07:50 rhel kernel: rcu: blocking rcu_node structures (internal RCU debug):
Nov 10 14:07:50 rhel kernel: Task dump for CPU 1:
Nov 10 14:07:50 rhel kernel: task:kworker/1:1 state:R running task stack: 0 pid: 42 ppid: 2 flags:0x80004008
Nov 10 14:07:50 rhel kernel: Workqueue: events_power_efficient wg_ratelimiter_gc_entries [wireguard]
Nov 10 14:07:50 rhel kernel: Call Trace:
Nov 10 14:07:50 rhel kernel: ? native_queued_spin_lock_slowpath+0x179/0x1c0
Nov 10 14:07:50 rhel kernel: ? wg_ratelimiter_gc_entries+0x11b/0x170 [wireguard]
Nov 10 14:07:50 rhel kernel: ? process_one_work+0x1a7/0x360
Nov 10 14:07:50 rhel kernel: ? create_worker+0x1a0/0x1a0
Nov 10 14:07:50 rhel kernel: ? worker_thread+0x30/0x390
Nov 10 14:07:50 rhel kernel: ? create_worker+0x1a0/0x1a0
Nov 10 14:07:50 rhel kernel: ? kthread+0x10b/0x130
Nov 10 14:07:50 rhel kernel: ? set_kthread_struct+0x50/0x50
Nov 10 14:07:50 rhel kernel: ? ret_from_fork+0x35/0x40
Nov 10 14:07:53 rhel kernel: watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:1:42]
Nov 10 14:07:53 rhel kernel: Modules linked in: bridge stp llc tun wireguard(E) ip6_udp_tunnel udp_tunnel nft_masq nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nf_tables_set nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink sunrpc snd_hda_codec_hdmi snd_hda_codec_idt snd_hda_codec_generic dell_laptop ledtrig_audio intel_powerclamp iTCO_wdt coretemp iTCO_vendor_support snd_hda_intel dell_wmi sparse_keymap snd_intel_dspcfg snd_intel_sdw_acpi iwldvm wmi_bmof dell_smbios kvm_intel dcdbas dell_wmi_descriptor mac80211 dell_smm_hwmon uvcvideo snd_hda_codec libarc4 snd_hda_core kvm videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 snd_hwdep iwlwifi snd_seq pcspkr irqbypass videobuf2_common snd_seq_device snd_pcm videodev snd_timer intel_cstate snd intel_uncore cfg80211 soundcore wmi joydev intel_ips rfkill lpc_ich i2c_i801 mei_me mei acpi_cpufreq tcp_bbr sch_fq xfs libcrc32c sr_mod cdrom i915 i2c_algo_bit
Nov 10 14:07:53 rhel kernel: sd_mod cec t10_pi intel_gtt sg drm_buddy drm_dp_helper drm_kms_helper ahci libahci syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata crc32c_intel uas r8169 usb_storage drm serio_raw realtek video dm_mirror dm_region_hash dm_log dm_mod fuse
Nov 10 14:07:53 rhel kernel: CPU: 1 PID: 42 Comm: kworker/1:1 Tainted: G EL --------- - - 4.18.0-425.3.1.el8.x86_64 #1
Nov 10 14:07:53 rhel kernel: Hardware name: Dell Inc. Inspiron N5010/0WXY9J, BIOS A12 01/25/2011
Nov 10 14:07:53 rhel kernel: Workqueue: events_power_efficient wg_ratelimiter_gc_entries [wireguard]
Nov 10 14:07:53 rhel kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x17d/0x1c0
Nov 10 14:07:53 rhel kernel: Code: 48 89 c1 0f 18 08 eb 20 f3 90 8b 07 85 c0 75 f8 f0 0f b1 17 75 f2 65 ff 0d 6c 5e cd 58 e9 1b b6 aa 00 31 c9 eb 02 f3 90 8b 07 <66> 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c6 74 20 c6 07 01 48 85
Nov 10 14:07:53 rhel kernel: RSP: 0000:ffffafcdc07bfe60 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
Nov 10 14:07:53 rhel kernel: RAX: 0000000000080001 RBX: ffffffffc1050160 RCX: 0000000000000000
Nov 10 14:07:53 rhel kernel: RDX: ffff9fd033eabcc0 RSI: 0000000000080000 RDI: ffffffffc1050fb8
Nov 10 14:07:53 rhel kernel: RBP: 000f420a486effc0 R08: ffffffffa97b9ae0 R09: 0000746e65696369
Nov 10 14:07:53 rhel kernel: R10: 8080808080808080 R11: 0000000000000018 R12: dead000000000200
Nov 10 14:07:53 rhel kernel: R13: 0000000000000000 R14: ffff9fd033ec0f00 R15: 0000000000000000
Nov 10 14:07:53 rhel kernel: FS: 0000000000000000(0000) GS:ffff9fd033e80000(0000) knlGS:0000000000000000
Nov 10 14:07:53 rhel kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 10 14:07:53 rhel kernel: CR2: 00007f863310f008 CR3: 0000000009610006 CR4: 00000000000206e0
Nov 10 14:07:53 rhel kernel: Call Trace:
Nov 10 14:07:53 rhel kernel: wg_ratelimiter_gc_entries+0x11b/0x170 [wireguard]
Nov 10 14:07:53 rhel kernel: process_one_work+0x1a7/0x360
Nov 10 14:07:53 rhel kernel: ? create_worker+0x1a0/0x1a0
Nov 10 14:07:53 rhel kernel: worker_thread+0x30/0x390
Nov 10 14:07:53 rhel kernel: ? create_worker+0x1a0/0x1a0
Nov 10 14:07:53 rhel kernel: kthread+0x10b/0x130
Nov 10 14:07:53 rhel kernel: ? set_kthread_struct+0x50/0x50
Nov 10 14:07:53 rhel kernel: ret_from_fork+0x35/0x40
Question 2: I'm happy to stick to the older Kernel for now but would rather have all my services running. Any clues on what might be happening?
Nov 10 18:52:27 rhel root[39035]: pmcd_wait failed in /usr/libexec/pcp/lib/pmcd: exit status: 2
Nov 10 18:52:27 rhel systemd[1]: pmcd.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Nov 10 18:52:27 rhel systemd[1]: pmcd.service: Failed with result 'exit-code'.
Nov 10 18:52:27 rhel systemd[1]: Failed to start Performance Metrics Collector Daemon.
Nov 10 18:52:27 rhel systemd[1]: Starting Performance Metrics Archive Logger...
Nov 10 18:52:27 rhel systemd[1]: pmcd.service: Service RestartSec=100ms expired, scheduling restart.
Nov 10 18:52:27 rhel systemd[1]: pmcd.service: Scheduled restart job, restart counter is at 47.
Nov 10 18:52:27 rhel systemd[1]: Stopped Performance Metrics Collector Daemon.
Nov 10 18:52:27 rhel systemd[1]: Starting Performance Metrics Collector Daemon...
Nov 10 18:52:33 rhel systemd[1]: pmlogger.service: Failed with result 'protocol'.
Nov 10 18:52:33 rhel systemd[1]: Failed to start Performance Metrics Archive Logger.
Nov 10 18:52:33 rhel systemd[1]: Starting pmlogger farm service...
Nov 10 18:52:33 rhel systemd[1]: Started pmlogger farm service.
Nov 10 18:52:33 rhel systemd[1]: pmlogger.service: Service RestartSec=100ms expired, scheduling restart.
Nov 10 18:52:33 rhel systemd[1]: pmlogger.service: Scheduled restart job, restart counter is at 47.
Nov 10 18:52:33 rhel systemd[1]: Stopping pmlogger farm service...
Nov 10 18:52:33 rhel systemd[1]: pmlogger_farm.service: Succeeded.
Nov 10 18:52:33 rhel systemd[1]: Stopped pmlogger farm service.
Nov 10 18:52:33 rhel systemd[1]: Stopped Performance Metrics Archive Logger.
Nov 10 18:53:27 rhel root[39711]: pmcd_wait failed in /usr/libexec/pcp/lib/pmcd: exit status: 2
Nov 10 18:53:27 rhel systemd[1]: pmcd.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Nov 10 18:53:27 rhel systemd[1]: pmcd.service: Failed with result 'exit-code'.
Nov 10 18:53:27 rhel systemd[1]: Failed to start Performance Metrics Collector Daemon.
Nov 10 18:53:27 rhel systemd[1]: Starting Performance Metrics Archive Logger...
Nov 10 18:53:27 rhel systemd[1]: pmcd.service: Service RestartSec=100ms expired, scheduling restart.
Nov 10 18:53:27 rhel systemd[1]: pmcd.service: Scheduled restart job, restart counter is at 48.
Nov 10 18:53:27 rhel systemd[1]: Stopped Performance Metrics Collector Daemon.
Nov 10 18:53:27 rhel systemd[1]: Starting Performance Metrics Collector Daemon...
Nov 10 18:53:33 rhel systemd[1]: pmlogger.service: Failed with result 'protocol'.
Nov 10 18:53:33 rhel systemd[1]: Failed to start Performance Metrics Archive Logger.
Nov 10 18:53:33 rhel systemd[1]: Starting pmlogger farm service...
Nov 10 18:53:33 rhel systemd[1]: Started pmlogger farm service.
Nov 10 18:53:34 rhel systemd[1]: pmlogger.service: Service RestartSec=100ms expired, scheduling restart.
Nov 10 18:53:34 rhel systemd[1]: pmlogger.service: Scheduled restart job, restart counter is at 48.
Nov 10 18:53:34 rhel systemd[1]: Stopping pmlogger farm service...
Nov 10 18:53:34 rhel systemd[1]: pmlogger_farm.service: Succeeded.
Nov 10 18:53:34 rhel systemd[1]: Stopped pmlogger farm service.
Nov 10 18:53:34 rhel systemd[1]: Stopped Performance Metrics Archive Logger.
Thanks, Luiz
Hi,
I've got exactly the same problem, it seems like wireguard-dkms package provokes those issue, could you please help us by publish a kernel patch, or tell to wireguard-dkms dev's to fix their package please ?
21:08:59-root@pxy:~$ dnf update
Mise à jour des référentiels de gestion des abonnements.
Dernière vérification de l’expiration des métadonnées effectuée il y a 0:00:31 le mer. 16 nov. 2022 21:08:40 CET.
Dépendances résolues.
==============================================================================================================================================================
Paquet Architecture Version Dépôt Taille
==============================================================================================================================================================
Installation:
kernel x86_64 4.18.0-425.3.1.el8 rhel-8-for-x86_64-baseos-rpms 8.8 M
kernel-core x86_64 4.18.0-425.3.1.el8 rhel-8-for-x86_64-baseos-rpms 41 M
kernel-modules x86_64 4.18.0-425.3.1.el8 rhel-8-for-x86_64-baseos-rpms 33 M
Résumé de la transaction
==============================================================================================================================================================
Installer 3 Paquets
Taille totale des téléchargements : 83 M
Taille des paquets installés : 94 M
Voulez-vous continuer ? [o/N] : y
Téléchargement des paquets :
(1/3): kernel-4.18.0-425.3.1.el8.x86_64.rpm 1.5 MB/s | 8.8 MB 00:05
(2/3): kernel-modules-4.18.0-425.3.1.el8.x86_64.rpm 2.9 MB/s | 33 MB 00:11
(3/3): kernel-core-4.18.0-425.3.1.el8.x86_64.rpm 3.2 MB/s | 41 MB 00:12
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 6.5 MB/s | 83 MB 00:12
Test de la transaction
La vérification de la transaction a réussi.
Lancement de la transaction de test
Transaction de test réussie.
Exécution de la transaction
Préparation : 1/1
Installation : kernel-core-4.18.0-425.3.1.el8.x86_64 1/3
Exécution du scriptlet: kernel-core-4.18.0-425.3.1.el8.x86_64 1/3
Installation : kernel-modules-4.18.0-425.3.1.el8.x86_64 2/3
Exécution du scriptlet: kernel-modules-4.18.0-425.3.1.el8.x86_64 2/3
Installation : kernel-4.18.0-425.3.1.el8.x86_64 3/3
Exécution du scriptlet: kernel-core-4.18.0-425.3.1.el8.x86_64 3/3
dkms: running auto installation service for kernel 4.18.0-425.3.1.el8.x86_64
Sign command: /lib/modules/4.18.0-425.3.1.el8.x86_64/build/scripts/sign-file
Signing key: /var/lib/dkms/mok.key
Public certificate (MOK): /var/lib/dkms/mok.pub
Building module:
Cleaning build area...
make -j2 KERNELRELEASE=4.18.0-425.3.1.el8.x86_64 -C /lib/modules/4.18.0-425.3.1.el8.x86_64/build M=/var/lib/dkms/wireguard/1.0.20220627/build.......(bad exit status: 2)
Error! Bad return status for module build on kernel: 4.18.0-425.3.1.el8.x86_64 (x86_64)
Consult /var/lib/dkms/wireguard/1.0.20220627/build/make.log for more information.
Done.
Exécution du scriptlet: kernel-modules-4.18.0-425.3.1.el8.x86_64 3/3
Exécution du scriptlet: kernel-4.18.0-425.3.1.el8.x86_64 3/3
Vérification de : kernel-core-4.18.0-425.3.1.el8.x86_64 1/3
Vérification de : kernel-4.18.0-425.3.1.el8.x86_64 2/3
Vérification de : kernel-modules-4.18.0-425.3.1.el8.x86_64 3/3
Produits installés mis à jour.
Installé:
kernel-4.18.0-425.3.1.el8.x86_64 kernel-core-4.18.0-425.3.1.el8.x86_64 kernel-modules-4.18.0-425.3.1.el8.x86_64
Terminé !
21:14:11-root@pxy:~$ cat /var/lib/dkms/wireguard/1.0.20220627/build/make.log
DKMS make.log for wireguard-1.0.20220627 for kernel 4.18.0-425.3.1.el8.x86_64 (x86_64)
mer. nov. 16 21:12:30 CET 2022
make : on entre dans le répertoire « /usr/src/kernels/4.18.0-425.3.1.el8.x86_64 »
CC [M] /var/lib/dkms/wireguard/1.0.20220627/build/main.o
CC [M] /var/lib/dkms/wireguard/1.0.20220627/build/noise.o
In file included from <ligne-de-commande>:
/var/lib/dkms/wireguard/1.0.20220627/build/compat/compat.h:415:19: error: redéfinition de « ktime_get_coarse_boottime_ns »
static inline u64 ktime_get_coarse_boottime_ns(void)
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from <ligne-de-commande>:
/var/lib/dkms/wireguard/1.0.20220627/build/compat/compat.h:415:19: error: redéfinition de « ktime_get_coarse_boottime_ns »
static inline u64 ktime_get_coarse_boottime_ns(void)
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from ./include/linux/ktime.h:266,
from /var/lib/dkms/wireguard/1.0.20220627/build/compat/compat.h:394,
from <ligne-de-commande>:
./include/linux/timekeeping.h:119:19: note: la définition précédente de « ktime_get_coarse_boottime_ns » était ici
static inline u64 ktime_get_coarse_boottime_ns(void)
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from ./include/linux/ktime.h:266,
from /var/lib/dkms/wireguard/1.0.20220627/build/compat/compat.h:394,
from <ligne-de-commande>:
./include/linux/timekeeping.h:119:19: note: la définition précédente de « ktime_get_coarse_boottime_ns » était ici
static inline u64 ktime_get_coarse_boottime_ns(void)
^~~~~~~~~~~~~~~~~~~~~~~~~~~~
make[1]: *** [scripts/Makefile.build:317: /var/lib/dkms/wireguard/1.0.20220627/build/noise.o] Error 1
make[1]: *** Attente des tâches non terminées....
make[1]: *** [scripts/Makefile.build:317: /var/lib/dkms/wireguard/1.0.20220627/build/main.o] Error 1
make: *** [Makefile:1585: _module_/var/lib/dkms/wireguard/1.0.20220627/build] Error 2
make : on quitte le répertoire « /usr/src/kernels/4.18.0-425.3.1.el8.x86_64 »
I highly recommend using ELRepo's kmod package. The latest version works on RHEL 8.7.
kmod-wireguard-1.0.20220627-3.el8_7.elrepo
One of the advantages of kmod packages is that they are kABI-tracking, meaning they do no require re-building upon each kernel update. If you decide to make a switch, be sure to remove the dkms version before installing the kmod.
nevermind use kmod-wireguard instead from elrepo, install procedure for red hat 8 is here : https://www.wireguard.com/install/