WARNING: CPU: xx PID: xxx at arch/x86/kernel/smp.c:128 native_smp_send_reschedule+0x34/0x40

Solution Unverified - Updated -

Issue

  • Multiple warnings triggered from native_smp_send_reschedule() upon sending reschedule IPI followed by the crash.
<4>[593202.698414] ------------[ cut here ]------------
<4>[593202.698415] sched: Unexpected reschedule of offline CPU#79!
<4>[593202.698419] WARNING: CPU: 78 PID: 482 at arch/x86/kernel/smp.c:128 native_smp_send_reschedule+0x34/0x40
<4>[593202.698420] Modules linked in: [...]
<4>[593202.698575] Features: eBPF/sock eBPF/event
<4>[593202.698581] CPU: 78 PID: 482 Comm: ksoftirqd/78 Tainted: G      D W  OE    --------- -  - 4.18.0-305.34.2.el8_4.x86_64 #1
<4>[593202.698582] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 02/10/2022
<4>[593202.698585] RIP: 0010:native_smp_send_reschedule+0x34/0x40
<4>[593202.698587] Code: 05 c1 b1 7c 01 73 15 48 8b 05 38 74 13 01 be fd 00 00 00 48 8b 40 30 e9 6a cc ba 00 89 fe 48 c7 c7 10 ef 8a 8e e8 45 b4 08 00 <0f> 0b c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 53 48 83 ec 20
<4>[593202.698588] RSP: 0018:ffffa5cbcdd1f268 EFLAGS: 00010086
<4>[593202.698591] RAX: 0000000000000000 RBX: ffff98e6bede9f40 RCX: 0000000000000007
<4>[593202.698593] RDX: 0000000000000007 RSI: 0000000000000002 RDI: ffff98e6bed96800
<4>[593202.698594] RBP: ffff98e24b6f4740 R08: 0000000000000002 R09: 0000000000029780
<4>[593202.698596] R10: 0004f1eab6421a56 R11: 00000000000ad224 R12: 0000000000000004
<4>[593202.698597] R13: ffffa5cbcdd1f2b8 R14: 0000000000000087 R15: ffff98e6bedc0000
<4>[593202.698599] FS:  0000000000000000(0000) GS:ffff98e6bed80000(0000) knlGS:0000000000000000
<4>[593202.698600] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4>[593202.698602] CR2: 000000c044bfe000 CR3: 0000003da89ac000 CR4: 0000000000350ee0
<4>[593202.698603] Call Trace:
<4>[593202.698607]  check_preempt_curr+0x7a/0x90
<4>[593202.698609]  ttwu_do_wakeup+0x19/0x140
<4>[593202.698612]  try_to_wake_up+0x1a8/0x590
<4>[593202.698615]  pollwake+0x74/0x90
<4>[593202.698617]  ? wake_up_q+0x80/0x80
<4>[593202.698620]  __wake_up_common+0x7a/0x190
<4>[593202.698623]  __wake_up_common_lock+0x7c/0xc0
<4>[593202.698626]  ep_poll_callback+0x103/0x2c0
<4>[593202.698629]  __wake_up_common+0x7a/0x190
<4>[593202.698631]  __wake_up_common_lock+0x7c/0xc0
<4>[593202.698635]  sock_def_readable+0x37/0x60
<4>[593202.698637]  __netlink_sendskb+0x51/0x70
<4>[593202.698639]  netlink_unicast+0x212/0x260
<4>[593202.698644]  queue_userspace_packet+0x4af/0x5f0 [openvswitch]
<4>[593202.698650]  ovs_dp_upcall+0x38/0x60 [openvswitch]
<4>[593202.698654]  ovs_dp_process_packet+0x143/0x1d0 [openvswitch]
<4>[593202.698659]  clone_execute+0x1c3/0x1f0 [openvswitch]
<4>[593202.698664]  do_execute_actions+0x435/0xaa0 [openvswitch]
<4>[593202.698673]  ? nf_conntrack_tcp_packet+0x1e1/0xb00 [nf_conntrack]
<4>[593202.698681]  ? nf_conntrack_tcp_packet+0x34a/0xb00 [nf_conntrack]
<4>[593202.698689]  ? nf_conntrack_in+0x498/0x5e0 [nf_conntrack]
<4>[593202.698695]  ? flow_lookup.isra.17+0x95/0xf0 [openvswitch]
<4>[593202.698700]  ovs_execute_actions+0x48/0x100 [openvswitch]
<4>[593202.698705]  ovs_dp_process_packet+0x96/0x1d0 [openvswitch]
<4>[593202.698710]  ? ovs_ct_execute+0x192/0x7b0 [openvswitch]
<4>[593202.698714]  clone_execute+0x1c3/0x1f0 [openvswitch]
<4>[593202.698719]  do_execute_actions+0x435/0xaa0 [openvswitch]
<4>[593202.698722]  ? __kmalloc+0x102/0x240
<4>[593202.698726]  ? vxlan_rcv+0x333/0xfb0 [vxlan]
<4>[593202.698732]  ? flow_lookup.isra.17+0x95/0xf0 [openvswitch]
<4>[593202.698737]  ovs_execute_actions+0x48/0x100 [openvswitch]
<4>[593202.698741]  ovs_dp_process_packet+0x96/0x1d0 [openvswitch]
<4>[593202.698747]  ovs_vport_receive+0x6c/0xc0 [openvswitch]
<4>[593202.698750]  ? ip_protocol_deliver_rcu+0xdf/0x1d0
<4>[593202.698752]  ? ip_local_deliver_finish+0x4a/0x50
<4>[593202.698755]  ? ip_local_deliver+0x6b/0xe0
<4>[593202.698759]  ? napi_gro_receive+0xba/0xe0
<4>[593202.698764]  netdev_frame_hook+0xc0/0x180 [openvswitch]
<4>[593202.698767]  __netif_receive_skb_core+0x6a4/0xc40
<4>[593202.698770]  ? __switch_to_asm+0x41/0x70
<4>[593202.698775]  ? netdev_create+0x30/0x30 [openvswitch]
<4>[593202.698778]  ? __switch_to_asm+0x35/0x70
<4>[593202.698780]  ? __switch_to_asm+0x41/0x70
<4>[593202.698783]  process_backlog+0xae/0x160
<4>[593202.698785]  net_rx_action+0x149/0x3b0
<4>[593202.698788]  __do_softirq+0xd7/0x2d6
<4>[593202.698791]  ? sort_range+0x20/0x20
<4>[593202.698793]  run_ksoftirqd+0x26/0x40
<4>[593202.698796]  smpboot_thread_fn+0xc5/0x160
<4>[593202.698798]  kthread+0x116/0x130
<4>[593202.698800]  ? kthread_flush_work_fn+0x10/0x10
<4>[593202.698802]  ret_from_fork+0x22/0x40
<4>[593202.698805] ---[ end trace 6a6f58bcdc4abdf4 ]---
<4>[593202.698809] ------------[ cut here ]------------

Environment

RHOCP 4.9
CoreOS release 4.9 (kernel-4.18.0-305.34.2.el8_4)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content