Multipathd stops with a segfault in RHEL

Solution Verified - Updated -

Environment

  • Red Hat Enterprise Linux Server(RHEL) 6
  • device-mapper-multipath

Issue

  • Every time we start multipathd service it stops showing a segfault in /var/log/messages
Dec  1 12:22:42 blinsr9b2 kernel: multipath[10568]: segfault at 0 ip (null) sp 00007fff953db238 error 14 in multipath[400000+4000]
Dec  1 12:36:04 blinsr9b2 kernel: multipathd[10813]: segfault at 0 ip (null) sp 00007fffdf1f2a48 error 14 in multipathd[400000+10000]

Resolution

  • Make sure server has latest packages for device-mapper-multipath,device-mapper and glibc.
# yum update device-mapper device-mapper-multipath glibc -y
# service multipathd restart
# multipath -ll

Root Cause

  • The server has latest package of device-mapper-multipath, but a very old version of device-mapper and glibc.

Diagnostic Steps

  • Check device-mapper-multipathd, glibc and device-mapper versions.
  • Below you will see that device-mapper and glibc have very old versions example running RHEL 6.5 :
[root@blinsr9b2 ~]# rpm -qa |grep mapper
device-mapper-1.02.79-8.el6.x86_64
device-mapper-multipath-0.4.9-80.el6_6.1.x86_64       <------------ device-mapper-multipath latest version
device-mapper-persistent-data-0.2.8-2.el6.x86_64
device-mapper-libs-1.02.79-8.el6.x86_64
device-mapper-event-libs-1.02.79-8.el6.x86_64
device-mapper-event-1.02.79-8.el6.x86_64
device-mapper-multipath-libs-0.4.9-80.el6_6.1.x86_64

[root@blinsr9b2 ~]# rpm -qa |grep glibc
glibc-common-2.12-1.132.el6.x86_64
glibc-2.12-1.132.el6.x86_64
glibc-devel-2.12-1.132.el6.x86_64
glibc-headers-2.12-1.132.el6.x86_64

[root@blinsr9b2 ~]# cat /var/log/messages
Dec  1 12:22:40 blinsr9b2 kernel: qla2xxx [0000:05:00.0]-505f:1: Link is operational (8 Gbps).
Dec  1 12:22:40 blinsr9b2 kernel: qla2xxx [0000:05:00.1]-505f:2: Link is operational (8 Gbps).
Dec  1 12:22:42 blinsr9b2 kernel: multipath[10568]: segfault at 0 ip (null) sp 00007fff953db238 error 14 in multipath[400000+4000]
Dec  1 12:36:04 blinsr9b2 kernel: multipathd[10813]: segfault at 0 ip (null) sp 00007fffdf1f2a48 error 14 in multipathd[400000+10000]

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments