6.3.2. Prerequisites for using Infiniband
The machines running the server and client must each have Infiniband properly installed. In particular:
- The kernel driver and the user space driver for your Infiniband hardware must both be installed.
- Allocate lockable memory for Infiniband.By default, the operating system can swap out all user memory. Infiniband requires lockable memory, which can not be swapped out. Each connection requires 8 Megabytes (8192 bytes) of lockable memory.To allocate lockable memory, edit
/etc/security/limits.conf
to set the limit, which is the maximum amount of lockable memory that a given process can allocate. - The Infiniband interface must be configured to allow IP over Infiniband. This is used for RDMA connection management.