Red Hat Enterprise Linux 6

Configuring the Red Hat High Availability Add-On with Pacemaker

Reference Document for the High Availability Add-On for Red Hat Enterprise Linux 6


Steven Levine

Red Hat Customer Content Services

Legal Notice

Copyright © 2017 Red Hat, Inc.
This document is licensed by Red Hat under the Creative Commons Attribution-ShareAlike 3.0 Unported License. If you distribute this document, or a modified version of it, you must provide attribution to Red Hat, Inc. and provide a link to the original. If the document is modified, all Red Hat trademarks must be removed.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, OpenShift, Fedora, the Infinity logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux® is the registered trademark of Linus Torvalds in the United States and other countries.
Java® is a registered trademark of Oracle and/or its affiliates.
XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries.
MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
Node.js® is an official trademark of Joyent. Red Hat Software Collections is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack® Word Mark and OpenStack logo are either registered trademarks/service marks or trademarks/service marks of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
All other trademarks are the property of their respective owners.


Configuring the Red Hat High Availability Add-On with Pacemaker provides information on configuring the Red Hat High Availability Add-On using Pacemaker.
1. Document Conventions
1.1. Typographic Conventions
1.2. Pull-quote Conventions
1.3. Notes and Warnings
2. Feedback
1. Red Hat High Availability Add-On Configuration and Management Reference Overview
1.1. Installing Pacemaker configuration tools
1.2. Configuring the iptables Firewall to Allow Cluster Components
1.3. The Cluster and Pacemaker Configuration Files
1.4. Cluster Configuration Considerations
2. The pcs Command Line Interface
2.1. The pcs Commands
2.2. pcs Usage Help Display
2.3. Viewing the Raw Cluster Configuration
2.4. Saving a Configuration Change to a File
2.5. Displaying Status
2.6. Displaying the Full Cluster Configuration
2.7. Displaying The Current pcs Version
3. Cluster Creation and Administration
3.1. Cluster Creation
3.1.1. Starting the pcsd daemon
3.1.2. Authenticating the Cluster Nodes
3.1.3. Configuring and Starting the Cluster Nodes
3.1.4. Enabling and Disabling Cluster Services
3.2. Managing Cluster Nodes
3.2.1. Stopping Cluster Services
3.2.2. Adding Cluster Nodes
3.2.3. Removing Cluster Nodes
3.2.4. Standby Mode
3.3. Setting User Permissions
3.4. Removing the Cluster Configuration
3.5. Displaying Cluster Status
4. Fencing: Configuring STONITH
4.1. Available STONITH (Fencing) Agents
4.2. General Properties of Fencing Devices
4.3. Displaying Device-Specific Fencing Options
4.4. Creating a Fencing Device
4.5. Configuring Storage-Based Fence Devices with unfencing
4.6. Displaying Fencing Devices
4.7. Modifying and Deleting Fencing Devices
4.8. Managing Nodes with Fence Devices
4.9. Additional Fencing Configuration Options
4.10. Configuring Fencing Levels
4.11. Configuring Fencing for Redundant Power Supplies
5. Configuring Cluster Resources
5.1. Resource Creation
5.2. Resource Properties
5.3. Resource-Specific Parameters
5.4. Resource Meta Options
5.5. Resource Groups
5.5.1. Group Options
5.5.2. Group Stickiness
5.6. Resource Operations
5.7. Displaying Configured Resources
5.8. Modifying Resource Parameters
5.9. Multiple Monitoring Operations
5.10. Enabling and Disabling Cluster Resources
5.11. Cluster Resources Cleanup
6. Resource Constraints
6.1. Location Constraints
6.1.1. Configuring an "Opt-In" Cluster
6.1.2. Configuring an "Opt-Out" Cluster
6.2. Order Constraints
6.2.1. Mandatory Ordering
6.2.2. Advisory Ordering
6.2.3. Ordered Resource Sets
6.2.4. Removing Resources From Ordering Constraints
6.3. Colocation of Resources
6.3.1. Mandatory Placement
6.3.2. Advisory Placement
6.3.3. Colocating Sets of Resources
6.3.4. Removing Colocation Constraints
6.4. Displaying Constraints
7. Managing Cluster Resources
7.1. Manually Moving Resources Around the Cluster
7.1.1. Moving a Resource from its Current Node
7.1.2. Moving a Resource to its Preferred Node
7.2. Moving Resources Due to Failure
7.3. Moving Resources Due to Connectivity Changes
7.4. Enabling, Disabling, and Banning Cluster Resources
7.5. Disabling a Monitor Operations
7.6. Managed Resources
8. Advanced Resource types
8.1. Resource Clones
8.1.1. Creating and Removing a Cloned Resource
8.1.2. Clone Constraints
8.1.3. Clone Stickiness
8.2. Multi-State Resources: Resources That Have Multiple Modes
8.2.1. Monitoring Multi-State Resources
8.2.2. Multi-state Constraints
8.2.3. Multi-state Stickiness
8.3. Configuring a Virtual Domain as a Resource
8.4. The pacemaker_remote Service
8.4.1. Host and Guest Authentication
8.4.2. Guest Node Resource Options
8.4.3. Remote Node Resource Options
8.4.4. Changing Default pacemaker_remote Options
8.4.5. Configuration Overview: KVM Guest Node
8.4.6. Configuration Overview: Remote Node
8.4.7. System Upgrades and pacemaker_remote
8.4.8. Converting a VM Resource to a Guest Node
9. Pacemaker Rules
9.1. Node Attribute Expressions
9.2. Time/Date Based Expressions
9.3. Date Specifications
9.4. Durations
9.5. Configuring Rules with pcs
9.6. Sample Time Based Expressions
9.7. Using Rules to Determine Resource Location
10. Pacemaker Cluster Properties
10.1. Summary of Cluster Properties and Options
10.2. Setting and Removing Cluster Properties
10.3. Querying Cluster Property Settings
11. Triggering Scripts for Cluster Events
11.1. Pacemaker Alert Agents (Red Hat Enterprise Linux 6.9 and later)
11.1.1. Using the Sample Alert Agents
11.1.2. Alert Creation
11.1.3. Displaying, Modifying, and Removing Alerts
11.1.4. Alert Recipients
11.1.5. Alert Meta Options
11.1.6. Alert Configuration Command Examples
11.1.7. Writing an Alert Agent
11.2. Event Notification with Monitoring Resources
A. Cluster Creation in Red Hat Enterprise Linux Release 6.5 and Red Hat Enterprise Linux Release 6.6 (and later)
A.1. Cluster Creation with rgmanager and with Pacemaker
A.2. Cluster Creation with Pacemaker in Red Hat Enterprise Linux Release 6.5 and Red Hat Enterprise Linux Release 6.6 (and later)
B. Configuration Example Using pcs Commands
B.1. Initial System Setup
B.1.1. Installing the Cluster Software
B.1.2. Creating and Starting the Cluster
B.2. Fencing Configuration
B.3. Configuring an Apache HTTP Server in a Red Hat High Availability Cluster with the pcs Command
B.3.1. Configuring an LVM Volume with an ext4 File System
B.3.2. Web Server Configuration
B.3.3. Exclusive Activation of a Volume Group in a Cluster
B.3.4. Creating the Resources and Resource Groups with the pcs Command
B.3.5. Testing the Resource Configuration
C. Updating Software Packages on a Running Cluster
D. Creating New Logical Volumes for an Existing Cluster
E. Revision History