Red Hat Storage 2.0

Administration Guide

Configuring and Managing Red Hat Storage Server

Edition 1

Divya Muntimadugu

Red Hat Engineering Content Services

Anjana Suparna Sriram

Red Hat Engineering Content Services

Legal Notice

Copyright © 2013 Red Hat Inc.
This document is licensed by Red Hat under the Creative Commons Attribution-ShareAlike 3.0 Unported License. If you distribute this document, or a modified version of it, you must provide attribution to Red Hat, Inc. and provide a link to the original. If the document is modified, all Red Hat trademarks must be removed.
Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries.
Linux® is the registered trademark of Linus Torvalds in the United States and other countries.
Java® is a registered trademark of Oracle and/or its affiliates.
XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries.
MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries.
Node.js® is an official trademark of Joyent. Red Hat Software Collections is not formally related to or endorsed by the official Joyent Node.js open source or commercial project.
The OpenStack® Word Mark and OpenStack Logo are either registered trademarks/service marks or trademarks/service marks of the OpenStack Foundation, in the United States and other countries and are used with the OpenStack Foundation's permission. We are not affiliated with, endorsed or sponsored by the OpenStack Foundation, or the OpenStack community.
All other trademarks are the property of their respective owners.


Red Hat Storage Administration Guide describes the configuration and management of Red Hat Storage Server for On-Premise and Public Cloud.
1. Audience
2. License
3. Document Conventions
3.1. Typographic Conventions
3.2. Pull-quote Conventions
3.3. Notes and Warnings
4. Getting Help and Giving Feedback
4.1. Do You Need Help?
4.2. We Need Feedback!
I. Introduction
1. Introducing Red Hat Storage
2. Red Hat Storage Architecture
2.1. Red Hat Storage Server for On-Premise Architecture
2.2. Red Hat Storage Server for Public Cloud
3. Key Features
3.1. Elasticity
3.2. No Metadata with the Elastic Hash Algorithm
3.3. Scalability
3.4. High Availability and Flexibility
3.5. Flexibility
3.6. No Application Rewrites
3.7. Simple Management
3.8. Modular, Stackable Design
3.9. Unified File and Object Storage
3.10. Hadoop Compatible Storage
4. Use Case Examples
4.1. Use Case 1: Using Red Hat Storage for Data Archival
4.1.1. Key Features of Red Hat Storage Server for Nearline and Archival Use Case
4.2. Use Case 2: Using Red Hat Storage for High Performance Computing
4.2.1. Key Features of Red Hat Storage Server for High Performance Computing Use Case
4.3. Use Case 3: Using Red Hat Storage for Content Clouds
4.3.1. Key Features of Red Hat Storage Server for for Content Clouds Use Case
5. Storage Concepts
II. Red Hat Storage Administration On-Premise
6. Managing the glusterd Service
6.1. Starting and Stopping glusterd Manually
7. Setting up Trusted Storage Pools
7.1. Adding Servers to Trusted Storage Pool
7.2. Removing Servers from the Trusted Storage Pool
8. Setting up Red Hat Storage Volumes
8.1. Formatting and Mounting Bricks
8.2. Encrypted Disk
8.3. Creating Distributed Volumes
8.4. Creating Replicated Volumes
8.5. Creating Distributed Replicated Volumes
8.6. Creating Striped Volumes
8.7. Creating Striped Replicated Volumes
8.8. Creating Distributed Striped Volumes
8.9. Creating Distributed Striped Replicated Volumes
8.10. Starting Volumes
9. Accessing Data - Setting Up Clients
9.1. Native Client
9.1.1. Installing Native Client
9.1.2. Mounting Red Hat Storage Volumes
9.2. NFS
9.2.1. Using NFS to Mount Red Hat Storage Volumes
9.2.2. Troubleshooting NFS
9.3. SMB
9.3.1. Mounting Red Hat Storage Volumes as SMB Shares
9.4. Configuring Automated IP Failover for NFS and SMB
9.4.1. Setting Up CTDB
9.4.2. Starting and Verifying your Configuration
9.5. POSIX Access Control Lists
9.5.1. Setting POSIX ACLs
9.5.2. Retrieving POSIX ACLs
9.5.3. Removing POSIX ACLs
9.5.4. Samba and ACLs
9.5.5. NFS and ACLs
10. Managing Red Hat Storage Volumes
10.1. Tuning Volume Options
10.2. Expanding Volumes
10.3. Shrinking Volumes
10.3.1. Stopping Remove Brick Operation
10.4. Migrating Volumes
10.5. Rebalancing Volumes
10.5.1. Displaying Status of Rebalance Operation
10.5.2. Stopping Rebalance Operation
10.6. Stopping Volumes
10.7. Deleting Volumes
10.8. Triggering Self-Heal on Replicate
10.9. Configuring Server-Side Quorum
11. Managing Geo-replication
11.1. Replicated Volumes vs Geo-replication
11.2. Preparing to Deploy Geo-replication
11.2.1. Exploring Geo-replication Deployment Scenarios
11.2.2. Geo-replication Deployment Overview
11.2.3. Pre-requisite
11.2.4. Setting Up the Environment for Geo-replication
11.2.5. Setting Up the Environment for a Secure Geo-replication Slave
11.3. Starting Geo-replication
11.3.1. Starting Geo-replication
11.3.2. Verifying Successful Deployment
11.3.3. Displaying Geo-replication Status Information
11.3.4. Configuring Geo-replication
11.3.5. Stopping Geo-replication
11.4. Restoring Data from the Slave
11.5. Triggering Geo-replication Failover and Failback
11.6. Best Practices
11.7. Troubleshooting Geo-replication
11.7.1. Locating Log Files
11.7.2. Rotating Geo-replication Logs
11.7.3. Synchronization is not complete
11.7.4. Issues in Data Synchronization
11.7.5. Geo-replication status displays Faulty very often
11.7.6. Intermediate Master goes to Faulty State
11.7.7. Remote gsyncd Not Found
11.7.8. Remote gsyncd Not Found
12. Managing Directory Quota
12.1. Enabling Quota
12.2. Disabling Quota
12.3. Setting or Replacing Disk Limit
12.4. Displaying Disk Limit Information
12.5. Updating the Timeout of Size Cache
12.6. Removing Disk Limit
13. Monitoring your Red Hat Storage Workload
13.1. Running Volume Profile Command
13.1.1. Start Profiling
13.1.2. Displaying the I/O Information
13.1.3. Stop Profiling
13.2. Running Volume Top Command
13.2.1. Viewing Open File Descriptor Count and Maximum File Descriptor Count
13.2.2. Viewing Highest File Read Calls
13.2.3. Viewing Highest File Write Calls
13.2.4. Viewing Highest Open Calls on Directory
13.2.5. Viewing Highest Read Calls on Directory
13.2.6. Viewing List of Read Performance
13.2.7. Viewing List of Write Performance
13.3. Listing Volumes
13.4. Displaying Volume Information
13.5. Performing Statedump on a Volume
13.6. Displaying Volume Status
14. Managing Red Hat Storage Volume Life-Cycle Extensions
14.1. Location of Scripts
14.2. Prepackaged Scripts
III. Red Hat Storage Administration on Public Cloud
15. Launching Red Hat Storage Server for Public Cloud
15.1. Launching Red Hat Storage Instance
15.2. Verifying that Red Hat Storage Instance is running
16. Provisioning Storage
17. Stopping and Restarting Red Hat Storage Instance
IV. Data Access with Other Interfaces
18. Managing Unified File and Object Storage
18.1. Components of Object Storage
18.2. Advantages of using Unified File and Object Storage
18.3. Pre-requisites
18.4. Configuring Unified File and Object Storage
18.4.1. Adding Users
18.4.2. Configuring Proxy Server
18.4.3. Configuring Authentication System
18.4.4. Configuring Proxy Server for HTTPS
18.4.5. Configuring Object Server
18.4.6. Configuring Container Server
18.4.7. Configuring Account Server
18.4.8. Starting and Stopping Server
18.5. Working with Unified File and Object Storage
18.5.1. Configuring Authenticated Access
18.5.2. Working with Accounts
18.5.3. Working with Containers
18.5.4. Working with Objects
19. Managing Hadoop Compatible Storage
19.1. Architecture Overview
19.2. Advantages
19.3. Preparing to Install Hadoop Compatible Storage
19.3.1. Pre-requisites
19.4. Configuring Hadoop Compatible Storage
19.5. Starting and Stopping the Hadoop MapReduce Daemon
19.6. Troubleshooting Hadoop Compatible Storage
19.6.1. Time Sync
V. Appendices
20. Command Reference
20.1. gluster Command
20.2. glusterd Daemon
21. Troubleshooting
21.1. Managing Red Hat Storage Logs
21.1.1. Rotating Logs
21.2. Troubleshooting File Locks
A. Revision History