RHEA-2015:1517 - Product Enhancement Advisory

Topic

Updated rhs-hadoop packages that adds an enhancement and fixes numerous bugs are now available for Red Hat Gluster Storage 3.1.

Description

Red Hat Gluster Storage is software-only, scale-out storage that provides
flexible and affordable unstructured data storage for an enterprise.
GlusterFS, a key building block of Red Hat Gluster Storage, is based on a
stackable user-space design and can deliver exceptional performance
for diverse workloads. GlusterFS aggregates various storage servers
over network interconnections into one large, parallel network file
system.

This advisory addresses the following bug fixes:

• Previously, directory with many small files were lining up files in

the listing by brick. As a consequence, there was a decrease in performance
of Hadoop jobs as the files were processed in the order of the listing.
The job was focusing on a single brick at a time. With this fix, the
files are sorted by directory listing and not by brick to enhance the
performance. (BZ#1093838)

• Previously, in a cluster, if a few nodes had similar names, some of the

nodes could be inadvertently skipped. With this fix, all the nodes are
processed regardless of naming similarities. (BZ#1205886)

• Previsouly, usage of https for Ambari was not supported. As a consequence,

enable_vol.sh and disable_vol.sh failed. With this fix, the user can chose
to use either http or https with Ambari and the scripts automatically
detect this. (BZ#1162181)

• Previously, setting entry-timeout=0 eliminated some caching and decreased

the performance. But this was the only setting which worked due to a bug
in the vfs kernel. With this fix, and the fact that the vfs bug has also
been fixed, eliminating setting of the entry-timeout and attribute-timeout
options (and thus using their default values) provides better performance.
(BZ#1209222)

• Previously, the hdp 2.1 stack was hard-coded and hence only the hdp 2.1

stack was visible. With this fix, all "glusterfs enabled" hdp stacks will
be visible in the Ambari installation wizard. (BZ#1217852)

• Previously, users in the "hadoop" group were unable to write to hive

directory. With this fix these users can now write to hive directory.
(BZ#1221344)

It also adds the following enhancement:

• The previous HTB version of the scripts have been significantly rewritten

to enhance the modularity and supportability. With some basic understanding
of shell command syntax, you can use the auxiliary supporting scripts
available at bin/add_dirs.sh and bin/gen_dirs.sh directories. (BZ#1062401)

All users of Red Hat Gluster Storage are advised to install these updated
packages.

Solution

Before applying this update, make sure all previously released errata
relevant to your system have been applied.

This update is available via the Red Hat Network. Details on how to
use the Red Hat Network to apply this update are available at
https://access.redhat.com/articles/11258

Affected Products

• Red Hat Gluster Storage Server for On-premise 3 for RHEL 6 x86_64

Fixes

• BZ - 1062401 - RFE: move code for directory tree setup on hcfs to standalone script
• BZ - 1093838 - Brick-sorted order of filenames in RHS directory harms Hadoop mapreduce performance
• BZ - 1195659 - rhs-hadoop package is missing dependencies
• BZ - 1217852 - enable all HDP/GlusterFS stacks
• BZ - 1221344 - Change hive/warehouse perms from 0755 to 0775

CVEs

(none)

References

• http://www.redhat.com/security/updates/classification/#normal