Chapter 7. Configure Cluster Templates

After registering the required components (]) and configuring the types of nodes you need (xref:confignodetemplates[), you can now configure cluster templates. Cluster templates define the following settings for a cluster:

  • The node composition of the cluster (as in, how many of each node type). Available node types are listed Project > Data Processing > Node Group Templates.
  • The Hadoop plug-in and version used by the cluster.
  • A list of processes that should only be launched once on a single host (anti-affinity).
  • Cluster-level parameters for Hadoop services.

To create and configure a cluster template:

  1. In the dashboard, select Project > Data Processing > Cluster Templates.
  2. Use the Plugin Name and Version drop-down menus to select the name and version of the Hadoop plug-in that the cluster will use.
  3. Click Create.
  4. Enter a name for your template in the Template Name field.
  5. Use the Description field to describe the cluster template you are creating (optional).
  6. From the Use anti-affinity groups for list, check the box of each process that should not be launched more than once on a host.
  7. Click the Node Groups tab. From here, configure how many nodes of each node type should run in the cluster. To do this:

    1. Use the Select a Node Group Template to add: drop-down menu to select a template (see Chapter 6, Configure Node Group Templates for related information).
    2. Click + to create a node group entry based on the template. Do this for each node group template you want to use in the cluster template.
    3. For each node group entry, set how many instances of that node type should launch in the cluster.

      You can also enter a name for each node group entry (optional).

  8. Configure Hadoop cluster settings by component as needed. Each component (for example, ZOOKEEPER, AMBARI, HUE) has its own parameters tab. Each tab contains related parameters, most of which also have brief contextual help. For more information on these parameters, consult your selected Hadoop plug-in’s documentation on supported functions for each component.
  9. Once you are satisfied with the configuration of your cluster template, click Create. Your template should now appear in the Cluster Templates table.

Alternatively, you can also use the Upload Template button to upload an existing cluster template from your local file system.

You can also launch a cluster using any existing templates from the Cluster Templates table. To do this, select Launch Cluster from the Actions drop-down menu of a cluster template. To view launched clusters, select Project > Data Processing > Clusters. For more information about launching a cluster, see Chapter 8, Launch a Cluster.