Chapter 2. Reference Architecture Environment

This section focuses on the components used during the deployment of Oracle RAC Database 12c Release 2 with Oracle Automatic Storage Management (ASM) on Red Hat Enterprise Linux 7 x86_64 in this reference architecture.

2.1. Reference Architecture Overview

A pictorial representation of the environment used in this reference environment is shown in Figure 2.1, “Reference Architecture Overview”

Figure 2.1. Reference Architecture Overview

ref arch overview rac

2.2. Network Topology

The network topology in this reference environment consists of two public switches using link aggregation to connect the two switches together (Public Switch A and Public Switch B), creating a single logical switch. A similar link aggregation is done for private switches (Private Switch A and Private Switch B), creating a single logical switch. Ethernet device em1 on the server connects to Public Switch A, while Ethernet device em2 on the server connects to Public Switch B. Ethernet devices em1 and em2 are bonded together as a bond device, bond0, providing high availability for the public network traffic. Ethernet device em3 on each server connects to Private Switch A, while Ethernet device em4 on each server connects to Private Switch B. Ethernet devices em3 and em4 take advantage of Oracle’s Highly Available Internet Protocol (HAIP) for Oracle’s private interconnect. HAIP can load balance Ethernet traffic for up to four Ethernet devices. Due to the use of Oracle’s HAIP, no bond device is created for private Ethernet devices em3 and em4 on each node within the Oracle RAC Database cluster. Figure 2.2, “Network Bonding” shows the pictorial representation of the network topology.

Figure 2.2. Network Bonding

network topology rac

2.3. Hardware Details

The following are the hardware requirements to properly install Oracle RAC Database 12c Release 2 on a x86_64 system:

  • Minimum of 8 GB of RAM for the installation of Oracle Grid Infrastructure
  • Minimum of 1 GB of RAM for the installation of Oracle Database, however 2 GB of memory or more is recommended
  • Red Hat Enterprise Linux 7 with kernel 3.10.0-123.el7.x86_64 or higher
  • The minimum of three Network Interface Cards (NIC) with the usage of direct attach storage or fibre channel storage; however, four NICs are recommended
  • One additional 1 GB NIC is required for iSCSI storage, however, two 10 GB NICs are recommended
  • Console access that supports 1024 x 768 for the Oracle Universal Installer (OUI)

Table 2.1, “Server Details” specifies the hardware for the server within this reference environment. This hardware meets the minimum requirements for properly installing Oracle RAC Database 12c Release 2 on a x86_64 system.

Table 2.1. Server Details

Server Hardware

Specifications

Oracle RAC Database 12c Release 2 Server (oracle1, oracle2) [2 x PowerEdge M520]

Red Hat Enterprise Linux 7 3.10.0-514.el7.x86_64

2 socket, 8 core, 16 threads, Intel® Xeon® CPU E5-2450 0 @ 2.10GHz

96 GB of memory, DDR3 16384 MB @ 1600 Mhz DIMMs

2x NetXtreme BCM5720 Gigabit Ethernet PCIe NICs for public network traffic

2x NetXtreme BCM5720 Gigabit Ethernet PCIe NICs for private network traffic

2x NetXtreme II BCM57810 10 Gigabit Ethernet NICs for iSCSI network traffic

Table 2.2, “Switch Details” specifies the switches within this reference environment.

Table 2.2. Switch Details

Switch Hardware

2 x Dell PowerConnect M6348

2 x Dell PowerConnect M8024-k

Table 2.3, “Storage Details” specifies the storage within this reference environment.

Table 2.3. Storage Details

Storage Hardware

Dell Equallogic PS Array

2.4. File System Layout & Disk Space Details

The following is the disk space requirements for properly installing Oracle RAC Database 12c Release 2 software for this reference environment.

Table 2.4. Disk Space Requirements

Software

Disk Space

Oracle Grid Infrastructure Home (includes software files)

12 GB

Oracle Database Home Enterprise Edition (includes software files and data files)

12 GB

/tmp

1 GB

Note

The actual amount of disk space consumed for Oracle Grid Infrastructure Home and Oracle Database Home Enterprise Edition may vary.

Table 2.5, “File System Layout” specifies the file system layout for the server used in this reference environment. The layout ensures the disk space requirements to properly install the Oracle Grid Infrastructure and Oracle Database software for Oracle RAC Database 12c Release 2

Table 2.5. File System Layout

File System Layout

Disk Space Size

/

15 GB

/boot

250 MB

/home

8 GB

/tmp

4 GB

/u01

50 GB

/usr

5 GB

/var

8 GB

While the size of the Oracle data files varies for each solution, the following are the Oracle data file sizes for this reference environment.

Table 2.6. Oracle OCR, Voting Disk, & Data File Sizes for Reference Architecture

Volume

Volume Size

RAID Group Type

Redundancy

Database Volume 1 (db1)

100 GB

RAID 10

External

Database Volume 2 (db2)

100 GB

RAID 10

External

Fast Recovery Area (fra)

200 GB

RAID 5

External

Oracle Redo Log Volume (redo)

10 GB

RAID 1

External

OCR & Voting Disks (ocrvote1)

4 GB

RAID 10

Normal

OCR & Voting Disks (ocrvote2)

4 GB

RAID 10

Normal

OCR & Voting Disks (ocrvote3)

4 GB

RAID 10

Normal

Grid Infrastructure Management Repository (GIMR) Volume

40 GB

RAID 10

External

Oracle RAC Database 12c Release 2 recommends three volumes each of at least 4 GB in size to store the Oracle Cluster Registry (OCR) and voting disks using normal redundancy. The OCR manages the Oracle Clusterware and Oracle RAC Database configuration information. The voting disk manages any information pertaining to the node membership.

Starting with Oracle Database 12c Release 2, the GIMR database has its own disk group typically labeled MGMT. GIMR is a mandatory installation with the release of Oracle Grid Infrsatructure 12c Release 2. Via Oracle’s documentation, it enables the Cluster Health Monitor, Oracle Database QoS Management, Rapid Home Provisioning, and provides a historical metric repository that simplifies viewing of past performance and diagnosis issues. Due to this, an additional volume must be created for proper allocation during the Oracle Grid Installation process. For the purposes of this reference environment, an external redundancy volume is used for the GIMR volume to keep the size of volume relatively small.

Important

The redundancy level plays a critical role in sizing GIMR. Review the tables found within Oracle Clusterware Storage Space Requirements for proper allocation.

2.5. Swap Space

Swap space is determined by the amount of RAM found within the system. The following table displays the swap space recommendation. This reference environment allocates 16 GB of RAM for swap space.

Table 2.7. Recommended Swap Space

RAM

Swap Space

2 GB up to 16 GB

Equal to the size of RAM

Greater than 16 GB

16 GB of RAM

Note

When calculating swap space, ensure not to include RAM assigned for hugepages. More information on hugepages can be found in Section 4.5, “Enabling HugePages”

2.6. Security: SELinux

Starting with Oracle 11g Release 2 version 11.2.0.3, SELinux is supported for Oracle database environments. The system in this reference environment runs with SELinux enabled and set to ENFORCING mode.