![]() ![]() ![]() |
Chapter 4: Installing HACMP on Server Nodes
This chapter lists the prerequisites for the HACMP software and describes how to install it. This chapter contains the following sections:
If you are upgrading an HACMP installation, see Chapter 3: Upgrading an HACMP Cluster.
If you are installing HACMP on a client, see Chapter 5: Installing HACMP on Client Nodes.
Prerequisites
Before you install the HACMP software:
Read chapters 1–8 of this guide and complete the planning worksheets and diagrams. Ensure that your system meets the requirements listed in this chapter. Supported Hardware
To ensure that your system meets the guidelines established for HACMP, contact your sales representative, or see the IBM sales guide using the following URL:
For information about the disks supported for concurrent resource manager, see the chapter Planning Shared Disk and Tape Devices in the Planning Guide.
Notes that RAID devices from other manufacturers may not support concurrent access. See Appendix B: OEM Disk, Volume Group, and Filesystems Accommodation for more information.
Disk Space Requirements
An HACMP installation has the following space requirements:
The /usr directory must have 82 MB of free space for a full installation. If you are not planning to install optional software, you can plan for less space (for example, HAView =14 MB, hativoli =140 KB). Also, install only the message catalogs for the language you will be using, rather than all message catalogs. (Japanese message catalogs use 1.6 MB.)
The / (root) directory must have 710 KB of free space (beyond any need to extend the /usr directory). Required Versions of AIX 5L and RSCT
HACMP 5.4 requires the versions of AIX 5L and RSCT listed in the following table. For more information about these requirements, see also:
Requirements When Upgrading AIX 5L
If AIX 5L is an earlier version, upgrade it before installing HACMP. If you install AIX 5L on an SP system, upgrade PSSP to version 3, release 5.
1. If you are upgrading from HACMP 4.5 running on AIX 5L v.5.2, install APAR IY50233 first.
2. If you upgrade the AIX 5L operating system, ensure that adapter SCSI IDs or SSA node numbers for the shared disk are not the same on each node. During an operating system upgrade, disk adapters are reset to the default value of 7. This setting can cause a SCSI ID conflict on the bus that prevents proper access to the shared disk.
3. Disable import of volume groups. If you upgrade AIX 5L to version 5.2 or greater, all volume groups are imported and varied on, on the node being upgraded. This causes loss of disk access by other nodes in the concurrent resource group in the cluster.
To prevent this disruption when migrating to AIX 5L v.5.2 or greater, use the option to disable import of volume groups.
4. Disable “restore a mksysb”. If you upgrade AIX 5L v.5.2 or greater, and are using or planning to use enhanced concurrent volume groups, the “restore a mksysb” function will open the disk(s) with reserve. Therefore, to avoid this, disable the “restore a mksysb” option.
5. Make sure that you upgrade the AIX 5L operating system before you install HACMP.
When you migrate the operating system to AIX 5L v.5.2 ensure that you have HACMP 5.1 plus the APAR IY55542 for SNMP v 3 compatibility running on AIX 5L v.5.1.
Note: The version of /etc/snmpd.conf depends on which version of AIX 5L you are using. For AIX 5L v.5.2 and up, the default version used in HACMP is snmpdv3.conf.
It is recommended to migrate from and to the same version of SNMP to ensure that SNMP-based applications function correctly. Once the migration has completed, you can switch to a different version of SNMP if you prefer.
For example, if you are migrating from an environment using SNMP v.1, and you are upgrading to AIX 5L v.5.3, then before migrating HACMP, execute the following series of commands:
stopsrc -s snmpd
/usr/sbin/snmpv3_ssw -1
startsrc -s snmpd
See the AIX documentation for full information on the snmpd.conf file. Version 3 has some differences from Version 1.
6. There are no known problems when upgrading to AIX 5L v.5.3.
Required AIX 5L BOS Components
The following AIX 5L base operating system (BOS) components are required for HACMP:
Requirements for RSCT
Install the RSCT images before installing HACMP. Ensure that each node has the same version of RSCT.
To determine if the appropriate filesets are installed and their level, issue the following commands:
If these filesets are not present, install the appropriate version of RSCT as described in Required Versions of AIX 5L and RSCT, and apply any updates.
Security Fileset Requirements
If you plan to use message authentication or encryption for HACMP communication between cluster nodes, the following filesets must be installed on each node:
rsct.crypt.des—for data encryption with DES message authentication rsct.crypt.3des—for data encryption standard Triple DES message authentication: rsct.crypt.aes256—for data encryption with Advanced Encryption Standard (AES) message authentication. You can install these filesets from the AIX 5L Expansion Pack CD-ROM.
HAView Requirements
HAView requires Tivoli NetView. Install NetView before installing HAView.
Contact your IBM sales representative for information on obtaining Tivoli NetView software.
The HAView fileset includes a server image and a client image. If NetView is installed using a client/server configuration, the HAView server and client images should be installed on the NetView server, and the client image on the NetView client.
Note: Installing HAView outside the cluster lessens the likelihood of losing monitoring capabilities during a cluster node failure.
For more information on using HAView to monitor a cluster, see Chapter 10: Monitoring an HACMP Cluster in the Administration Guide.
For information about installing HACMP on a client system, see Chapter 5: Installing HACMP on Client Nodes in this guide.
Tivoli Requirements
If you plan to monitor your cluster through Tivoli Distributed Monitoring, install the following Tivoli software:
Tivoli Managed Framework (on TMR and cluster nodes) Tivoli Application Extension Facility (AEF) (on TMR only) Tivoli Distributed Monitoring (on TMR and cluster nodes) Unix Monitors Universal Monitors. Contact your IBM sales representative for information on obtaining Tivoli Framework and Distributed Monitoring software.
Note that the Tivoli Management Region (TMR) node should be outside the HACMP cluster.
In addition, install the cluster.hativoli filesets.
Review the installation steps and prerequisites to effectively monitor your cluster through Tivoli. For more information, see Appendix A: Cluster Monitoring with Tivoli.
English and Japanese Message Catalogs
US English and Japanese message catalogs are available. Set the LANG variable to an appropriate locale value so that SMIT help is available in the desired language.
Note that in SMIT, pressing F1 displays help information in the correct language only if the LANG variable is set correctly. HACMP supports the following locales:
en_US En_US ja_JP Ja_JP. Also ensure that the correct base system locale is installed. To list the installed locales, type:
To list the active locale, type:
Since the active locale is determined by the LANG environment variable setting, the locale will be en_US if LANG=en_US.
Ensure that the proper HACMP message catalogs for the chosen language have been installed. To list the message catalogs, type:
Contents of the Installation Medium
The HACMP software installation medium contains the HACMP Enhanced Scalability Subsystem images, some of which you install on all cluster nodes and clients. This facility provides the services for cluster membership, system management, configuration integrity and control, fallover, and recovery. It also includes cluster status and monitoring facilities for programmers and system administrators.
HACMP includes the Concurrent Logical Volume Manager as an installation option. This adds concurrent shared-access management for supported disk subsystems. Concurrent access is provided at the raw logical volume level. Applications that use the Concurrent Logical Volume Manager must be able to control access to the shared data.
The HACMP Application Plug-in software (on the HACMP installation medium) contains the network service plug-in images. This plug-in fileset provides example scripts to start and stop the network service scripts for Domain Name Server (DNS), Dynamic Host Configuration Protocol (DHCP), and printer services. Each network service has start and stop scripts bundled in a fileset. These scripts are provided as examples that may be customized for your environment.
Several prerequisites must be completed before setup begins. A setup wizard is included in each fileset to assist with the setup after installation.
The plug-in filesets are as follows:
cluster.es.plugins.dns. This plug-in fileset provides scripts to start and stop the DNS server process, a script to confirm that configuration files are present and stored in a shared filesystem, and scripts called by the monitoring functions of HACMP that check on DNS server process life. cluster.es.plugins.dhcp. The DHCP Network Service Plug-in provides scripts to start and stop the DHCP server process, a script to ensure that configuration files are present and stored in a shared filesystem, and scripts called by the monitoring functions of HACMP that check on DHCP server process life. cluster.es.plugins.printserver. This plug-in fileset provides scripts to start and stop the print server process, a script to ensure that configuration files are present and stored in a shared filesystem, and scripts called by the monitoring functions of HACMP that check on print server process life. HACMP Installable Images
The organization of cluster images on the HACMP medium allows you to make individual or multiple image selections through SMIT when installing the HACMP software.
2. The cluster.es and cluster.es.cspoc images contain HACMP runtime executable files and are required.
The following list shows the installable HACMP images with the filesets for each image listed under the image:
cluster.es
cluster.es.cspoc
cluster.es.cspoc.cmds CSPOC Commands cluster.es.cspoc.rte CSPOC Runtime Commands cluster.es.cspoc.dsh CSPOC dsh
cluster.es.cfs
cluster.es.clvm
cluster.es.worksheets
cluster.adt.es
cluster.man.en_US.es
cluster.msg.en_US.es
cluster.msg.en_US.es.server Recovery Driver Messages—U. S. English cluster.msg.en_US.es.client Client Messages—U. S. English cluster.msg.en_US.cspoc CSPOC Messages—U. S. English
cluster.haview
cluster.man.en_US.haview.data
cluster.msg.en_US.haview
User documentation image and filesets:
cluster.doc.en_US.es
cluster.doc.en_US.es.html HTML Documentation—U. S. English cluster.doc.en_US.es.pdf PDF Documentation—U. S. English
HACMP Tivoli image and filesets:
cluster.hativoli
cluster.msg.en_US.hativoli
Application plug-in software image and filesets:
cluster.es.plugins
cluster.es.plugins.dns DNS Network Service Plug-in cluster.es.plugins.dhcp DHCP Network Service Plug-in cluster.es.plugins.printserver Printer Server Network Service Plug-in
Note: There are filesets corresponding to En_US, ja_JP, and Ja_JP for cluster.doc..., cluster.msg..., and cluster.man....
HACMP Installation Choices
Install the HACMP software on each cluster node (server) and on any client machines that run the clinfo daemon. You can install the software in the following ways:
From a Network Installation Management (NIM) server From a hard disk to which the software has been copied Directly from the installation medium. Note that you must accept the license agreement as you install. Each node requires an HACMP software license.
A user with root privileges must perform the installation.
If you are installing HACMP on a client system, see Chapter 5: Installing HACMP on Client Nodes.
Installing from an Installation Server
To install the HACMP software in a cluster environment, you can create an HACMP installation server (containing all HACMP software installable images) on one node and then load the images onto the remaining cluster nodes. Creating an installation server lets you load the HACMP software onto other nodes faster from the server than from other media. HACMP supports the Network Installation Management (NIM) program including the Alternate Disk Migration option. For instructions on creating an installation server, see the AIX 5L Installation Guide or the AIX 5L Network Installation Management Guide and Reference.
After installing the HACMP software, verify the software installation. For information about verifying the software installation, see the section Verifying the Software Installation.
Installing from a Hard Disk
To install the HACMP software from your hard disk, first copy the software from the installation medium to the hard disk.
After installing the HACMP software, verify the software installation. For information about verifying the software installation, see the section Verifying the Software Installation.
Copying HACMP Software to Hard Disk
To copy the HACMP software to your hard disk:
1. Place the HACMP CD into the CD-ROM drive.
2. Enter smit bffcreate
3. Enter the name of the CD-ROM drive in the INPUT device / directory for software field and press Enter.
Select the proper drive from the list and press Enter. That value is entered into the INPUT device/directory field as the valid input device.
4. Press Enter to display the Copy Software to Hard Disk for Future Installation panel.
5. Enter field values as follows:
6. Enter values for the other fields as appropriate for your site.
7. When you are satisfied with the entries, press Enter.
8. Press Enter again to copy the software.
Installing HACMP from the Hard Disk
After the HACMP software has been copied to your system (that is not an SP system), install the software by following the instructions in the section Directly Installing HACMP.
If you are installing the software on the SP, see the section Installing HACMP on an SP from the Hard Disk.
Installing HACMP on an SP from the Hard Disk
Install the HACMP software on all nodes of the SP system that will be used to form an HACMP cluster. If a node or control workstations is used to monitor the cluster, HACMP client code must be installed on those systems.
Use the SP dsh command to speed installation of the LPP filesets (images).
To install HACMP on an SP system:
1. Create a file called /HACMPHOSTS that contains host names of nodes in the SP frame that will have the HACMP software installed.
2. Export the Working Collective (WCOLL) environment variable using the following command:
3. Ensure that all hosts listed in the /HACMPHOSTS file are up (that is the hosts respond) using the following command:
where SDRGetObjects refers to the SP database. Host responds should indicate a 1 for all nodes that respond.
4. Mount the filesystem (from the control workstation) onto all nodes, enter the command:
where CWNAME is the hostname of the control workstation and STORAGE_DIRECTORY is the directory where the software is stored.
5. Install the HACMP software on the nodes:
To install filesets one at a time, issue the following command: dsh "/etc/installp -Xagd /mnt LPP_NAME”
where LPP_NAME is the name of the package/fileset to install. Do this for each fileset you need to install.
or
To install all packages and filesets included in the HACMP software, issue one of the following commands: dsh "/etc/installp -Xagd /mnt cluster*”
or
dsh /usr/lib/instl/sm_inst installp_cmd -a -Q -d '/mnt' -f '_all_latest' -cNgXG
Warning: Make sure that the _all_latest directory contains only HACMP filesets. If the _all_latest directory contains filesets other than those for the HACMP software, the preceding command installs those files as well.
6. To ensure that HACMP was successfully installed on each node, enter:
For SP nodes installed through the SP install process, you can use that process or the customize process to install HACMP and PTFs. See the IBM Parallel System Support Programs for AIX 5L: Installation and Migration Guide.
HACMP files are installed in the /usr/es/sbin/cluster directory.
Installing from the Installation Medium
If you install the HACMP software from the CD-ROM, you install the software directly onto each cluster node.
To install the Concurrent Logical Volume Manager, include the cluster.es.clvm image when you select which software to install.
Installing RSCT Files for AIX 5L
To install the required RSCT files:
1. Insert the CD into the CD-ROM drive and enter:
smit install_allSMIT displays the first Install and Update from ALL Available Software panel.
2. Enter the device name of the installation medium or install directory in the INPUT device / directory for software field and press Enter.
If you are unsure about the input device name or about the install directory, select one from the picklist.
3. Either enter all for SOFTWARE to install or select items from a picklist.
4. Press Enter to begin the installation.
5. After the installation of finishes, install the HACMP software as described in the following section Directly Installing HACMP.
Directly Installing HACMP
To install the HACMP software on a server node from the installation medium:
1. Insert the CD into the CD-ROM drive and enter:
smit install_allSMIT displays the first Install and Update from ALL Available Software panel.
2. Enter the device name of the installation medium or install directory in the INPUT device / directory for software field and press Enter.
If you are unsure about the input device name or about the install directory, select one from the picklist.
3. Enter field values as follows. Press F1 for help on any field.
Note: Use F4 to list the software before proceeding with the installation. This way you can install either the English or the Japanese message catalogs, and you can omit optional software if you wish.
INPUT device /
directory for software This field shows the device or directory you specified earlier. SOFTWARE to install Select an option from the picklist, or enter all to install all server and client images. For a list of filesets, also see the section HACMP Installable Images.Install the following required images (which contain the HACMP runtime executables) on all servers:Make sure to install the level of RSCT required for your release of AIX 5L. See Required Versions of AIX 5L and RSCT.If you are installing the Two-Node Cluster Configuration Assistant, install cluster.es.server.cfgast.If you are installing the Cluster Test Tool, install cluster.es.server.testtool. (If cluster.es is selected, the Cluster Test Tool is installed automatically.)Your selections appear in this field. Note that selecting cluster.es and cluster.cspoc installs HACMP and all associated messages. PREVIEW only? If set to yes, the preview option will check and ensure that installation prerequisites are met (for example, that required software is installed and sufficient disk space is available). Press F1 for details.When you are ready to perform the actual installation, set this field to no. COMMIT software
updates? This field applies only when installing software updates (PTFs). See F1 help for details. SAVE replaced files? Use the default.This field applies only when installing software updates (PTFs). If you select no to commit software updates? you must select yes for this field. See F1 help for details. AUTOMATICALLY install requisite
software Use the default.Set this field to no if the prerequisite software for HACMP is already installed or if the OVERWRITE same or newer versions? field is set to yes; otherwise, set this field to yes to install required software. See F1 help for details. EXTEND filesystems if
space needed? Select yes if you have adequate hard disk space, no if you have limited space. See F1 help for details. OVERWRITE same or newer versions? Use the default.For normal new installations, leave this field set to no. Set it to yes if you are reinstalling. If you set this field to yes, you must set the Automatically install requisite software field to no. See F1 help for details. VERIFY install and
check file sizes? Use the default.Select yes if you want the system to perform some checks on the software you installed. See F1 help for details. DETAILED output? Select yes if you want a detailed log of all installation messages. Process multiple
volumes? Select this option if you want to enable the processing of multiple-volume CDs. See F1 for information. ACCEPT new license
agreements? Select yes for this item to proceed with installation. If you select no, installation may stop with a warning that one or more filesets require software license agreements. You accept the license agreement only once for each node. Preview new license
agreements? Select yes to view the text of the license agreements. The text appears in the current window in the language defined on your system.
4. When you are satisfied with the entries, press Enter.
5. Press Enter again to install.
6. After the installation completes, verify the installation as described in the section Completing the Installation in this chapter.
Be sure to read the HACMP release_notes file in the /usr/es/sbin/cluster/ directory for further instructions and the latest information on requirements or known issues.
Completing the Installation
After you install the HACMP software, complete the tasks described in this section.
Verifying the Software Installation
To complete the installation after the HACMP software is installed:
1. Verify the software installation by using the AIX 5L command lppchk, and check the installed directories for the expected files.
The lppchk command verifies that files for an installable software product (fileset) match the Software Vital Product Data (SWVPD) database information for file sizes, checksum values, or symbolic links.
2. Run the commands lppchk -v and lppchk -c “cluster.*”
3. Reboot each HACMP cluster node and client.
Addressing Problems during the Installation
Review the following sections if you encounter problems during an HACMP installation.
Cleaning up after an Unsuccessful Installation
If you experience problems during the installation, the installation program automatically performs a cleanup process. If the cleanup does not perform automatically, you can perform a cleanup manually.
To perform a manual cleanup after an unsuccessful installation:
1. To display the Installation and Maintenance menu, enter smit install
2. Select Install and Update Software.
3. Select Clean Up After a Interrupted Installation.
4. Review the SMIT output (or examine the /smit.log file or /smit.log.<locale> file) for the interruption’s cause.
5. Fix any problems and repeat the installation process.
Resolving System ID Licensing Issues
The Concurrent Logical Volume Manager is licensed to the system ID (hardware system identifier) of a cluster node. Many of the clvm or concurrent access commands validate the system ID against the license file. A mismatch causes the command to fail with an error message indicating the lack of a license.
Note: The licensing of the Concurrent Resource Manager to the system ID is not related to the licensing of the HACMP software.
Removing the HACMP Software
Before you remove the HACMP software from a system, stop cluster services. You cannot remove the software while the cluster is running.
To stop cluster services, enter the fastpath smitty clstop and press Enter.
For more information about stopping cluster services see Chapter 9: Starting and Stopping Cluster Services in the Administration Guide.
To remove the HACMP software and your cluster configuration on cluster nodes and clients:
1. Enter smit install_remove
2. Enter the following values for these fields:
3. When you are satisfied with the entries, press Enter.
4. Press Enter again to remove the software.
Installing and Configuring WebSMIT
WebSMIT is a Web-based user interface that provides consolidated access to the SMIT functions of configuration, management, status, and the HACMP documentation. Starting with HACMP 5.4, you can use WebSMIT to navigate the running cluster and view graphical displays of cluster topology and resource group dependencies. With cluster services running on one node in the cluster, you can view cluster and node status.
Planning for WebSMIT
You can run WebSMIT on a single node; however, if that node goes down, WebSMIT will be unavailable. To provide better availability, you can set up WebSMIT to run on multiple nodes. Since WebSMIT is retrieving and updating information from the HACMP cluster, that information should be available from all nodes in the cluster.
Typically, you set up WebSMIT to be accessible from the cluster’s internal network that is not reachable from the Internet. Network access is required between the browser and cluster node that serves as a Web server. To run WebSMIT on a node at a remote site, it is highly recommended that you ensure HTTP(S) connectivity to that node; it is not handled automatically by WebSMIT or HACMP.
Most HACMP cluster utilities require root authority. Allowing execution of such programs through a Web browser requires careful analysis and planning to reduce security risks.
HACMP does not supply the Web server software, but it does supply a default configuration. See the usr/es/sbin/cluster/wsm/README file for information on WebSMIT, the default security mechanisms in place when HACMP 5.4 is installed and how to create a more secure Web server installation.
We recommend that you plan to create a new user for the sole purpose of using WebSMIT. This allows you to distinguish between root logins and WebSMIT session logins, and permits a user other than root to configure HACMP using WebSMIT without having knowledge of the root password.
You have the option of specify a group of users that have read-only access to WebSMIT. Users with read-only access may view the configuration and cluster status, and may navigate through the WebSMIT screens but cannot execute commands or make any changes to the configuration.
Prerequisites Tasks for Installing WebSMIT
Install HACMP 5.4 on all nodes in the cluster. For installation information, see Chapter 9: Installing HACMP on Server Nodes.
Steps for Installing and Configuring WebSMIT
Here are the steps to install and configure WebSMIT:
Upgrading from a Previous Configuration
Note: If you are configuring WebSMIT for the first time, this section does not apply. See Steps for Installing and Configuring WebSMIT.
If you are upgrading from a previous configuration that was integrated with the system-wide server configuration, we strongly recommend removing that configuration and creating a new configuration using the provided template files and sample configuration script. This will make the WebSMIT configuration self-contained and eliminate the need to manually reconfigure WebSMIT in the future.
A self-contained WebSMIT configuration means that the Web server configuration only serves WebSMIT, it does not need to be integrated into any existing configuration, and it will not interfere with non-WebSMIT Web server configurations.
If you have upgraded to HACMP 5.4, and before the upgrade, had a working configuration for WebSMIT in HACMP 5.3 that was integrated with a system-wide Web server configuration, do the following:
1. Remove WebSMIT from your existing Web server configuration and reconfigure it using one of the provided templates and the sample configuration script. This is described in the "Configuration" section of the README file. This option is strongly recommended. In most cases, this will eliminate the need to manually reconfigure the Web server for WebSMIT, greatly reducing the risk of human error.
2. Integrate the configuration in the appropriate template file:
httpd.wsm.conf.ihs.templatehttpd.wsm.conf.apache.templatehttpd.wsm.conf.apache2.templatehttpd.wsm.conf.httpd.template/usr/es/sbin/cluster/wsm/cgi-bin/wsm_cmd_exec/usr/es/sbin/cluster/wsm/utils/sperlThose file permission changes are just one step of several taken by the sample setup script (websmit_config). Refer to that script for other actions that may need to be taken.
Where You Go from Here
After you install the HACMP software, complete the following steps to configure an HACMP server:
1. Set up the Cluster Information Program.
Copy the clhosts.client file to each client node as /usr/es/sbin/cluster/etc/clhosts and edit the /usr/es/sbin/cluster/etc/clinfo.rc script as described in Chapter 5: Installing HACMP on Client Nodes.
2. Ensure that the network interfaces and shared external disk devices are ready to support an HACMP cluster.
3. Define shared LVM components, including creating shared volume groups, logical volumes, and filesystems for your cluster. Also define enhanced concurrent volume groups.
4. Customize your AIX 5L environment for HACMP.
5. If you want to set up a basic two-node configuration, use the Two-Node Cluster Configuration Assistant. For information about using the Two-Node Cluster Configuration Assistant, see Chapter 9: Creating a Basic HACMP Cluster.
6. (Optional) Configure the HACMP cluster using the Online Planning Worksheets application.
If you decided not to use the application, use the paper planning worksheets you filled out during the planning process, and follow the steps in the Administration Guide to configure your cluster using SMIT or WebSMIT.
7. Test your configuration using the Cluster Test Tool.
![]() ![]() ![]() |