Consider using multiple levels of primary storage pools to form a storage hierarchy. For example, your fastest devices are disks, but suppose you do not have enough space on these devices to store all data that needs to be backed up. You have tape drives, which are slower to access, but have much greater capacity. You can define a hierarchy so that files are initially stored on the fast disk volumes in one storage pool. This provides clients with quick response to backup requests and recall requests. Then, as the disk storage pool becomes full, the server migrates, or moves, data to volumes in the tape storage pool. Migrating files to sequential storage pool volumes is particularly useful because TSM migrates all the files for a single node together. This is especially helpful if you have not enabled collocation.
When you define or update a storage pool, you establish a hierarchy by identifying the next storage pool, sometimes called the subordinate storage pool. The server migrates, or moves, data to the next storage pool if the original storage pool is full or unavailable.
Restrictions:
Understanding how the server selects and accesses a primary storage pool can help you estimate the amount of space required for each storage pool in the hierarchy.
When a user backs up or archives files from a client node, the server may group multiple client files into an aggregate (a single physical file). The size of the aggregate depends on the sizes of the client files being stored, and the number of bytes and files allowed for a single transaction. Two options, one in the server options file and one in the client options file, affect the number of bytes and files allowed for a single transaction:
This option sets a target size for the aggregate file. An aggregate file will usually be smaller than the value specified by the TXNBYTELIMIT option. A logical file (a single user's file) that is larger than the value specified by TXNBYTELIMIT option will not become part of an aggregate, but will be stored as a single physical file.
The recommended value is 25600.
Together these options allow you to control the size of aggregate files stored by the server. For more information on using options to tune performance, see the performance tuning guide on the Web page ( http://www.tivoli.com/tsm ).
When an HSM client migrates files (space-managed files), the files are not grouped into an aggregate.
When a user backs up, archives, or migrates a file from a client node, the server looks at the management class that is bound to the file. The management class specifies the destination, the storage pool in which to store the file. The server then checks that storage pool to determine the following:
ADSM Version 2 Clients: | When an ADSM Version 2 client backs up or archives files, the server must estimate the size of the aggregate file that the client will send. The server bases the estimate on earlier transactions with the client. The server uses the estimated size to check whether the storage pool has enough space to store the file. Because the server uses the estimated size rather than the actual size for ADSM Version 2 clients, the server may not always store files in the storage pool that you expect. |
Using these factors, the server determines if the file can be written to that storage pool or the next storage pool in the hierarchy.
As an example, assume a company has a storage pool hierarchy as shown in Figure 17.
Figure 17. Storage Hierarchy, Read/Write Access, and Maximum File Size
The storage pool hierarchy consists of two storage pools:
Assume a user wants to archive a 5MB file that is named FileX. FileX is bound to a management class that contains an archive copy group whose storage destination is DISKPOOL, see Figure 17.
When the user archives the file, the server determines where to store the file based on the following process:
The maximum file size applies to the physical file being stored, which may be a single client file or an aggregate file. The maximum file size allowed in DISKPOOL is 3MB. FileX is a 5MB file and therefore cannot be stored in DISKPOOL.
If the DISKPOOL storage pool has no maximum file size specified, the server checks for enough space in the pool to store the physical file. If there is not enough space for the physical file, the server uses the next storage pool in the storage hierarchy to store the file.
It is strongly recommended that all primary storage pools that are linked to form a storage hierarchy use the same copy storage pool for backup. If you do this, then a file that is copied to a copy storage pool does not need to be recopied when the file migrates from its original primary storage pool.
In most cases, a single copy storage pool can be used for backup of all primary storage pools. The number of copy storage pools you need depends on whether you have more than one primary storage pool hierarchy and on what type of disaster recovery protection you want to implement.
Multiple copy storage pools may be needed to handle particular situations, including:
A common way to use the storage hierarchy is to initially store client data on disk, then let the server migrate the data to tape. A guideline for how much primary disk storage should be dedicated to this staging of client data is enough storage to handle one night's worth of the clients' incremental backups. While not always possible, this guideline proves valuable when considering storage pool backups.
For example, if you have enough disk space for nightly incremental backups for clients and have tape devices, you can set up the following pools:
You can then schedule the following steps every night:
Backing up disk storage pools before migration processing allows you to copy as many files as possible while they are still on disk. This saves mount requests while performing your storage pool backups.
When this migration completes, raise the high migration threshold back to 100%.
The tape primary storage pool must still be backed up to catch any files that might have been missed in the backup of the disk storage pools (for example, large files that went directly to sequential media).
See Estimating Space Needs for Storage Pools for more information about storage pool space.