Another consideration when evaluating each vendor's RAIN architecture implementations is the type of hardware to be used. Although each vendor uses off-the-shelf Intel server hardware to host its software, Archivas' ArC and Permabit's Permeon Compliance Store allow users to choose any vendor's brand of server, while CAS vendors such as EMC and HP require users to purchase server and storage hardware from them. HP only sells and certifies its ProLiant DL380 servers as nodes to support its StorageWorks RISS software.
Users with existing server hardware or server agreements may opt for Archivas' ArC or Permabit's Permeon Compliance Store because they run on any server vendor's hardware. For firms more concerned with deploying an end-to-end configuration sold and supported by a single vendor, choosing EMC or HP for the hardware and software in a preconfigured CAS product may be a better option.
The hashing algorithms a CAS product uses to create digital identifiers for each object is also important. Some hashing algorithms may be cracked or hacked over time; having the ability to upgrade the digital signature may therefore become more important. Caringo Inc.'s CAStor, a new CAS software product, lets users upgrade the hashing algorithm and digital signature as new ones become available.
Most RAIN architectures support only nodes with internal disk drives. Only Bycast's StorageGrid and Caringo's CAStor let users deploy nodes that support different types of external storage and manage the placement of data on these different tiers of storage based on policies set by users.
A final concern is the protocols used to access the RAIN nodes. One way RAIN vendors circumvent the API problem is by presenting a mountable file system to the OS and allowing apps to use the more common NFS and CIFS protocols to store and retrieve data. Most RAIN vendors, including Archivas, Bycast, HP and Permabit, support this configuration, and even EMC is jumping on the bandwagon.
NetApp's NAS products use file systems, but they support CAS in a slightly different manner. By using SnapLock (an optional WORM feature) with the Data Ontap OS that comes standard with all NetApp filers, and its new Advanced Single Instance Storage (ASIS) feature, users can lock down data and optimize storage capacity on filers. The main drawback of file-system architectures is that they require either a separate appliance or third-party software such as Open Text or FileNet to classify each file, create and store meta data, and manage the file's data-retention periods and user access permissions.
IBM prepackages its TotalStorage DR550 with TSM for Data Retention software to enable apps to classify and manage data. (Shops already using TSM can host the Data Retention component on an existing TSM server.) For small- to medium-sized firms, IBM offers DR550 Express, which also ships with the TSM software, but supports only internal disk drives with an option for tape vs. the DR550 that supports external disk and tape and is available in clustered configurations. TSM is required to manage data placement, retention and security policies; all host apps will need to support TSM's APIs to store and retrieve data.
Capacity management
There are three primary ways CAS products manage and reduce the amount of data they store: object-based storage, SIS and data deduplication.
CAS vendors that support RAIN and networked storage array architectures store files by saving them as objects. Incoming files are scanned and a hashing algorithm creates a unique identifier for that file, which is stored in the CAS product meta data database used to reference and access that object in the future. This technique, called SIS, reduces the amount of storage. When a file is submitted to the CAS product for storage, the hashing algorithm used to analyze a file will always create the same unique identifier for the file even if some of the file attributes are different. This lets users save storage space because they're not storing multiple instances of the same file.
Before implementing SIS, users need to consider the time it takes the CAS product to generate the unique identifier and check its meta data database to see if that identifier already exists. Searching for a unique identifier may be done quickly during initial deployment, but as the size of the meta data database grows it takes longer to search it.
For the fastest file storage and recovery possible, users should use the latest version of the RAIN OS. EMC, for example, claims that under certain conditions the latest version of Centera's CentraStar OS performs four to five times faster than earlier releases. Another option is to upgrade hardware nodes with faster CPUs and 1 Gigabit Ethernet ports rather than the 100Mb ports common to first-generation nodes. Upgrading shouldn't be that painful because RAIN nodes may be taken offline and replaced nondisruptively, and different generations of nodes can operate in the same cluster.
Another factor to consider before turning on SIS is the type of file being archived. For certain types of files, such as check images, nothing will be gained by turning on SIS. Conversely, users will see significant savings using SIS when storing e-mail attachments, for example.
Data deduplication and classification
Some CAS products use data deduplication, which breaks files apart, analyzes them at the block level and only stores identical blocks once to minimize the amount of data stored. HP's StorageWorks RISS and Permabit's Permeon Compliance Store include this as part of their software, but users need to turn it on.
NetApp introduced ASIS last March and EMC has announced a partnership with Avamar Technologies Inc. to provide similar functionality for Centera.
HP says users will experience a three- to five-fold reduction in total storage using deduplication, but the technology will introduce some performance overhead. NetApp estimates that its filers will experience a 1% to 3% performance hit when ASIS is turned on.
CAS products classify data in several ways, using mostly meta data databases. As files are stored in RAIN architectures, meta data is extracted based on policies provided by the vendor and user. NetApp's filers index files after they're stored, although users can use any data classification engine to index, classify and tag data. NetApp's IS1200 appliance uses Kazeon Systems Inc.'s algorithms to deliver this functionality.
IBM's DR550 classifies data based on policies set previously with its TSM software. TSM then places the data on the correct tier of storage, moves the data to other tiers of storage when appropriate, and deletes the file at the end of its retention period. For this scenario to work, TSM APIs must be on each server.
A problem with all data classification approaches is the need to re-index data if requirements change. Depending on the size of the data store, re-indexing can be a performance-intensive exercise.
CAS cost considerations
Upfront and ongoing costs associated with each CAS product should be considered; as data grows, the hidden costs/savings of these architectures will become more apparent. Purchasers of RAIN products from Archivas, Bycast, EMC, HP and Permabit should expect to pay as little as $7,500 for a 1.5TB configuration to as much as $350,000 or more for a 50TB setup.
Permabit is the only vendor with two pricing models: per node or by capacity. The per-node option, also offered by Bycast, EMC and Permabit, will probably be the less-expensive option because capacity on CAS products could scale into the petabytes. Per-node licensing is also more favorable for products such as Bycast's StorageGrid, which support portable media such as tape, which requires fewer nodes to house data.
There are exceptions, of course. Users who anticipate keeping data from different departments or customers on separate nodes may find licensing by total capacity to be cheaper. Users also need to examine what storage optimization features, if any, they'll turn on and if that will control data growth.
In the future, it's likely CAS products will emerge as the preferred means of managing structured and unstructured retention data. The four CAS options--RAIN, file system, HSM and storage architectures--all allow users to start small, scale economically and satisfy the data-retention requirements that meet specific apps. But integrating CAS with various apps isn't always as easy as sometimes advertised, and reclassifying data after it's stored is a major headache.