Advanced data storage management

Data management process <<previous|next>> :Managing data migration among storage tiers

Enterprise storage, planning and management

The rising cost of cheap storage

By Pierre Dorion

SearchStorage.com

Storage budgeting tip: The commoditization of storage has been driving acquisition costs down for quite some time. However, hidden costs are now starting to surface as organizations struggle to manage hundreds of terabytes of data. This tip discusses some of the pitfalls of "cheap storage" and offers advice for keeping costs in check.

Storage management information
SRM packages: A closer look

Buyer's Guide: Data classification tools

Is storage automation right for you?
If I had to pick one term that comes to mind when talking about cheap storage, it would have to be procrastination. Wikipedia defines procrastination as "the deferment or avoidance of an action or task which requires completion by focusing on some other action or task." Avoidance is exactly what a lot of organizations are opting for when faced with the growing problem of data explosion combined with the absence of data retention policies. The declining cost of storage has allowed companies to address the problem by throwing more hardware at it -- much like we give a spoiled kid more candy to appease repeated tantrums. Eventually, there is no candy sweet enough and concrete actions are required… but enough server room psychology.

Declining data storage costs have allowed organizations to put off having to make decisions regarding data lifecycle management and data categorization. Some of the major resulting issues include:

  • Massive email servers that are difficult to restore
  • Multi-terabyte file servers that can hardly be backed up over a weekend (forget restoring)
  • Storage management challenges (complex environment and shortage of skills)
  • Inability to meet growing data availability requirements
  • Backup storage capacity requirements that are multiples of the production data
  • A daunting data inventory task
  • Uncertain records discovery and retrieval capabilities in the event of litigation
  • Costly data and storage management solutions

    • It becomes clear that declining storage costs can quickly be overshadowed by other rising costs such as those outlined above. This is easily noted if you consider that overall IT spending doesn't follow the same curve as storage capacity cost.

    Reducing the costs

    Without trying to trivialize the effort, the first step is to start identifying what data the organization has in storage. This is an inventory effort, in which all functional areas of the business must participate. The IT department cannot identify data much beyond reporting on file types, size, the systems or applications that access the data and the last access date.

    Once the data is inventoried (and this is no small task), it is up to the data users/owners to indicate how critical that data is to their daily activities or if it is still used/needed. If the data is no longer used and can be disposed of, it should be deleted now. If the data must be retained (for whatever reason), it should be taken out of the costly daily data management loop (mirroring, backups, monitoring, virtualization, etc.).

    There are a number of products available that provide data archival or hierarchical storage management capabilities while making use of storage tiers but they all have one thing in common -- products will not make the decisions for you. It must be noted that the object is not necessarily to reduce the amount of data stored, but rather to reduce the amount of data that is subject to costly storage-related processes.

    Organizations cannot prevent the creation of new data or transactional records although some are taking steps to control it. For example, some companies are adopting policies to encourage use of the telephone (remember that device you use to actually talk to people) to reduce the volume of email messages. However, the true gains come from storage decisions about data that is no longer needed or used on a regular basis.

    Of course, this cannot be considered a one-time exercise. To make this a cost-effective effort, the decisions made about existing data must also be applied to new data as it is being created to avoid having to repeat the same exercise down the road. It is also the foundation for information lifecycle management.

    Do you know…

    How to manage data migration among storage tiers?

    About the author: Pierre Dorion is a certified business continuity professional for Mainland Information Systems Inc.


    07 Sep 2006

    Disclaimer: Our Tips Exchange is a forum for you to share technical advice and expertise with your peers and to learn from other enterprise IT professionals. TechTarget provides the infrastructure to facilitate this sharing of information. However, we cannot guarantee the accuracy or validity of the material submitted. You agree that your use of the Ask The Expert services and your reliance on any questions, answers, information or other materials received through this Web site is at your own risk.