Commentary: Unix Systems Administrator John Vignoni had some interesting insights to share with SearchStorage recently...
on how he is approaching the establishment of storage management policies in his IT organization. Readers might be surprised to learn that he sees the storage management tools as a very important, but secondary, component to this process.
More importantly, Vignoni remarks that the process must begin with end users of a company's data. The usage of SRM tools and features must always be applied first through the "filter" of a company's users and how they most like to operate. Do you agree or disagree with his assertions? How does what he describes relate to your own organization? Read his comments, then rate this tip, and .ekaEatXggsM^10@.ee83ce3/309!viewtype=>add your own input.
How do you empower users to start managing their own data? How do you get them started?
At Lockheed Martin's Palmdale, Calif.-based Enterprise Information Systems group, we chose the equivalent of giving the end user a pretty big "file cabinet" to archive their data: In our case, it was via a centralized storage management tool, Tivoli Storage Manager (TSM), which we use for both archiving and backups. We also included a custom, client-side archiving tool that we place on the users' desktops to help them perform their own archiving, track when archiving will occur and what they've already archived.
We then ask end users to take time to organize their data, as they would when organizing a file cabinet in their own home. After having analyzed our existing data problems, concerns and needs, we identified this aspect -- getting users to manage their own data and communicating the need to them -- as the most crucial components in the storage management puzzle. Implementing quotas should also help to drive end users to use the archiving tools we've set up to manage their data.
In our process of developing an appropriate storage management strategy, we've also explored related issues like setting quotas, auto-archiving and hierarchical storage management (HSM) to see how they would fit within the end user culture, and to learn how they'd best meet the archiving needs of our users and organization. The sidebar story shares some thoughts on ways to communicate to end users.
How we implemented our data archiving/backup solution and evaluated the use of other data management features like HSM
As previously mentioned, we use Tivoli Storage Manager (TSM) for both centralized archiving and backups.
We also developed a front-end archiving tool placed on the client's desktop that allows archiving to take place at the client's request.
This custom, client-side tool now provides users with many answers to their questions right from their desktop, such as:
- Which type of data will be archived
- For how long it will be archived
- When the archive will run (at a specified interval, such as daily, weekly, etc.)
- Which specific files have been already archived by the user (via a log file)
Prior to this implementation, many users took advantage of other tools for archiving, such as zip drives, CD burners and even locally attached tape drives. It's one thing to have a user work with another piece of software, let alone handle the media and manage the storage of that media.
Our current, custom desktop tool now eliminates the need for the user to work with and manage separate media, and reduces hardware costs because there is no CD burner or zip drive being purchased. Other benefits have included the media being handled and managed by a centralized organization (computer operations) as well as the elimination of media being lost (a common problem experience when users were writing to CDs and zip disks). It also gives the end user community a virtually unlimited amount of storage space as there is always an ample supply of tapes.
End users now also use the archive feature in TSM for archives of larger files as follows: They contact the help desk and open a trouble call identifying the data that needs to be archived. The call is then assigned to computer operations at this site, and the established procedure handles the archive. Even with the implementation of an archive tool on the desktop, this process is still considered important for archives involving large amounts of data, perhaps 10 to 20G Bytes or more.
There are several benefits to using TSM for this. Computer operations is already trained and familiar with the movement of tapes through TSM. The implementation of the archiving feature is transparent to them. Those who are familiar with TSM realize that this method of archiving also fits perfectly into the disaster recovery module of TSM. A second copy of all the archived data is also produced that will be shipped off-site - something that most likely didn't occur when clients archived their own data locally.
In looking at user needs and requirements, we also grappled with the prospect of automating the movement of end users' least-accessed data to a secondary virtual online storage location. This would be hierarchical storage management, or HSM. At first glance, this seemed like the best solution from an end user standpoint.
However, IT groups also need to carefully evaluate some of the risks involved in long-term storage via HSM before they determine if it makes sense for their organization. While it's true that HSM does immediately manage storage issues, there are also long-term storage issues (six months to one year down the road) that need to be considered:
- HSM would manage the disk space, but it still does not manage the data.
- There are high administrative costs to support HSM
- There is a capacity limitation in regards to keeping the data that has been HSM'd in an online form.
- There is still a finite amount of space in a tape library.
All HSM does is merely propagate to another device the problem of running out of disk space. While HSM is a viable tool for storage management, it is only one piece of the total data management package.
A delicate balancing act for IT, the needs of end users and your organization
For the items we've discussed in this story and sidebar (archiving through the help desk, end-user archiving, automated archiving, HSM and quotas), it may take any combination of one, two, three, four and/or all five of these tools. Each company is different and should be looked at as such.
Outside of communicating to end users and education, how can you best achieve success in storage management? Gaining buy-in from upper management makes this process considerably easier. Upper management in many companies often sees IT as an expense to the business as opposed to enhancing the business. Sometimes, it is not easy to be heard at that level.
Perhaps, if a business case were developed identifying down-side risks and upside benefits, it might help. Perhaps you could identify to management such items as:
- The dollar impact of lost work due to system downtime or running out of disk space
- Hardware savings involved in not buying CD burners and zip drives
- The dollar impact of lost work due to the end user managing secondary media
- The cost of data loss when local hardware media is in use for archiving and becomes lost
Once upper management buy-in is there, however, it all flows down the management chain.
About the author: John Vignoni is a Unix System Administrator with Lockheed Martin, Enterprise Information Systems. He has a foundation in application programming on the mainframe and Unix systems environments.
Dig Deeper on Data management tools