Has the storage consolidation parade rolled through your town yet? Storage vendors are in the front of the line, mustering a crowd with promises of a fast ROI, reduced TCO, simplified management and streamlined backup and recovery. Their pitch is downright seductive: Consolidate your direct-attached storage (DAS) into a giant, single logical pool of storage and then allocate and reallocate this capacity as needed with just a click of...
a mouse. It's a compelling pitch. And the promises are true, except for one thing--none of it is easy, fast or cheap.
"It is getting easier, but there are still obstacles," says Scott Robinson, CTO, Datalink Corp., Chanhassen, MN, a storage consulting firm. And the hard-dollar savings don't come right away. To the contrary, it will likely cost much more at the outset: "You'll be buying a lot of new hardware and you have the whole cost of buying a network," he says. Still, the payoff from consolidation can be big if you carefully and patiently work through the obstacles.
For example, most consolidation involves Fibre Channel (FC) storage area networks (SANs), which still present significant technical hurdles for most corporate IT departments. "We have a lot of technical skill here, but the change to Fibre Channel was difficult, much more difficult than, say, trying to make SCSI work on a PC in the early days of SCSI," says Kelly Carpenter, senior technical manager, Genome Sequencing Center, Washington University School of Medicine, St. Louis.
The Center's IT group called Datalink for help when it tried to consolidate 15TB of varied storage onto a large Hitachi storage system. "Fibre Channel is very finicky. You have to have the right versions of the drivers matched with the right firmware. You need somebody who really knows what works with what," Carpenter says.
No quick payback
Carpenter's experience seems easy compared to what others have encountered. In interviews with storage managers in the midst of consolidation efforts--managers who have requested they and their organizations not be identified--the widespread consensus is that storage consolidation is harder, costs more and takes longer than expected. "If you think you are going to consolidate and get a fast payback, you are living in a dream world," says a storage manager at a large bank. To begin with, that giant logical pool of storage is extremely difficult to set up correctly. "It is very hard to get the zoning and the LUNs right," he says.
Consolidating tape backup when you consolidate storage increases your payback. Storage consolidation streamlines the tape backup process in the following ways:
In his experience, you can consolidate to a point. "You can go to about 40 servers and their attached storage," he says. More than that and the multiple operating systems, different release levels, varied firmware and devices from multiple vendors will turn into an implementation and management nightmare. "Just mapping which application on which server goes to which individual LUN can drive you crazy," the bank's storage manager says.
The bigger problem, adds a storage manager at a leading insurance company, "is that consolidation is really about changing the way we do business in IT." Previously, the standard IT approach to solving a problem was to throw more hardware and infrastructure at it. "With consolidation, we are now scaling back this infrastructure and that means scaling back the operational processes that run the infrastructure if you hope to get any of the benefits from consolidation," he says.
Business unit buy-in is key
Not only will people in IT resist, but the business units will scream about these kinds of operational changes. "The business units want to control their own destiny," the manager from the insurance company says. To them, it means having their own applications running on their servers and storage. Even guaranteeing dedicated LUNs within a consolidated storage infrastructure won't satisfy them unless you can deliver the whole benefits package immediately--better performance and availability and lower costs. And if business units with different service level requirements have to share key portions of the storage infrastructure, you not only face an extreme technical balancing act, but a diplomatic challenge as well.
Despite the difficulties, the researchers and analysts remain bullish about the opportunities in storage consolidation. "Our research confirms that storage consolidation provides real operational benefits and delivers real savings," says John McArthur, VP of storage research, IDC, in a report for Hitachi Data Systems (HDS).
For instance, "The cost of managing information is sharply reduced when storage is consolidated and centrally managed. Labor costs are the biggest factor. As a rule of thumb, half of the staff can manage twice the data in a state-of-the-art data center," McArthur says. In addition, the need to maintain fewer facilities coupled with tighter control over storage assets produce more savings. Even more gains follow through integration. "Once consolidated, the integration among storage systems can be improved," he says.
Enterprise Storage Group's senior analyst, Nancy Marrone, cites similar benefits from storage consolidation. However, she's quick to point out issues that must be addressed before organizations can effectively consolidate their storage. These issues involve sizing, resource management and the degree of heterogeneity in the storage to be consolidated.
"You have to appropriately size your consolidation," says Marrone. A large amount of the direct-attached storage, for example, goes unused. Just counting existing storage won't give you a correct figure.
Similarly, you need to do some serious storage resource management before you consolidate by reviewing what you are actually storing. "You need to look at the files and ask how much of that data you really want to consolidate," Marrone says. Some of that data probably should be shipped off to archival storage. Other data most likely should be thrown away.
Finally, she warns IT managers about consolidating storage from different operating systems. "You have to be careful about how you zone off Windows or it will grab every available LUN," she says.
There's also the question of what to do with the existing storage arrays. When you are consolidating on a SAN, some arrays could be retrofitted for FC. This may be appealing in tight economic times when the folks in accounting pressure IT to squeeze every bit of depreciable life out of each storage asset. "In theory, you can attach the existing devices to the SAN, but usually companies want to upgrade the disk at the same time," says Datalink's Robinson. Often the older devices carry higher maintenance and support costs compared to newer devices, so hanging onto them is no bargain.
To ease the strain on its budget when it consolidated storage, the Los Angeles Unified School District used a lease-to-purchase strategy, says Greg Rapozo, deputy director of data processing for the school district. The project entailed consolidating DAS on a SAN using IBM's Enterprise Storage Server 2105 with Brocade switches connecting to the school district's Parallel Sysplex and Unix systems. The resulting system more than quadrupled the total disk capacity to 3.5TB, increased disk operation performance by 60% and reduced backup time by more than 80% without stressing the budget.
High start-up costs
Even with leasing, however, consolidation doesn't come cheap. Companies that turn to storage consolidation for immediate hard-dollar savings will be surprised and disappointed. The organization will likely have to put out money to buy new storage devices--the SAN and switches if it is consolidating to a SAN--and new servers. In addition, the organization may be buying new storage management software, hiring consultants to help with the consolidation effort and will have to train staff on the new storage environment.
A Canadian energy company consolidated its servers when it consolidated storage, which isn't uncommon. So, it faced the added expenses of new servers and a major OS software upgrade along with the cost of buying a new EMC storage system with 29TB of capacity and advanced features such as mirroring. The company also consolidated its backup, which required the purchase of a large automated tape library from StorageTek.
There are, however, some ways to mitigate the cost. For example, organizations that normally lease equipment will find that leases for the new equipment can be written for a longer time period, which effectively lowers the monthly outlay, much like refinancing a house. Similarly, replacing maintenance agreements on old equipment with less costly agreements on the new equipment also will lower the out-of-pocket expenses. And the consolidated system is cheaper to operate and manage. At the Los Angeles Unified School District, the cost of the leased storage equipment was offset by the reduced maintenance costs. "Now, just two people internally can manage the whole thing," Rapozo says.
The energy company is just starting to see significant savings from its consolidation. When it started, the company employed about 130 people to manage its server and storage infrastructure. Today, the company runs the new infrastructure with approximately 100 people. "We were able to get rid of almost all the contractors," says the storage manager. But it took about two years to arrive at this point, which isn't exactly a fast payback.
Two consolidation options
There are two basic ways to consolidate storage, via a network--network-attached storage (NAS), a SAN or by connecting directly to a large storage subsystem loaded with ports. IDC clearly favors the network approach, particularly SAN, in a report on storage consolidation sponsored by Dell Computer. In today's IT environment, many enterprise customers turn to a SAN solution as the most effective way to consolidate their storage devices. SANs promise to deliver higher utilization rates by the nature of their design, which allows all servers to access data stored across the SAN.
Datalink's Robinson also favors the network route: "If you go with a storage network, you get more flexibility." You can attach more devices and hosts, and you have more and easier redundancy options for high availability. Consolidating to a NAS system not only consolidates the storage, but automatically gives you file and print server consolidation.
"One huge [non-networked] storage subsystem does not solve the problem of heterogeneous hosts," says Marrone. SAN consolidation--at least in theory--handles hosts from multiple vendors.
Still, consolidating on a giant storage subsystem--such as those provided by IBM, EMC, or HDS--works, says Robinson. You'll get the same advantages of centralized management and flexible storage configuration. However, you'll be limited by the available ports, which could prove a problem. Redundancy, for example, requires extra ports.
In truth, most large enterprises do both. "We have multiple, large HDS storage systems and they are all part of the SAN, actually multiple SANs," says the Genome Sequencing Center's Carpenter. Although this hybrid approach may reduce some of the advantages of consolidation, it allows the organization to avoid disrupting some critical applications, such as its Oracle database.
Determining the potential payback from storage consolidation is tricky. Even IDC punts on the storage consolidation TCO and ROI question: "Because of the increasing complexity of storage solutions, it can be quite challenging to effectively evaluate TCO and ROI in a reasonable period of time," says Bill North, IDC. Part of the problem is that a consolidated storage environment will likely grow much larger than the previous environment--given the steady growth of storage--making comparisons difficult.
Still, the TCO question seems pretty straightforward. As the Canadian energy company's experience suggests, the ability to reduce the infrastructure support staff by 25% while greatly increasing the amount of storage being managed is attractive. That was also the experience at Los Angeles Unified School District. The consolidated storage produces "bigger savings compared to the individual storage we had before," Rapozo says. But getting there requires a significant upfront investment in new storage hardware, software and services.
You also need to consider the remaining organizational issues. Successful consolidation requires effective change management both within IT--which may have entrenched interests in the old infrastructure--and the business units, which will aggressively protect their own interests. At best, addressing these issues will slow the consolidation process. At worst, they can undo any advantages from consolidation.
No one has suggested that storage consolidation isn't effective. Almost every large organization can benefit from some level of storage consolidation. Those benefits, however, aren't guaranteed and won't materialize overnight.