Managing and protecting all enterprise data


Manage Learn to apply best practices and optimize your operations.

Hot Spots: Tap virtual servers, storage for all they're worth

To keep pace with changes in the server and storage domains, organizations need to ensure that the I/O path doesn't become a bottleneck. Automated patch panels, N_Port ID Virtualization, Fibre Channel over Ethernet and InfiniBand are just some of the technologies that might resolve this issue.

I/O obstacles could throw a monkey wrench into virtual server environments, but there are alternatives to traditional methods.

It's no secret that virtualization services are proliferating in the data center. Server virtualization has become one of the most significant agents of change in today's IT shop. In addition to enabling far greater server utilization rates, this technology offers corresponding power and cooling benefits that many IT organizations find attractive. In response to successful server virtualization efforts, many companies are now developing storage virtualization products that offer single pools of storage, thin provisioning and snapshot to create similar efficiencies.

To take full advantage of server virtualization benefits like app mobility and high-availability/disaster recovery (HA/DR) capabilities, virtualized servers need networked storage. According to a recent ESG research report, "Server Virtualization: The Impact on Storage," 86% of respondents using server virtualization support their virtualized environments with networked storage, and the majority of those are Fibre Channel (FC) SANs. The result is a highly dynamic infrastructure in which every server device requires connectivity to every storage device to ensure flexibility and mobility. However, the I/O path is still being provisioned as it would be in a fixed, nonvirtualized environment. To keep pace with changes in the server and storage domains, organizations need to ensure that the I/O path is not a bottleneck.

Major drawbacks to today's I/O model
I/O provisioning has remained largely unchanged in the last 10 years. Network interface cards (NICs) are required to provision IP connectivity, while host bus adapters (HBAs) provision FC access to servers. The technology has advanced--increasing in both speed and intelligence--but it still hasn't managed to keep pace with rapidly changing virtualized environments.

One of the most obvious issues with this type of arrangement is the cost associated with deploying and maintaining an environment that, in a high-availability configuration, will sport two NIC cards and two HBAs per server, in addition to all of the cabling that goes with it.

Troubleshooting an environment with multiple connections becomes difficult because each path may be a point of failure. Some of the most difficult problems to track are related to cables. It's not uncommon for IT staff to spend days trying to troubleshoot a problem only to find that it can be traced to a cable with an extreme bend in it.

There's also the complexity inherent in provisioning new physical servers in enterprises with separate networking and storage groups, both of which need to coordinate to provision NIC and HBA cards. In some cases, this could take weeks.

Traditional HBAs can't see virtual machines, which creates potential security and management issues. From a security standpoint, all applications running on a physical server must be in the same zone. From a management standpoint, it's difficult to tie applications to the storage if you can't identify the virtual machines. Ultimately, you need a better solution for greater scale and flexibility, and improved functionality.


There are solutions that address these problems, but the extent to which they solve them varies. Let's take a look at some of the technologies looking to resolve these problems.

Automated patch panels. This option offers the ability to wire all connections into a single patch panel, which can then handle all reconfigurations. This solution has been available for many years and is very popular in lab configurations. (However, it doesn't address the need to see virtual machines.) For those environments with constantly changing physical environments, this would be very useful. Key suppliers in this market include Apcon and OnPath Technologies (formerly IntelliPath).

N_Port ID Virtualization (NPIV). NPIV recognizes multiple IDs from one physical HBA, essentially creating logical HBA ports. This technology was specifically designed to recognize virtual machines on a physical server. Many refer to it as virtual HBAs. The technology is focused mainly on FC, so while it doesn't reduce the number of cables, it does provide additional intelligence in virtualized servers and reduces some security and management burdens. Key suppliers of this technology are Emulex and QLogic.

Fibre Channel over Ethernet (FCoE). Here's another technology looking to solve the I/O problem. Based on developing enhancements to existing Ethernet protocols like priority flow control, lossless Ethernet, congestion management and priority grouping, FCoE will reduce connectivity requirements. It does this by using a single converged network adapter to handle both IP and FC traffic through a single physical interface. It will support 10Gb throughput and current FC management solutions. This technology is still emerging and products (demonstrated at trade shows) aren't expected to be widely available until late 2008 or early 2009. There's a great deal of support for this technology from many of the industry's leading providers like Brocade, Cisco, Emulex, Network Appliance, Nuova and QLogic.

InfiniBand. This option provides high throughput and is currently available. Companies are taking advantage of this technology to enable I/O virtualization; essentially, a single card can have multiple virtual NICs or virtual HBAs. This type of solution eliminates the need for multiple cables, NICs and HBAs, and provides sufficient bandwidth to eliminate any I/O bottlenecks. One company pioneering virtual I/O with InfiniBand is Xsigo Systems. The company has solutions available today, and has also built an open solution that will enable it to convert to FCoE when it's available.

Implementing technology for the sake of technology doesn't make sense. Deploying new technology because it saves you time and money, and delivers higher levels of service, is worth investigating. The benefits of virtual I/O include:

  1. Monetary savings. Virtual I/O infrastructures require fewer interface cards and cables. Only a single card and cable (two of each for high availability) are required for each physical server installation. Operational costs are reduced due to a single interface requiring only one team to install it; purchasing, inventory and so on are also simplified.

  2. Time savings. Virtualizing the I/O path enables change to occur in almost real-time, as it creates an abstract layer for network and storage resources. It also accelerates the time to deploy new services on physical infrastructures, as there are fewer server connections.

  3. Higher levels of service. Regardless of the technology implemented to virtualize the I/O path, service levels can be improved dramatically. At the very least, leveraging an HBA with NPIV provides greater clarity in virtual server environments. Leveraging InfiniBand or FCoE technology not only provides that visibility, but has the additional benefit of greater throughput. This will become critical as more virtual machines and corresponding applications are placed on physical servers.
This environment should also facilitate the centralized control of I/O resources and improve responses to application migration/failovers, new deployments and DR situations. The ability to identify each virtual machine can establish QoS for the I/O path, as well as enhance security options. As virtualization technology becomes more widely used, it will continue to highlight deficiencies in other areas of the data center. In this case, the spotlight is now on the I/O path's role as a potential bottleneck.

Virtualizing the I/O path may be the best way to accommodate the dynamic nature of these environments. There's a variety of technologies available--with more on the horizon--that address some or all of the issues created by server virtualization. The first step is to become familiar with the various techniques and to decide what makes the most sense for you today and in the future.

Article 18 of 19

Dig Deeper on Storage virtualization

Start the conversation

Send me notifications when other members comment.

Please create a username to comment.

Get More Storage

Access to all of our back issues View All