This article can also be found in the Premium Editorial Download "Storage magazine: How does your storage salary stack up?."
Download it now to read this article plus other related content.
|Get a grip on your environment|
Once you have all the firmware and driver information in a format you like, it's time to determine what needs to be upgraded. Most firmware and driver requirements come from the disk subsystem vendors, rather than the operating system, server, HBA or infrastructure manufacturers. Start by understanding what your disk vendor's specification limits are and their requirements; then do the same for the rest of the environment. Make sure to include any SAN-related software packages such as HBA failover, SRM, etc. Certain software packages may require minimum firmware levels on some of your hardware. Understanding all of these requirements will help you to formulate an upgrade plan.
Consult with your team as well as vendors to determine the versions of firmware you need for your upgrade. Consider issues such as bug fixes, feature releases and compatibility concerns. Once you have an idea of what you want the environment to look like, it's time to start documenting again.
For this round of documentation, put the firmware and driver requirements in a matrix organized so that the rows and columns have the same titles. There should be an entry for everything in your environment. You may also want to include the most current firmware, driver or software versions from each of the hardware and software components in your environment. The matrix should reflect where you want your environment to be, not what it is today.
When building the matrix, many cells may be blank or require information that's not available; try to make the entries as detailed as possible, as overlooked items might introduce problems. Don't be surprised if many of your vendor's firmware requirements have related firmware or driver requirements. The more complex the environment, the more likely it is that you'll need to make revisions to your matrix.
Once you figure out and document where you need the environment to be, look for those products that have multiple firmware requirements and work with those first. Determine which version(s) of firmware satisfy all of the requirements.
For example, in our sample firmware matrix (see Firmware upgrade matrix), if we choose an HBA firmware version between 1.8 and 1.9, we satisfy the HBA requirements for every element in our environment. If we choose the most current version available, 2.1, we may introduce problems with HBA failover and our disk subsystem. If you decide to go with the latest version, your disk vendor may ask you to back rev if new problems arise. Particular attention should therefore be paid to disk vendors' requirements. Typically, a disk vendor will get the initial call for help regardless of the actual source of the problem you're experiencing. This is probably why disk vendors' requirements are the most restrictive.
Take steps to upgrade
If you haven't performed firmware and driver upgrades in some time, it may be necessary to take a phased approach to upgrading. You might have to upgrade your HBAs to a newer version to upgrade another product and, once that second product is upgraded, you may have to upgrade the HBAs again to satisfy other requirements in your environment. Whatever the case, best practice calls for upgrading only one thing at a time and then verifying that the environment is still stable.
Once you've made the necessary firmware upgrades, update the environment document with the new firmware information. You may want to retain a copy of the original to use as a historical reference in the event you need to troubleshoot or roll back firmware versions.
Make it easier next time
How can you eliminate some of this work in the future? If you answered "standardize," give yourself a pat on the back. Try not to let the purchasing agent buy whatever HBA is on sale and make sure the server team doesn't use any old firmware or driver version for that HBA. Create unambiguous standards with sufficient detail to indicate the specific firmware and drivers required for each component make and model in your system. You should supply all the firmware, drivers and software you expect everyone to use. An intranet or network share can be used to publish all software revisions and related information.
Job No. 1 for storage administrators and managers is to keep the system up and running. Ignoring firmware and driver upgrades may help you to avoid the pain associated with upgrades, but it may cause many more problems in the long run with unplanned outages, intermittent problems or unnecessarily complicated upgrades when adding new hardware. Setting up a good system will pay off now and later because just when you think you're caught up with firmware upgrades, it'll probably be time to start all over again.
This was first published in December 2004