Managing and protecting all enterprise data


Disks Get Switched

Incredible switching disk

The behind-the-scenes march by storage system vendors to switch disks within the array began a couple of years ago, but recent announcements from providers of storage silicon suggest that the pace is quickening. As a result, storage buyers should begin to see high-end arrays with better availability and performance characteristics than what they are currently used to.

This spring, PMC-Sierra announced a 4Gb cut-through switch, or loop switch, which the company bills as a big improvement to the intelligent port bypass circuit (PBC) it announced in 2003. More recently, the semi-conductor company Broadcom, which has shown an intense interest in the storage market, announced an entire 4Gb/sec 16-port fabric--as opposed to loop--switch designed to go inside high-density arrays.

The trend of switching disks within the array was arguably started by Vixel when it introduced its InSpeed switch on a chip (SOC) more than two years ago. Vixel has since been acquired by Emulex, which recently reported it had shipped more than 2 million InSpeed ports across at least 15 storage systems, says Brian Reed, Emulex vice president of business development. InSpeed customers include vendors such as BlueArc, Hewlett-Packard and Network Appliance.

What does switching fix? According to Peter Wong, manager of strategic marketing at PMC-Sierra, building a Fibre Channel array out of disks and PBCs on an Fibre Channel Arbitrated Loop (FC-AL) loop introduces "a myriad of problems." Those problems include maintaining signal integrity and achieving consistent performance. But PBCs biggest drawback is arguably its poor "diagnosability," or the difficulty one has in identifying a failed drive if its on a PBC-controlled loop.

A loop switch, in contrast, maintains the simplicity of FC-AL, but allows "the user to dive down and tell what drive is having trouble," Wong says. At the same time, a loop switch can improve system performance through reduced arbitration--in other words, by reducing the number of hops (PBCs) you need to go through in order to get to a drive.

Broadcom's fabric BCM8441 takes the concept of switched disks one step further. Because it is a fabric switch, it frees array manufacturers from FC-AL's limited device support of 126 devices per loop. In contrast, a Fibre Channel fabric supports more than 16 million devices. That's important for high-end arrays, especially when you consider the small form factor drives joining the market.

In the past, "126 devices wasn't an issue," says Michael McDonald, senior director of storage area networking for Broadcom, but with small form factor drives, "we'll be getting up to 126 devices fairly quickly."

Furthermore, says Arun Taneja, analyst and founder of Taneja Group, a 4Gb fabric switch can support disk drives at both 1Gb, 2Gb and 4Gb; in a loop, bandwidth is capped at the slowest device on the loop. That may be important for modular arrays, where customers buy a shelf of 2Gb/sec drives today, but 4Gb/sec drives tomorrow.

Nor surprisingly, existing loop switch vendors aren't sold on the concept of a fabric switch in the array. Both PMC-Sierra's Wong and Emulex's Reed point to additional cost and complexity of fabric switching as prohibitive and unnecessary. "Our customers report that [fabric switching] is a cumbersome solution, and overkill for what more customers are looking for," says Wong.

But if Broadcom's BCM8441 finds favor among array manufacturers--and according to Taneja, it is currently being evaluated by a large number of them--fabric switching's complexity should not be passed down to the storage buyer. "Whatever minimal level of complexity a fabric brings will be completely transparent to the end user," he says, "and by that I mean the IT administrator."

Article 12 of 18

Dig Deeper on Primary storage devices

Questions and answers from SAN School Storage area networks (SANs) have the ability to save a company money, hasten backups and help consolidate the data center. But, a SAN is not to be left alone. It's a complex, growing, breathing entity that constantly needs to be tweaked and upgraded.

So what is SAN School? If this is the first time you are asking yourself, "What's a SAN?" -- SAN School is for you. If you are implementing your first SAN and need implementation and migration help -- SAN School is for you. If you are far along in the SAN process and need to extend your SANs or connect SAN islands -- SAN School is for you.

The authors of "Storage Area Networks for dummies", Christopher Poelker and Alex Nikitin, are your SAN School professors. Through 15-minute Webcast lessons, they covered SANs from A to Z, from what a SAN is, to connecting those last nodes for optimal performance. readers sent Chris and Alex received a lot of questions during each SAN School Webcast lesson. Since each lesson only lasted 15 minutes, they weren't able to answer all of your questions. Thanksfully, though, Chris Poelker was kind enough to answer them after each lesson.

The editors of have taken each of your questions and Chris's answers and posted all of them for you here. Also, if you missed any of teh SAN School Webcasts, click here

Start the conversation

Send me notifications when other members comment.

Please create a username to comment.

Get More Storage

Access to all of our back issues View All