This article can also be found in the Premium Editorial Download "Storage magazine: Surprise winner: BlueArc earns top NAS quality award honors."
Download it now to read this article plus other related content.
Until recently, most grid storage systems have been deployed in specialized high-performance computing environments such as oil and gas exploration. But new grid storage systems specifically designed for low-cost, general-purpose data protection from Cleversafe--an open-source community that's creating software for dispersed data storage--and NEC are making their way out of research labs and into corporate beta-testing environments.
Computer scientists say the Internet will soon have the same impact on data storage that it's had on computing and communications technologies. Cleversafe, started by Chris Gladwin, its president and CEO, has developed a way to store documents and files over the Internet in slices of encrypted data that can be reassembled only by the computers that originally created the files. In the case of a node or nodes failing, any majority of nodes can put the data back together; for example, in an 11-node system, six nodes can recover all the data, says Gladwin.
Cleversafe consists of two parts: Cleversafe.org, an open-source project that's developing the code that enables the dispersed grid storage architecture; and Cleversafe LLC, which plans to commercialize the project by licensing grid node sites. Cleversafe operates a multiterabyte research grid users can tap into to explore the storage grid software. The research grid is for testing only, however, and data is flushed periodically.
NEC's Hydrastor storage platform is much
What NEC calls Distributed Resilient Data (DRD) technology protects against up to three disk or node failures, which is 300% more protection than RAID-5, says Karen Dutch, NEC's general manager for advanced storage products. Other data management services migrate or replicate data between nodes, and constantly changing files can be protected through continuous data protection. DataRedux, NEC's data-reduction software, eliminates repetitive data segments.
If the primary Hydrastor site fails, data can be continuously accessed through the nodes in another location without disrupting the application. When the primary site is brought back online, the data is automatically rebuilt and load balanced to that site from the other nodes, eliminating the need for complex failover and failback scripts.
This was first published in June 2007