This article can also be found in the Premium Editorial Download "Storage magazine: RAID turns 20: Do you still need it?."
Download it now to read this article plus other related content.
Do-it-yourself method (build or buy)|
Google decided to build its own. Other companies, such as Facebook and MySpace, opted to buy products that supported their needs. Building out the infrastructure might make sense for Google because it has specialized expertise building massively scalable parallel storage systems and a culture that supports this type of approach. However, this isn't the preferred approach for most companies. Leveraging commodity disks and building out a proprietary file system takes years and lots of resources. If you believe your company has the talent, time, support and internal buy-in to take on this endeavor, you may want to consider this option. But ask yourself this question: Can you get your company's new service or product to market faster by building it yourself or with an off-the-shelf solution?
Again, the requirements for Web 2.0 models are very different from those associated with email or database applications. With Web 2.0, you're aiming to build a user population of hundreds of thousands (and potentially millions) of users. The data will be stored forever and will probably be filled with images, audio files and movies. If you choose to buy the infrastructure, where do you begin? Do you leverage your existing storage infrastructure that was really built for a different set of requirements or do you seek out next-generation storage systems built for
| these types of apps? These systems need to be massively scalable, provide predictable and reliable performance, and come at an affordable price point. With the potential to store billions of files and objects, they must also be easy to manage across multiple systems or geographies. In addition, they must interface with Web-based protocols and have replication capability.
This was first published in November 2007