MySpace branches out with Isilon clustered NAS

MySpace drops EMC SAN storage for Isilon's clustered NAS as extreme data growth forced changes that could be the future of the storage industry, according to the MySpace CTO.

This Content Component encountered an error

SAN DIEGO -- As the latest Internet phenomenon, MySpace.com has been flirting with the outskirts in storage technology advancements from the very beginning, according to chief technology officer and co-founder Aber Whitcomb, who walked attendees at Storage Networking World (SNW) through the rapid changes MySpace has seen in its storage environment since its founding in 2003.

From DAS, to clustered databases, to virtualized storage from 3Par Data Inc. and a large clustered NAS system from Isilon Systems Inc., the process MySpace went through in just a few years could be the future of the entire industry as storage grows across the board, Whitcomb said.

In the very beginning, Whitcomb said a simple cluster of two servers to balance loads on the sites' Oracle databases was adequate. "And if you can get away with it," he said, "That's the architecture I still recommend because of its simplicity."

Related articles

Get ready for universal grid storage

The rapid evolution of NAS -- It's no longer simple storage

Users scale performance with clustering  

But, like many users, data growth forced changes in the MySpace shop. As the site grew to half a million users, and then to a million, and then two million, the company moved rapidly across the many phases of data growth, first partitioning reads and writes into separate databases, then breaking up its databases vertically between services the Web site offered, including e-mail, blogs and photos. Eventually, Whitcomb said, the site was forced to break its databases up horizontally, setting up clusters of databases for groups of users.

The site stuck with that model even as it added an EMC Corp. Clariion SAN to replace its DAS.

"Horizontal partitioning, we found, is very scalable," Whitcomb said. "In 2004, IBM did some tests showing that databases were capable of up to 3.2 million transactions a minute, but our database cluster this past March was doing 4.5 million transactions a minute."

But as the site grew to 10 million users, MySpace hit another ceiling.

"That's our theme, at MySpace," Whitcomb said. "We max everything out."

Even partitioning its SAN demanded too much time and "hot spots" were cropping up on frequently accessed disks. Eventually, MySpace let go of the traditional EMC storage to go with 3Par's Inserv SAN box, which includes a virtualization layer that automatically balances data across physical disks -- no more hot spots, no more time spent partitioning.

But servers and file sharing was still a problem. The clustered and continually repartitioned databases were becoming too cumbersome to manage; shared file systems also grew too big to take care of manually.

"I had engineers up all night walking a single file tree from one piece of hardware to another," Whitcomb said. "We were stuck."

It was at last year's SNW, Whitcomb said, that he saw a presentation by the Kodak EasyShare gallery -- a business very similar to MySpace, he noted -- about its use of clustered NAS systems from Isilon , and a light bulb went on.

"When I was rehearsing today's talk at home," he told the SNW audience, "My girlfriend remembered Isilon because I had come home last year so excited about them."

According to Whitcomb, Isilon had done for them with file sharing what 3Par had done for disk partitioning, balancing files across multiple nodes and allowing new nodes to be added with a minimum of management.

"We consider this a long-term solution because we can have up to 500 terabytes in a single file system and just keep adding more nodes," Whitcomb said. "And we have less than one full-time engineer managing it."

MySpace now serves its MP3 and video streaming features through Isilon's clustered NAS at a rate of 600 Mbps per node, giving an aggregate throughput of 10 Gbps for the whole system.

They'll need it -- MySpace is projected to boast more than 100 million users by January 2007; 250,000 new users join every day. MySpace is now looking at internationalization and a globally distributed network.

"You'll be seeing MySpace China soon," Whitcomb said.

Earlier at SNW, IDC analyst Doug Chandler predicted that more MySpace-style businesses would begin to grow, as well, and more and more storage vendors would find themselves in uncharted territory as they sell their storage into "instant coffee" Web-based storage resources like MySpace and various photo-hosting sites.

"This is a long-term trend for storage OEMs," Chandler said. "They are going to have to understand that they will become the arms suppliers -- their partners' partners will be selling their capacity, and it won't necessarily be visible to Wall Street."

Dig deeper on NAS management

Pro+

Features

Enjoy the benefits of Pro+ membership, learn more and join.

0 comments

Oldest 

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to:

-ADS BY GOOGLE

SearchSolidStateStorage

SearchVirtualStorage

SearchCloudStorage

SearchDisasterRecovery

SearchDataBackup

Close