Access your Pro+ Content below.
Dealing with big data: The storage implications
This article is part of the Vol. 11 Num. 3 May 2012 issue of Storage magazine
Whether it’s defining “big data,” understanding Hadoop or assessing the impact of large data stores, storage pros need a clear understanding of the big data trend. It seems impossible to get away from the term “big data” nowadays. The challenge is that the industry lacks a standard definition for what big data is. Enterprise Strategy Group (ESG) defines big data as “data sets that exceed the boundaries and sizes of normal processing capabilities, forcing you to take a non-traditional approach.” We apply the term “big data” to any data set that breaks the boundaries and conventional capabilities of IT designed to support day-to-day operations. @pb These boundaries can be encountered on multiple fronts: The transaction volume can be so high that traditional data storage systems hit bottlenecks and can’t complete operations in a timely manner. They simply don’t have enough processing horsepower to handle the volume of I/O requests. Sometimes they don’t have enough spindles in the environment to handle all the I/O requests. This ...
Access this Pro+ Content for Free!
Features in this issue
Cloud archiving services can offer accessibility and data preservation at a fraction of the cost of building an on-site archive infrastructure.
Direct-attached storage may seem passé, but it’s making a comeback and gaining widespread interest.
Storage budgets have been recovering, but progress might be slowing. Storage managers are looking for tools to get more out of the gear they have or plan to buy.
Find out what readers had to say about hard disk drive price increases and shortages. What types of compromises did they have to make when placing orders?
Columns in this issue
Lower prices, no vendor lock-in, endless storage capacity -- cloud storage is getting downright friendly these days.
Give or take a few million years, the Mayans say we’re doomed; but our data storage systems may be living on borrowed time right now.
Whether it’s defining “big data,” understanding Hadoop or assessing the impact of large data stores, storage pros need a clear understanding of the big data trend.
Flash technology can be attractive for cloud service providers -- and enterprises -- looking for a highly available, scalable and efficient data storage solution.