Premium Content

Access "Big file storage scales for large data applications"

Published: 03 Feb 2014

There are two sides to the big data story: the more familiar one involves analytics using vast numbers of small files, but dealing with big file storage is another issue. Much of the discussion around big data analytics involves dealing with extensive data sets that typically comprise thousands or millions of smaller data objects gleaned from sources such as Web traffic, transactional databases or machine sensor output. But there's another side to the big data discussion where rather than focusing on analytics using huge numbers of smaller files, the processes involved require the handling and manipulation of much larger files. Use cases would include "big data archive" and similar applications, and some of the unique characteristics of big files will warrant special consideration when it comes to storage systems design. Big file data defined Typically, big file data involves some kind of images or video, with the most common example being digital content such as movies and television. The production processes used to create those assets generate some very ... Access >>>

Access TechTarget
Premium Content for Free.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

What's Inside

Features

More Premium Content Accessible For Free

  • Flash storage technology decisions
    storage_0414.png
    E-Zine

    Just about as quickly as we learn the merits of a new solid-state form factor, a new one appears. While the use and location of spinning disk ...

  • Cloud storage tools manage data stored in the ether
    storage_0314.png
    E-Zine

    As much as we might want to assume an "out of sight, out of mind" attitude about the data we ship to cloud storage services, the truth is that it ...

  • Object storage systems come of age
    object-based_storage.png
    E-Handbook

    Object storage is sizzling hot, with technologists calling it the necessary building block for efficient cloud storage and big data projects. As ...