Premium Content

Access "Big file storage scales for large data applications"

Published: 03 Feb 2014

There are two sides to the big data story: the more familiar one involves analytics using vast numbers of small files, but dealing with big file storage is another issue. Much of the discussion around big data analytics involves dealing with extensive data sets that typically comprise thousands or millions of smaller data objects gleaned from sources such as Web traffic, transactional databases or machine sensor output. But there's another side to the big data discussion where rather than focusing on analytics using huge numbers of smaller files, the processes involved require the handling and manipulation of much larger files. Use cases would include "big data archive" and similar applications, and some of the unique characteristics of big files will warrant special consideration when it comes to storage systems design. Big file data defined Typically, big file data involves some kind of images or video, with the most common example being digital content such as movies and television. The production processes used to create those assets generate some very ... Access >>>

Access TechTarget
Premium Content for Free.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

What's Inside

Features

More Premium Content Accessible For Free

  • A lesson in flash caching
    storage_0714.png
    E-Zine

    Solid-state storage is proliferating as a replacement for hard disk drives, where it offers a quick shift into the fast lane of storage processing...

  • Storage performance management: Ways to maximize your environment
    better_storage_performance.png
    E-Handbook

    Making your storage perform to the very best of its ability is an age-old problem with a long list of ways to approach it. But how should you start ...

  • Hypervisor vendors up the ante with new storage features
    storage_0614.png
    E-Zine

    There's a struggle between doing storage the "old way" and the new demands that virtual servers put on networked storage. Storage vendors have ...