Premium Content

Access "Compression puts the squeeze on dedupe"

Published: 22 Oct 2012

DEDUPLICATION IS ALL the rage these days, while the good old-fashioned Lempel-Ziv (LZ) compression technology we all grew up with is taken for granted. The real differences between dedupe and compression have to do with algorithms or how each one does its job. But not many of us need to know algorithm differentials to do our jobs. "I think there's a lot of confusion in the marketplace," says Arun Taneja, founder and consulting analyst at Taneja Group in Hopkinton, MA. "Most people aren't computer scientists." Both technologies shrink data volumes. Compression does it by squeezing out repetitive bits in a data stream, cleaning redundant data within a file. Dedupe compares objects at the file and sub-file level, removes duplicate files by referencing the original and saves only one instance. Standard compression technology provides about a 2:1 ratio, halving the number of bits in a stream. Both tape and disk can accommodate compression. Dedupe, which is strictly for disks (tape can't accommodate its serial nature), boasts ratios on the order of 30:1. "But it's... Access >>>

Access TechTarget
Premium Content for Free.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

What's Inside

  • Columns
    • Hot Spots: Don't let SaaS costs sneak up on you by Lauren Whitehouse

      There are plenty of good reasons to opt for backup storage as a service, but there are also plenty of questions you should ask before green lighting any move to online backup.

    • Storage Bin 2.0 The color of money

      If your actions will help meet the company's overall green objectives of making more money faster, you'll probably find your status growing along with your budget.

    • End in sight for Fibre Channel?

      End in sight for Fibre Channel?

    • Best Practices: Why you can't go it alone by Ashish Nadkarni

      Most IT departments are split into islands of expertise, like storage, servers and networks. But the time is coming when those disparate groups will have to learn to work together. Network consolidation is just one of the technologies forcing storage pros to build stronger interdisciplinary IT teams.

More Premium Content Accessible For Free