Home > Ask the Storage Technology Experts > Questions & Answers > Looking for a device to compress 'on the fly' data
Ask The Storage Expert: Questions & Answers
EMAIL THIS

Looking for a device to compress 'on the fly' data

Marc Farley EXPERT RESPONSE FROM: Marc Farley

Pose a Question
Other Storage Categories
Meet all Storage Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 25 July 2003
I was thinking about compression and encryption and wondering if anyone has developed a device that will compress information "on the fly" so that it could be sent over a network in real time using less network resources, particularly bandwidth and throughput. I was thinking of something along the lines of a PCI card or some type of external device perhaps. Does such a device exist already?

>
EXPERT RESPONSE
There has been a lot of work done on compression but I don't know what products, if any, are available as PCI cards.

Architecturally, this would have to be done at an application layer, above the transport layer. This makes it more difficult to put in a card. Device drivers would have to force their way just above the network device drivers (and for storage, below volume manager or virtualization code).

Finally, both senders and receivers would have to use it. If it's on a card, then every system would need to use the same cards and who wants to buy cards like THAT? But, if it's not on a card, then where is it anyway? It's not likely to be wire speed.

This is one of those things that sounds simple at first but is pretty blasted complicated without a strong market requirement for it. As it is, most end nodes can't use 1Gb or 2Gb of bandwidth so there is little benefit to compression.

The situation for encryption is different.

Regards,
Marc

Editor's note: Do you agree with this expert's response? If you have more to share, post it in one of our discussion forums.


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


RELATED CONTENT
SAN management
Storage Decisions New York 2008 Session Downloads
Storage Decisions Session Downloads: Storage Systems & Networking Track (New York 2008)
EMC, Pillar offer options to boost Oracle performance on storage disk arrays
Quality Awards IV: It's a tie--EMC and NetApp share enterprise array honors
Does SAP eat more than its share of storage?
Solid-state drives quiz
Windows Server 2008 steps on some storage toes
Storage Decisions Chicago 2008 Session Downloads
Storage Decisions Session Downloads: Storage Systems & Networking Track (Chicago 2008)
Determining the number of drives in a RAID group
SAN management Research

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
Fast Guide to Storage Technologies  (WhatIs.com)
fat provisioning  (SearchStorage.com)
oversubscription  (SearchStorage.com)
RAID  (SearchStorage.com)
storage area management  (SearchStorage.com)
storage area network  (SearchStorage.com)
thin provisioning  (SearchStorage.com)
unified storage  (SearchStorage.com)
virtual provisioning  (SearchStorage.com)
zoned-bit recording  (SearchStorage.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice



Search for Data Management Tools and Tiered Storage Reseller Solutions
TechTarget Storage Media
Storage Magazine View this month\\'s issue and subscribe today.
Storage Decisions Apply online for free conference admission.
SearchStorage.com
HomeNewsMagazineTopicsLearningMultimediaWhite PapersBlogsEventsAbout Us

About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
TechTarget provides enterprise IT professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective IT purchase decisions and managing their organizations' IT projects - with its network of technology-specific Web sites, events and magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Reprints  |  Site Map




All Rights Reserved, Copyright 2000 - 2008, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts