Home > Ask the Storage Technology Experts > Storage Management Questions & Answers > Staging older files to the SATA partition
Ask The Storage Expert: Questions & Answers
EMAIL THIS

Staging older files to the SATA partition

Stephen Foskett EXPERT RESPONSE FROM: Stephen Foskett

Pose a Question
Other Storage Categories
Meet all Storage Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 24 August 2004
I am using Solaris 9 on Sun servers with Hitachi storage system (on SAN with Brocade FC switch). I would like to add a few SATA terabytes to the storage system. I'm looking to do "disk staging" so that all the files from my partition older than two weeks or bigger than 10 MB will be staged to the SATA partition. These operations must be transparent to the application. I'm using VxFS and VxVM now.

>
Surprisingly, this is not easy to accomplish. In order to have some files on one storage system and others on another, you either have to use two different filesystems (and volumes and volume groups) and move the files with a script or SRM package, or you have to use an HSM (Hierarchical Storage Management) product.

One free method I've seen is to use a script to move the old files to your nearline/ATA storage and leave Unix symbolic links behind. Let's call this manual HSM. This works surprisingly well in some circumstances, especially if there are relatively few files to be managed in this way. But watch out -- each symbolic link requires an inode in the filesystem, and you can quickly run out of inodes! df_vxfs will show you how many inodes are left, and if you will have more than 8 million files, you need to use the "largefiles" option of mkfs when creating the filesystem. And look out for applications that aren't friendly to symbolic links, or none of this will work!


BROWSE BY TAG
Primary Storage or Storage Hardware,   Disk drives,   Storage Management,   VIEW ALL TAGS

Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   



RELATED CONTENT
Disk drives
How to add solid-state storage to your enterprise data storage systems
Hot storage technologies for 2010
Enterprise data storage technologies rise from the dead
Fail-in-place systems: Avoiding hard disk drive failures
Dataram enters solid-state storage market with XcelaSAN
Pliant claims up to 180,000 IOPS per drive with new Lightning Enterprise Flash Drive
Low-cost MLC NAND flash gains in enterprise solid-state storage
Solid-state storage update
STEC Inc. CTO looks at the future of flash and solid-state drives
STEC ships enterprise-ready MLC solid-state drives, but acknowledges tradeoffs
Disk drives Research

Storage Management
Why RAID rebuilds obstruct data migration
Creating half a mirror out of 3 drives totaling 300 GB
Growing a RAID group by adding old drives
How to calculate available disk space on a RAID 5
Why does my EMC 45 TB drive yield only 41 TB of usable storage?
RAID 4 vs. RAID 5
External SATA RAID array vs. system replacement
RAID-5 configuration
Separate or combine tiers in SAN?
Stephen Foskett: Blogs and more

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
backup robot  (SearchStorage.com)
DASD  (SearchStorage.com)
disk-to-disk-to-tape  (SearchStorage.com)
Fibre Channel  (SearchStorage.com)
hard-drive encryption  (.com)
holographic disk drive  (SearchStorage.com)
hybrid hard drive  (SearchStorage.com)
Robson  (SearchStorage.com)
Serial ATA  (SearchStorage.com)
solid-state drive  (SearchStorage.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice



Search for Data Management Tools
TechTarget Storage Media
Storage Magazine View this month\\'s issue and subscribe today.
Storage Decisions Apply online for free conference admission.
SearchStorage.com
HomeNewsMagazineTopicsLearningMultimediaWhite PapersBlogsEventsAbout Us

About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Site Map




All Rights Reserved, Copyright 2000 - 2009, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts