Problem solve Get help with specific problems with your technologies, process and projects.

Staging older files to the SATA partition

I am using Solaris 9 on Sun servers with Hitachi storage system (on SAN with Brocade FC switch). I would like to add a few SATA terabytes to the storage system. I'm looking to do "disk staging" so that all the files from my partition older than two weeks or bigger than 10 MB will be staged to the SATA partition. These operations must be transparent to the application. I'm using VxFS and VxVM now.
Surprisingly, this is not easy to accomplish. In order to have some files on one storage system and others on another, you either have to use two different filesystems (and volumes and volume groups) and move the files with a script or SRM package, or you have to use an HSM (Hierarchical Storage Management) product.

One free method I've seen is to use a script to move the old files to your nearline/ATA storage and leave Unix symbolic links behind. Let's call this manual HSM. This works surprisingly well in some circumstances, especially if there are relatively few files to be managed in this way. But watch out -- each symbolic link requires an inode in the filesystem, and you can quickly run out of inodes! df_vxfs will show you how many inodes are left, and if you will have more than 8 million files, you need to use the "largefiles" option of mkfs when creating the filesystem. And look out for applications that aren't friendly to symbolic links, or none of this will work!

Dig Deeper on Storage tiering

Have a question for an expert?

Please add a title for your question

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

Start the conversation

Send me notifications when other members comment.

Please create a username to comment.