Home > Ask the Storage Technology Experts > Questions & Answers > Replicating large amounts of data
Ask The Storage Expert: Questions & Answers
EMAIL THIS

Replicating large amounts of data

Christopher Poelker EXPERT RESPONSE FROM: Christopher Poelker

Pose a Question
Other Storage Categories
Meet all Storage Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 01 November 2001
I read your explanation on H/W vs. S/W replication techniques. In replicating large amounts of data over databases, have you experienced any problems?

>

Sure... there can be many issues when doing remote copy for DR.

One of the basic problems that customers face is bandwidth and link reliability. Over time, you will be adding capacity to your production site and if the link between the local and remote sites was not spec'ed out with growth in mind, then you can hit a bottleneck during replication. This dramatically affects Sync copy to a DR site. Your production apps will slow to a crawl, and the remote copy may also suspend itself due to timeout conditions existing on the link.

A good rule of thumb to use for defining you connection requirements is 10Mbit of network bandwidth for every 1MByte of write I/O per second. Determine your WIO during peak periods. This is important, as many folks set requirements for the "average" load. During end of month, end of year, or batch processing, your WIO may increase dramatically and flood the links. You can determine average WIO per day by looking at your incremental backup logs, and get the total MB backed up. The best way to do this though is to use things like NT PERFMON logs. Set up a log file for all disk I/O over a week period during month end processing. (On NT, remember to use the diskperf -Y command in a DOS prompt and reboot to enable disk statistics.)

Also, if during any time of day you do a DBCC (database consistency check) on your databases, it will touch every block in the database. This is true for things like Exchange utilities too. Before running these utilities, it's best to suspend the remote copy process for those volumes. This can be automated on some disk arrays using vendor supplied automation scripts for backup and databases.

Software remote copy has the same issues. If doing a DBCC on Oracle, while running host base replication, CPU usage and network usage will shoot up. Keeping these things in mind, and having an expert help you with all the nuances of the remote copy process, can help eliminate most of these things from ever occurring.

Chris

Editor's note: To view Chris' answer to the HW-SW replication techniques referred to in the above question go to:

H/W-S/W replication techniques, Part I http://www.searchStorage.com/ateQuestionNResponse/0,289625,sid5_cid414545_tax286192,00.html

H/W-S/W replication techniques, Part II http://www.searchStorage.com/ateQuestionNResponse/0,289625,sid5_cid414550_tax286192,00.html

H/W-S/W replication techniques, Part III http://www.searchStorage.com/ateQuestionNResponse/0,289625,sid5_cid414554_tax286192,00.html

Editor's note: Do you agree with this expert's response? If you have more to share, post it in our Storage Networking discussion forum at http://searchstorage.discussions.techtarget.com/WebX?50@@.ee83ce4.


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   



RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice



Search for Data Management Tools
TechTarget Storage Media
Storage Magazine View this month\\'s issue and subscribe today.
Storage Decisions Apply online for free conference admission.
SearchStorage.com
HomeNewsMagazineTopicsLearningMultimediaWhite PapersBlogsEventsAbout Us

About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Site Map




All Rights Reserved, Copyright 2000 - 2010, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts