Consolidation (but not backup) taking much longer on one disk in rotation?


Author
Message
jphughan
jphughan
Most Valuable Professional
Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)
Group: Forum Members
Posts: 3.3K, Visits: 24K
I have an odd performance anomaly in my backups for which I'm trying to determine root cause and ideally a fix, but I'm wondering if Macrium staff or anyone else might have possible causes that haven't occurred to me yet.  First, a description of the backup strategy in question:

1. Every weeknight, an Image backup runs at 10PM (for everything except the Data partition) and a File/Folder Backup runs at 11PM (for the Data partition).  I do this because Reflect currently does not offer a built-in method of restoring data from image backups that preserves custom NTFS permissions, and that's important for this system's Data partition.  The machine in question is a Dell PowerEdge T330 running Windows Server 2016 and the latest release of Reflect V6.
2. Backups are stored on a rotation of 9 identical WD 3TB USB 3.0 disks -- one for each of the 5 possible Mondays in the month, and one for each of the remaining weekdays, the latter of which are used every week. The Monday disks are used once per month, or less in the case of the "5th Monday" disk.
3. The strategy is Incrementals Forever with Synthetic Fulls, with 7 Incrementals retained.  This plus the rotation strategy means that the non-Monday disks contain weekly backups going back essentially 2 months.

I'm going to ignore the Monday disks here since their less frequent use will cause their backup times to differ from the others, and also because this strategy has not been implemented long enough for sufficient backups to accumulate on the Monday disks to trigger consolidation anyway. Looking at the Tuesday through Friday disks, the time to complete the actual backup (i.e. total time minus consolidation time) is approximately 1h30m, nearly identical across all of them -- as would be expected under this rotation strategy.  HOWEVER, looking at the consolidation time, the Wednesday, Thursday, and Friday disks complete that operation in approximately 1h25m, but the Tuesday disk consistently takes 3h30m.  The logs reflect this occurring consistently for several months now.

Looking at Event Viewer I haven't found any references to activity going on late Tuesday night or very early on Wednesday that might slow this operation down, and I would be surprised if a hardware defect with the Tuesday disk could still allow its write speeds to keep up with the other disks and only affect consolidation I/O.  I'm reluctant to deliberately connect the wrong disk on Tuesday to isolate the day vs. the disk or to kill the Tuesday set and start fresh to see if that solves the issue (especially since I'd have to wait 2 months to get my answer with this retention policy), and copying the Tuesday files to another disk and using Consolidate.exe to test that operation on the Tuesday files while they reside on another disk isn't as easy as it might sound because the Full plus first Incremental total about 800 GB.

So at this point I'm just curious if anyone has any ideas as to what may be causing this anomalous behavior or what other tests potentially more feasible tests I can run to determine root cause.

Edited 13 May 2017 7:56 PM by jphughan
Nick
Nick
Macrium Representative
Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)Macrium Representative (2.6K reputation)
Group: Administrators
Posts: 1.5K, Visits: 8.3K
Hi 

Thanks for posing. 

This is difficult to isolate but consolidation involves a lot of reads and writes, whereas the backup itself is only writes to the backup disk. Can you try an independent read speed test of your Tuesday disk?

Kind Regards

Nick - Macrium Support

jphughan
jphughan
Most Valuable Professional
Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)Most Valuable Professional (4.7K reputation)
Group: Forum Members
Posts: 3.3K, Visits: 24K
^ I was thinking about CrystalDiskMark, so I'll give that a shot next time the Tuesday disk is connected.  I may also just cave and ask the person who rotates disks to deliberately connect the Wednesday disk on Tuesday and vice versa to isolate weeknight vs. disk, and I'll report back on the results of either/both tests.  Thanks!

GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...




Similar Topics

Reading This Topic

Login

Explore
Messages
Mentions
Search