| Re: Backup Process [message #144520 is a reply to message #144384] |
Thu, 29 November 2018 17:38   |
Maerad
Messages: 275
Registered: August 2013
|
|
|
|
The problem in this case is mostly the CPU on the server and the storage where kerio lies.
First of all, AFAIK kerio uses only one CPU to zip the files, that's why it's "slow". And depending on the server, it can take some time to get it done.
On the other side, the storage is is also a huge factor. It's not about the total size of the files, but the amount of them.
A fuckload of small files needs AGES to be read and compressed, even on a fast raid 10. We have Kerio running on an Epyc with 3.2 Ghz boost and the storage on a hardware raid 10 with 4x 15k SAS Disks. Backupserver is a N54L HP Microserver with a hardware raid 5 (NAS SATA Disks). That config can easily use the 1 GB connection to the fullest and still have some extra. Still, our full backup needs around 7 hours to complete with a total size of around 98 GB and 715713 files.
I also had the same problem with our DMS system. That software saved every document as seperate tiff per side, no multi page tiff.
So I had like 2 billion files to backup - a weekend was quite short for that. Even with our ERP System and z7 and LZ4 or 5 it needs a really long time to backup. Direct file copy needs even longer. And the ERP System is on a NVMe PCI Raid with 6 GB/s reading speeds. Way too many small files.
Still - even if the zip is multi core, it will take some time to backup the files. That's why I run hyperv replica for disaster recovery and backup the VM instead of the folder itself, block transfers are way faster.
But I also use Kerio Backup - just to be sure. You really can't have enough of those :3
@ Lisa Lyons (Kerio):
Maybe you could update the zip routine to a multicore approach?
|
|
|
|
| Re: Backup Process [message #145771 is a reply to message #144520] |
Tue, 14 May 2019 00:24 |
WeHoDo
Messages: 12
Registered: August 2018
|
|
|
|
I make a full scripted backup of the mail store incl the config files.
We got around 500GB of data and backup takes no longer than 2 hours.
Yes, its easier to have the backup of Kerio itself, just restore and it works.
My way of backup takes maybe 5 minutes more of your time, but saves backup time.
I never had issuu's when restoring an emailbox.
|
|
|
|
Members
Search
Help
Register
Login
Home
