Import processing speed question (Full Version)

All Forums >> [Archiving & Fax] >> GFI MailArchiver



Message


chuckh -> Import processing speed question (29.Oct.2009 7:32:49 AM)

Has anyone had to import several million emails from PSTs? I have over 1TB of PSTs that I've been exporting and then putting into the Pickup folder. The export process is no problem, I have several machines running eewiz and they go through the PSTs pretty fast. However it seems like the most the import service will do is around 10k emails an hour. After 1-2 hours the rate slows down drastically and you have to restart the import service to get the rate higher again. This is on a Dell R300 single quad core Xeon 2.5ghz 4GB ram Running Server 2008 R2 and SQL 2008 std 64bit. SQL is on FC SAN. Exchange is on a separate box. The marc.MAIS.exe process stays around 25-30% cpu usage, the machine as a whole hovers around 35% cpu. Seems like it should be able to process them faster but I don't know. Does anyone have any similar experience or have tested the speed of the imports? Anyone have any suggestions? At this rate it would take over 40 days to import 10 million emails, and I think I have more than 10 million.[:(]




ianb -> RE: Import processing speed question (29.Oct.2009 7:46:23 AM)

Importing has a high disk usage so it is important that your disks are highly optimised.

Some suggestions
1) Use MsSQL databases instead of Firebird
2) Have MsSQL server on a different server than the MailArchiver
3) Install MailArchiver on a different partition than the system partition

Hope these help




Page: [1]