Import processing speed question

	Forums Register Login My Profile Inbox Address Book My Subscription My Forums Member List Search FAQ Ticket List Log Out

Import processing speed question

Logged in as: Guest

Users viewing this topic: none

Printable Version

All Forums >> [Archiving & Fax] >> GFI MailArchiver >> Import processing speed question

Page: [1]

Message

<< Older Topic Newer Topic >>

Import processing speed question - 29.Oct.2009 7:32:49 AM

chuckh

Posts: 2
Joined: 29.Oct.2009
Status: offline

Has anyone had to import several million emails from PSTs? I have over 1TB of PSTs that I've been exporting and then putting into the Pickup folder. The export process is no problem, I have several machines running eewiz and they go through the PSTs pretty fast. However it seems like the most the import service will do is around 10k emails an hour. After 1-2 hours the rate slows down drastically and you have to restart the import service to get the rate higher again. This is on a Dell R300 single quad core Xeon 2.5ghz 4GB ram Running Server 2008 R2 and SQL 2008 std 64bit. SQL is on FC SAN. Exchange is on a separate box. The marc.MAIS.exe process stays around 25-30% cpu usage, the machine as a whole hovers around 35% cpu. Seems like it should be able to process them faster but I don't know. Does anyone have any similar experience or have tested the speed of the imports? Anyone have any suggestions? At this rate it would take over 40 days to import 10 million emails, and I think I have more than 10 million.

Post #: 1

RE: Import processing speed question - 29.Oct.2009 7:46:23 AM

ianb

Posts: 268
Status: offline

Importing has a high disk usage so it is important that your disks are highly optimised.

Some suggestions
1) Use MsSQL databases instead of Firebird
2) Have MsSQL server on a different server than the MailArchiver
3) Install MailArchiver on a different partition than the system partition

Hope these help

_____________________________

Ian Bugeja
Software Developer - GFI Software - www.gfi.com
Messaging, Content Security & Network Security Software

(in reply to chuckh)

Post #: 2