GFI Software

Welcome to the GFI Software community forum! For support please open a ticket from https://support.gfi.com.

Home » GFI User Forums » Kerio Connect » 2012 data deduplication issues? (any problems)
2012 data deduplication issues? [message #117746] Tue, 25 November 2014 10:18 Go to next message
BMAdmin is currently offline  BMAdmin
Messages: 21
Registered: July 2013
Location: UK
Morning All,

We have a storage issue on our 2008 R2 server. We are actively looking at upgrading the OS to 2012 and switching on the Data Deduplication option to increase the storage space available to kerio connect.

We've made a copy of the kerio folders onto another 2012 production server as a test and confirmed the deduplication rate we can expect. I excluded the fld files from the deduplication option.

My question is can you see any issues arising with the Kerio Server accessing these files in a deduplicated state?

[Updated on: Tue, 25 November 2014 10:18]

Report message to a moderator

Re: 2012 data deduplication issues? [message #117750 is a reply to message #117746] Tue, 25 November 2014 12:25 Go to previous messageGo to next message
Mark Price (Kerio) is currently offline  Mark Price (Kerio)
Messages: 136
Registered: February 2011
Location: UK
Hi Tazho

I don't believe this scenario has been tested, but we always recommend that the Kerio store is never access by thirdparty systems, especially if they interfere with the files that are contained there.

I would suggest not using de-duplication I'm afraid.


Mark Price
Kerio technical support.

Log Support Incidents here: http://www.kerio.com/support
Also, please use our KB: http://kb.kerio.com
Re: 2012 data deduplication issues? [message #117752 is a reply to message #117750] Tue, 25 November 2014 12:49 Go to previous messageGo to next message
BMAdmin is currently offline  BMAdmin
Messages: 21
Registered: July 2013
Location: UK
Thanks for the response.

As the Deduplication is a sub-system process of the Server OS I'm not envisioning a problem especially if I ignore the index files and only include the eml files.

We will be going ahead with this during our xmas shutdown period, so looks like I'll be testing it for you then Smile

Re: 2012 data deduplication issues? [message #117755 is a reply to message #117752] Tue, 25 November 2014 13:34 Go to previous messageGo to next message
Mark Price (Kerio) is currently offline  Mark Price (Kerio)
Messages: 136
Registered: February 2011
Location: UK
Hi Tazho

I would seriously not have this system looking at the .eml's or other files in the store as this will affect the live running of indexes and cause possible data issues. if it removes files on a live system, there is a very good chance of this happening.

I hope this helps.


Mark Price
Kerio technical support.

Log Support Incidents here: http://www.kerio.com/support
Also, please use our KB: http://kb.kerio.com
Re: 2012 data deduplication issues? [message #117759 is a reply to message #117755] Tue, 25 November 2014 15:26 Go to previous messageGo to next message
BMAdmin is currently offline  BMAdmin
Messages: 21
Registered: July 2013
Location: UK
I'm sorry but after re-re-reading how Deduplication works I believe it will work fine. But please correct me if I'm wrong.

http://blogs.technet.com/b/filecab/archive/2012/05/21/introd uction-to-data-deduplication-in-windows-server-2012.aspx
Re: 2012 data deduplication issues? [message #117761 is a reply to message #117759] Tue, 25 November 2014 16:09 Go to previous messageGo to next message
Mark Price (Kerio) is currently offline  Mark Price (Kerio)
Messages: 136
Registered: February 2011
Location: UK
Hi Tazho

After having a word with our Developers, they have said that this would not be recommended for use with Kerio and suggest that you do not use.

I'm sorry about this, but its always a good idea to never interfere with the mail server when its live.

I hope this helps.


Mark Price
Kerio technical support.

Log Support Incidents here: http://www.kerio.com/support
Also, please use our KB: http://kb.kerio.com
Re: 2012 data deduplication issues? [message #117775 is a reply to message #117761] Wed, 26 November 2014 09:33 Go to previous messageGo to next message
clan is currently offline  clan
Messages: 187
Registered: May 2011
Did your developers tell you why they don't recommend this? Looking at the paper linked by Tazho it should work, as long as Connect uses standard file access methods, but it will have a performance impact because of the use of reparse points. On a mail server that seems to handle amounts of data to justify thinking about reducing it, instead of just adding disks, the performance impact might be too much.
Re: 2012 data deduplication issues? [message #117776 is a reply to message #117775] Wed, 26 November 2014 10:10 Go to previous messageGo to next message
BMAdmin is currently offline  BMAdmin
Messages: 21
Registered: July 2013
Location: UK
I can see there point if the system is a low spec'd server, but we have a raid 10 Dell R620 with Sas drives, currently running 140 users and 400gb of storage.

I monitored disk and system usage yesterday and the impact on the server was minor to say the least.

I see upgrading the OS a major saving to having to replace the server with a larger storage. It will at least delay the replacement for another year at least at current usage trends.
Re: 2012 data deduplication issues? [message #117778 is a reply to message #117776] Wed, 26 November 2014 10:51 Go to previous messageGo to next message
Mark Price (Kerio) is currently offline  Mark Price (Kerio)
Messages: 136
Registered: February 2011
Location: UK
Hi all.

Development did say that there would be a performance issue for one.

But, as its not tested or approved by Kerio, we cannot recommend this and if an issue was to arise due to this system, it would not be supported I'm afraid.

Perhaps you could use the suggest idea feature in Connect and add this to the requests to get it supported fully.

Hope this helps.


Mark Price
Kerio technical support.

Log Support Incidents here: http://www.kerio.com/support
Also, please use our KB: http://kb.kerio.com
Re: 2012 data deduplication issues? [message #117779 is a reply to message #117778] Wed, 26 November 2014 10:54 Go to previous messageGo to next message
BMAdmin is currently offline  BMAdmin
Messages: 21
Registered: July 2013
Location: UK
Will do.Thanks Mark.
Re: 2012 data deduplication issues? Update [message #118676 is a reply to message #117746] Fri, 16 January 2015 17:09 Go to previous messageGo to next message
BMAdmin is currently offline  BMAdmin
Messages: 21
Registered: July 2013
Location: UK
Update:-
I Upgraded the server on the 28th December to 2012R2. Absolutely no problems at all, still running version 8.3.4.

I set the deduplication options on the data drive to only do .eml files and run during the night.
We are currently running at 57% deduplication rate(Saving 240GB) with very little additional impact on the server.

[img]./fa/3717/0/[/img]
  • Attachment: jedi.JPG
    (Size: 39.14KB, Downloaded 306 times)

[Updated on: Fri, 16 January 2015 17:09]

Report message to a moderator

Re: 2012 data deduplication issues? Update [message #118695 is a reply to message #118676] Tue, 20 January 2015 00:28 Go to previous message
Maerad is currently offline  Maerad
Messages: 275
Registered: August 2013
Thanks for the feedback, was also interested in this. Maybe I try it ouf if the storage is a problem. But still unsure about the backup etc, if I still can mount any vhdx in windows an access all files with dedup etc.

I think the main reason for kerio to not use dedup was that they didn't test and try out any dedup with kerio, so they are basically not sure what could or will happen. If something goes down, you're on your own.

I wouldn't recommend any new techique either, if it's not tested and ok by the developers for their product. Even if it runs under the file system itself.

[Updated on: Tue, 20 January 2015 00:31]

Report message to a moderator

Previous Topic: Recommended specs for new server installation
Next Topic: Messages Remain in Drafts Folder w/ OSX Yosemite
Goto Forum:
  


Current Time: Sat Jun 10 19:39:14 CEST 2023

Total time taken to generate the page: 0.02953 seconds