Joinutility seperatorLogin utility separator Infobright.com
   
 
Disabling Compression
Posted: 31 May 2010 03:21 PM   Ignore ]  
Newbie
Rank
Total Posts:  1
Joined  2010-05-31

Hi there,

Is it possible to disable compression in ICE 3.3.2 Community Edition? if so, how is it done?

Best,

—Noah

Profile
 
Posted: 31 May 2010 03:26 PM   Ignore ]   [ # 1 ]  
Member
RankRankRank
Total Posts:  218
Joined  2008-08-18

Hi Noah, Compression is always enabled. There is no option to disable it. BTW, what is the purpose to disable it?

[ Edited: 31 May 2010 03:29 PM by Mahib]
Signature 

Mahib

Profile
 
Posted: 09 December 2010 08:41 PM   Ignore ]   [ # 2 ]  
Newbie
Rank
Total Posts:  3
Joined  2009-07-29

Hi, i have the same request. As for me the purpose is to optimize performances. I am storing a column which holds a hmac of some other fields (for verification purpose) as a varbinary or a varchar. This gives me a pseudo random, thus amost not compressible. When loading data, the loader seem to work very hard to compress this while it is mostly useless (i end up with compression ratio near 1:1). That would be a nice addition to be able to simple disable compression for this column. As a workaround, i am planning to try storing my checksum in multiple bigint columns, which compression/decompression speed is usually much faster.

Thanks,

Profile
 
Posted: 10 December 2010 06:23 AM   Ignore ]   [ # 3 ]  
Super Duper Member
Avatar
RankRankRankRankRank
Total Posts:  914
Joined  2008-08-18

Hi
The idea to use a few bigint columns is fine - numerical compression is faster.

Currently there is no option to disable compression, however it could be introduced. I guess this request should go to the product management…

Profile
 
Posted: 10 December 2010 11:42 AM   Ignore ]   [ # 4 ]  
Newbie
Rank
Total Posts:  3
Joined  2009-07-29

Looks like it’s time for me to annoy Andrew smile Thanks !

Profile
 
Posted: 10 December 2010 07:28 PM   Ignore ]   [ # 5 ]  
Newbie
Rank
Total Posts:  3
Joined  2009-07-29

For the record, replacing my VARBINARY(16) column with two BIGINT columns gave be almost 100% speedup at load time (21.6s vs 41.6s) at the cost of 8% size increase (33.6MB vs 31.0MB). I guess that worth a try for people struggling with slow compression.

Profile
 
Posted: 17 December 2010 06:54 PM   Ignore ]   [ # 6 ]  
Administrator
RankRankRankRank
Total Posts:  413
Joined  2010-09-22

Dominique—
Wonderful suggestion.  We’ll take a look at the possibility, but I agree that it’s a great feature.

Cheers,

Jeff

Signature 

jeff kibler

Profile
 
   
 
 
‹‹ Sorted Files      Export To CSV Issue ››