Joinutility seperatorLogin utility separator Infobright.com
   
2 of 2
2
Compression Ratio increases drastically with export + import?
Posted: 30 November 2011 05:50 AM   Ignore ]   [ # 16 ]  
Super Duper Member
Avatar
RankRankRankRankRank
Total Posts:  964
Joined  2008-08-18

Hi !

The problem detected by Nadir has been logged in bugs.infobright.org (http://bugs.infobright.org/ticket/1916, though I do not know if it is visible publicly). It seems to stay there not fixed. Strange…
——

I checked it in practice and the problem of growing files sizes when loading by small chunks has been fixed. Can you tell more precisely what problem you have? And which IB version you use?

[ Edited: 30 November 2011 06:26 AM by Janusz Borkowski]
Profile
 
Posted: 02 December 2011 05:20 PM   Ignore ]   [ # 17 ]  
Newbie
Rank
Total Posts:  8
Joined  2011-07-14

Thanks both for your replies. As stated earlier we are using ICE 4.0.3, and we notice big increase in size of data files when we do bulk import with few rows at a time. And that size decreases sharply on exporting the whole database and re-importing it back. Its the same issue as reported in this post.

Which version did you checked it on, Janusz? Please let me know if this has been fixed in any newer version. 

Thanks,
Puneet

Profile
 
Posted: 05 December 2011 05:44 AM   Ignore ]   [ # 18 ]  
Super Duper Member
Avatar
RankRankRankRankRank
Total Posts:  964
Joined  2008-08-18

Hi !

I tried 4.0.5. Could you post the results of “ls -l” on the table directory after importing by a few rows, and then after a bulk import ?

I verified it using the scenario supplied with the previously reported bug (the one reported as “unfixed”) and in practice it is fixed. AFAIK the problem has been fixed in 2010 using a different bug report. By looking at the “ls -l” output we will be able to understand the situation.

Profile
 
Posted: 06 December 2011 08:48 PM   Ignore ]   [ # 19 ]  
Newbie
Rank
Total Posts:  8
Joined  2011-07-14

Thanks for your response, Janusz. I tried testing it with 4.0.5, and I am still seeing similar issue. I added 9000 rows to my Data table (3 rows at a time) and size of table directory went up to 7.4 MB. After export + import, it reduced to 1.6 MB. I have attached the results of ‘ls -l’ on table directory as you asked for, one before bulk import (by importing 3 rows at a time), and one after bulk import.  Let me know your thoughts on it, or if there is anything else you need.

Thanks,
Puneet

File Attachments 
before.txt  (File Size: 31KB - Downloads: 110)
after.txt  (File Size: 24KB - Downloads: 107)
Profile
 
Posted: 07 December 2011 05:49 AM   Ignore ]   [ # 20 ]  
Super Duper Member
Avatar
RankRankRankRankRank
Total Posts:  964
Joined  2008-08-18

Hi !

You are right. The problem reported by Nadir, now by you, is not fixed in ICE (fixed for IEE). I suggest you can create a ticket in bugs.infobright.com. Please refer to an existing ticket http://bugs.infobright.org/ticket/1916 created by Nadir just reminding that the problem is still unsolved.

Profile
 
Posted: 07 December 2011 12:28 PM   Ignore ]   [ # 21 ]  
Administrator
RankRankRankRank
Total Posts:  448
Joined  2010-09-22

I have created a new bug within bugs.infobright.com for this issue.  Please reference: http://bugs.infobright.com/ticket/2112

Signature 

jeff kibler

Profile
 
   
2 of 2
2