Joinutility seperatorLogin utility separator Infobright.com
   
 
Infobright Uknown Error on Load
Posted: 25 June 2010 01:27 PM   Ignore ]  
Newbie
Rank
Total Posts:  4
Joined  2008-10-15

Hello:

We are running the community version of Infobright - IB_3.3.1_r6997_7017(ice). We have this issue during bulk load of a certain table. The error we get is:

ERROR 1402 (XA100) at line 1: The Infobright storage engine has encountered an unexpected error. The current transaction has been rolled back. For details on the error please see the brighthouse.log file in
the /mnt/infobright-3.3.1-x86_64/data/ directory.

Now looking at the logs did not provide any clues. All it says in the logs is:

2010-06-24 21:43:39 The Infobright storage engine has encountered an unexpected error. The current transaction has been rolled back.
2010-06-24 21:43:39 Error: Unknown error.

Now, to narrow down the issue, what I did was break the large file into smaller junks of 10K lines and then try to load them. Doing this—loading the smaller chunks of 10K each succeeded.


Does any one know what maybe causing this issue?

TIA,
M.

Profile
 
Posted: 25 June 2010 06:45 PM   Ignore ]   [ # 1 ]  
Sr. Member
Avatar
RankRankRankRank
Total Posts:  723
Joined  2008-08-18

The error message is just a translation of the MySQL error message, which is not very specific, but would lend itself to an ‘out of resources’ scenario.

Questions:
- How large is a 10k line file?  How large are all of them combined?
- What platform are you running on?  Windows/Linux?  32- or 64-bit?  How much memory?  How much memory allocated to the database server?

Sorry to ask for so many details.  Just trying to be thorough and efficient in a single response.

Signature 
Profile
 
Posted: 28 June 2010 12:42 PM   Ignore ]   [ # 2 ]  
Newbie
Rank
Total Posts:  4
Joined  2008-10-15

Hello David,

Thanks for your reply. Sorry I should have provided more information in the OP.


(i) Each individual file is ~2.7 MBytes and the total big file is: ~30MBytes. The big file has 113,614 lines in it.
(ii) We are running on 64-Bit CentOS with 32GB RAM. These are the parameters in brighthouse.ini
ServerMainHeapSize = 24000
ServerCompressedHeapSize = 4000
LoaderMainHeapSize = 800


TIA,
M

Profile
 
Posted: 06 July 2010 10:00 AM   Ignore ]   [ # 3 ]  
Newbie
Rank
Total Posts:  4
Joined  2008-10-15

Friendly bump smile

Profile
 
Posted: 07 July 2010 03:03 AM   Ignore ]   [ # 4 ]  
Sr. Member
Avatar
RankRankRankRank
Total Posts:  651
Joined  2008-08-18

Hi !

Do you have a scenario (data and statements) to reproduce the problem ? Finding the reason may require deeper investigation…

Profile