Joinutility seperatorLogin utility separator Infobright.com
   
 
bhloader giving error
Posted: 14 October 2009 06:24 PM   Ignore ]  
Newbie
Rank
Total Posts:  2
Joined  2009-10-09

I was previously able to load mysql data in my VM similar to the following:

mysql> LOAD DATA INFILE ‘/mnt/hgfs/shared/DimDummy.csv’ INTO TABLE dimdummy FIELDS TERMINATED BY ‘|’;

This now gives
ERROR 5 (HY000): Unknown Error.

it appears that I have bhloader (suggested from another community post)
$ sudo find / -name bhloader
/usr/local/infobright-3.2-i686/bin/bhloader

Since the last time I used LOAD DATA INFILE… I created data connections and a Mondrian cube.  I deleted all of those items and connections, yet I still get this error. 

mysql> describe dimdummy;
(works fine… Field Description ;  varchar(50) ; Null NO )

$ more /mnt/hgfs/shared/DimDummy.csv
(shows my data file)

Does anyone know how to troubleshoot this or what I should do next.  I’m thinking of starting from a fresh VM (from the downloads).  Thanks.

Profile
 
Posted: 15 October 2009 01:17 AM   Ignore ]   [ # 1 ]  
Member
RankRankRank
Total Posts:  220
Joined  2008-08-18

Hi Steve

One thing comes to my mind is that it’s could be related to insufficient memory. You can check memory status and also can lower the “LoaderMainHeapSize” settings down in brighthouse.ini file. This ini file can be found in data directory (default data dir is /usr/local/infobright/data).

Do you see any log messages in the data directory/*.log or data directory/*.err file?

Signature 

Mahib

Profile
 
Posted: 15 October 2009 09:55 AM   Ignore ]   [ # 2 ]  
Newbie
Rank
Total Posts:  2
Joined  2009-10-09

Mahib,
Thank-you for the quick reply.  I am still getting the error and appreciate any assistance.

I checked free memory.  Are these values OK?  If not, what should I do?  (I did a logout… then logged back in)
$free -t -m
(Mem:  total = 1011   used=996 free=14 shared=0 buffers=42 cached=43)
(Swap total=400 used=341 free=58)
(Total:  total=1411 used=1338 free=72)

I re-created the error today and show some of the log files below (/usr/local/infobright/data)
—————————————————————————-
brighthouse.log
2009-10-15 09:42:51 Error: Unknown error.

updater.log (nothing new for today)

general_query.log
091015 9:41:39   27 Query   select count(*) from dimdummy
091015 9:42:51   27 Query   LOAD DATA INFILE ‘/mnt/hgfs/shared/DimDummy.csv’ INTO TABLE dimdummy FIELDS TERMINATED BY ‘|’
091015 9:43:08   27 Quit  

bh.err has 350 lines.  None seem new today.
——————————————————————————-

Profile
 
Posted: 15 October 2009 11:42 AM   Ignore ]   [ # 3 ]  
Sr. Member
Avatar
RankRankRankRank
Total Posts:  505
Joined  2008-08-18

Can you share your data file, table DDL, and my-ib.cnf config file?

Signature 
Profile
 
Posted: 15 October 2009 12:10 PM   Ignore ]   [ # 4 ]  
Member
RankRankRank
Total Posts:  220
Joined  2008-08-18

Hi Steve

> free -t -m
> (Mem:  total = 1011   used=996 free=14 shared=0 buffers=42 cached=43)
> (Swap total=400 used=341 free=58)
> (Total:  total=1411 used=1338 free=72)

Free memory (14 m) is too little. So definitely loader needs memory.  Can you try command “top” to see which processes are taking memory.
If it is infobright, then you can edit brighthouse.ini file and set lower memory settings (try optimum) and restart the it.

For instance you can try (this may not be optimal):

# ServerMainHeapSize - Size of the main memory heap in the server process, in MB
ServerMainHeapSize=300

# ServerCompressedHeapSize - Size of the compressed memory heap in the server process, in MB.
ServerCompressedHeapSize=200

# LoaderMainHeapSize - Size of the memory heap in the loader process, in MB.
LoaderMainHeapSize=180


Please note that to get performance, you need more memory.

cheers

Signature 

Mahib

Profile