Joinutility seperatorLogin utility separator Infobright.com
   
 
Ignore Errors during Data Loading
Posted: 20 August 2010 02:32 AM   Ignore ]  
Newbie
Rank
Total Posts:  7
Joined  2010-08-17

Hi,
Iam receiving some error during data loading. However, i would like to ignore those errors during data loading and continue to load rest of the data.
How could it be done?

Thanks.

Profile
 
Posted: 29 June 2011 11:36 PM   Ignore ]   [ # 1 ]  
Newbie
Rank
Total Posts:  7
Joined  2011-06-28

I also has this problem, when I load datas as follows:

mysql—default-character-set=utf8 -ujyl -***  incrementbak -h****  -P 5029 -f -q—execute=“load data local infile ‘D:/docs/bak/ad_site_trace.sql’ replace into table ad_site_trace character set utf8 fields terminated by ‘\\t’ ENCLOSED BY ‘’  “

report an error : Wrong data or column definition. Row : 633823,field:5.

How can I ignore the error , and let the loading forward.

Any suggestion is welcome! Thanks a lot.

[ Edited: 29 June 2011 11:50 PM by tigerKing]
Profile
 
Posted: 30 June 2011 10:04 AM   Ignore ]   [ # 2 ]  
Administrator
RankRankRankRank
Total Posts:  413
Joined  2010-09-22

Hi tigerKing,

This error is quite common; it typically means either:
1) Row 633823 field 5 doesn’t fit the dimension specified in the DDL/Schema, or
2) There exists some erroneous character which is throwing off the import.  This is typically rectified by running “dos2unix” on the input file
3) The delimiter used (in this case, \\t or the enclosed by character) is present within the actual data (and is an inappropriate delimiter)

I’d first look at that row and field to ensure it fits the proper type.  Then, I’d recommend running dos2unix first on the data file.

As for ignoring the error,  I don’t believe you can within Infobright.  It’s all or nothing.  Someone will correct me if I’m wrong :-D


All the best,

Jeff

Signature 

jeff kibler

Profile
 
Posted: 30 June 2011 10:06 AM   Ignore ]   [ # 3 ]  
Administrator
RankRankRankRank
Total Posts:  413
Joined  2010-09-22

Note: tigerKing’s issue has been addressed within forum post http://www.infobright.org/Forums/viewthread/2401/.

Signature 

jeff kibler

Profile