Infobright.org Forums

Inforbright 3.4..1 update problems

2010-07-01T02:25:34-05:00

I got the below errors while upgrading inforbright from infobright-3.3.2-x86_64-iee.rpm to infobright-3.4.1-x86_64 .

[root@ZWH infobright]# ./bin/chmt—datadir=/home/info_data/data/

2010-07-01 12:38:26 Charsets migration for table MATTLE_AG_DATAMART/DIM_DATE_TIME ... [ NOT NEEDED ] Already migrated.
2010-07-01 12:38:26 Charsets migration for table MATTLE_AG_DATAMART/DIM_LIST_TYPE ... [ NOT NEEDED ] Already migrated.
2010-07-01 12:38:26 Character Set Migration Tool error: FileSystem Error : Bad file descriptor

bh.err

/usr/local/infobright/bin/mysqld: Unable to open /usr/local/infobright-3.2.1-x86_64/data/brighthouse.log
100701 14:02:56 [ERROR] Plugin ‘BRIGHTHOUSE’ init function returned error.
100701 14:02:56 [ERROR] Plugin ‘BRIGHTHOUSE’ registration as a STORAGE ENGINE failed.
/usr/local/infobright/bin/mysqld: File ‘/usr/local/infobright-3.2.1-x86_64/data/slow_query.log’ not found (Errcode: 13)
100701 14:02:56 [ERROR] Could not use /usr/local/infobright-3.2.1-x86_64/data/slow_query.log for logging (error 13). Turning logging off for the whole duration of the MySQL server process. To turn it on again: fix the cause, shutdown the MySQL server and restart it.
/usr/local/infobright/bin/mysqld: File ‘/usr/local/infobright-3.2.1-x86_64/data/general_query.log’ not found (Errcode: 13)
100701 14:02:56 [ERROR] Could not use /usr/local/infobright-3.2.1-x86_64/data/general_query.log for logging (error 13). Turning logging off for the whole duration of the MySQL server process. To turn it on again: fix the cause, shutdown the MySQL server and restart it.
100701 14:02:56 [ERROR] Unknown/unsupported table type: brighthouse
100701 14:02:56 [ERROR] Aborting

100701 14:02:56 [Note] /usr/local/infobright/bin/mysqld: Shutdown complete

100701 14:02:56 mysqld_safe mysqld from pid file /usr/local/infobright-3.2.1-x86_64/data/ZWH.pid ended

100701 14:07:44 mysqld_safe Starting mysqld daemon with databases from /usr/local/infobright-3.2.1-x86_64/data
Loading configuration for Infobright instance ...
100701 14:07:44 [ERROR] Unable to load configuration
100701 14:07:44 [ERROR] ERROR: Failed to parse brighthouse.ini, parsing error = unknown option UseCharset
100701 14:07:44 [ERROR] Plugin ‘BRIGHTHOUSE’ init function returned error.
100701 14:07:44 [ERROR] Plugin ‘BRIGHTHOUSE’ registration as a STORAGE ENGINE failed.
100701 14:07:44 [ERROR] Unknown/unsupported table type: brighthouse
100701 14:07:44 [ERROR] Aborting

100701 14:07:44 [Note] /usr/local/infobright/bin/mysqld: Shutdown complete

100701 14:07:44 mysqld_safe mysqld from pid file /usr/local/infobright-3.2.1-x86_64/data/ZWH.pid ended

how can i resolve this issue?

Thanks,
Raja K

dump from ICE and reload (in order to add columns)

2010-05-28T00:11:18-05:00

I’m trying to add one or several columns ( with known data from some file) to existing table.

Since i know ICE does not support ANY alter statements, i decide to dump all the data from the table into a text file, merge this file with ‘the other columns’ data’, then drop the table, recreate the table, and load data from the merged file.

This should take a long time, can any one tell me if there is any better ways to do this?(for example, using binary data, using pipes, or any possible way that may increase the speed)

Thanks!

files created by INTO OUTFILE only has 660 permission?

2010-07-23T09:16:09-05:00

Hi guys,

From MySQL document, any files created by INTO OUTFILE is writable by all users, but I only get the 660 permission when using above command:


-rw-rw---- 1 mysql mysql        140 Jul 21 14:05 test.out

Therefore, I got following error when loading file back:

The file ‘test.out’ must be in the database directory or be readable by all

The permission of directory contains output file:


drwxr-xr-x 2 mysql mysql 4096 Jul 21 14:08 mysqldata/

Even when I created it in database directory, I got the another error:

mysql> load data infile '/usr/local/infobright/outfile/test.out' into table xx;
 ERROR 13 (HY000): Can't get stat of '/usr/local/infobright/outfile/test.out (Errcode: 2) 

Only when executing chmod o+r, I can LOAD DATA INFILE successful.

Any help will be appreciated.

PS: LOAD DATA LOCAL INFILE works fine on my server itself.

Does ICE support cluster?

2010-05-31T20:50:52-05:00

Can ICE deploy in multiple nodes?

thanks.

Which TB?

2010-07-29T07:55:59-05:00

I understand that the supported version of Infobright is priced by the terabyte of data loaded into it, but is the definition of terabyte specific down to the number of bytes? By which standard is it measured?

There are two accepted definitions of the term terabyte:

Using the International System of Units definition: “1 terabyte equals 1,000,000,000,000 bytes = 1000^4 or 10^12 bytes.”

Using the traditional binary definition: “1 terabyte equals 1,099,511,627,776 bytes = 1024^4 = 2^40 bytes.”

Which definition does Infobright use? There is a difference of 99,511,627,776 bytes (approx 99 GB) between the two. Is it specified in the Support contract?

Thanks.

Problem with Float data type in views

2010-06-27T22:35:00-05:00

Hi,

I have a table defined for the IRIS data set as:

CREATE TABLE IRIS
(SEPAL_LENGTH FLOAT,
SEPAL_WIDTH FLOAT,
PETAL_LENGTH FLOAT,
PETAL_WIDTH FLOAT,
DECISION_CLASS VARCHAR(17)
)ENGINE=BRIGHTHOUSE;

when I do the select * on the iris table, the results are:

| 5.1 | 3.5 | 1.4 | 0.2 | Iris-setosa |

and now when i define a view on this table as:

CREATE VIEW iris_setosa AS
SELECT * FROM iris
WHERE decision_class = “Iris-setosa”;

and when I select * on the newly created view - iris_setosa, the values are shown as

| 5.0999999046326 | 3.5 | 1.3999999761581 | 0.20000000298023 | Iris-setosa |

As we can see the precision in the view is changed from the one in the original table. This is causing me issues in comparing the data. Please advise.

Also I want to know what is the best way of doing the INTERSECT in Infobright. Thanks.

Plan to upgrade the mysql version of 5.1.14?

2009-12-08T14:43:20-05:00

Are you all gonna upgrade the underlying mysql version? GA is up to 5.1.41.

erin

Really slow query.

2010-07-15T10:07:03-05:00

I am trying to execute a query against a fact table of approximately 13 million rows. The query joins in one of its dimensions and a third table that will be used to map that dimension from a slowly changing type 2 to a type 1 dimension. Additionally, I am removing a degenerate dimension.

I know it sounds complicated, but the query is pretty straight forward. I originally was selecting into an outfile and let the query run for 12 hours before killing it. I then attempted to select the first 100 rows using limit 100, and it ran for an hour before I killed it.

All fields in the fact table are integers, except the degenerate dimension that is being removed. The fact table has roughly 13 million rows, the dimension has 250,000 rows, and the mapping table has 3200 rows. Any recommendations on how to make this query execute would be appreciated.

SELECT `date_dimension_id`
, `specialty_dimension_id`
, `geo_dimension_id`
, `max_ad_dimension_id`
, `customer_dimension_id`
, `page_dimension_id`
, `domain_dimension_id`
, `channel_dimension_id`
, sum(`impression_count`)
, sum(`click_count`)
FROM `ad_performance`
JOIN `ad_dimension` on `ad_dimension`.`id` = `ad_performance`.`ad_dimension_id`
JOIN `ad_dim_map` on `ad_dim_map`.`ad_id` = `ad_dimension`.`ad_id`
GROUP BY `date_dimension_id`
, `specialty_dimension_id`
, `geo_dimension_id`
, `ad_dimension_id`
, `customer_dimension_id`
, `page_dimension_id`
, `domain_dimension_id`
, `channel_dimension_id`
ORDER BY `date_dimension_id`
, `specialty_dimension_id`
, `geo_dimension_id`
, `ad_dimension_id`
, `customer_dimension_id`
, `page_dimension_id`
, `domain_dimension_id`
, `channel_dimension_id`;

Cast & OutFile

2010-07-19T08:15:34-05:00

I am getting error “Brighthouse other specific error: type not supported” when I try to output a date-casted constant into an outfile.

This is a query that illustrates the point, although the issue is not specific to the fx table I’m using, happens with all tables I’ve tried. Same query works with “as unsigned”. Also fails if you cast a date into a date (not that you’d want to, but thought I’d see if it worked). Everything works if you do a normal select rather than an “into outfile”.

select Cast(20100714 as Date) as COBDate
into outfile ‘f:/foo.csv’
FIELDS TERMINATED BY ‘,’ ENCLOSED BY ‘”’
LINES TERMINATED BY ‘n’
from fx f
limit 10;

Any help much appreciated.

Same ‘group by’ query with large unsorted data set produces wrong result.

2010-07-02T10:03:37-05:00

HI,

I am running a group by query with grouping on multiple parameters.

When this query runs on a large sorted dataset of around 30 million records, it works fine; but when the same same query runs on an unsorted dataset, it gives wrong result for group by.

What could be the possible reason for this. Can it be a memory issue or it has to do something with infobright configuration.

Kindly let me know your inputs.

Thanks,
Manu