I’ve been trying to get some data into ICE and kept getting errors. I found someone saying that the BRIGHTHOUSE engine doesn’t support INSERT, UPDATE or DELETE statements, which makes me think that InfoBright not might be the one for me…

I found this article on dev.mysql.com and just by trying out the examples with my freshly installed InfoBright, I get errors…
http://dev.mysql.com/tech-resources/articles/datawarehousing_mysql_infobright.html

mysql> create table t (c1 int) engine=brighthouse;
Query OK, 0 rows affected (0.01 sec)

mysql> insert into t values (1), (2), (3);
ERROR 1031 (HY000): Table storage engine for ‘t’ doesn’t have this option

/Anders

I just realized that those functions only come in the Enterprise edition…

Yeah I found out the same after downloading and installing it Also ran into exactly the same problems and gave up I don’t fancy rewriting all my Kettle routines to use truncate table and MySQL bulkloader for every load!

The DML statements should be in the community edition..is very difficult to use or try a dbms without them.

Hi Everyone,
Thank you very much for your feedback. The reason for the the differences between ICE and IEE are to support the different use-cases that the two versions were designed for: ICE as a load and read traditional data warehouse, IEE with enhanced operational support including DML capability and technical support.
Kind Regards,
Andrew

Ouch! I had assumed that I could use the community version to prototype my possible use of the enterprise version… this makes that a bit problematic as I have an application that in addition to bulk load, has INSERT/UPDATE/DELETE…

Exactly as spickelmier says. It’s difficult to test the usage of InfoBright in the current environment without those functions.

At the London MySQL conference last month, Miriam talked about InfoBright as an replacement for MySQL, that it could be installed instead of MySQL and everything would work. After that she encouraged everyone to try out ICE…well

/Anders

I realize that this forum is for the community edition… however, is there a straightforward way to evaluate the full enterprise version?  All I see is ‘schedule a demo’ or pay for it, nothing about evaluation (even limited time or limited size)?

Hi,

I’ll have someone get in touch with you directly about this.  You should hear from us shortly.

Thanks,
Mark

Hello,

Is there a straightforward way to evaluate the full enterprise version? All I see is ‘schedule a demo’ or pay for it, nothing about evaluation (even limited time or limited size)?

Thanks very much for your interest. We do have an Evaluation Version of Infobright Enterprise Edition (IEE). Please contact us If you would like to get a trial version.

Kind regards,
Andrew

After getting some data loaded with the much restricted mysql bulk loader i thought great, i can truncate table and then bulk load as my loading strategy…however i don’t see the ability to “truncate table?”  So with ICE, the only incremental ETL loading strategy you have is to:

1) drop table
2) create table
3) bulk load it (with a file that matches perfectly since bulk loader is limited in functionality)

I guess ICE can be used for some very simple proof of concepts, but beyond that, it is too featureless to be of use unless I am missing something?  Do you guys envision adding additional features to ICE?

Thanks!

If Infobright Community Edition cannot update or delete, how can one handle slowly changing dimensions or corrections to facts and dimensions?

Thanks,
Alan

Becker - 19 February 2009 09:06 PM

After getting some data loaded with the much restricted mysql bulk loader i thought great, i can truncate table and then bulk load as my loading strategy…however i don’t see the ability to “truncate table?”  So with ICE, the only incremental ETL loading strategy you have is to:

1) drop table
2) create table
3) bulk load it (with a file that matches perfectly since bulk loader is limited in functionality)

I guess ICE can be used for some very simple proof of concepts, but beyond that, it is too featureless to be of use unless I am missing something?  Do you guys envision adding additional features to ICE?

Thanks!

The ability to TRUNCATE TABLE has been provided by the Community in contributions (JavaScript must be enabled to view this email address).  There is both a shell script and a stored procedure to facilitate this operation.  Even in the Enterprise Edition, which supports this function, these are preferred and recommended options.

Alan Musnikow - 27 August 2009 05:41 PM

If Infobright Community Edition cannot update or delete, how can one handle slowly changing dimensions or corrections to facts and dimensions?

Thanks,
Alan

ICE does not support DML - INSERT, UPDATE and DELETE.  This functionality is provided in the Enterprise Edition, IEE, the commercial product.  ICE is not intended for on-going production environments that require such techniques.  Rather it is provided for free to allow evaluation of the LOAD speed, compression and improved analytical query performance.

However, there are techniques involving external temporary structures that essentially reduce the maintenance of slowly changing dimension tables to post-processing re-LOAD processes which can be performed in ICE.  Most commonly this is done in the supported MyISAM storage engine leveraging MyISAM as a staging and ELT repository.  I have used these techniques even in traditional technologies that support DML for performance reasons.

For corrections to fact tables and other more persistent objects, it is recommended to always have a backup of all objects prior to any incremental LOADs in the case they must be DROPped to remove the errors and reLOADed.  The alternative is the commercially supported IEE.

Best wishes for your continued use of ICE.  If you would like to evaluate IEE, please refer to the (JavaScript must be enabled to view this email address).

bugg_tb - 10 November 2008 08:34 AM

Yeah I found out the same after downloading and installing it Also ran into exactly the same problems and gave up I don’t fancy rewriting all my Kettle routines to use truncate table and MySQL bulkloader for every load!

A Connector for Pentaho Kettle that is compatible with ICE can be found here.

Thank you David. You have fully answered my question.

Regards,
Alan