Infobright.org Forums

ICE Installation trouble!!!!!

2011-11-16T16:21:29-04:00

Hi,
I downloaded : ICE v4.0.4 Source Code: infobright-4.0.4-0-src-ice.tar.gz, unpacked and started the installation process fellowing the README doc. Bt when I do this command :


>make EDITION=community release

It gives me this error :

mkdir -p build/community/release/infobright && cd src && libtoolize --force --install > /dev/null 2>&1 || libtoolize --force > /dev/null 2>&1 && automake --add-missing --force-missing > /dev/null 2>&1 ; cd "/home/Downloads/infobright-4.0.4/build/community/release/infobright" && autoreconf ../../../../src && cd "/home/Downloads/infobright-4.0.4" > /dev/null 1>&2 && touch -cr src/configure.ac src/configure && touch build/community/release/infobright/configure.stamp
autoconf-wrapper: invalid number of arguments
make: *** [build/community/release/infobright/configure.stamp] Error 255 

Can anyone can help on solving this problem?

Thanks!!

Compilation error

2012-05-08T02:35:41-04:00

Hello everyone,

I am writing this message because I face some difficulty to compile the community edition.

After installing gcc and boost successfully, the command


make EDITION=community release

triggers errors as follow:

Makefile:514: recipe for target `readline.o’ failed
make[3]: *** [readline.o] Error 1
make[3]: ディレクトリ `/cygdrive/c/Documents and Settings/ksksol/My Documents/source code/infobright-4.0.6-0-src-ice/infobright-4.0.6/build/community/release/vendor/cmd-line-utils/libedit’ から出ます
Makefile:463: recipe for target `all-recursive’ failed
make[2]: *** [all-recursive] Error 1
make[2]: ディレクトリ `/cygdrive/c/Documents and Settings/ksksol/My Documents/source code/infobright-4.0.6-0-src-ice/infobright-4.0.6/build/community/release/vendor/cmd-line-utils’ から出ます
Makefile:526: recipe for target `all-recursive’ failed
make[1]: *** [all-recursive] Error 1

I probably missed something but I can’t figure what.
Can anyone help me?

Thank you

Test data

2012-05-16T13:52:47-04:00

Hi,

I was recently trying to set up some test data for running Infobright.
I was going to use TPC-H generator.
However trying to compile data generator proved to be frothed with too many problems since I do not have any compilers installed on my system.
I figure, trying to install compiler and make it work may take too much time.

Does anybody have this generator already compiled?
Or perhaps some other generator?

I would appreciate any help in this area.

Thanks
C_George

Invalid value should be imported as NULL.

2012-05-15T21:23:34-04:00

Hi,

Currently ICE import invalid value as 0 fro numeric columns, and ‘’ for string columns, but I think them should be NULL, if the columns are defined as not null, then the rows containing invalid values should be rejected, as 0 and ‘’ are manful values.

Regards,

Xiaobo Gu

What would you suggest with a server with 64G RAM regarding to infobright memory settings.

2012-05-15T21:20:23-04:00

Can you suggest the exact numbers for these?

# System Memory Server Main Heap Size Server Compressed Heap Size Loader Main Heap Size

GLIBC problem in 3.5.2 causing connection problems

2011-02-14T11:33:41-04:00

Hi,

Here is another problem I encountered. I am trying to connect via JDBC to the server I am running locally.
When I go through jdbc:mysql://localhost:5029/db or jdbc:mysql://127.0.0.1:5029/db it connects just fine.
Whenever I use my LAN IP address (e.g. jdbc:mysql://10.1.6.xxx:5029/db) it fails (see CLIENT error below).

At first I blamed firewall, but then I tested it with netcat from another machine. The port is wide open in and out.

Then from “bh.err” I discovered that the server receives the connection request and immediately fails. It even restarts itself (see SERVER log). Looks like it is complaining (again) on “glibc” (see my GLIBC versions below).

My server OS is Ubuntu 10.10, 64Bit.

Help?

==== CLIENT JDBC error ====

Last packet sent to the server was 1 ms ago.

com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:

java.io.EOFException
MESSAGE: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.

java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1997)
at com.mysql.jdbc.MysqlIO.readPacket(MysqlIO.java:573)
at com.mysql.jdbc.MysqlIO.doHandshake(MysqlIO.java:1044)
at com.mysql.jdbc.Connection.createNewIO(Connection.java:2924)
....

==== SERVER log from bh.err ====

mysqld: relocation error: /lib/libnss_files.so.2: symbol __rawmemchr, version GLIBC_2.2.5 not defined in file libc.so.6 with link time reference
110214 09:49:05 mysqld_safe Number of processes running now: 0
110214 09:49:05 mysqld_safe mysqld restarted
110214 9:49:05 [Warning] options—log-slow-admin-statements,—log-queries-not-using-indexes and—log-slow-slave-statements have no effect if—log_slow_queries is not set
Loading configuration for Infobright instance ...
Option: AllowMySQLQueryPath, value: 0.
........... blah-blah-blah
Infobright instance configuration loaded.
110214 9:49:05 [Note] Event Scheduler: Loaded 0 events
110214 9:49:05 [Note] Infobright Community Edition is ready for connections.
socket: ‘/tmp/mysql-ib.sock’ port: 5029 build number (revision)=IB_3.5.2_r11794_12019(ice)

==== GLIBC versions ====
$> strings /lib64/libc.so.6|grep GLIBC_
GLIBC_2.2.5
GLIBC_2.2.6
GLIBC_2.3
GLIBC_2.3.2
GLIBC_2.3.3
GLIBC_2.3.4
GLIBC_2.4
........ sequentially through ........
GLIBC_2.12
GLIBC_PRIVATE

DELETE from Infobright Tables - Very Slow

2012-05-11T10:14:11-04:00

We purchased IEE to use as database for new datawarehouse. Our ETL process is designed such that we extract from a MySQL operational database hourly and stage to another MySQL database. Operational records that have been created or modified are being extracted and stored in this `staging` area. At the conclusion of the day we need to delete from inforbright any of these records that have changed and then insert a clean copy of the record into the fact table. We do this by creating a table with id’s that need to be deleted from infobright and run SQL as follows:

DELETE FROM ORDERS WHERE EXISTS (SELECT * FROM OrdersList WHERE OrdersList.id = Orders.id);

This SQL works but can take as much as 3+ hours for a single table. It also seems like it get’s slower everytime we try and run this SQL statement. I have read some posts stating if you need to do large amounts of deletes you may want to do them in MySQL and then truncate and reload all data to infobright. Only issue with this is it pretty much means we need to maintain a mirror image of the datawarehouse in MySQL and doing a fill reload to infobright can also take time (even when using bulk loader).

Wondering if anyone else has run into similar performance issues using DELETE statements in Infobright and how you may have addressed them.

Thanks,
Bob

ICE 4.0.6 Setup on Ubuntu 12.04

2012-05-10T09:05:43-04:00

Greetings,

I’m attempting to setup a new instance of ICE on an Ubuntu 12.04 Virtual Box VM. I’m getting and error during setup with my version of GLIBC 2.2.5 doesn’t exist but 2.2.6 does. It can’t install the default tables.

=============ERROR=======================
Failed on infobright initialization. You can investigate /tmp/ib4.0.6-0-install.log and log files from /usr/local/infobright-4.0.6-i686/data.
At this stage the current installation may be broken. You need to uninstall it and
fix the cause before retrying the installation.
Possible reasons for the failure are: LDAP service is running or
system has unsupported glibc but nscd service is not running.
Possible work arounds are: If LDAP is running, you may stop LDAP service prior to the installation.
If you have unsupported glibc, you need to start nscd service prior to the installation.

Following this, I’m unable to start any of the MYSQL executables. The second error I run into is the “Can’t change to run as user ‘mysql’”. This makes sense since the tables aren’t available.

I tried compiling the source but only get as far as…
checking for boostlib >= 1.42.0… yes
checking whether the Boost::Program_Options library is available… yes
configure: error: Could not link against !

Can someone suggest possible fixes for these problems.

Robert

Parallel Processing

2012-05-08T09:23:05-04:00

I am running Infobright ICE on a Windows 2008 R2 Server on HyperV. Each morning I perform a dataload (app 3m records) which takes app. 20 mins. This is followed by three stored procedures which generate three aggregates. Each of these procedures run against the same table and each outputs data to a txt file before a data load. Total time for aggregates is 3.5 hours.

To speed up the process (i.e. reduce total start to end time), I intend creating a second, identical database. I will load the data into both and will create the aggregate data, some on one database and some on the other. I will load the resulting data onto both databases.

Am I mad or is there a better way?

Typo on http://www.infobright.org/Download/ICE

2012-05-07T21:18:58-04:00

In the second sentence on http://www.infobright.org/Download/ICE, “lead” should be “load”:

For video lessons on how to install or lead data on Linux or Windows, please visit our How-To channel on Youtube