Infobright Community Edition 3.5 Beta

October 5, 2010

 

 

 

About ICE

ICE is an open source software solution designed to deliver a scalable data warehouse optimized for analytic queries. The architecture delivers the following key benefits:

 

·       Ideal for data volumes up to 50TB

·       Market-leading data compression (from 10:1 to over 40:1), which drastically reduces I/O (improving query performance) and results in significantly less storage than alternative solutions

·       No licensing fees

·       Fast response times for ad hoc analytic queries

·       Query and load performance remains constant as the size of the database grows

·       No requirement for specific schemas, e.g. Star schema

·       No requirement for materialized views, complex data partitioning strategies, or indexing

·       Simple to implement and manage, requiring little administration

·       Reduction in data warehouse capital and operational expenses by reducing the number of servers, the amount of storage needed and their associated maintenance costs, and a significant reduction in administrative costs

·       Runs on low cost, off-the-shelf hardware

·       Is compatible with major Business Intelligence tools such as Pentaho, JasperSoft, Cognos, Business Objects, and others

 

ICE is designed to run high-performance ad hoc, complex queries on very large data sets without the need of manual tuning, data partitioning, or index creation.

 

 

Important:         Please see the upgrade instructions under Upgrade Issues below for additional steps to the upgrade procedure for ICE 3.5 Beta.

 

ICE 3.5 Beta build number: IB_3.5.0_r9686_9787

 

 

 

New Features

Infobright Community Edition 3.5 includes enhancement query performance through Memory Management and more:

 

• Enhanced Memory Management

• Provides better error handling and notification for out of resources cases

• Foundational work on new extensible memory management, future phases of Workload Management will leverage for enhanced query performance

 

• Durability Improvements

• Enhancements for preserving durability in support in ICE

 

• Lookup Enhancements

• Significant improvement to the comment ‘lookup’ column option to improve VARCHAR query performance

• Much improved speed of load for columns with lookup, including wide VARCHAR columns

 

 

 

Upgrade Issues

1. Due to a known MySQL issue with the embedded version of MySQL 5.1.40 GA, it is recommended you run the MySQL Updater program after any upgrade to avoid issues with stored procedures or table structures. Please see the revised Upgrade Instructions below.

 

2. The enable UTF-8 flag (UseCharset = 0/1) is no longer needed and if present, must be removed from the brighthouse.ini file. For table structures created prior to ICE 3.3.1 the Charset Migration Tool (CHMT) should be run during upgrade. Please see the revised Upgrade Instructions below.

 

 

 

Upgrade Instructions

The upgrade instructions are also available online at:

 

Windows:                   http://www.infobright.org/wiki/Upgrade_Guide_for_Windows/

Linux:                                    http://www.infobright.org/wiki/Upgrade_Guide/

 

 

 

Supported Platforms

ICE 3.5 Beta is available on the following platforms for 64-bit Intel or 64-bit AMD:

 

·       Red Hat Enterprise Linux 5

·       CentOS 5.2

 

ICE is also available on the following platforms for 32-bit Intel or 32-bit AMD: (for solution testing purposes only, not recommended for performance testing or production deployments):

 

·       Windows XP

 

 

 

System Requirements

 

For Personal Evaluation and/or Application Development

 

CPU Speed                  32-bit:                    1.6GHz minimum

                                                      2.0GHz or faster dual or quad core recommended

64-bit:                    1.8GHz minimum

                                                      2.0GHz or faster dual or quad core recommended

Memory                  32-bit:                    1GB minimum

2GB or more recommended

64-bit:                    2GB minimum

                                                      4GB or more recommended

 

For Multi-User Evaluation or Production Deployment

 

CPU Speed                  64-bit:                    2.0GHz minimum

2.0GHz or faster dual or quad core recommended

Memory                  64-bit:                    4GB minimum

                                                      16GB or more recommended (and at least 2GB per core

 

 

Download ICE

http://www.infobright.org/Downloads/ICE/

 

 

 

Installation Instructions

Windows:                   http://www.infobright.org/wiki/Install_Guide_for_Windows/

Linux:                                    http://www.infobright.org/wiki/Install_Guide_for_Linux/

MacOS (VM):                  http://www.infobright.org/wiki/Install_Guide_for_Mac_OS/

 

 

 

Upgrade Instructions

Windows:                   http://www.infobright.org/wiki/Upgrade_Guide_for_Windows/

Linux:                                    http://www.infobright.org/wiki/Upgrade_Guide/

 

 

 

Issues Fixed

The following issues have been fixed and verified since the release of ICE 3.4 GA. For more details on these, please visit http://bugs.infobright.org/

 

Ticket                  Description                                                                                                                                                                                                     

#1280                  Delete/Drop/Update in multiple sessions can cause system crash

#1282                   A variable declaration as a result of an aggregation may switch to mysql query path

#1774                   joining large tables without WHERE conditions very slow on rough level

#1786                   select format(count(*),0) from ... crash server

#1799                   Error in export with DATE() function

#1811                   server crash when selecting from myisam into ib table

#1815                   mysql locked on freeing items

#1827                   Typo in the RPM Script

#1867                  Rename error: Can't find file

#1881                   infobright upgrade clobbers mysql if mysql-ib is soft link

#1901                   mysqld got signal 11, because = 0 in where condition

#1910                   rename table is not atomic

#1929                   test rally ticket (please ignore)

#1932                   lost connection during query

#1934                   CURRENT_TIMESTAMP uses different TZ on INSERT vs. UPDATE

#1937                   Infobright crashes when you execute a "create table as select..."

 

 

 

Known Issues

For the current list of known and closed issues, please visit http://bugs.infobright.org/

 

Ticket                  Description                                                                                                                                                                                                     

#888                   installer hardening: quotes in path (and spaces) not handled by installer

#891                    Default MySQL tests included in Infobright contain tests that will not run

#916                    Use of constants in select causes switch to MySQL Path (and slow performance)

#933                    Results of queries executed by IB engine aren't cached

#935                    Usability: "Cannot start bhloader" needs improved error message

#960                    escaped N should be loaded as NULL

#987                    Cannot support Debian Etch because fdopendir is available in glibc from version 2.4

#997                    Embedded enclosure character aborts load without error or warning

#1010                    Server crashes if, for some reason, one of the DPN files doesn't exist or not accessible

#1019                    mysqld crashes when killing mysql client during load

#1026                    ICE Src: ability to set build comment from commandline

#1030                    ICE: make 'txt_variable' as the default dataformat for export

#1031                    ICE: delete with condition doesn't report error

#1039                    Untarring the 3.0.2 tarbal will overwrite contents in previous 3.0 install - it does not create new 3.0.2 dir

#1042                    Queries with join on Infobright and myisam table do not return warning that is executed by mysql.

#1072                    "LINES TERMINATED BY" ignored on export

#1073                    FF: Query using views with a condition in the WHERE clause using function/complex expression on column from views switches to mysql engine.

#1115                    text load skips last line if no newline present

#1141                    ICE: compile warning

#1161                    ICE: Misleading error message about termination of session

#1172                    Dropping a table while it is currently loading hangs rather than returning an error

#1174                    LOCK TABLES does not work as expected.

#1177                    rename source tar to not have hardware (i686 or x86_64 or win32)

#1179                    Permission issue in Infobright binary causes the installation to fail for /home or /root folder

#1188                    load of a lookup column slows a lot for larger number of distinct values

#1235                    ICE32 VMWare: export file gets newline character M at the end of each line

#1275                    TPC-H Q22 wrong results

#1310                    Wrong conversion value '0000-00-00 00:00:00' in timestamp datatype column.

#1315                    "CHARACTER SET" not recognized in LOAD DATA INFILE

#1338                    Loader - enhancement to allow for rejected records option

#1344                    Problems related to character_set_server

#1418                    rpm install: force installation or upgrade doesn't set the owner on data directory

#1452                    dump/load is inconsistent

#1453                    inconsistent dump/load, continued

#1454                    corrupt dump/load when ordering data

#1469                    SHOW xxx returns BINARY

#1470                    --debug-info broken in mysql-ib

#1479                    security issue in InfoBright? engine

#1484                    LOAD DATA INFILE ignores "LINES TERMINATED BY"

#1601                    DATE_FORMAT returns a binary result

#1627                    No ability to change name/location of my-ib.cnf with RPM/DEB

#1649                    bugs in build system

#1657                    non-database folders and files in data directory

#1662                    "Numeric string" cannot be inserted into numeric columns, inconsistent with standard MySQL treatment

#1718                    importing escaped backslashes fails

#1720                    Add brighthouse.ini variable to make bh_dataformat="txt_variable" default

#1730                    mysqld crashes when process killed

#1766                    STDDEV wrong result

#1770                    crash when with select and subquery and <> any

#1780                    Hash-based authentication

#1789                    rpm install with prefix parameter doesn't work

#1801  &nbs