Hi,

I am working on columnar storage on flash media and I am considering using the ICE codebase as a starting point for implementing my ideas. But before I do that, I want to try to understand the codebase a bit more.

I tried going through the files in the storage/core directory to relate them to the architecture whitepaper but find many many levels of abstraction in there.

I am wondering if there is a document on how the DPN’s, RCAttribute’s, MultiIndex’s etc are all related to each other—so that I can make some sense out of it ?.

If not, then what is a good point to start if my goal is to exactly understand how DPN’s are used for filters. And where do more advanced things like histogram’s etc fit in to the overall scheme.

Any suggestions would be welcome.

I have already searched the forum and wiki (and read all the whitepapers) but couldn’t find such a ‘code design overview’ kind of a document.

Thanks a lot
-Devesh Agrawal
Grad Student at UMass Amherst

Hello Devesh,

Unfortunately, I don’t think we have the level of description that you’re looking for.

On the other hand, I’m very glad that you’re looking into the code and of course we’ll try to help you.

Which papers did you read so far? On top of technical white papers, did you read our VLDB and SIGMOD publications?

Best greetings,

Dominik

Hi Dr Dominik,

I am truly sorry that the the Infobright papers missed my radar. I will read them ASAP. It never occured to me that I should search and read for papers by you.

Are there any specific papers that you think would be a good start ? I plan to start my survey on Infobright based on the Sigmod 2009 and VLDB 2008 papers. (They are easy to find since you are an author of them :) ).

Thanks.

Hello again!

I’m afraid that you won’t find exactly what you asked for in those papers. But I hope they will be at least a little bit helpful to understand general ideas. Please let me know whenever you have more questions, on forum or by email. You’re right about vldb 2008 and sigmod 2009. There is one more paper. So, besides #54 and #60, take a look also at #64 at:

http://www.informatik.uni-trier.de/~ley/db/indices/a-tree/s/Slezak:Dominik.html

Best greetings,

Dominik