You are not logged in.

Dear visitor, welcome to Palo Community Forum. If this is your first visit here, please read the Help. It explains in detail how this page works. To use all features of this page, you should consider registering. Please use the registration form, to register here or read more information about the registration process. If you are already registered, please login here.

sebast

Intermediate

  • "sebast" started this thread

Posts: 4

Date of registration: Feb 3rd 2012

  • Send private message

1

Tuesday, March 6th 2012, 6:50pm

Is there a relation of the cube size to the input?

Hello,

I am searching for a relation between my input data and the size of the Cube.
I have 16 Dimensions with ~98.000 Categories and the Input has 7.000.000 lines.

Hope you can tell me how big the cube can be?

Actually I didnt try it, because my laptop has only 2 gigabyte and i want to know how much i need.

This post has been edited 1 times, last edit by "Cretos" (Mar 7th 2012, 4:47pm)


  • "dmarkovic" is male

Posts: 90

Date of registration: Aug 11th 2011

Location: Vienna / Austria

Occupation: Vector SW DV GmbH

  • Send private message

2

Wednesday, March 7th 2012, 11:50am

Hello sebast,

Of course there is a relation between the input data and the size of the cube.
It depands on witch version of Palo/Jedox you are using?
In the palo community 3.2 version is a lower compression rate, than in the Jedox 3.3 verison.

Also it depands on the bit length of your values/lines. I estimate that you need near 2 GB, with the CE 3.2 Version.
In your case, i would go ensure and take a computer with 4 GB RAM.

Regards.
Djordja Markovic
Vector SW DV GmbH

Interessant things:
Internal derby:
http://www.jedox.com/community/palo-foru…14338#post14338
Calculate your cube size:
http://www.jedox.com/community/palo-foru…14406#post14406

sebast

Intermediate

  • "sebast" started this thread

Posts: 4

Date of registration: Feb 3rd 2012

  • Send private message

3

Wednesday, March 7th 2012, 1:18pm

Hello dmarkovic,

thanks for the fast answer.

Is the length of each cell important?
How much size does one cell take?
And how much size does the dimensions take?

May be there is a formula?

edit:
I am using palo community 3.2.

  • "dmarkovic" is male

Posts: 90

Date of registration: Aug 11th 2011

Location: Vienna / Austria

Occupation: Vector SW DV GmbH

  • Send private message

4

Wednesday, March 7th 2012, 2:47pm

Hello sebast,

of course the length of each cell is important.
The size of a cell depands on, what the cell is defined. If it is a numeric, e.g.: int (i think palo save an int value as a float), then palo reserved as much bits as the size of a float is defined.
If it is a text, then it is as long as the text is.
The limit of a dimension is 4 million elements (3.3 Jedox).

Just as an example:
If you have 7.000.000 lines of information and in each line, there are 2 columns (price, pieces), than you double your cube size to 16.000.000 cells.
Also when you have a dimension with 10 measures, you get 10 multiple 16.000.000 cells, and so on.
Also the structure and logic is important. If you have a "complex" tree structure for example, it will also increases your cube size.

I don't know if there is a formular and i wouldn't say/guess anything about the cube size, but if you find one, please let me know. ;)

Regards.
Djordja Markovic
Vector SW DV GmbH

Interessant things:
Internal derby:
http://www.jedox.com/community/palo-foru…14338#post14338
Calculate your cube size:
http://www.jedox.com/community/palo-foru…14406#post14406

sebast

Intermediate

  • "sebast" started this thread

Posts: 4

Date of registration: Feb 3rd 2012

  • Send private message

5

Wednesday, March 7th 2012, 3:29pm

Hello,

for example:
I have 16 Dimensions, this means (in my case) each cell has 16 connections and its own value?
Number of cells X 4 Byte = Memory usage of all cells?

This post has been edited 2 times, last edit by "Cretos" (Mar 7th 2012, 4:48pm)


  • "dmarkovic" is male

Posts: 90

Date of registration: Aug 11th 2011

Location: Vienna / Austria

Occupation: Vector SW DV GmbH

  • Send private message

6

Wednesday, March 7th 2012, 4:40pm

Hi,

thats maybe for the simpliest structure correct in a way, but i don't believe.
Like I said above, everything is important, the structure, the logic, the number of your measures and so on.
I think that palo is calculating that in an other way.
I opened a support ticket (because now i want to know it exactly) :D

Regards.
Djordja Markovic
Vector SW DV GmbH

Interessant things:
Internal derby:
http://www.jedox.com/community/palo-foru…14338#post14338
Calculate your cube size:
http://www.jedox.com/community/palo-foru…14406#post14406

  • "dmarkovic" is male

Posts: 90

Date of registration: Aug 11th 2011

Location: Vienna / Austria

Occupation: Vector SW DV GmbH

  • Send private message

7

Wednesday, March 14th 2012, 4:12pm

Hello sebast,

here is the offiziell answer of jedox support, how to calculate the cube size:

Quoted

This is a very rough and unofficial estimation of the memory consumption.

up to 80 bytes per element in flat dimensions + string length
up to 250 bytes per element in "real-life" dimension + string length
you can find details here http://bugs.palo.net/mantis/view.php?id=8596#c33092

up to 16-20 bytes per numeric value in a cube
the same + string length for a string value

if you have markers, e.g. [budget, feb] = 2 * [[budget, jan]]
then for each value with coordinate [budget, jan, ...] additional 16-20 bytes


I have no time to "test" it, i hope it help you! ;)

Regards.
Djordja Markovic
Vector SW DV GmbH

Interessant things:
Internal derby:
http://www.jedox.com/community/palo-foru…14338#post14338
Calculate your cube size:
http://www.jedox.com/community/palo-foru…14406#post14406

Rate this thread