You are not logged in.

Problem while importing data

Dear visitor, welcome to Palo Community Forum. If this is your first visit here, please read the Help. It explains in detail how this page works. To use all features of this page, you should consider registering. Please use the registration form, to register here or read more information about the registration process. If you are already registered, please login here.

pradnya

Intermediate

  • "pradnya" started this thread

Posts: 8

Date of registration: Oct 8th 2008

  • Send private message

1

Wednesday, October 8th 2008, 2:27pm

Problem while importing data

I'm new to palo.
I created one simple cube called SAlES with 3 dimensions.
CITYID, SNAME, SALE

and I put the formula in B2 as
=PALO.SETDATA(C1,FALSE,"localhost/Test","sales",A1,B1)

I run the ODBC query on sql server database as

select cityid,sname, total_sale from sales

data getting displayed on A1,B1,C1 cell.
But same datais not apearing in Palo modellar.

dominik_l

Jedox Team

  • "dominik_l" is male

Posts: 344

Date of registration: May 7th 2008

Location: Freiburg / Germany

  • Send private message

2

Wednesday, October 8th 2008, 3:31pm

You mustn't confuse building a database structure (e.g. elements for the CITYID dimension) with importing data. Both processes should be run separately.
Data itself will never appear in the modeller, only the DB structure.

pradnya

Intermediate

  • "pradnya" started this thread

Posts: 8

Date of registration: Oct 8th 2008

  • Send private message

3

Thursday, October 9th 2008, 6:40am

Then why I'm able to see the data of palo demos in modeller?
So what is the next step?

you can see the image here
http://docs.google.com/View?docid=dfxv3vkb_34f4ctzsf2

This post has been edited 1 times, last edit by "pradnya" (Oct 9th 2008, 6:43am)

h_decker

Sage

  • "h_decker" is male

Posts: 763

Date of registration: Oct 26th 2005

Location: Cologne, Germany

  • Send private message

4

Thursday, October 9th 2008, 8:51am

What you see in modeller are dimension and cubes and when you click on dimension registers you can see the dimension elements. You can't see the cube data in the modeller.

What you need to do is to create the dimensions with the elements you need. E.g. dimension cityid with city ids as elements and dimensionsname with snames as elements, then a dimension measures with element sale and perhaps some more.

Then create a cube with that dimensions.

According to your query the PALO.SETDATA formula would look like like this:

=PALO.SETDATA(C1,FALSE,"localhost/Test","sales",A1,B1,"sale")

You can check data by using paste view after import.

Holger

pradnya

Intermediate

  • "pradnya" started this thread

Posts: 8

Date of registration: Oct 8th 2008

  • Send private message

5

Thursday, October 9th 2008, 9:16am

Sorry but I'm not getting you.
You mean to say MOdeller >> city >> there I need to create elements with cityids?
Same for the Snames? Manualy?
There more than 200 cities... I'm trying to import them using import wizard.

Currently under City and sname there are no elements. By seeing at the Demo database I thought elements means data under that particular column.


I tried with this formula as well
=PALO.SETDATA(C1,FALSE,"localhost/Test","sales",A1,B1,"sale")

but on paste view or paste elements I'm not getting any data

This post has been edited 1 times, last edit by "pradnya" (Oct 9th 2008, 9:17am)

dibe0014

Sage

Posts: 85

Date of registration: Sep 25th 2008

Location: Oakville, ON

  • Send private message

6

Thursday, October 9th 2008, 9:41am

Hi,

you can add elements using the Import Wizard, but you have to use the function PALO.EADD() for that.
You can also add element with copy & paste. You can copy them in Excel and paste them into the Dimension inside the Modeler.

Benjamin
My blog on Open Source BI and living in Canada

pradnya

Intermediate

  • "pradnya" started this thread

Posts: 8

Date of registration: Oct 8th 2008

  • Send private message

7

Tuesday, October 14th 2008, 5:23am

Thanks guys for help.

One last and basic question.

For importing the data on daily basis do I need to have a seperate tool like kettle or IMP Palo?
Basically palo is a front end and some other tool will import the data for it?
In such case which tool is a better option?

This post has been edited 1 times, last edit by "pradnya" (Oct 14th 2008, 5:25am)

dominik_l

Jedox Team

  • "dominik_l" is male

Posts: 344

Date of registration: May 7th 2008

Location: Freiburg / Germany

  • Send private message

8

Tuesday, October 14th 2008, 9:16am

For more complex imports, and if you want to do something like scheduling, an extra tool for data import is recommended. Besides the ones you named, you may wanna check the Palo ETL Server, which is also open source and free for download.

apohl

Professional

  • "apohl" is male

Posts: 31

Date of registration: Apr 26th 2006

Location: Germany

Occupation: consultant for pmo, controlling and olap implementation

Hobbies: MTB, running, art, classical music

  • Send private message

9

Friday, October 17th 2008, 12:05pm

tools for automatic data load

Hi Pradnya,
Pentaho is from our past experience great for automatic data loads. There is a scheduler embedded, which works independent of the underlying OS. Talend is also great, but the Palo interface is not as good tested as it is with Pentaho.
IMP is not a bad choice either, but it is not as comfortable, feature rich and bullet proof as the products from Talend and Pentaho.

The ETL Server is also free of costs, but it is still a long way to get an environment as we are used to by commercial ETL vendors. And Pentaho and Talend are in this league!
They have connectors for everything what is in the future required, the only missing connector is for IBM mainframes. They have an embedded transaction control or logging with debuggin facility, you can use them in a clustered environment, they support slow moving dimensions and so on ...

I hope this helps!
Cheers, Alexander
Rate this thread