You are not logged in.

Dear visitor, welcome to Palo Community Forum. If this is your first visit here, please read the Help. It explains in detail how this page works. To use all features of this page, you should consider registering. Please use the registration form, to register here or read more information about the registration process. If you are already registered, please login here.

Gcasty

Trainee

  • "Gcasty" started this thread

Posts: 1

Date of registration: Jul 8th 2009

  • Send private message

1

Wednesday, July 8th 2009, 6:33pm

Low-Cost data migration and ETL tools

Hi, Im building a database for my company. We are a rather small size book company with a lot of references and still growing.

We have a Mysql database here and are trying to find some good tools to use it at its best. Basically we are just starting up the database after dealing with Excel: we had a size problem… So im trying to find a program that will allow us to do two different things: the migration of our data from the old system to the new one and a specialized software to perform ETL (Extract, transform and load) on our database.

About the price of the tools, if we were one year ago, the accounting department would have been pretty relaxed about this. But today, we have some budget restrictions and therefore need a low cost tool. So could you give me some advice on a good data migration and etl tool for a low cost?

Thanks for your help.

gleesoto

Master

  • "gleesoto" is male

Posts: 68

Date of registration: Nov 12th 2005

Location: Ireland

Occupation: datasmith

  • Send private message

2

Wednesday, July 8th 2009, 6:40pm

RE: Low-Cost data migration and ETL tools

If your focus is purely Palo, then Jedox's own ETL Server will handle most ETL requirements. For a more generalised ETL tool, Talend would be my choice, but Pentaho's PDI (aka Kettle) is also very good (both also have Palo add-ins).

As for the cost, all three are free and open source.

Tom

Tgroul

Intermediate

Posts: 10

Date of registration: Jun 18th 2009

  • Send private message

3

Thursday, July 9th 2009, 3:25pm

Hi,

Some companies have budget problems and are having to reduce their cost of operation.

Have you ever heard of open source tools? They can do the job easily and less expensive than proprietary solutions that cost a lot of money.

As Gleesoto says in the previous post, you can have a look at a good ETL open source program called Talend Open Studio: it is user-friendly but also has advanced features intended for technical users (java debugger, code injection…). It can perform data migration and ETL.

The website is http://www.talend.com/solutions-data-int…a-migration.php to download the open source program. They have a forum and documentation you can read. Tell us what you think about the software.

For an ETL benchmark: http://blogs.sun.com/aja/entry/talend_s_new_data_processing

Posts: 122

Date of registration: Aug 1st 2007

  • Send private message

4

Friday, July 10th 2009, 2:55am

Hi Tgroul,

Since you are advertising for Talend, are you guys able to provide some step to step instructions on integration with Palo.

Of all the ETL tools, I find Talend the hardest one to get my head around.

I have successfully being able to do a basic import in Kettle. I have been able to use Cubeware IMP:PALO. I have been able to use ETL server 3.0 with relative ease, but it is just impossible to get Talend up and running no matter how hard I try!!!



Kind Regards,

Jimmy

axi

Sage

Posts: 664

Date of registration: Mar 5th 2009

Location: Germany / Bargteheide

Occupation: BI

  • Send private message

5

Friday, July 10th 2009, 10:38am

Jimmy,

I was about to write the same you did!

Thank You

Tgroul

Intermediate

Posts: 10

Date of registration: Jun 18th 2009

  • Send private message

6

Friday, July 10th 2009, 10:40am

Hi Expresson and Axi,

First, Talend Open Studio has many components for different programs. Including Palo. You can check our component page: http://www.talendforge.org/components/index.php .

Second, you might also want to check out the tutorials page where you will get all the information you need to get started with Talend and do an import with the tool: http://www.talendforge.org/tutorials/menu.php

And then, if you still have problems to resolve, you can chat with the community and use the bugtracker.

All of these solutions are given to you for free!

This post has been edited 1 times, last edit by "Tgroul" (Jul 10th 2009, 10:41am)


gleesoto

Master

  • "gleesoto" is male

Posts: 68

Date of registration: Nov 12th 2005

Location: Ireland

Occupation: datasmith

  • Send private message

7

Friday, July 10th 2009, 11:56am

Talend's Palo connector is very limited, handles only 'value' loads (i.e fact table loads), the hard work associated with OLAP ETL is the handling of dimensional changes. Kettle's Palo Add-in is much better (but there has been some confusion over versions, which I think is now resolved).

Cubeware IMP is a nice product, but it's closed source and the free version is time limited (no guarantee it'll work after 12 months) and I think has limits on what size of dataset it can handle.

But if your focus is Palo, Jedox's own ETL tool would be the obvious choice.

Tom

Tgroul

Intermediate

Posts: 10

Date of registration: Jun 18th 2009

  • Send private message

8

Friday, July 10th 2009, 2:50pm

If you think the Palo connector could be better, you can go to the bugtracker: to tell the Talend technical team to improve on the component.
The community is involved in the creation of new components.

gleesoto

Master

  • "gleesoto" is male

Posts: 68

Date of registration: Nov 12th 2005

Location: Ireland

Occupation: datasmith

  • Send private message

9

Friday, July 10th 2009, 4:04pm

I mentioned my concerns re: the Talend Palo Plugin to its developer over a year ago http://blog.gobansaor.com/2008/01/26/dub…/#comment-3904.

Tom

Tgroul

Intermediate

Posts: 10

Date of registration: Jun 18th 2009

  • Send private message

10

Friday, July 17th 2009, 4:55pm

Your blog post is interesting. But it might not be the best way to get information through to Talend.

I would go on the bugtracker and create a bug report to give your feedback to the tech team. They should at least acknowledge your problem, at best fix the plug in to make it work properly.

Here is a link to the bugtracker: http://www.talendforge.org/bugs/my_view_page.php

Posts: 122

Date of registration: Aug 1st 2007

  • Send private message

11

Saturday, July 18th 2009, 2:17am

Dude,

Given that you work for Talend, maybe you should be our representative to Talend.

Why don't we play this the other way round.

Why don't you download the free and open source version of PALO ETL and figure out the functionalities that Tal-End doesn't have and add to it. Hint: There is a lot................(Hint: Look under Transformation)

If you have a look at the PALO transformation options such as "Tree FH", "Tree NC", "Tree FC", they are all good places to start.

So far, I have been able to use the Palo ETL to do everything including loading up my SQL database. Don't see why I need to try to learn another!

These things are not "Bugs", these things are enhancements. What's the point of trying to log it with the tech team when there is the possibility of no action? Wouldn't I be better off just using Palo ETL?

As I said before, the problem with Talend starts off where it is really hard to get the god damn thing up and running! I have used many other ETL tools and have been able to figure it out, so therefore it must be your tool (and your tutorial!) that's turning people off in even trying to use it for Palo.

JH

je_manth

Intermediate

  • "je_manth" is male

Posts: 6

Date of registration: Apr 1st 2010

  • Send private message

12

Friday, April 2nd 2010, 7:51pm

I think as well as some previous speakers. TOS is in my opinion not suitable for rapid learning.
My problem now: How can I uninstall it again? I find nowhere an uninstall link. Can I simply delete the folders?

  • "Pommie" is male

Posts: 412

Date of registration: Feb 21st 2007

Location: Lytham UK

Occupation: OLAP consultant specialising in retail

  • Send private message

13

Sunday, April 4th 2010, 5:51pm

Having experienced TM1's recommendation of third party ETL tools before they got off their backside and develeoped their own Turbo Integrator, I'd be quite cautious of relying on any 3rd party tool.

The problem is that the 3rd party developers don't have the inside track and you can't assume that any third party tool will continue to work when Jedox relase a new version of Palo.

Sad but true, which is why I would always choose the Jedox version of a component like ETL or Web as long as it works properly.
Best wishes

John Hobson
The Planning Factory, Lytham, UK
www.planfact.co.uk

jayku

Intermediate

Posts: 11

Date of registration: May 29th 2009

  • Send private message

14

Tuesday, April 20th 2010, 12:14pm

We successfully use Kettle (aka PDI/Pentaho Data Integration) with
the kettle-palo plugin at http://sourceforge.net/projects/palokettleplug/

We load dimensions and cubes. Maybe the Palo ETL is better when extracting / loading Palo dimensions / cube. But IMHO Palo ETL is far away in terms of "classic" ETL features and ease of use.

Best regards
Jayku

  • "Michel" is male

Posts: 154

Date of registration: Jun 1st 2007

Location: Netherlands

  • Send private message

15

Friday, September 3rd 2010, 2:10pm

RE: Low-Cost data migration and ETL tools

Is anyone moderating this forum? This clown is already posting for some days now...

[edit: post I referred to has been removed]

This post has been edited 1 times, last edit by "Michel" (Jun 28th 2011, 8:28pm)


robertom

Intermediate

Posts: 7

Date of registration: Jun 26th 2011

  • Send private message

16

Sunday, June 26th 2011, 2:32pm

Talend Open Studio

I think Talend Open Studio is an excellent choice. Open Source, powerfull, easy to use and learn. It's a tool focused on data integration in general. Here you can find some slides:
http://www.robertomarchetto.com/www/tale…n_studio_slides

A comparison on Pentaho Kettle and Talend is here:
http://www.robertomarchetto.com/www/tale…_pdi_comparison
Business intelligence consultant
http://www.robertomarchetto.com

This post has been edited 1 times, last edit by "robertom" (Jun 26th 2011, 2:33pm)


Rate this thread