You are not logged in.

rows in CSV-file not properly recognized, also single quote error

Dear visitor, welcome to Palo Community Forum. If this is your first visit here, please read the Help. It explains in detail how this page works. To use all features of this page, you should consider registering. Please use the registration form, to register here or read more information about the registration process. If you are already registered, please login here.

jlp2097

Intermediate

  • "jlp2097" started this thread

Posts: 9

Date of registration: Aug 20th 2010

  • Send private message

1

Friday, August 20th 2010, 10:39am

rows in CSV-file not properly recognized, also single quote error

Hello everybody,

I am currently trying to set up a pilot to see whether Palo fits our needs and whether we will invest more money and time in Palo or whether TM1 is more appropriate. A very simple demo using hand-created csv-files seemed promising, so I went on and tried to do a pilot using real CSV files. This failed however.

I have a very basic file connection set up:



And a very basic extract:



The preview however shows, that this is not working. Please note, that I could get around the single quotes not found error, but I could not get around the fact that Palo starting failing around the POS_TITEL and RATING column in recognizing the rows correctly.



I've tried different encodings in Palo, I've tried opening & saving with excel in different formats (\t-delimited, ; ). I've tried reencoding the csv as Unicode, as Windows (CR/LF) etc. I could not get a clean import recognizing the rows correctly. I am using the latest open source edition of palo suite for trying the pilot.

The file can be found here:CSV-File

Help would be very much appreciated

holger_b

Sage

  • "holger_b" is male

Posts: 271

Date of registration: Jun 1st 2010

Location: Freiburg, Germany

Occupation: BI Consultant

  • Send private message

2

Friday, August 20th 2010, 11:00am

RE: rows in CSV-file not properly recognized, also single quote error

Hello jlp2097,

would you mind posting your ETL Server project together with a small sample file? That would make it easier to understand what the problem is.

Regards
Holger

buettner

Professional

  • "buettner" is male

Posts: 22

Date of registration: May 17th 2010

Location: Germany

  • Send private message

3

Friday, August 20th 2010, 11:58am

RE: rows in CSV-file not properly recognized, also single quote error

Hello jlp2097,

I had similar problems with single-quote error: they were caused by "CR/LF" within on field. Palo/ETL thought that row is finished....

In your csv-file (beginning in second dataset) in field "AKTUELLES_MEMO_DER_LST" are some quotes "", but not regularly. Perhaps this is the reason. Try to import totally without this field if possible.

Regards
Helmut

This post has been edited 2 times, last edit by "buettner" (Aug 20th 2010, 12:04pm)

axi

Sage

Posts: 661

Date of registration: Mar 5th 2009

Location: Germany / Bargteheide

Occupation: BI

  • Send private message

4

Friday, August 20th 2010, 12:02pm

the attached file is stripped to the minimum possible

works under Windows and Linux (there I have to specify the codepage)

a good approach is always to let ETL-server do the work of sorting things out

I never use quotes and always use TABs as delimiter

jlp2097

Intermediate

  • "jlp2097" started this thread

Posts: 9

Date of registration: Aug 20th 2010

  • Send private message

5

Tuesday, August 31st 2010, 2:57pm

RE: rows in CSV-file not properly recognized, also single quote error

Hello,

sorry for not answering - I was on vacation and did not have access to our systems.

@holger_b: I've attached the project file and some simple test data. Thanks for looking into this!

@buettner: yes, there are quotes. But these are needed and since enclosure character is set to NONE, it should work. Regarding CR/LF: I've tried a lot of possible encodings but to no avail. Excel, Notepad++ all work fine.

@axi: is your answer related to my original post? If yes, I don't really understand.

Regards,
jlp2097

holger_b

Sage

  • "holger_b" is male

Posts: 271

Date of registration: Jun 1st 2010

Location: Freiburg, Germany

Occupation: BI Consultant

  • Send private message

6

Wednesday, September 1st 2010, 5:31pm

RE: rows in CSV-file not properly recognized, also single quote error

Hi jlp,

I got your zip file, but I cannot make my ETL Server run currently, I will be back as soon as this is solved.

Regards
Holger

jlp2097

Intermediate

  • "jlp2097" started this thread

Posts: 9

Date of registration: Aug 20th 2010

  • Send private message

7

Thursday, September 2nd 2010, 2:25pm

Interesting. I've completely uninstalled Palo Suite, deleted all jedox folders and reinstalled Palo Suite. It almost seems to work now (almost because the single quotes error still appears) but at least the rows are being recognized now.

This behavior does not exactly instill confidence in Palo but I'm still looking into it.

I'm still open for suggestions regarding the single quotes error - Palo seems to mind the double-quotes (which I've removed for now) but then the error message is wrong. Maybe someone from the palo team should fix that :-)

Thanks to those who looked at my problem!

This post has been edited 1 times, last edit by "jlp2097" (Sep 3rd 2010, 10:51am)

Rate this thread