CSV conversion problems in File adapter

Hi,
Hi,
We had a problem with CSV conversions in file adapter.Our scenario is: IDOC>Xi>FTP(csv)
Our target file should be show as when I open in notepad:
"Active","1234","fdsfs","fsdfsdfs"
"","","fsdfda"","Fsdfsfsdfsdf""12202003"
Is this possible for put "Double quotes" for each and every field.
currently my conversion file is coming like this:
Active,1234,fdsfs,fsdfsdfs
,,fsdfda,Fsdfsfsdfsdf,12202003
when I open this file in excel ..some fields data occupying next or before cells...it means mismatching the data between cells.
probably if I put "double quotes" for each and every field then i could aviod this mismatch data presentation in different cells in excel?
Thanks,
PILearn

Hi,
When you try to open such files in Excel...if there is no space between two field even it is comma....it will take it as whole string...
if you have fixed length...excel gives you the option either with delimiters or with fixed lengths.
Regards.
Akshay.
Reward points if find useful.

Similar Messages

File Content Conversion Problem: Sender File Adapter

Hi All,
In Sender File Adapter, how to spilt the single line into different lines using + as a separator. Plz see below my source file.
#SMESS=IV01:672633SAP:676968:::NL51:02:11+
COPS=678713:676968:070416:IV01'3:11IVFR=678713:PDA and'IND 2'9206 AD'Dtn'INIVDA=070416IVNR=6264008195:676968add1
#EMESS=0+
In above txt file there are 3 lines.
1st line starts with #SMESS
2nd line starts with COPS
3rd line starts with #EMESS.
In 2nd line, if u observe there are 3 lines separating by +. My task is, I have to spilt the 2nd line into 3 lines using + separator.
I already used the xx.endSeparator as '+' to spilt the line but it is not working....
Could anyone help me how to do this. This is very urgent
Thnx,
Kumar.

Hi Shankar,
1) My Expected XML Structure:
<?xml version="1.0" encoding="utf-8" ?>
- <ns:MT_IV01 xmlns:ns="http://ms.com/dev/ms">
- <Recordset>
- <DT_SMESS>
<D_9901>IV01</D_9901>
<D_9902>672633SAP</D_9902>
<D_9903>676968</D_9903>
<D_9904 />
<D_9905 />
<D_9906>NL51</D_9906>
<D_9907>02</D_9907>
<D_9908>11</D_9908>
</DT_SMESS>
- <DT_COPS_2>
<D_C022>678713</D_C022>
<D_C023>676968</D_C023>
<D_C008>070416</D_C008>
<D_C111>IV01'3</D_C111>
<D_H559>11</D_H559>
</DT_COPS_2>
- <DT_IVFR_2>
<D_C024>678714</D_C024>
<D_D333>PDA and'IND 2'9206 AD'Dtn'IN+</D_D333>
</DT_IVFR_2>
- <DT_IVDA_2>
<D_D365>070416</D_D365>
</DT_IVDA_2>
- <DT_IVNR_2>
<D_D189>6264008195</D_D189>
<D_H364>676968add1</D_H364>
</DT_IVNR_2>
- <DT_EMESS>
<D_D9901_1>0</D_D9901_1>
</DT_EMESS>
</Recordset>
</ns:MT_IV01>
2) I am not getting any error even if I use key Fields or Not becoz in the RecordSet Structure I mentioned DataType, 1 instead of DataType, *.
3) FCC Parameters:
Document Name: MT_IV01
Document Namespace: http://ms.com/dev/ms
Recordset Structure: DT_SMESS,1,DT_COPS_2,1,DT_IVFR_2,1,DT_IVDA_2,1,DT_IVNR_2,1,DT_EMESS,1
Recordset Sequence: Ascending
Key Field-type : String (Case-sensitive)
4) Error:
Conversion of file content to XML failed at position 0: java.lang.Exception: ERROR converting document line no. 2 according to structure 'DT_COPS_2':java.lang.Exception: ERROR in configuration: more elements in file csv structure than field names specified!

Problem with file content conversion in receiver file adapter

Hi All
I have a problem with file content conversion in receiver file adapter.
This is my recordset structure: Header_Record,1,Claim_Record,*,Check_Rec,1
These are the content conversion parameters:
Header_Record.fieldSeparator = ,
Header_Record.endSeparator = 'nl'
Claim_Record.fieldSeparator = ,
Claim_Record.endSeparator = 'nl'
Check_Rec.fieldSeparator = ,
Check_Rec.endSeparator = 'nl'
In SXMB_MONI, i can see that the data is correctly extracted from proxy, and correctly mapped to receiver message, and i see a checkered flag (success).
But, Adapter status is RED with the following error message:
Conversion initialization failed: java.lang.Exception: java.lang.Exception: Error(s) in XML conversion parameters found: Parameter '1.fieldFixedLengths' or '1.fieldSeparator' is missing
In communication channel monitoring, i get the following error message:
Message processing failed. Cause: com.sap.aii.af.ra.ms.api.RecoverableException: Channel has not been correctly initialized and cannot process messages
What is going wrong here? Can anyone please tell me?
Thanks
Chandra

Posted in Incorrect forum.
Posted again in Process Integration forum

File Content Conversion Parameters in FIle Adapter

Hi
I am doing a scenario - XML file to Text file using File content conversion parameters in Receiver File Adapter Channel.
I given FCC Parameters like:
DATA.addHeaderLine - '0'
DATA.fieldSeparator - ,
DATA.endSeparator - 'nl'
But im getting error in Receiver File Adapter as - fieldSeparator not specified.
i would be greatful if any one help me.
Regards
Rajesh

Hi Rajesh,
There are lot of blogs which explain File Content Conversion in different scenarios:-
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/venkat.donela/blog/2005/06/08/how-to-send-a-flat-file-with-various-field-lengths-and-variable-substructures-to-xi-30
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
/people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
/people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns
/people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
/people/sap.user72/blog/2005/01/06/how-to-process-csv-data-with-xi-file-adapter
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
I hope this helps.
Regards.
Praveen

File Content Conversion in Sender File Adapter

Hi,
I am implementing a scenario, where I need to do Content conversion in My file Adapter.My input file is as follows
BGN00S-A200711281003ET4
REF38381012
DTP007D820071128
N1P5P5MicrosoftFI58-0612397
INSY18030XNAN
REFZZZZ666666666
DTP336D819970331
NM1ILIL1AdamsMarkE34666666666
PERIPIPHP770555-5555
N31470 Georgia Club Drive
N4StathamGA30666
DMGD819571022MM7
HD030HLTAE1D
My data type is as below.
<header>
     <BGN>
          <A></A>
          <B></B>
          <C></C>
          <D></D>
     </BGN>
     <REF>
          <A1></A1>
          <B1></B1>
          <C1></C1>
          <D1></D1>
     </REF>
     <DTP>
          <A2></A2>
          <B2></B2>
          <C2></C2>
          <D2></D2>
     </DTP>
</header>
<Content>
     <N1>
          <A></A>
          <B></B>
          <C></C>
          <D></D>
     </N1>
     <REFAR>
          <A1></A1>
          <B1></B1>
          <C1></C1>
          <D1></D1>
     </REFAR>
     <DMP>
          <A2></A2>
          <B2></B2>
          <C2></C2>
          <D2></D2>
     </DMP>
</Content>
My issue is, How do I set my parameter in Sender Comm channel for content conversion especially at record structure.
I have provided the value as Header,1,Content,*
But its not working.
If I do provide like
BGN_REC,,REF_REC,,DTP_REC,,N1_REC,,INS_REC,,NM1_REC,,PER_REC,,N3_REC,,N4_REC,,DMG_REC,,HD_REC,* then ,I am not getting above XML format. Please suggest or How can I modify my Data type which competes to configure in Channel
Thanks
Manmadha

Hi All,
I am sorry for the Jumbled Content. I dont know what happened.
I should get the XML output as below.
header>
     <BGN>
          <A></A>
          <B></B>
          <C></C>
          <D></D>
     </BGN>
     <REF>
          <A1></A1>
          <B1></B1>
          <C1></C1>
          <D1></D1>
     </REF>
     <DTP>
          <A2></A2>
          <B2></B2>
          <C2></C2>
          <D2></D2>
     </DTP>
</header>
<Content>
     <N1>
          <A></A>
          <B></B>
          <C></C>
          <D></D>
     </N1>
     <REFAR>
          <A1></A1>
          <B1></B1>
          <C1></C1>
          <D1></D1>
     </REFAR>
     <DMP>
          <A2></A2>
          <B2></B2>
          <C2></C2>
          <D2></D2>
     </DMP>
</Content>

Problem with FIle Adapter

Hi
We r facing typical problem with file adapter.
Lets say there are 30 files to be processed by placing an copy in arichive folder by file adapter based on pooling
parameters.
All the 30 files are picked up and we can see the copies in archive folder.
But when we go to RWB and check the audit log,
there we could see only 25 files , the 5 files are missing.
no trace found therre about the 5 files.
This is happening only some times and not to all the files placed in the FTP. Later when the same file is placed back from the Archive folder to the Source folder, the file is being picked and processed succesfully.
unfortunately this is happening on Production server
Any pointers which could trouble shoot this issue.
Regards
shekar chandra

Hi,
Couple of thing which you can try....
1. Use EOIO QoS and check if you still face the issue.
Is some program or application writing files to the directory? If yes I would recommend the use of a temporary name to write the files and then rename them.
Sometimes when an external application connects via FTP and transfers the files...
The file could be picked up by the adapter poll even before the transfer of data is done.
Which is why you will find that the file is archived but there is no xml message created for the same in the Integration engine.
Try increasing the poll interval. This helps sometimes.
Regards,
Sidharth

To CSV conversion problem

hi all,
could you fix this problem in the File Adapter :-
Initialization error: Conversion initialization failed with java.lang.Exception: java.lang.Exception: Error(s) in XML conversion parameters found:
Parameter '.fieldFixedLengths' or '.fieldSeparator' is missing
while trying to write XML to a CSV file.
i've configured the FCC as:
Structure = structs ( with 6 columns)
struct.fieldFixedLengths 20,10,10,10,10,10
struct.fieldSeparator ,
struct.endSeparator 'nl'
thanks in advance
nikhil
null

I think the problem is a spelling error: you named your structure "structs" and then you refer to it as "struct".
You have to choose one between the two (or a better one if you can find it).
About File content conversion I suggest you to see the following links:
Content Conversion (Pattern/Random content in input file)
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file
File Content Conversion for Unequal Number of Columns
/people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns
How to send a flat file with fixed lengths to XI 3.0 using a Central File Adapter
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
Content Conversion ( The Key Field Problem )
/people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
Solution to the problem encountered using Variable Substitution with XI-SP12
/people/sravya.talanki2/blog/2005/08/11/solution-to-the-problem-encountered-using-variable-substitution-with-xi-sp12
I hope this will be helpfull.
Regards,
Salvatore

File Conversion in Rec File Adapter with subnodes

Hi
My XML Structure is like this -->
<?xml version="1.0" encoding="UTF-8" ?>
- <ns0:MT_Test xmlns:ns0="urn:TESTconversion">
<MstName>Hello</MstName>
- <Header>
<TableName>1tst</TableName>
<PayDate>0102</PayDate>
<TotalAmt>24.00</TotalAmt>
<Total>000002</Total>
<PaySource>CHK</PaySource>
- <Subheader>
<TableName>1tst</TableName>
<SelectCatgry>test</SelectCatgry>
<CustID>200</CustID>
<PayAmount>11.00</PayAmount>
</Subheader>
- <Subheader>
<TableName>1tst</TableName>
<SelectCatgry>test</SelectCatgry>
<CustID>400</CustID>
<PayAmount>13.00</PayAmount>
</Subheader>
</Header>
- <Header>
<TableName>1tst</TableName>
<PayDate>0103</PayDate>
<TotalAmt>10.00</TotalAmt>
<Total>000001</Total>
<PaySource>ONE</PaySource>
- <Subheader>
<TableName>1tst</TableName>
<SelectCatgry>test</SelectCatgry>
<CustID>100</CustID>
<PayAmount>10.00</PayAmount>
</Subheader>
</Header>
</ns0:MT_Test>
which means
MT_Test is root 1..1
Header is the sub-node of MT_test as 1...*
Subheader is sub-node of Header which is also 1...*
rest of the fields are elements as 1..1
Now I need to convert this into Flat file using Receiver File Adapter, I gave this in my content conversion logic
recordset Structure -
MstHeader,BFKKZK,BFKKZP
MstName.addHeaderLine     0
MstName.fieldFixedLengths     8
MstName.endSeparator     'nl'
Header.addHeaderLine     0
Header.fieldFixedLengths     30,10,15,6,6
Header.endSeparator     'nl'
Subheader.addHeaderLine     0
Subheader.fieldFixedLengths     34,10,35,16
Subheader.endSeparator     'nl'
But with this I am getting exception as -->
Could not process due to error: java.lang.Exception: Exception in XML Parser (format problem?):'java.lang.Exception: Message processing failed in XML parser: 'Conversion configuration error: Unknown structure 'ns0:MT_Test' found in document', probably configuration error in file adapter (XML parser error)'
I know that http://help.sap.com/saphelp_nwpi711/helpdata/en/44/686e687f2a6d12e10000000a1553f6/content.htm says following -->
The expected XML structure contains the structure as nodes filled with any number of elements without additional subnodes.
But does that mean Structure with sub-nodes cannot be converted in flat format.
Pls. suggest the solution for this.
- lalit -

Shab
I resolved the issue & able to convert the hierarchical XML file into flat file with the desired format I wanted.
Rather then FCC, I use MessageTransformBean module and I have to insert more dummy contexts & dummy fields in the target structure in order to achieve the flat file format.
I am getting file ( not actual file below just template is shown below) like this now
Header1 ....details....
SubHeader1.1
SubHeader1.2
SubHeader1.x
Header2 ....details....
SubHeader2.1
SubHeader2.2
SubHeader2.x
Headerx ....details....
SubHeaderx.1
SubHeaderx.2
SubHeaderx.x
Once the total development is over on my side I will create the blog for this. So this following statement is only correct when you use protocol as FCC but not with module.
"The expected XML structure contains the structure as nodes filled with any number of elements without additional subnodes."
Thanks
Lalit

Problem with file adapter for delimiter

Hi,
I am working in a file-idoc scenario where i need to read a file with comma delimited body.
Content configuration for the body of the file is as follows,
BODY.fieldNames F1,F2,KEY,F3,F4,F5 where KEY is the key field
BODY.keyFieldValus 01
BODY.fieldSeparator ,
BODY.endSeparator 'nl'
For most of the cases it is working fine.
The record for which this is not working is,
AAA,,01,XXX,FFF,GGG
XI file adapter is ignoring this records.
1) I tried with some option like fieldContentFormatting but this is not working.
2) Most surprisingly if i shift the KEY to left(in place of F2), record is getting picked up properly with SPACE in the tag KEY and '01' in F2.
3) I tried using record like 126126,JJJ,01,,,GGG
Record is picked up with value in F3 and F4 fields are SPACE.
The problem is only with blank between two separator before KEY field.
Is there any other parameter which can solve the problem.
In case any body knows the solution please let me know.
With Regards
Amitesh

By making BODY mandatory with 1 record, i am getting the below given error message in Adapter monitoring...
Sender Adapter v2722 for Party '', Service 'BS_MRS':
Configured at 2007-08-29 09:40:17 BST
History:
- 2007-08-29 09:46:26 BST: Retry interval started. Length: 2.000 s
- 2007-08-29 09:46:26 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:26 BST: Processing started
- 2007-08-29 09:46:24 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:24 BST: Processing started
With Regards
Amitesh

Weird problem in File Adapter polling

Hi Guys,
My BPEL process is working fine not until today wherein the File Adapter cannot poll for new files in the target directory. I tried restarting the bpel server and still my bpel process was not able to poll for new files. I tried creating a test bpel process and configure the file adapter (see below):
Operation Type: Read
Archive processed files: Enable
Delete files after successfule: Enable
Include files with pattern: *.csv
Publish messages in batches of: 1000
Polling frequency: 5 seconds
Minimum file age: 0 seconds
Sample File: test.csv
12345,12345,12345
When I tried testing it, the file was deleted but it was not able to archive the file and bpel process did not appear in the instance tab of BPEL console. I have check the domain.log and orabpel.log files and it didn't show any exceptions or error (log level is set to error)
Any idea how to fix this problem?
FYI, I'm using the version 10.1.3.1.
thanks,

What does your process do other than poll files, does it call any other adapter / service. This is more likely the issue although I have seen issues with the file and ftp adapter in 10.1.3.3 and 10.1.3.1. I never sorted the issue it just seemed to affect that process.
10.1.3.1 is really out of date and has a number of issues you should look at upgrading to 10.1.3.4 or 10.1.3.5 but I have seen some posts that have issues with 10.1.3.5.
cheers
James

Character Converting Problem at File Adapter

I am having a character conversion problem bringing in a XML file into XI.
It is converting the data wrong.
I have a file adapter picking up Audit.xml encoding is utf-8, use binary mode to pick it up.
XI takes the file and converts it into a text file.
I compared the hex of Audit.xml source file and the Audit.txt file and the characters are different for a specific few.
See attached image for details
Please let me know if any additional information will help
http://i9.photobucket.com/albums/a68/tkc204/SAP%20XI/Audit.png

Actually for this case Christian is right the source xml that I am receiving wasn't valid UTF-8. The program generating the xml was just putting the encoding - utf-8 tag on top because that's what the code told it to do.
The actual data is Windows-1252 in xml. So when XI reads it, it uses the utf-8 tag on top and is expecting UTF-8, but it was getting something else causing the unsupported characters to get converted.
The HEX was different on the Source XML comparing it to what XI was generating after File Adapter.
After making the output change to Windows 1252. It changes back to the expect HEX.
Source - is at Windows 1252
XI - it will use UTF-8 (no way to change it)
Target - forced to create in Windows 1252
Other helpful tools I used: W3C Validator - upload the file and found that I wasn't receiving UTF-8
I hope this is clear and helps someone else in the future.
Thanks For everyone's input.
Chirag

Performance problems with File Adapter and XI freeze

Hi NetWeaver XI geeks,
We are deploying a XI based product and encounter some huge performance problems. Here after the scenario and the issues:
- NetWeaver XI 2004
- SAP 4.6c
- Outbound Channel
- No mapping used and only the iDocs Adapter is involved in the pipeline processing
- File Adapter
- message file size < 2Ko
We have zeroed down the problem to Idoc adapters performance.
We are using a file channel and every 15 seconds a file in a valid Idoc format is placed in a folder, Idoc adapter picks up the file from this folder and sends it to the SAP R/3 instance.
For few minutes (approx 5 mins) it works (the CPU usage is less then 20% even if processing time seems huge : <b>5sec/msg</b>) but after this time the application gets blocked and the CPU gets overloaded at 100% (2 processes disp_worker.exe at 50% each).
If we inject several files in the source folder at the same time or if we decrease the time gap (from 15 seconds to 10 seconds) between creation of 2 Idoc files , the process blocks after posting 2-3 docs to SAP R/3.
Could you point us some reasons that could provoke that behavior?
Basically looking for some help in improving performance of the Idoc adapter.
Thanks in advance for your help and regards,
Adalbert

Hi Bhavesh,
Thanks for your suggestions. We will test...
We wonder if the hardware is not the problem of this extremely poor performance.
Our XI server is:
     Windows 2003 Server
     Processors: 2x3GHZ
     RAM: 4GB (the memory do not soak)
The messages are well formed iDocs = single line INVOICES.
Some posts are talking 2000 messages processed in some seconds... whereas we got 5 sec per message.
Tnanks for your help.
Adalbert

File conversion in a file adapter

Hi
I am using a FTP file adapter to place the file in the ftp servers.
The structure of the file is
<?xml version="1.0" encoding="UTF-8" ?>
- <p2:MT_Cust xmlns:p2="http://RashidaBPM">
<Cust_no>KRTEST2</Cust_no>
<Cust_Name>XI CUSTOMER 2</Cust_Name>
<Cust_Address>GB</Cust_Address>
</p2:MT_Cust>
I want the resulta to come in as cust_no , cust_name, cust_address
Can someone please help me to get the centent conversion parameters correct to get the desired result
Thanks
Nikhil

Hi Nikhil,
To convert a XML file into a flat file you need to have a Stucture of the XML file like this one mentioned below:
<root>
<substructure>
<data>
</data>
</substructure>
<root>
By XML I mean the input data, that will be routed from XI server to FTP servers.
now the parameters to be given in Content Conversion Tab and which are of utmost importance are:
substructure.fieldSeparator
root.fieldSeparator
substructure.endSeparator
you can also use the methods such as fieldFixedLengths etc.
Include these methods and test your scenario again.
I hope it helps,
Thanks & Regards,
Varun Joshi

REG: File content conversion in Receiver file adapter

HI Gurus,
I have the scenario like proxy to file with content conversion
my message type for the source like this
MT_SOURCE
-----||
       |---ROW
------------||
                |---LINE
target strucuture also same
MT_TARGET
-----||
       |---ROW
------------||
                |---LINE
i am using the following FCC parameters in receiver file adapter
LINE.fieldSeparator = '                       '
LINE.fixedLineWidth = 90
LINE.lineSeparator = 'nl'
LINE.fieldFixedLengths = 200
LINE.endSeparator        = 'nl'
the output file show the data differently in note pad when compare to word
word output
dgepvs                       023456987
kgdd0016155710                SS Smw Ne 01
kgdd0016155710                SS Smw Ne 01
kgdd0016155710                SS Smw Ne 01
kgdd0016155710                SS Smw Ne 01
kgdd0016155710                SS Smw Ne 01
kgdd0016155710                SS Smw Ne 01
kgdd0016155710                SS Smw Ne 01
notepad out put
dgepvs           023456987   kgdd0016155710                SS Smw Ne 01       kgdd0016155710                SS Smw Ne 01          kgdd0016155710                SS Smw Ne 01            kgdd0016155710                SS Smw Ne 01    kgdd0016155710                SS Smw Ne 01
word output is the correct output wat i am expect but same out put i want in note pad can any help me out for this how can i resolve this
Thanks in advance

There is nothing wrong in your content conversion parameters. This is pure editors interpretation for the next line character.
I would do in java program to fix this issue using '\r\n'   You might want to try and see how that helps for notepad editor.

Content conversion in Reciever File Adapter

Hi Frens,
Iam doing A FCC in Reciever file adapter. My input structure is
DT_structure
->Record
->Row
       Field1
       Field2
       Field3
I have donr the configuration as
Recordset Structure : Record,Row
Row.fieldSeparator : ,
Row.endSeparator : 'nl'
Record.fieldSeparator : 'nl'.
With this configuration Iam able to display only one record but I need to display multiple records in the file. Please do suggest me wha need to be done to achieve this.
Radhika.

First check whether your datatype has the occurrence of records unbounded or not. Then goto content conversion. If both your Record and Row tags can occur multiple times, then use
Recordset Structure : Record,*,Row,*
Or if Record occurs only once and multiple Row nodes are required, then use
Recordset Structure : Record,1,Row,*
Regards,
Prateek

CSV conversion problems in File adapter

Similar Messages

Maybe you are looking for