Character Converting Problem at File Adapter

I am having a character conversion problem bringing in a XML file into XI.
It is converting the data wrong.
I have a file adapter picking up Audit.xml encoding is utf-8, use binary mode to pick it up.
XI takes the file and converts it into a text file.
I compared the hex of Audit.xml source file and the Audit.txt file and the characters are different for a specific few.
See attached image for details
Please let me know if any additional information will help
http://i9.photobucket.com/albums/a68/tkc204/SAP%20XI/Audit.png

Actually for this case Christian is right the source xml that I am receiving wasn't valid UTF-8. The program generating the xml was just putting the encoding - utf-8 tag on top because that's what the code told it to do.
The actual data is Windows-1252 in xml. So when XI reads it, it uses the utf-8 tag on top and is expecting UTF-8, but it was getting something else causing the unsupported characters to get converted.
The HEX was different on the Source XML comparing it to what XI was generating after File Adapter.
After making the output change to Windows 1252. It changes back to the expect HEX.
Source - is at Windows 1252
XI - it will use UTF-8 (no way to change it)
Target - forced to create in Windows 1252
Other helpful tools I used: W3C Validator - upload the file and found that I wasn't receiving UTF-8
I hope this is clear and helps someone else in the future.
Thanks For everyone's input.
Chirag

Similar Messages

Problem with FIle Adapter

Hi
We r facing typical problem with file adapter.
Lets say there are 30 files to be processed by placing an copy in arichive folder by file adapter based on pooling
parameters.
All the 30 files are picked up and we can see the copies in archive folder.
But when we go to RWB and check the audit log,
there we could see only 25 files , the 5 files are missing.
no trace found therre about the 5 files.
This is happening only some times and not to all the files placed in the FTP. Later when the same file is placed back from the Archive folder to the Source folder, the file is being picked and processed succesfully.
unfortunately this is happening on Production server
Any pointers which could trouble shoot this issue.
Regards
shekar chandra

Hi,
Couple of thing which you can try....
1. Use EOIO QoS and check if you still face the issue.
Is some program or application writing files to the directory? If yes I would recommend the use of a temporary name to write the files and then rename them.
Sometimes when an external application connects via FTP and transfers the files...
The file could be picked up by the adapter poll even before the transfer of data is done.
Which is why you will find that the file is archived but there is no xml message created for the same in the Integration engine.
Try increasing the poll interval. This helps sometimes.
Regards,
Sidharth

Problem in file-Adapter during polling with u00E4,u00F6 etc.

Hallo,
i have the problem described above. Is there any help?
Thanks,
Frank

Hi,
Please change the File Encoding in the sender file adapter to ISO-8859-1.
Please look into this link,.
http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/content.htm
--> File Type.
File Type
Specify the document data type.
○ Binary
○ Text
Under File Encoding, specify a code page.
The default setting is to use the system code page that is specific to the configuration of the installed operating system. The file content is converted to the UTF-8 code page before it is sent.
Permitted values for the code page are the existing Charsets of the Java runtime. According to the SUN specification for the Java runtime, at least the following standard character sets must be supported:
■ US-ASCII
Seven-bit ASCII, also known as ISO646-US, or Basic Latin block of the Unicode character set
■ ISO-8859-1
ISO character set for Western European languages (Latin Alphabet No. 1), also known as ISO-LATIN-1
■ UTF-8
8-bit Unicode character format
■ UTF-16BE
16-bit Unicode character format, big-endian byte order
■ UTF-16LE
16-bit Unicode character format, little-endian byte order
Regards
Bhavesh

Performance problems with File Adapter and XI freeze

Hi NetWeaver XI geeks,
We are deploying a XI based product and encounter some huge performance problems. Here after the scenario and the issues:
- NetWeaver XI 2004
- SAP 4.6c
- Outbound Channel
- No mapping used and only the iDocs Adapter is involved in the pipeline processing
- File Adapter
- message file size < 2Ko
We have zeroed down the problem to Idoc adapters performance.
We are using a file channel and every 15 seconds a file in a valid Idoc format is placed in a folder, Idoc adapter picks up the file from this folder and sends it to the SAP R/3 instance.
For few minutes (approx 5 mins) it works (the CPU usage is less then 20% even if processing time seems huge : 5sec/msg) but after this time the application gets blocked and the CPU gets overloaded at 100% (2 processes disp_worker.exe at 50% each).
If we inject several files in the source folder at the same time or if we decrease the time gap (from 15 seconds to 10 seconds) between creation of 2 Idoc files , the process blocks after posting 2-3 docs to SAP R/3.
Could you point us some reasons that could provoke that behavior?
Basically looking for some help in improving performance of the Idoc adapter.
Thanks in advance for your help and regards,
Adalbert

Hi Bhavesh,
Thanks for your suggestions. We will test...
We wonder if the hardware is not the problem of this extremely poor performance.
Our XI server is:
 Windows 2003 Server
 Processors: 2x3GHZ
 RAM: 4GB (the memory do not soak)
The messages are well formed iDocs = single line INVOICES.
Some posts are talking 2000 messages processed in some seconds... whereas we got 5 sec per message.
Tnanks for your help.
Adalbert

File Content Conversion Problem: Sender File Adapter

Hi All,
In Sender File Adapter, how to spilt the single line into different lines using + as a separator. Plz see below my source file.
#SMESS=IV01:672633SAP:676968:::NL51:02:11+
COPS=678713:676968:070416:IV01'3:11IVFR=678713:PDA and'IND 2'9206 AD'Dtn'INIVDA=070416IVNR=6264008195:676968add1
#EMESS=0+
In above txt file there are 3 lines.
1st line starts with #SMESS
2nd line starts with COPS
3rd line starts with #EMESS.
In 2nd line, if u observe there are 3 lines separating by +. My task is, I have to spilt the 2nd line into 3 lines using + separator.
I already used the xx.endSeparator as '+' to spilt the line but it is not working....
Could anyone help me how to do this. This is very urgent
Thnx,
Kumar.

Hi Shankar,
1) My Expected XML Structure:
<?xml version="1.0" encoding="utf-8" ?>
- <ns:MT_IV01 xmlns:ns="http://ms.com/dev/ms">
- <Recordset>
- <DT_SMESS>
<D_9901>IV01</D_9901>
<D_9902>672633SAP</D_9902>
<D_9903>676968</D_9903>
<D_9904 />
<D_9905 />
<D_9906>NL51</D_9906>
<D_9907>02</D_9907>
<D_9908>11</D_9908>
</DT_SMESS>
- <DT_COPS_2>
<D_C022>678713</D_C022>
<D_C023>676968</D_C023>
<D_C008>070416</D_C008>
<D_C111>IV01'3</D_C111>
<D_H559>11</D_H559>
</DT_COPS_2>
- <DT_IVFR_2>
<D_C024>678714</D_C024>
<D_D333>PDA and'IND 2'9206 AD'Dtn'IN+</D_D333>
</DT_IVFR_2>
- <DT_IVDA_2>
<D_D365>070416</D_D365>
</DT_IVDA_2>
- <DT_IVNR_2>
<D_D189>6264008195</D_D189>
<D_H364>676968add1</D_H364>
</DT_IVNR_2>
- <DT_EMESS>
<D_D9901_1>0</D_D9901_1>
</DT_EMESS>
</Recordset>
</ns:MT_IV01>
2) I am not getting any error even if I use key Fields or Not becoz in the RecordSet Structure I mentioned DataType, 1 instead of DataType, *.
3) FCC Parameters:
Document Name: MT_IV01
Document Namespace: http://ms.com/dev/ms
Recordset Structure: DT_SMESS,1,DT_COPS_2,1,DT_IVFR_2,1,DT_IVDA_2,1,DT_IVNR_2,1,DT_EMESS,1
Recordset Sequence: Ascending
Key Field-type : String (Case-sensitive)
4) Error:
Conversion of file content to XML failed at position 0: java.lang.Exception: ERROR converting document line no. 2 according to structure 'DT_COPS_2':java.lang.Exception: ERROR in configuration: more elements in file csv structure than field names specified!

Problem in File Adapter jca.file.FileName

Hello, I have problem in sending variable data to the file adapter property
I have defined Variable FlowData of Type Element from a XSD
When I am trying to assign the variable data to the File adapter it is throwing error
*<bpelx:inputProperty name="jca.file.FileName"*
variable="flowData"
query="ns2:flowData/ns2:fileInfo/ns2:name"/>
Error query "ns2:flowData/ns2:fileInfo/ns2:name" is invalid, because step 'ns2:flowData' is not valid.
Please help me!!

Hi,
Try to add a slash */* at the beginning of the xpath...
*/ns2:flowData/ns2:fileInfo/ns2:name*
Cheers,
Vlad
Give points - it is good etiquette to reward an answerer points (5 - helpful; 10 - correct) for their post if they answer your question
https://forums.oracle.com/forums/ann.jspa?annID=330

Performance Problem with File Adapter using FTP Conection

Hi All,
I have a pool of 19 interfaces that send data from R/3 using RFC Adpater, and these interfaces generate 30 TXT files in a target Server. I'm using File Adapters as Receiver Comunication Channel. It's generating a serious perfomance problem. In File Adpater I'm using FTP Conection with Permanently Conection, Somebody knows if PERMANENTLY CONECTION is the cause of performances problem ?
These interfaces will run once a day with total of 600 messages.
We still using a Test Server with few messages.

Hi Regis,
We also faced teh same porblem. Whats happening is that when the FTP session is initiated by the file adapter, then its getting done from teh XI server. Hence the memory of the server is also eaten up. Why dont you give a try by using 'per file transfer'.
If this folder to which you are connecting is within your XI server network then you can mount(or map) that drive to the XI server and use it with a NFS protocol of the file adapter and thereby increasing the performance.
Cheers
JK

Problem with file adapter polling on Unix

Hi everybody,
I'm trying to run my BPEL process with receive activity of File adapter partner link. Everything is working OK on Windows file system - folder polling is set correctly and when the new file appears and is at least 2 minutes old, the process starts. But when I try to run the process on the UX server with BPEL (folders are changed to the correct values as '/home/myfolder', rights for this folder are set to RWX for everybody and process is deployed successfully to the appropriate domain) nothing is done when the new file appears in the folder.
I really don't know, where is the problem. Any hint from you?
Thanks,
Milan K.

Hi Suraj,
From The Note ``
"lock" option:- This is the option that is almost similar to the above; The key difference being in very rare circumstances, the first option may still allow channels to be run on both server nodes. When this option is set, file adapter acquires a enqueue service lock. Lock is taken on channel object and it is exclusive and non-cumulative such that no second message(even it is from the same channel) can fetch the files from configured FTP/File directories unless and until first message has completed(success/fail) its processing.
This is exactly my requirement.
but when I see the end time of the message its they are withing second only as
14:02:38     14:02:39
14:02:48     14:02:48
14:02:58     14:02:58
14:03:08     14:03:08
14:03:18     14:03:18
14:03:28     14:03:28
14:03:38     14:03:38
14:03:48     14:03:48
14:03:58     14:03:58
14:04:08     14:04:08
14:04:18     14:04:19
14:04:28     14:04:29
14:04:38     14:04:39
14:04:49     14:04:49
14:04:59     14:04:59
14:05:09     14:05:09
14:05:19     14:05:19
14:05:29     14:05:29
14:05:39     14:05:39
14:05:49     14:05:49
14:05:59     14:05:59
14:06:09     14:06:09
14:06:19     14:06:19
14:06:29     14:06:31
14:06:39     14:06:40

Problem with file adapter for delimiter

Hi,
I am working in a file-idoc scenario where i need to read a file with comma delimited body.
Content configuration for the body of the file is as follows,
BODY.fieldNames F1,F2,KEY,F3,F4,F5 where KEY is the key field
BODY.keyFieldValus 01
BODY.fieldSeparator ,
BODY.endSeparator 'nl'
For most of the cases it is working fine.
The record for which this is not working is,
AAA,,01,XXX,FFF,GGG
XI file adapter is ignoring this records.
1) I tried with some option like fieldContentFormatting but this is not working.
2) Most surprisingly if i shift the KEY to left(in place of F2), record is getting picked up properly with SPACE in the tag KEY and '01' in F2.
3) I tried using record like 126126,JJJ,01,,,GGG
Record is picked up with value in F3 and F4 fields are SPACE.
The problem is only with blank between two separator before KEY field.
Is there any other parameter which can solve the problem.
In case any body knows the solution please let me know.
With Regards
Amitesh

By making BODY mandatory with 1 record, i am getting the below given error message in Adapter monitoring...
Sender Adapter v2722 for Party '', Service 'BS_MRS':
Configured at 2007-08-29 09:40:17 BST
History:
- 2007-08-29 09:46:26 BST: Retry interval started. Length: 2.000 s
- 2007-08-29 09:46:26 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:26 BST: Processing started
- 2007-08-29 09:46:24 BST: Error: Conversion of complete file content to XML format failed around position 0: Exception: ERROR consistency check in recordset structure validation (line no. 3: missing structure(s) before type 'TRL'
- 2007-08-29 09:46:24 BST: Processing started
With Regards
Amitesh

Weird problem in File Adapter polling

Hi Guys,
My BPEL process is working fine not until today wherein the File Adapter cannot poll for new files in the target directory. I tried restarting the bpel server and still my bpel process was not able to poll for new files. I tried creating a test bpel process and configure the file adapter (see below):
Operation Type: Read
Archive processed files: Enable
Delete files after successfule: Enable
Include files with pattern: *.csv
Publish messages in batches of: 1000
Polling frequency: 5 seconds
Minimum file age: 0 seconds
Sample File: test.csv
12345,12345,12345
When I tried testing it, the file was deleted but it was not able to archive the file and bpel process did not appear in the instance tab of BPEL console. I have check the domain.log and orabpel.log files and it didn't show any exceptions or error (log level is set to error)
Any idea how to fix this problem?
FYI, I'm using the version 10.1.3.1.
thanks,

What does your process do other than poll files, does it call any other adapter / service. This is more likely the issue although I have seen issues with the file and ftp adapter in 10.1.3.3 and 10.1.3.1. I never sorted the issue it just seemed to affect that process.
10.1.3.1 is really out of date and has a number of issues you should look at upgrading to 10.1.3.4 or 10.1.3.5 but I have seen some posts that have issues with 10.1.3.5.
cheers
James

CSV conversion problems in File adapter

Hi,
Hi,
We had a problem with CSV conversions in file adapter.Our scenario is: IDOC>Xi>FTP(csv)
Our target file should be show as when I open in notepad:
"Active","1234","fdsfs","fsdfsdfs"
"","","fsdfda"","Fsdfsfsdfsdf""12202003"
Is this possible for put "Double quotes" for each and every field.
currently my conversion file is coming like this:
Active,1234,fdsfs,fsdfsdfs
,,fsdfda,Fsdfsfsdfsdf,12202003
when I open this file in excel ..some fields data occupying next or before cells...it means mismatching the data between cells.
probably if I put "double quotes" for each and every field then i could aviod this mismatch data presentation in different cells in excel?
Thanks,
PILearn

Hi,
When you try to open such files in Excel...if there is no space between two field even it is comma....it will take it as whole string...
if you have fixed length...excel gives you the option either with delimiters or with fixed lengths.
Regards.
Akshay.
Reward points if find useful.

Problems with File adapter

Hi All
I am facing some problems with XI system. XI production server was restarted couple of days back. From that time, 1 file is not reaching its destination. When i go to communication channel monitoring, i see this message for all the communication channels with file adapter "No adapter registered for this channel".
But, communication channels with SOAP adapter are working fine, and the corresponding files are reaching its destinations. So, what should i do to rectify this probelm? Do we have to restart XI server onceagain? Is there anything pirticular, to be careful about, while restarting XI system?
Many Thanks in Advance
Chandra Sekhar

Hi Chandra shekar,
Plz try to do the following steps:
1)Try after restarting the Java Stack.
2)Try after SLD cache.
To clear the SLD cache, from the Integration Builder main menu, choose Environment ® Delete Cache for SLD Data.
Once we have deleted the cache for SLD data, accessing objects in the SLD may take longer than usual initially.
This will help you to find SP Level
http://help.sap.com/saphelp_nw2004s/helpdata/en/1f/c45b4211aac353e10000000a1550b0/frameset.htm
http://hostname:5/CPACache/refresh?mode=full
Regards,
Vinod.

Problem in file adapter @ receiver end

Hi ,
I am using file adapter @ receiver end using content conversion.
Using field separator as 'nl'.
When i open file in Hex mode it's showing the field separator as 2 Cariage returns(CR) & 1 line feed(LF).
But the requirement is only 1 CR n 1 LF .
Appriciate ur help..
Regards,
Kishore

Hi
I tried giving like this,
Datarow.fieldFixedLengths : 15,15,15,15,10,10,10,10
Datarow.endSeparator : '0x0A' or '0x0D'
but da result is same...2 CR n 1 LF..
even if i dont give endseparator then also same thing is happening..
Regards
Kishore

Problem Using File adapter(Urgent)

Hi,
I have a simple ESB service where I have one Read File adapter for reading a file and other Write file adapter to write the same file to a folder.
I was able to deploy it to ESB instance successfully.
But when I put a file to read ESB is throwing
"OracleASjms/ESBDeferredTopic" error.
Can any one please help me.
Thanks
Rao.

We would be able to help you better if you provided the full error stack as this is very generic.
Generally the most common issue with the file adapter is permissions, make sure the SOA suite owner is able to read and write on the directory and the file.
otherwise post the error stack which may identify the real cause.
cheers
James

Problem with file adapter (FTP) created under business service

Hi
I am using file adapter in my receiver communication channel. I dont know the physical existance of the system so i have created one business service. Under this business system i have created a file adapter with FTP protocol. I have given all the parameters. But when i am trying to execute my scenarion i am getting the following error in SXMB_MONI.
com.sap.aii.utilxi.misc.api.BaseRuntimeException thrown during application mapping com/sap/xi/tf/_SQLMediaCodeToCRMCapaign_: RuntimeException in Message-Mapping transformatio~
In RWB i am getting the following error.
Mapping Error
Execption_During_Execution
In Communication Channel monitoring I am not getting any information regarding receiver file adapter. Its not showing any message either error or sucessful. How to find whether my receiver communication channel FTP parameters configured correctly or not.What is the error. Please help me.
Regards
Sowmya

Somya,
Error clearly indicates that issue is with mapping....so there is no point of checking receiver adapter..
BTW for checking whether the FTP site is working properly or not , you can use any ftp client softwares or command prompt of windows also.
---->In Communication Channel monitoring I am not getting any information regarding receiver file adapter. Its not showing any message either error or successful.
Message has not reached up to that level so no point of looking at receiver communication channel.
Regards,

Character Converting Problem at File Adapter

Similar Messages

Maybe you are looking for