File Adapter , Processing Sequence

Hi All,
Can you please help me to understand these?
1. When i configure a Sender File Adapter with file pattern *.txt, Does it handle the files one after another? Or does it span multiple threads and processes multiple files in parallel?
2. If i select processing sequence as DATE, does it consider the time stamp also?
3. If a 100 mb file with name BIG.txt created at 1.00 AM,
and a 0.1 mb file with name small created at 1.10 on the sender system. If 100MB file needs 30 min to get processed,
Then can i assume the second file get processed only after big file completely processed and reached the destination?
Regards
Ganges Leaves

Ganges,
During any polling interval, XI will pick all files matching your Criteria and process them parallely.
Even if the big file is being processed, the next file will be picked up by the adapter if it is available during the next polling interval.
All interfaces are executed independent of the other.
All this is if u choose the mode as Best Effort.
Regards,
bhavesh

Similar Messages

FTP Sender Adapter - Processing Sequence

Does anybody know what the processing sequence of files is when I using a ftp sender adapter? I can only determine this if I use a file sender adapter (NFS).

Hi,
in sender file ( FTP ) adapter:
when qos :eoio
the sequence the msg processess will be in ascending alphabetical order.
ex: if i have 10 files in a folder
as per the my requirement all the 10 files are picked up at the same time, then
the files will be arranged in queue specified in ascending alphabetical order and processed in the same order.
but, when i use QOS: EO
the same thing is going to happen right!!
picks all the files , processess in ascending alphabetical order to xi..
then what is the use of queue here in eoio???
on the other hand,
in sender file ( NFS ) adapter:
file will be processed based on the processing sequence( either by date or time ).
so both EO and EOIO use the processing sequence... then wat is the work of queue here in EOIO MODE.. any way they are processed according to the proccessing sequence parameter.. ???
Please reply..

File adapter processing in FTP mode

Hello SDN,
I need some info on File adapter working in FTP mode.
What happens when we point to a remote file location that runs on FTP server?
FTP in standard does not support a remote read operation at all. So the only possible logic that strikes me is issue a FTP get command over the file and get the file locally, read it. Does it happen this way? Or SAP has customised FTP to enable the read operation from a remote location directly?
Regards,
Jai Shankar

Hi Jai,
I am sure you must have gone through this File/FTP help file earlier also. If you read the Procedure section of it, I think it will give you a clear idea what exactly happening there:
http://help.sap.com/saphelp_nw04s/helpdata/en/0d/00453c91f37151e10000000a11402f/frameset.htm
Regards,
Subahsha

File Adapter-Processing Parameters

can one tell me the difference between and when to use the following processing parameters
poll interval(secs)
poll interval(msecs)
Retry Interval(Secs)
Advanced Mode & Msecs to wait before modification

Hi,
from help.sap.com
http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/content.htm
Poll Interval (secs)
Number of seconds that the adapter must wait if no files are found for processing.
Poll Interval (msecs)
Additional waiting time in milliseconds.
If Poll Interval (secs) is set to null, processing times will be short and close to real time.
If Poll Interval (secs) and Poll Interval (msecs) are set to null, the adapter is only called once.
Retry Interval (secs)
Specify the number of seconds that the adapter is to wait before a file processed with errors is processed again.
If the value is set to null, then the adapter is canceled if an error occurs, even if a value greater than null is specified for Poll Interval (secs).
Regards,
michal

File Adapter--Processing parameter configuration

Hi Experts,
I need to configured the sender and reciever FTP Adapter to Archive a 37 MB text file within a FTP server.
It is taking 20 min to archive the file.
does this requirement requires any change in Parameter configuration(like transfer mode, channel availabilty planning( i am using daily with duration 30 min) to make it fast.
Thank you,
MK

Hi Experts,
To archive huge files using FTP adapter, i looked at the Michal weblog to zip the file :
/people/michal.krawczyk2/blog/2007/02/08/xipi-command-line-sample-functions
please explain how and where to write the below file
@ECHO OFF
7za.exe a -tzip D:\file_cat\%2.zip %1
del %1
and also explain
Zipping a file can also be done with jar.
For example,
jar cvf m.zip m.txt
will zip m.txt into m.zip
No need for any other software as jar is highly likely to be on the XI/PI server...
and how to implement it in the FTP adapter configuration.
Thanks in Advance.

File adapter causes FTP process stop result 0 byte file.

Has anyone ever heard that FTP adapter can cause FTP process to stop and end up with 0 byte file transferred?
We use the normal ftp script to ftp file from external file server place file in XI inbound folder so that file adapter can pick them up from that folder.
We have encounter a few 0 byte FTPed file in our system. One suspecting is the network between XI server and file server might get some interruption. With out just blaming on the network. We would like to know if there is any possibility that it is also causes by our file adapter? Says, it try to read the file that is not yet complete transferring make FTP give up transferring??
We would like to know if FTP process is transferring the file over and file adapter try to read, what will happen? Will it read file with incomplete content and ftp still go on? Or will it stop reading and return back error as the file could not be open? Or it will force FTP process to let go the file??
Best rgds,
Thida

Hi,
>We would like to know if there is any possibility that it is also causes by our file adapter? Says, it try to read the file that is not yet complete transferring make FTP give up transferring??
have not seen the file adapter causing any such problems. So, it looks like a network issue.
>We would like to know if FTP process is transferring the file over and file adapter try to read, what will happen? Will it read file with incomplete content and ftp still go on? Or will it stop reading and return back error as the file could not be open? Or it will force FTP process to let go the file??
Am not exactly sure, but when a file is being created and the file adapter tries to read such a file, the file would be READ and WRITE Locked and so File adapter should not be able to read such a file until the creation of the file is complete.
Also, take a look at the note : 821267 , question 31 for how file adapter processes empty file.
Regards,
Bhavesh

Generic File Adapter Schema

I am trying to pick up a .csv file that doesn't comform to a strict format, mainly because of human formatting errors in the file.
I've tried to create a fixed length schema and a comma delimited schema but both fail as soon as they get a file that doesn't exactly fit. How should I create the schema to cope with a file like this?
Regards
Jen

I too am trying to accomplish something similar.
My file is tab delimited and has 10 fields. It begins with 6 lines of header and ends with 1 line of footer. The Header is easy enough to skip over, but the footer is causing me no end of problems because the file Adapter is rejecting the entire file when it hits this malformed line. I tried to turn on uniqueMessageSeparator as ${eol} but that didn't seem to do anything different (I suspect it is because ${eol} is also a field terminator for the last field but I'm not sure).
Ideally I'd like to say any line that has 9 tabs is a Data line, and any line that doesn't is a NotData line but I haven't found any functions that will take a regular expression match as a condition for processing in the XSD.
I tried using the "choice" method of conditional processing but is seems that I must provice a string that is an exact match for nxsd:conditionValue and not a regex. I don't have a spcific string to look for.
I also tried to use the "Sequence" method of conditional processing that will treat any record that doesn't begin with a digit as a NotData Message of 1 string element terminated by ${eol} and any record that begins with 8 digits (which is a date in YYYYMMDD format) as a Data record using the "nxsd:startsWith" function but it seems I can only create multiple message types on files when there is some specific string to test. That's not going to work for me. There is no specific string on the records to identify them. The format of the line could be used to identify the records if a function supporting a regex could be found.
When I tried to deploy the "Sequence" method using a regex for the nxsd:startsWith value it seemed to put my BPEL Process into an infinite loop consuming 100% CPU. I had to kill the app server to stop it.
A detailed reference on how the File Adapter processes files and what functions are available for ignoring bad records and/or conditional processing would be appreciated. Also, any more ideas on how to get this file parsed would be appreciated.

Receiver File Adapter - Empty document found error

Hi,
I have a slight issue that I do not understand.
For example, I have a file that is 256 bytes in size and definitely has some content. However, when the file adapter processes the file it says in the log "Empty document found" - but I can see the file has content.
Any ideas ? I am using using XI 3.0 SP19.
Cheers
Colin.

hi colin,
i will agree with u,
may be the XI can not understand your test data,
can u tell me the language of test data.
In file adapter go to encoding select TEXT and UTF-8.
may be this will works.
regards
sandeep.

File Adapter - anonymous login (or )User name ,password login - Efficient?

Hi Folks,
In File Adapter processing , anonymous login (or) proper user name password based login is recommended ?
Because we have faced many issue while using username based login in File adapter .
Which one is best ?
Regards.,
Shiva

Hi Shiva ,
We will go one by one :
You can go for the Anonymous login but the problem is the any body can access the FTP server and it is not the secure one,that is why business generally don't allow the Anonymous login.
Coming to Proper user name password login ,I would advice you to use this one as the connection is more secure in this case.But this also comes with a problem that the username password generally expires after some time as per security policy and you have to change the username password for the FTP server as well as in File adapter which you are using.But this problem can be solved by going for a permanent username and password.
I would recommend you to go for Proper user name and password.
Regards
Ravi Anand
Edited by: Ravi Anand@85 on Mar 12, 2010 7:56 AM

File adapter - Unexpected exception running file2xmbprocessor

Hallo,
I've a fileadapter running and a couple of time the adapter is running fine.
After a while I get the following exception:
Unexpected exception running file2xmbprocessor
java.util.NoSuchElementException
at java.util.TreeMap$EntryIterator.nextEntry(TreeMap.java:1024)
at java.util.TreeMap$KeyIterator.next(TreeMap.java:1051)
at com.sap.aii.messaging.adapter.File2XMBProcessor.processFileAccess(ModuleFile2XMB.java:1383)
at com.sap.aii.messaging.adapter.File2XMBProcessor.run(ModuleFile2XMB.java:872)
at java.lang.Thread.run(Thread.java:534)
File adapter processing stopped
I have no idea whats wrong.
Any idea
Thanks harald

Hi Prasad,
sorry - but I can't understand what you mean.
The file-adapter I'm talking about runs on a fileserver. This adapter read the files and send them to the XI-System where a java-mapping is running.
Therefore I can't believe that the problem is the mapping.
The way I see it is that the error must be in a part of the file-read-process because the exception says
[fileprocessor] Error: Unexpected exception running file2xmbprocessor
java.util.NoSuchElementException
at java.util.TreeMap$EntryIterator.nextEntry 
Could you please explain what you mean.
Thanks and best regards
Harald

File adapter: file processing in correct sequence

Hello All
We have inbound file scenario.
File will be picked up and processed by XI and sent to SAP system.
All the files have to be processed in the same sequence.
Once the file is picked and processed in XI, data will be sent to receiving SAP system thru proxy call.
But, if there is an error in processing received data in the receiving system (because of duplicate data or any other application related error, which is specific to receiving application), how can we stop XI from picking and processing the next file?
Second file should be picked and processed by XI only after 1st file is successfully processed by the receiving system.
How can i ensure this?
Please let me know...
Many Thanks
Chandra

Hi Chandra
If you are on NFS then you can enable Processing Sequence by Name or Date in sender file adapter. With this you need to implement EOIO this allows messages to be picked in sequence and process in queue. If one of the file failed the queue will error.
To avoid more than one thread processing you can use additional parameter "clusterSyncMode" refer Note 801926.
With the above other solution can be creating a SYNC or interface that can act as an ACK from the system then you process the next message. BPM can also be useful if you use Fault messages and capture them for errors for processing of next message.
Hope above info can be used to come to a final approach for you
Thanks
Gaurav

How to process files one by one using sender file adapter

Hi,
I have to process file one by one using my file adapter (sender), because while doing the G/R materials get locked, if the same materal exist in other files.
I have maintained QOS as "Exactly Once in Order" & processing Sequence as "by date".
Processing sequence come in which tab? What will be the Queue name?
Thanks,
krishna

It will come under Processing tab
Here you need to select the first parameter QOS as EOIO
Then QUEUE name and processing sequence will be enabled.
NOTE: This will work only for NFS protocol not for FTP.

File pick & process in sequence

Hi Experts,
We have a problem on client site, the problem is that we are picking files from FTP Server.
The files are related to sales order and shipping notification. Both are on FTP system & sent at same time at FTP.
Some times Shipping notification is running first & sales order is not there, so it is going in Error.
How I can run these file in order ?
Study SAP

hi,
>>>Let the processing Mode be BY NAME and now the file will be processed sequentially
Processing Sequence (for transport protocol File System (NFS))
(it only works with NFS)
this does not make a lot of sense:
a) what if the sales order comes to the folder a second after the shippment?
b) what about EOIO in IDOC adapter?
c) EOIO should always be avoided is there are some other alternatives
so the best way to do it is to schedule a restart in ERP I blieve and not go into EOIO at all
Regards,
Michal Krawczyk

File Adapter : Sequence Check

Hello,
I'm facing the following issue: We receive files from a trade parter. These files have a sequence number in their file name. Eg. utilmd001.txt. We need to send these files as idocs to our SAP system. But we can only process a file if the previous file is already processed. Eg. utilmd003.txt can only be processed if utilmd002.txt is processed. Any idea on how to incorporate this in the file/FTP Adapter? Also note that we cannot assume that utilmd002.txt arrives before utilmd003.txt.
Any ideas?
Greetings,
Bart

Hi Bart,
I know it is possible to define generic modules (here is where the Java function comes into the picture) for each adapter in the module processor to enhance the adapter with additional functionality (e.g. SequenceCheck). I haven't tried before but you can always try. The FTP/batch commands alternative is a workaround that is simply and fast (without knowing your specific requirements) to implement.
Check this link for more info on the module processor: http://help.sap.com/saphelp_nw04/helpdata/en/f4/8620c6b58c422c960c53f3ed71b432/frameset.htm
And
This one for more info related to the development of your own modules: http://help.sap.com/saphelp_nw04/helpdata/en/f4/8620c6b58c422c960c53f3ed71b432/frameset.htm
Cheers,
R.

EOIO sequence XI file adapter

Hi All,
The scenario is below:
1. File Adaper polls a unix folder every 10 minutes, and comm channel is set as EOIO. A queue name prefix is specified in the comm channel.
2. If 30 files are found, they are all sent to a BPM receiver for processing on the Integration Engine. 30 separate BPM instances are triggered (but each one is actually running the same BPM definition).
3. Although the files appear in SXMB_MONI in the correct sequence, they are not processed in sequence - e.g. the files are sometimes be processed in the sequence 1, 2, 3, 4...8....5, 6, 7
4. The messages are all assigned to a queue id.... XBQO$PE_WS91100160, and although if an error occurs in one message, the queue can be stopped, the problem is that the transactions in this
queue are not necessarily in the sequence the files were found by the File Adapter
We have tried adding a "Only Once" queue option in SWF_INB_CONF, but to no avail. The sequence of the messages still appears to be unreliable.
In SXMB_ADM, we have tried to specify filter prioritisation. once again, to no avail.
Some additional information. An ABAP mapping class is being called in the BPM, and we have used this to track the sequence of the files being processed (by writing into a logging table).
My problem is at the time when the files go through EOIO queue and arrive at the BPM, the order has already changed. And according to the note833740, BPE should support EOIO at arrival side. Any more thought?

Hi Karun
while determining interface click on the check box MAINTAIN ORDER AT RUNTIME
hope this may help you
or if you are using PI 7.0 SP14 or above use message packaging
Thanks
sandeep

File Adapter , Processing Sequence

Similar Messages

Maybe you are looking for