File adapter parameter "Msecs to Wait Before Modification Check" is gone

We are using PI 7.1 and we have the problem that the file adapter (ftp) picks up incomplete files from time to time. That causes a mapping error.
Have a look at sap note 821267 question 3.
https://websmp230.sap-ag.de/sap(bD1kZSZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=821267
Here you can find a solution. But in reality this parameter isn't there. And if you check the current documentation
http://help.sap.com/saphelp_nwpi71/helpdata/en/44/655453b48a4ddfe10000000a1553f7/content.htm
you can't find this parameter too.
Has anybody of you the same effect? Does anybody of you know the reason? And the most important question is: What is the solution for this problem. The suggested work around in this note isn't possible for us.

Hi,
May be this thread can give you some idea to deal with your problem.. see my reply there
Re: Use temporary file in FTP receiver adapter
Sorry this will not help you here..
One solution which I think is.....
Put file in your source directory with diff name, and write an script which will rename it to its original name.
The logic for scrip should be something like this.
First of all when reading the file for the very first time then check the size and wait for 10 sec and then again check the size. If both size are same then scrip should rename the file to its original name.
Regards,
Sarvesh
Edited by: Sarvesh Singh on Mar 26, 2009 4:35 PM

Similar Messages

File Adapter Advanced Mode - Msecs to Wait Before Modifications Check

Hi, Can anybody tell me how to set this parameter "Msecs to Wait Before Modifications Check" in PI 7.1? I don't see this parameter at all. In advance mode of PI 7.1, we just have Maximum File Size(bytes). Also when I checked the SAP note 801926 for Advanced Mode we can just set only
1. Parameter name: "clusterSyncMode"
2. Parameter name: "ftp.timeout"
Please let me know if anybody has configured this already in PI 7.1.

Hi Ravi
I think this feature is no longer supported in PI 7.1. Although it work with PI 7.0 for NFS and non FCC only.
Thanks
Gaurav

Poll Interval, Msecs To wait before modification checks & Queue Name in CC

Hi All,
I have 3 inter-related interfaces which is having 3 File Sender Communication channels as below charasteristics;
All 3 ccs are running on a common Queue Name inorder to cater the business scenario;
so PI should consume the files in the same sequance of files are copping into the locations;
(time gap between incoming files is around 1-3 secs)
Existing Values in Production system
IF086
Poll Interval                                                                        1 secs
Msecs To wait before modification checks                      10000
Queue Name                                                                     XI_QUE1
run sequance must be 1
IF913
Poll Interval                                                                        1 secs
Msecs To wait before modification checks                      10000
Queue Name                                                                     XI_QUE1
run sequance must be 2
IF084
Poll Interval                                                                        1 secs
Msecs To wait before modification checks                      10000
Queue Name                                                                     XI_QUE1
run sequance must be 3
we are having PI Alert email configured in the system;
when we get a big files into the locations, we get an unwanted Alert emails saying Error;
when I check PI, Overall file transfer is successful,
but we have the below error in the Message Display Audit log as
"Channel CC_Cxxx: Attempt to send file 'T201_200909141702' failed because file was modified during processing. 0 bytes expected, 1202248 bytes found. Trying to resend file"
but Overall file transfer is successful;
Does anyone can explain the reason for this error; ?
Also to remove this error & unwanted Alert email (since final status is successfull), I changed the Poll Interval to 3 for all 3 above CCs; Now I dont get the above error;
Do you think there might be a sequance issue due to this change;?
(time gap between incoming files is around 1-3 secs)
quite lengthy to explain sorry;
Appreciate your help please
thanks
Iver

Hello Iver
Question 3 in the note #821267 FAQ: XI 3.0 / PI 7.0/ PI 7.1 File Adapter, explains what is happening here. This answers your first question.
The file in question was being written to by another process when the file adapter attempted to send it. Depending on the length of time/amount of data that is being written to these files, increasing the polling interval to 3 seconds will help.
Regards
Mark

File Adapter -- Picking has to wait untill it get fully loaded/write.

Hi All,
I need to pick the files from a folder and I need to pick the files only which has been written completely.
I should not pick the file in the middle while writing, I need to wait untill it finishes the writing completely.
Is there any setting I can put in Sender File adapter to do this?
Thanks
Seema

Nithya,
>> Try to increase the processing time in the sender communication channel, so that it allows you to completely load the file. Check the time which is needed to upload the file to the directory manually and correspondingly change the processing time.
We do not know exactly at what time the file will be placed in the folder. It may be at any time. So I cannot put the processing time accurately.
Aamir,
>> If you are picking from FTP,MSecs wont work there.the sender program which writes the file must write the file in some temporary format like .dat etc and once the file is complete it should change the filename to .txt,configure the sender file adapter to pick only *.txt files.
This is a good idea. But I don't think I can ask them to change at the other end as it is working previously with other middleware.
Guys,
Can you please advice which is the best thing we can do at this point of time.?
Thanks
Seema.

Which will execute first in File Adapter (parameter,Identifier,module)

Hi,
I have written a module for my sender file adapter, and choose FCC to parase my complex structure...here my doubt is whether adapter module will call first or FCC which is there in Identifier tab in file adapter?
Regards,
Irshad.

Chandras sekhar,
i have already seen that blog...
could you plz read my message once again?
Regards,
Mansoor
ya i got it..Call sap adapter module will store the message in send queue.
just want to know which module is building the xi header whether it is same call sap adapter module or is there any specific module which will convert native message to xi message.
Is call sap adapter module is the responsible for building the xi message header with the help of cpa lookup? if its so again confuse for me.....
In File adapter we have 3 tabs one is parameter identifier and module...As u said first parameter tab will run as per FCC/ File message protocol then this parsed/content of text file will be input to the module tab .in this module tab we have custom modules and standard module these modules are executed in the same sequence as mentioned.
what is the module name which converts native message to xi message?
Regards,
Mansoor

File adapter picking up file before them is completely written

HI all
My problem is that, a sender communication channel (FTP) pick up the file before them is completely written on to the FTP folder.
the parameter "Msecs to Wait Before Modification Check" is in 6000, but the CC pick them up.
Please help!
Thanks.

Hey
>>Msecs to Wait Before Modification Check
The above parameter is only applicable when picking file from NFS,it has no effect on FTP.
To solve your problem,please look at question 3 of SAP Note 821267
Thanks
Aamir

File by File picking with Standard File Adapter with NFS Protocal !!

Hi Folks,
How to pick file by file with little gap in a file directory by Standard File Adapter. One interface, one communication channle.
Ex: XML_XXXXX_XXXX1.xml
      XML_XXXXX_XXXX2.xml
      XML_XXXXX_XXXX3.xml
First I need to pick one file XM_XXXXX_XXXX1.xml then wait for 2 minutes and pick another one in ascending order.
I have tried with Advance option "File size" and "Msec to wait before modification check" with 1200000 MS, but no use.
Please folks any one can help in this, which is very big help?
Kind Regards
Many Thanks in advance
San

Hi
My BPM steps are as follows:
1. Receive step -- Asynch
2. Transformation -- split the message
3. Switch step -- Condition "ID != ' ' from transform message'
4. In side Switch Branch 1 -- Receiver determination - Receive acknowledgment - Application
5. Send 1 -- with Application Transport, Queue Name - 'XXX'
      This XXX queue I have configured on ID with EOIO Service
6. block step - Send multiple messages to same receiver on top
    I have send 2 different message to one receiver, the first message is only one , second message are multiple. I am splitting    with transformation step
7. Sender -2 no acknowledgement active
8. stop
Can you please tell me where I am gonna wrong!!
I will apprecite for your efforts
Regards
San

Sender File Adapter pulling Incomplete File - Throwing Alert with MSecsWait

Hi,
 We have sender File communication channel which is polling every 600 Secs. The directory where the files are available is basically an FTP Server directory. Vendors are putting file in this directory and PI is picking up from there.
 
Sometimes File CC is picking up incomplete files.
 
So, I set up Advanced Mode, additional parameter 'Msecs to Wait Before Modification Check' to 10000 (10Secs)
 
Now, it is not picking up incomplete files.
 
But, sometimes PI is trying to process files which are being written by Vendors and stopping the process because of 'Msecs to Wait Before Modification Check' and throwing an error and retrying to process in next polling. As far as stopping the process it si fine.
 
But, the problem is whenever it does this, PI is triggering an alert. We have bunch of Vendor Services and set up an alert rule for all Runtime errors.
 
My question is:
1) Is there any way we can stop sending alerts for this error and keep the generic alert rule ?
 
2) Or, is there any other way not to generate error and at the same time not to process incomplete files.?
 
The error we get is:
2009-11-11 13:10:12 Error Channel CC_XYZ_SENDER: Attempt to send file 'VendorXYZ.xml' failed because file was modified during processing. 2383872 bytes expected, 2678784 bytes found. Trying to resend file
Any pointers are really appreciated.
Regards,
Ramesh

Hi,
An alternative approach would be to have the vendors write the fles to a temporary ftp directory and have an OS script scheduled to move the files from the temporary directory to the directory from where XI picks the files.
This way, XI will not pick up partially written files.
Regards,
Ravi Kanth Talagana

File adapter Need to wait When Other Applicatio is writing the file

Hi All,
This is File to File Interface, iam using NFS here.
While other application is writing the file to the Folder, XI Sender File Adapter shld wait for certain time and then pick it up.
We have the Option " MSecs to Wait Before Modification Check" on File Sender Advanced TAB.
But it is no Use, it is not behaving correctly.
Please assist me on this
Regards

Hey Vamsi,
I think you're good to go here. The behaviour is exactly as it should be. The polling interval takes priority when there is no file there but when there is a file there the modification check will take priority over polling interval so it will still wait the mandatory 2 minutes to ensure that no modification is taking place & that's exactly what you want. You don't want to pick up an incomplete file irrespective of when it was put there. So there will always be just over a 2 minute delay (or whatever you set the Msecs value to + a few seconds depending on where the polling cycle is when a file is written out but a max of 2 minutes & 19 seconds delay) when there is a file there but at least you'll have consistent data. If there is no file there the adapter will just poll every 20 seconds until a file arrives.
The 2 minute 'wait' step is exactly that. The adapter will see the file then wait 2 minutes & probably does a timestamp comparison or something. It doesn't do a modification check within those 2 minutes. Having said that, I don't see why you can't reduce the Msecs interval. My reasoning is that you basically want to establish whether it's still being wriiten out before you pick it up. Even if you set it to 5 seconds you should still be able to pickup whether the file is being modified (I'm assuming that the check is doing a timestamp comparison). That will significantly reduce your time wait period.
My assumption on the timestamp comparison was wrong It's actually does a comparison on file size when it reads the data in, see SAP Note (Point 3): [http://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/oss_notes/sdn_oss_bc_xi/~form/handler%7b5f4150503d3030323030363832353030303030303031393732265f4556454e543d444953504c4159265f4e4e554d3d383231323637%7d]
Another suggestion made on the note: Get the writing application to write the file out with an extension different to the one you're polling for. Then, after they have completed writing out the file, they can do a re-name to the extension that you're polling for. That could also speed up things.
Regards, Trevor
Edited by: Trevor Naidoo on Oct 8, 2009 9:38 AM

Restricting polling in sender file adapter

Hi friends,
I have a requirement where I need to poll a file from an FTP server. But, if the file is being edited (some other application is writing to it) I need to avoid picking that file. Plz tell me how i can achieve this...waiting for ur replies.
Regards,
Shilpa

Shilpa,
Check out this sap note :
[https://websmp230.sap-ag.de/sap(bD1kZSZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=821267|https://websmp230.sap-ag.de/sap(bD1kZSZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=821267]
File Locking / Incomplete Processing
Q: I sometimes observe that files are processed only partially, i.e., only a fragment from the file's start is converted into an XI message. Nevertheless, the file is usually archived completely. Does the File Sender Adapter honor if another process has locked a file for exclusive use?
A: Unfortunately, the J2EE 1.3 technology the File Adapter is built upon does not support file locking. This limitation affects the File Adapter's operation. Depending on whether the JRE implementation for the operating system under which the adapter runs uses mandatory file locking or advisory file locking, opening a file that is currently being written to by another process will fail or not.
If opening the file fails, no problem exists and the adapter will try to open the file each poll interval until it succeeds.
However, if opening the file is not prevented by the operating system, the adapter starts to process the file although it is still being modified. Since XI 3.0 SP11 / PI 7.0 there is a parameter named "Msecs to Wait Before Modification Check" in the advanced settings of the File Sender channel configuration to work around this issue. This setting causes the File Adapter to wait a certain time after reading, but before sending a file to the Adapter Engine. If the file has been modified (which is basically determined by comparing the size of the read data with the current file size of the input file) after the configured interval has elapsed, the adapter aborts the processing of the file and tries to process the file again after the retry interval has elapsed.
If this option is not available for the settings you would like to use, the following algorithm (to be implemented in your application) may be used to ensure that the File Adapter only processes completely written files:
Create the file using an extension, which does not get processed by the File Adapter, e.g., ".tmp"
Write the file content
Rename the file to its final name, so the File Adapter will notice its existence and pick it up
Hope this will help.
Thanks,
Nilesh

File adapter - how to make shure a file is complete for sender/receiver?

Hi everybody,
I want to use the file adapter and a question arises for both sender and
receiver:
On the sender: How does the PI know when a file is complete for reading?
Can this be a problem (PI starts reading the file when it is not complete?)
On the receiver: How does the receiver know when a file written by
PI is complete? Does PI support some kind of write to tmpfile then rename
schema?
Thanks for any suggestions
Best regards
Stefan

Hi Stefan,
On the sender: How does the PI know when a file is complete for reading?
Can this be a problem (PI starts reading the file when it is not complete?)
Yes, it could be a problem: Have a look at below from help.sap
Advanced Mode
To specify additional parameters in the adapter configuration, set the Advanced Modeindicator.
● Msecs to Wait Before Modification Check
Enter the number of milliseconds that the adapter must wait before it checks whether the files have been changed.
This parameter is not available if you have selected File Content Conversion as the Message Protocoland then made an entry under Recordsets per Message that splits an input file into several messages.
This parameter is applicable only for the File adapter. If you enter a value in this field when configuring the sender FTP adapter, it will have no effect.
Regards,
Carlos

Can File Adapter Select Based on File Age?

Is there a way to configure a File Sender communication channel to only pick up files that are at least 10 minutes old (been in the sending directory for that long)?
I want to avoid anything requiring an external process (ie. temp directory or outside scheduler moving files).
Thanks,
Keith

Hi Keith,
Do you mean, if the input file is still being written by some applications the File adapter is supposed to wait for the application before processing?
If so, you have the option Msecs to Wait Before Modification Check
Msecs to Wait Before Modification Check
Enter the number of milliseconds that the adapter must wait before it checks whether the files have been changed.
This parameter is not available if you have selected File Content Conversion as the Message Protocol and then made an entry under Recordsets per Message that splits an input file into several messages.
From SAP Help.
Regards,
Jaishankar

Empty file picked although file have lot of data in file adapter SAP PI

Hello All,
We are facing the weired behaviour of SAP PI file adapter channel.
In without mapping Scenario of 7.31
At some time whole file is archived properly in archive folder but in SAP PI log we can see the file size 0 bytes.
And at received side empty file will be sent.
But in actual there is lot of data in the file.
The same file triggered next time then it working fine.archived and sent as it is.
So can anybody help me for this ?what is the issue why sometime file with no data is picked by PI?
If file is pick up by PI before it is written completely by third party then is it possible that archived file will have all data as it although processed empty ?
Thanks in advance,
Anant

Hi,
Thanks for reply.
I know this is common issue of file picking before completing the process of file writting and also i can use Msec to wait before modification check for avoiding this but
my question is how the archived folder have the file with all data that sender is sending.
So is it possible that empty file (before compete writting )is picked up by sap pi and then after completing the picking process it will archive the file that is completely written by third party in source folder.
In other way file picking & File archiving is separate process means file that is picked is not archived but once pi processed the file then it will again check the source folder and archive and delete the same file.
Thanks
Anant

File adapter picking up partial files

Hi All,
We are facing a wierd problem with the File Adapter.
The problem is that, we are getting the xml files from the source system, and PI is supposed to pick them up and process them. Sometimes, the file adapter is picking up the empty files / partial files, i.e., before the file is completely written on to the FTP folder.
We tried increasing the polling interval. But this did not help. Since we are taking the files from the FTP, the option "MSecs" in Additional Parameters also will not work. As we are on PI 7.0 SP13, we tried to search for the "Empty File Handling" option wherein we can make the file adapter skip the 0kb files. But we are not able to find that option anywhere.
Please help us find a solution to this problem.
Thanks,
Hari.

Hari,
In sender communication channel click on Advanced. Then you see the paramter Msecs to Wait Before Modification Check. Add a value 3000. Then you should be good.
Regards,
---Satish

Selective Polling in the Sender File Adapter

Hi,
I have the following requirement
1) File X is placed in the directory which is the source file for the sender adapter to poll
2) File X is appended regulary with data until it is polled. During this appending the sender adapter should not poll this file
3) Current process (without PI) they use a control file to stop this happening. i.e. they place a File Y in the directory to show the file is being updated and not to be touched. Once The file is appended File Y is removed and the file should be polled
So ultimately I have to configure the sender adapter to poll for File X (say every minute) except when there is File Y in the directory.
Any ideas?

Hello,
You can use the "Msec to wait before modification check" feature in sender file adapter to achieve the requirement.
No need to place the "File Y"...i.e step 3 to perform.
Check the below link for more details:
http://help.sap.com/saphelp_nwpi711/helpdata/en/44/658ac3344a4de0e10000000a1553f7/frameset.htm
-Rahul

File adapter parameter "Msecs to Wait Before Modification Check" is gone

Similar Messages

Maybe you are looking for