XI Picking up an incomplete file

We have a scenario that an application writes out a file where XI is configured to poll for it. XI will pick up and move to a local file system. Sometime XI picks up a file while the other external process/application is actually writing out the file.
To verify our theory of behavior is wrote a custom java application that slowly streams out small bits of data to a file location that XI is polling for. The behavior of XI is consistent. XI does not does not seem to account for any type of file handler or anything like that.
Are we missing some configuration step in the File Adapter module.
Simple scenerio
Custom Java Application (file output) --- > XI --> local file system
Thank you for your time and responses
Whit Armstrong

Pls check the note...821267 and see the section 3. File Locking...
see if it makes sense to you...
you might want to try useing the "Msecs to Wait Before Modification Check" parameter in the advanced setting...
Thanks,
Renjith

Similar Messages

Sender File Adapter pulling Incomplete File - Throwing Alert with MSecsWait

Hi,
 We have sender File communication channel which is polling every 600 Secs. The directory where the files are available is basically an FTP Server directory. Vendors are putting file in this directory and PI is picking up from there.
 
Sometimes File CC is picking up incomplete files.
 
So, I set up Advanced Mode, additional parameter 'Msecs to Wait Before Modification Check' to 10000 (10Secs)
 
Now, it is not picking up incomplete files.
 
But, sometimes PI is trying to process files which are being written by Vendors and stopping the process because of 'Msecs to Wait Before Modification Check' and throwing an error and retrying to process in next polling. As far as stopping the process it si fine.
 
But, the problem is whenever it does this, PI is triggering an alert. We have bunch of Vendor Services and set up an alert rule for all Runtime errors.
 
My question is:
1) Is there any way we can stop sending alerts for this error and keep the generic alert rule ?
 
2) Or, is there any other way not to generate error and at the same time not to process incomplete files.?
 
The error we get is:
2009-11-11 13:10:12 Error Channel CC_XYZ_SENDER: Attempt to send file 'VendorXYZ.xml' failed because file was modified during processing. 2383872 bytes expected, 2678784 bytes found. Trying to resend file
Any pointers are really appreciated.
Regards,
Ramesh

Hi,
An alternative approach would be to have the vendors write the fles to a temporary ftp directory and have an OS script scheduled to move the files from the temporary directory to the directory from where XI picks the files.
This way, XI will not pick up partially written files.
Regards,
Ravi Kanth Talagana

Sender file adapter to pick up only 2 files at a time

Hi ,
I need to configure my sender file adapter in a way so that it picks up only 2 files at a time even though at FTP more files are placed.
Mudit Mehra

Hi,
As said above there is no such option to pick only 2 files at a time, however if possible you can create files in the sender/source directory in a manner that only two files are created at a time.
Thanks!

Pick up a specific file with File Sender Adapter.

Hi guys,
I would like to know how I can pick a specific file in a file pool (folder)? I would like to choose this file by name, like FileA or FileB, etc.
Im asking this because I have an asynchronous file scenario (BPM) with a receiver adapter that put the File with a specific name (variable substitution) in a folder.
And I would like to do something like this:
In another asynchronous scenario (BPM), a File sender adapter picks up this specific file (using the name). The correlation is made trough an IDOC that XI receives before pick up the file, this IDOC has payload field with the name of file to be picked.
Is it possible receives the IDOC, read the field with the name of the file to be picked and choose this specific file? In a Sender File Adapter how I can do something like variable substitution like receiver adapter does.
Thanks in advance,
Ricardo.

Hi,
Is it possible receives the IDOC, read the field with the name of the file to be picked and choose this specific file? In a Sender File Adapter how I can do something like variable substitution like receiver adapter does.
No this is not possible. The only dynamic thing you can do is use wild card characters like *.
So, maybe you can pick a file like . or AA. and so on...
Regards,
Bhavesh

Picking the abc.B file if abc.A file is present in source location.

Hi All,
I need to pick a file using SFTP adapter.
In the source location two files abc.A and abc.B are placed.
abc.A is placed only after abc.B is fully processed and complete.
I need to pick and process the file abc.B ,only after finding abc.A in source location.
only abc.B should be picked ,as abc.A file is just a indicator that abc.B is fully loaded and ready to be processed.
How this can be done in SFTP adapter?Please help.
Thanks,
Akkasali.

Best way to handle this is write some Unix Sxripting program at OS level copy the file B wheneve A file present in Folder,and create one more folder on FTP to store only B file,and connect to new folder using SFTP adapter .
it will avoide burden on implementing logic in PI side.it is bit simple too,as per my exp.
no standard feature available to acieve this type of requirement i think .
Regards,
Raj

How do I remove damaged or incomplete files from computer?

I have had difficulty removing about a dozen files from my computer. I have tried all resources that I possess including using the original installation procedure for Maverick (as described) to no avail. I've tried renaming, seeing if they are locked (they aren't) unlocking the bottom lock in the "Get Info" window, and still no luck. All files contain no bytes of information and some possess a "do Not Open" symbol (a shaded circle with a line through it) I get a message that says it can't be deleted because it is damaged or possibly incomplete files. Some are listed as tmp. files, "Image Capture," "1 Password, and "remove.rtf." I was able to rename them, ie. a single letter "u" but still no luck. Running ther latest Maverick on a MacBook Pro. Any help would be appreciated. A minor problem to be sure, nevertheless. . . . .

Quoting from the Help:
If you are an administrator for your computer, you can delete user accounts on your computer that are no longer needed.
When you delete a user account, you can choose to save the user's files or delete them.
IMPORTANT: If the user's account is encrypted (FileVault is turned on), turn FileVault off for the user before you delete the account.
Choose Apple menu > System Preferences and click Accounts.
If some settings are dimmed, click the lock icon and type an administrator name and password.
Select the user account you want to delete, then click Delete '-'.
Click OK to save the user's files on the computer, or click Delete Immediately to remove the user account and all the user's files.
If you saved the user's files, they are stored in a disk image in the Deleted Users folder, which is in the Users folder on your Mac OS X disk. To see the saved files, double-click the disk image in the Deleted Users folder. You can drag the disk image to the Trash to delete the files.
Note that you have to create a new admin user account for yourself before you proceed: you cannot delete the only admin account on the computer (which would leave you unable to do anything).

Damaged or incomplete files at launch

When I try to start up iTunes, i get the message 'Damaged or incomplete files'. I tried reinstalling and it din't work. I REALLY like iTunes so if you have an answer that would be great!

I would first refer you to Isolating issues in Mac OS X. If you can't get things resolved, then the next place to look would be Mac OS X: About the Archive and Install feature.

Clients not picking up changed application files

I created an application and deployed it to a collection containing 1 workstation. I needed to make a change to one of the files in the application, so I made the change in the source for the application, redistributed the content to my distribution
point and tried to run the updated application on the client.
The workstation will not pick up the changed file. I have run the Machine Policy check in, the User Policy check in, and the Application Deployment Evaluation Cycle multiple times to no avail.
We are just beginning our implementation of SCCM (converting from Altiris) and this is really frustrating me to no end.
Any help will be greatly appreciated.

There are multiple ways to check if the current version of the application is being installed. One of them is to check the AppEnforce client log file after triggering the installation.
That should show a line like the following, which includes the revision of the installed application:
<![LOG[+++ Starting Install enforcement for App DT "<DeploymentType>" ApplicationDeliveryType - ScopeId_A351EC12-B25C-4327-80EE-247F25E4CE55/DeploymentType_26778027-8288-4f4e-b588-f8259f85777d,
Revision - 6, ContentPath - C:\Windows\ccmcache\2, Execution Context - User]LOG]!>
My Blog: http://www.petervanderwoude.nl/
Follow me on twitter: pvanderwoude

Sender FTP picks up incomplete files while transfering...any clue?

Hi !!
After reading some posts, I understand that this problem has no complete solution yet. Am I right?
The "Msecs to wait before Modification check" advanced option, only works for NFS, not for FTP. I am using central adapter engine.
How about the Run OS Command BEFORE message processing...?? when does this OS command exactly runs ?? before mapping ?? after succesfully polling target directory?
Thanks
Matias

I was asking for a more detailed answer...specifically this: does the Run OS command BEFORE, runs:
- before the file adapter starts polling the source directory
- after file adapter found any file in the source directory
depending on the answer, I could run a shell script to "pre-rename" all files matching a condition, to ensure the poll finds them, or something like that...
Now I'm thinking that maybe it is not important...if it runs after founding a source file, those renamed files could be found by the adapter in the next cycle of the loop.
Thanks,
Matias.

PI 7.11 how to pick up only one file at a time in file adapter

Hi
Is there a smart way of only picking up one file at a time (for every poll) in a sender file adapter?
E.g. There are 100 files in the source folder but I only want to pick up 1 of the files every time I poll the source folder in my sender file adapter.
BR
Mikael

Thanks
I did something like this:
FOR /F %%I IN ('DIR
srv145.??????????\reload\files\*.* /B /O:-D') DO (
echo %%I
move
srv145.????????????\reload\files\%%I
srv145.??????????\DMI\out\nocontentconversion
exit /B 0

Picking a IDOC Flat File stored in SAP R/3 Application Server by SAP PI

Hi,
Can SAP PI pickup a IDOC Flat File stored in SAP R/3 Application Server Directory and send it back as an Inbound IDOC.
Scenario:
We have a data in the EXCEL Sheet, which will be used to a fill an IDOC and the IDOC will be just save in the SAP R/3 Application Server Directory, but can not be triggered due to its peculiar behavior. Afterwards, SAP PI should pole the SAP R/3 and pick up that IDOC Flat File from the R/3 Application Server and send it back to the SAP R/3 as an Inbound IDOC.
For Ref: IDOC does not have a Outbound Process Code, thus can not be triggered and send to SAP PI. It is always used as a Inbound IDOC in SAP R/3 system.
Regards,
Saurabh

SAP PI should pole the SAP R/3 and pick up that IDOC Flat File from the R/3 Application Server
If SAP PI = 7.11 --> /people/william.li/blog/2009/04/01/how-to-use-user-module-for-conversion-of-idoc-messages-between-flat-and-xml-formats
send it back to the SAP R/3 as an Inbound IDOC
why to send some information again into R3 which it already has? cant some internal code in R3 read the info from excel and then update the IDOC directly?

B2B not picking up the input file

Hi All,
I am trying to test aB2B scenario. Oracle B2B is not picking up the file from Endpoint URI. Can someone please suggest. What might be going wrong?
TIA
Phani

Hi Ramesh,
Its an inbound scenario. I've placed a file on the host ftp server from where B2B is configured to pick the files, which isn't happening.
Can you please tell me the possible reasons and the files which i've to look into in case of any errors.

Which user is used to pick-up and archive files using the file adapter?

Hi guys,
which one it is? is it XIPADM?
thank you,
Olian

Hi! Olian,
You can get archive the file from FTP Server also or else even you can kept the folderrs in your local machine also....its your choice..
Suppose if you want to Keep and archive directory or else a folder of another copy at which you are sending files from XI you can follow the below steps...
1. While configuring the Sender File Adapter you can select the option of ARchive directory ....there in File Adapter Parameters..
2. Select that radio button and then create first one seperate folder in FTP location and then you can enter that directory path name in the Archive directory 3. Also if you want to delete the files from where the XI is picking the files from the source directory means select option called Delete.......
3. Then automatically it will be deleted once the file is picked and also it can maintain another copy file in the archive folder or directory...
I hope it can be useful to you.and this is sufficent to you...
Regards:
Amar Srinivas Eli

Images cut from Microsoft Word document being picked up in the file size by Acrobat distiller

Hello All;
I have a large MS Word document (book manuscript) with almost 400 images (all grayscale) and found that the tiff images needed to be replaced with jpegs to reduce the file size. I created the jpegs, cut the tiff images from the document, and inserted the replacement jpeg image for each tiff image cut. It reduce the file size in Word from 595 Mb to 210Mb. However, when I ran the distiller, it is somehow picking up the file sizes of the tiff files as it still gives roughly the same output (595 Mb) for the Acrobat document. Is there a way I strip out the tiff image overhead from the pdf or a way I can cleanse it from the MS Word document? Thanks in advance.

Acrobat automatically compresses images when a PDF is made, usually doing something equivalent to JPEG (it's your choice, check the creation options).
So, changing from TIFF to JPEG in the original file will usually make not a bit of difference to the original file size.
There is no simple 1 to 1 connection between the size of a Word document and a PDF. Some things are bigger, some are smaller.
You can experiment with Save as ... optimized PDF settings. Also, use Audit Space Usage in that dialog to see what is using the space.

Pick up the input file if delta betweeb two files is 30%

Hi Experts,
A file is placed at the source folder..will it be possible for XI to check if previous file exists in that folder..
If yes then if th diffrence between both fields is greater than 30 % then pick up the file???
I do not see any which way it can be done in XI..
pls share ur thoughts..
Regards,
Teja
Edited by: Ravindra Teja on Jan 24, 2010 8:53 AM

Thanks Michal...
Yes this is a nice idea..lemme start off right away...
I ll have to put a . right???
any help onthe code???
Would ther be some blog on reading both files or how to read an attachment using adapter modules??
appreciate ur help
Edited by: Ravindra Teja on Jan 24, 2010 11:54 AM

XI Picking up an incomplete file

Similar Messages

Maybe you are looking for