File adapter picking up partial files

Hi All,
We are facing a wierd problem with the File Adapter.
The problem is that, we are getting the xml files from the source system, and PI is supposed to pick them up and process them. Sometimes, the file adapter is picking up the empty files / partial files, i.e., before the file is completely written on to the FTP folder.
We tried increasing the polling interval. But this did not help. Since we are taking the files from the FTP, the option "MSecs" in Additional Parameters also will not work. As we are on PI 7.0 SP13, we tried to search for the "Empty File Handling" option wherein we can make the file adapter skip the 0kb files. But we are not able to find that option anywhere.
Please help us find a solution to this problem.
Thanks,
Hari.

Hari,
In sender communication channel click on  Advanced. Then you see the paramter Msecs to Wait Before Modification Check. Add a value 3000. Then you should be good.
Regards,
---Satish

Similar Messages

  • Sender File Adapter picking the same file twice

    We are facing a weird issue with File Sender Adapter
    We are using PI File Adapter ( NFS ) to read files for a NFS folder and
    processing those in PI.Normally it works fine. But for a scenario we
    are noticing it sometimes process the same file twice before archiving,
    thus duplicating the financial postings.
    What we have is :
    File Sender Adapter - NFS, Polling interval 60 secs, and Processign
    mdoe Archive. File name includes Wildcards - JE_Upload*.txt
    what we are noticing is that :
    when it picks up a file, it immediately polls again to check for
    another file, and sometimes the file is not yet archived so it picks up
    and reprocess the same file.
    If you see the message below, both belong to the same file, and it
    picked up the same file again in 12 secs after processing it the first
    time
       Successful 02.11.2009 15:01:00 02.11.2009 15:01:01   APMANUAL     urn:bl:i2g:003:100
    SI_SKF_FIDOC_OB XI Message
       Successful 02.11.2009 15:00:49 02.11.2009 15:00:50   APMANUAL     urn:bl:i2g:003:100
    SI_SKF_FIDOC_OB XI Message
    Anyone seen this behavior before?

    Hi,
    Please check the script which creates file in source NFS Folders. There is possibility that script is making change in file when PI is picking up the file.
    When PI picks the file first time it creates one message ID in system. After that if script is making any change in file without file name change (This need not necessary data change), for PI it becomes new file and new message gets generated in PI for same file.
    This error normally comes when File adapter is not able to archive file succesfully. For eg. file with same name alredy exists in Archive folder.
    File adapter generates the new message id whenfile get modified(eg.change in its length or data change) even though
    the file name is same and when file get change ,XI file adapter thinks that its new file and hence generate the new message id for same file.
    If file has same name and notmodified then XI adapter will not generate new message id and will keep on throw the error till you remove that file with same name from the
    archieve directory.
    -Warm Regards,
    Gouri

  • File Adapter picks up the file but cant see it in MONI/Message Monitoring

    Hi
    I am using FCC in Sender File Adapter and have only one sub structure under Recordset hence I have not used the 'Key Field Name' though ''Key Field Type' by default is 'String(Case-Sensitive)'. Besides the 'fieldNames' heading I have mentioned all the fields of the sub structure in the same order as I have mentioned in the Data Type.
    The problem that I am facing is that even though the file is picked up from ftp successfully still I cant see any traces of it in either MONI or Message Monitoring though
    The error that I receive in the MDT is -
    Success : Entire file content converted to XML format
    Warning : Empty document found. Proceed without sending message
    Success : File "Test.csv" deleted after processing
    and I have data in the file.
    Can u suggest a solution?
    Warm regards,
    Vaibhav

    > Hey
    > >>So I have filled my test excel file with the values
    > A and B in adjacent columns
    > are you picking up some .xls file?if yes,then Content
    > conversion wont work,You have to create adapter
    > module processor and you have to add to your module
    > processor bean to the adapter...Just check the
    > following procedure...
    > https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/
    > 1967
    > Thanx
    > Aamir suhail
    Hi Aamir
    I had a look at the blog and according to that I will need to create a module...the prob with that is in the blog he hasnt provided the full steps for that. Also I had tried this thing earlier of using an excel file and saving it in .csv format and it had worked. I cant figure out what the error is this time
    Have u worked on creating amodule for excel files b4?
    Vaibhav

  • Sender File Adapter stop processing all files

    Hello all,
    the file adapter pick up all files in the directory by default.
    if  a large number of files are in the directory then this could slow down the pi processing.
    is there any way to process only one file per polling??
    regards

    >
    Ralf Zimmerningkat wrote:
    > Hello all,
    > the file adapter pick up all files in the directory by default.
    > if  a large number of files are in the directory then this could slow down the pi processing.
    > is there any way to process only one file per polling??
    >
    > regards
    I do not have any proble if you have got the answer. BUT this blog says how to exclude the other files from the same folder.
    Your Case: For example, Your Sender CC wants to pick up file ABC.txt from /xyz dir, now suppose there are 10 thousand files of same name in the dir and you want ABC.txt should be picked up one by one, So how this blog is going to help you. Can you Plz explain to me and others too?
    @Sachin may be you can throw some light on this... may be I am missing something.

  • File adapter picking up files with wrong content

    Hello, We configured a file adapter to read *.xml files. We also defined the xsd for the files. We expected that the adapter would only pick up files that conform to the xsd. However we found that all *.xml files (even renamed jpeg's) are read. Is this intended behaviour? Or did we miss some configuration setting?
    Richard

    A short follow-up:
    To make matters worse. If I take a completely different file (like the jpeg) and rename it .xml it gets picked up by the file adpater but there is no audit trail of the BPEL process instance. The file is not archived either, so it's completely gone! If I just change one of the elements the file is read and archived. I can also have the file adapter write the file with the wrong content.
    I found a reference to a bug. (bug 5926809 or SR 6327165.994) is this related, is it solved?
    Richard

  • File Adapter polls all the files from the directory when deployed again

    Hi,
    File Adapter polls all the files from the inbound directory irrespective of the timestamp when deployed again.
    For ex. when the BPEL process with file adapter is deployed, it starts polling the directory based on the timestamp as and when the directory is written with the files. I did not opt for deleting the files after read by the File Adapter.
    But, when BPEL process is modified and deployed again, this time, the file adapter picks up all the files in the inbound directory and doesn't consider the timestamp.
    My guess is that it should not pick all the files but based on timestamp only.
    I guess I can observe the same behavior if I bounce the Application Server also
    Do I have an option to achieve this?
    Thanks,
    Sasi Bhushan.

    try this:
    1- create a File object for the directory. (look at isDirectory() )
    2- create a File[] that represents the files in that directory. (.listFiles())
    3- if (file[x].isDirectory()) {recursive method call;}
    4- else {
    process file;
    If you want more help--do some work on it, and come back with specific questions relating to specific lines in your code and specific error messages you've been receiving.

  • File Adapter to read Zip file and send it as input to another webservice

    Hi,
    I have the below requirement:
    1. A service will generate 3 attachments and place it in a particular directory.
    2. SOA service has to pick those 3 files and send those files as input to another custom application which will email.
    Design :
    1. First SOA will create an archive file of those 3 attachements and then file adapter will poll for that zip file in that location and send that file as a whole to the custom application.
    Query:
    Now my question, is the above design feasible? If so, how to configure the file adapter to pass the file as input to that custom application?
    Kindly do the needful
    Thanks,
    Priya

    You can accomplish this via java embedding activity...Create a java embedding, which will create a zip file.. this java code is easy to implement..
    You can also do away with un-necessary polling file adapter.. and you can use "Synchronous File Read" operation of File Adapter.. For Sync Read, you'll have to pass the zip file name, which you can easily fetch from java embedding activity..
    Let me know, if this doesn't work.

  • File Adapter is not polling File.

    Hi All,
    I am using file adapter to poll a file. When I am restarting server then it is picking file. After then when I am dropping a file then File Adapter is not picking File.
    Can any one guide me what si problem?
    I am using SOA SUITE 10.1.3.4
    Thanks in Advance.

    First clusterGroupId is a unique value. Do not use the same clusterGroupId across different adapters even in different process.
    Once clusterGroupId is defined, the multiple activations of the same adapter Activation Agent is to be detected implicitly and automatically by all the instances of the adapter framework active in that cluster. The cluster will allow onlye one node activation to start the reading the files/messages. The adapter framework instances chooses one among multiple nodes, randomly to assume the Primary Activation responsibility. The other activations (instances) in the cluster will initiate to a hot stand-by state, without actually invoking EndpointActivation on the JCA resource adapter.
    If a primary activation at some point becomes unresponsive, is deactivated manually or if it crashes/exits, then any one of the remaining adapter framework members of the cluster group will immediately detect this, and reassign the primary activation responsibility to one of activation agents standing by.
    This feature uses JGroups underneath for the implementation, hence the clusterGroupId property. These features require cluster and JGroups configuration in collaxa-config.xml and jgroups-protocol.xml. All BPEL instances participating in the cluster must share the same cluster name in collaxa-config.xml,and the same multicast address and port in jgroups-protocol.xml.
    As far as for this issue, I too face the same across diff environments and searching for the exact reason. I believe this happens when primary activation agent crashes, the hand-over to the other node is not happening properly through jgroups.
    Nirav

  • File adapter reading while the file is still being written....

    Hello BPEL Gurus,
    I had a quick question around BPEL or ESB file adapter. Does BPEL file adapter starts reading a huge file that is being written or it waits until the writing process is completed and file is complete?
    Any response is highly is appreciated.
    Thanks.
    SM

    It goes like this. At every polling frequency, the adapter looks into the directory for the files with specified pattern (e.g. *.csv, MYCOMPANY*.txt) and specified condition, e.g. minimum file age. This means if there will be 2 files available with matching criteria, the both will be picked up and processed simultaneously in two different BPEL instances. No specific order of execution. However you will find the instances in BPEL console with little delay based on file size.
    Perhaps you can elaborate your scenario further. Do we have knowledge of the file name that are to be picked up from the folder. You may use synchronous read option. If you are using 10.1.3.4 version then you can specify the file name before file adapter makes a synchronous read into the give directory.

  • XI File Adapter sending/receiving zip files

    Can the XI File Adapter create a zip file to send outbound from XI and/or can it also translate a zip file inbound into XI?

    Hi Kirk.
    What you can do is use the OS command option on the adapter in order to unzip the file after the File\FTP adapter completes its file transfer to the specified path.One of my colleagues used a freeware zip app. that excepts an os command actions.
    I know it works for file receiver but not sure about the sender. check SAP Note 801926 for more sender adapter parameters.
    Regards
    Nimrod Gisis

  • NFS File adapter donu00B4t generate log file.

    Hello!
    We have a problem with a File adapter. when adapter catch file, this one don´t archive this file into archive directory.
    We have:
    Processing mode: Archive.
    Archive directory : /XIcom/INT181_GECAT/LOG
    This directory is created correctly.
    Someone can i help me. Thanks.
    Best regards.

    Hi ,
    >>>NFS File adapter don´t generate log file
    Do you mean you are not getting the processed files archived only when the file adapter set to NFS File system ?
    Did you try same thing by setting File adapter as FTP ?
    If you face same issue with File adpter set in FTP mode also then there is some issue with access to the folders.
    Please check this ...
    Regards,
    Nanda
    Message was edited by: Nanda kishore Reddy Narapu Reddy

  • Sender File Adapter: Picking of Files

    Hi,
    I have a requirement where in my file adapter has to pick files from a FTP server after 10 minutes of its creaion on the FTP server. Some application will place file on this FTP server exactly after 10 minutes of its creation on this FTP server only it should be picked by the sender File Adapter. Is there any way to achieve this? Please provide me your thoughts on resolving this.
    Thanks,
    Vijay Kumar T.

    >
    Vijay Kumar Thirumareddi wrote:
    > Hi,
    >
    > I have a requirement where in my file adapter has to pick files from a FTP server after 10 minutes of its creaion on the FTP server. Some application will place file on this FTP server exactly after 10 minutes of its creation on this FTP server only it should be picked by the sender File Adapter. Is there any way to achieve this? Please provide me your thoughts on resolving this.
    >
    > Thanks,
    > Vijay Kumar T.
    as mentioned by suraj, the ideal way is to have a spearate folder where the files will be moved after the 10 minutes of its creation.
    PI/XI will poll this folder and pick files.
    out of curiosity, can i know why there is such a requirement of 10 min?

  • File adapter picking

    hi experts,
                      iam facing a problem in testing the file scenario i had developed. message monitoring and channel monotoring shows succesful messages. but, the file was not picking from the source folder.
    i have access to ftp server but i cannot copy or paste the files within the server. iam accessing the xi server (dev)server through vpn . ftp also belongs to dev . iam accessing it through anonymous login. will i need to get more access to pick the file. please help

    HI chiru,
    do u access the files from FTP or local machine, if it is an FTP do check with the authorizations  of the folder first  and then check in the sender communication channel attributes i,e SET processing mode as delete it may be in Test mode and if it is OK.. then
    go to Runtime Work Bench and choose component monitoring and from there choose adapter and go for communicatioin channel monitoring and there u just give the sender communication channel name and see the status of the communciation channel if it is ok the file is successfully picked by the adapter.. and then go and check with SXMB_MONI whether the file is processed or not..
    For file adapter configuration follow this
    http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/frameset.htm
    reply if problem is not solved..
    regards,
    Kishore

  • File Adapter -- Picking has to wait untill it get fully loaded/write.

    Hi All,
    I need to pick the files from a folder and I need to pick the files only which has been written completely.
    I should not pick the file in the middle while writing, I need to wait untill it finishes the writing completely.
    Is there any setting I can put in Sender File adapter to do this?
    Thanks
    Seema

    Nithya,
    >> Try to increase the processing time in the sender communication channel, so that it allows you to completely load the file. Check the time which is needed to upload the file to the directory manually and correspondingly change the processing time.
    We do not know exactly at what time the file will be placed in the folder. It may be at any time. So I cannot put the processing time accurately.
    Aamir,
    >> If you are picking from FTP,MSecs wont work there.the sender program which writes the file must write the file in some temporary format like .dat etc and once the file is complete it should change the filename to .txt,configure the sender file adapter to pick only *.txt files.
    This is a good idea. But I don't think I can ask them to change at the other end as it is working previously with other middleware.
    Guys,
    Can you please advice which is the best thing we can do at this point of time.?
    Thanks
    Seema.

  • File Adapte picking up XML if XSD valid without verifing the XSD in adapter

    hi',
    I am facing one issue
    I have a sample XML file which I want to read through BPEL process
    for this I have configured the file adapter with the schema and reading the file adapter with the receive activity
    next I have created one XSD file (which file adapter referes to) and one XML file,
    File adapter reads it after the XML file gets validated with the XSD which is kept in a location *'/test/xsd/emp.xsd'*,
    now the issue is that the file adapter is picking up and initiating the process without verifying the XSD mentioned in the adapter
    it is only checking the XML file with the XSD mentioned in the XML,
    for example if I have a xml file which is refering to some other schema it also gets read by file adapter without worring about what schema is mentioned in file adapter
    please advice me is this the way File adapter works in Oracle BPEL or I am doing some thing wrong
    I am using SOA suite 10.1.3.3.0 which is deployed in UNIX enviornment.
    thanks
    Yatan

    thanks Ketan ,
    as you suggested, after adding validateXML to true, the XML is getting validated to the XSD in the adapter,
    the process is getting invoked and the receive activity is throwing error of 'Invalid XML', this is perfect as I expected
    however now the issue is, the file which is invalid in terms of XSD present in the file adapter is still being archived to 'success dir' i.e. 'LogicalArchiveDirectory', ideally it should have moved to fail directory,
    but if the XML file is not complete or having some error in terms of the XSD it is refering to 'target namespace' and 'target location'
    then it will move to the fail directory and the receive activity is also showing the error,
    see this is how I have configured my bpel.xml file for the file adapter.
    <activationAgents>
    <activationAgent className="oracle.tip.adapter.fw.agent.jca.JCAActivationAgent" partnerLink="Read_Tph_ProdTrans_File">
    <property name=*"prod_trans_success_file" type="LogicalArchiveDirectory"*>/aaa/bb/ccc/wis/tph/bpl_inbound/adjust/success</property>
    <property name=*"prod_trans_incoming_file" type="LogicalDirectory"*>/aaa/bb/ccc/wis/tph/bpl_inbound/adjust/new</property>
    <property name="portType">Read_ptt</property>
    <property name="rejectedMessageHandlers">file:///aaa/bb/ccc/wis/tph/bpl_inbound/adjust/fail</property>
    </activationAgent>
    please advice how to bring this adapter to proper behaviour.
    thanks
    Yatan

Maybe you are looking for