FTP Adapter duplicate processing of files in Active-Active cluster env

Hi All,
We have single active-active cluster environment and we have configured all the HA configurations for Inbound and Outbound operations (except outboundDatasourceLocal). But we faced a situation that the FTP Adapter processed a file twice. This happened when there was a fail-over in oracle database in where SOA-INFRA schema is created.
Please let me know if anyone faced similar issue and what would be the resolution for this duplication issue.
Thanks in Advance.

Hi Vernetto,
Thanks for your reply.
I too had opened a ticket with oracle and they are looking into the issue.
can you please let me know what are the inbound and outbound operation configurations you have specified in the 'outbound connection pools'. Also is there any other specific property you set in jca file?
one more thing is, we have configured outboundLockTypeForWrite to 'oracle' as we are using the oracle database. but i couldnt see any data in FILEADAPTER_IN or in FILEADAPTER_MUTEX tables. you said you could see data in FILEADAPTER_IN table. so is there any specific property requires to be set which i am missing?
please suggest.
Thanks.

Similar Messages

  • 10.1.3.4 - ESB FTP adapter not processing the files in the input directory

    I created a process that reads from a logical inputDir. I migrated the ESB service to another box and created the same adapter connection etc. however nothing really happens in this new environment. In the opmn.log i see the following statements and no other info.
    2008-12-16 14:03:41,994> <INFO> <collaxa> <ServerManager::loadProcesses> Done loading processes for all domains
    <AdapterFramework::Inbound> Instantiating inbound part of Adapter Framework instance: OraESB
    <AdapterFramework::Inbound> Adapter Framework instance: OraESB - endpointActivation for portType=Get_ptt, operation=Get
    <AdapterFramework::Inbound> Creating new instance of Resource Adapter oracle.tip.adapter.ftp.FTPResourceAdapter
    <AdapterFramework::Inbound> Adapter Framework instance: OraESB - starting Resource Adapter oracle.tip.adapter.ftp.FTPResourceAdapter
    <FTP Adapter::Inbound> File/FTP Adapter started successfully.
    <FTP Adapter::Inbound> ENDPOINT ACTIVATION CALLED IN FTP ADAPTER
    <AdapterFramework::Inbound> Adapter Framework instance: OraESB - successfully completed endpointActivation for portType=Get_ptt, operation=Get
    <FTP Adapter::Inbound> Connection Created
    <FTP Adapter::Inbound> Connection Created
    The last message "Connection Created" keeps repeating, but no processing occurs. I tried increasing all the loggers to finest. but still nothing happens.
    any idea how to troubleshoot this ? the only difference in the environment is that the new environment has 10.1.3.4 MLR2 and the first one is just plain 10.1.3.4

    Make sure that you modified the oc4j-ra.xml file in the FtpAdapter directory and have put the correct hostname and username and password. The directory structure looks like this //some-directory/oc4j_soa/application-deployments/default/FtpAdapter/oc4j-ra.xml.

  • Need Help on FTP Adapter Archival Process

    Hi Guru's,
    I implemented FTP Adapter for Inbound Operation to read the file from inbound directory and after reading the file should be archived in Archival Directory and Delete the file from directory from inbound directory.
    In my case file is successfully picked from inbound directory and records inserted in to database table. File is not Archiving in Archival Folder and File deleted from Inbound Directory. Here I need to Archive the files in Archival Folder.
    Thanks in Advance
    Could you please help me in this regard and Please provide pointers to me

    <property name="UseRemoteArchive" value="true"/>
    Set this property to "true" to notify the Oracle FTP Adapter that the archival directory is on the same FTP server. If set to "false", the Oracle FTP Adapter uses a local file system folder for archival.
    for more Information here to go : http://docs.oracle.com/cd/E15523_01/integration.1111/e10231/adptr_propertys.htm#CHDEDJEA
    Regards,
    MS Raghava

  • FTP adapter --- Not picking up files

    Hi,
    I have set up an FTP adapter in archive mode to read files from FTP server and process it while archiving a copy of it. I have set up Poll interval at 40 secs and retry interval also set up. It works great the first time . Processes the file and archives it. But when the same files comes in again in the FTP server, I see the foll. message in the adapter monitor "Error: Stopped due to error: com.sap.aii.adapter.file.ftp.FTPEx: inputdat.txt: No such file or directory: No such file or directory."..The file exists in the FTP server but its not processed..I am not sure what I am missing...
    -Teresa

    Hi Michal,
      I have timestamp set up for archive directory..So every run will create an archive file with timestamp..But the input filename remains the same..Archive functionality would remove the file inthe FTP server..So when the file comes again into the FTP server, the FTP adapter doesn't trigger automatically. Everytime I had to activate the IB for FTP adapter to trigger the process. I know this is not how XI-FTP adapter should work..Our scenario is we would receive weekly files into the FTP adpater with the same name. We need to archive each weekly file and also send it for further processing..I can't be activating the process manually ....I know something is going wrong but can't figure it out...:(..Any help is appreciated...:)
    -Teresa

  • HA File Adapter still processing same file twice

    We are using the eis/HAFileAdapterMSSQL to watch for ZIP files that get dropped into a directory. We are running SOA Suite 11.1.1.6 on WebLogic 10.3 with a 2-server cluster. We set our PollingFrequency to 120 seconds.
    When our ZIP files are small enough to where our BPEL process (which does some unzipping and merging of files therein) completes within those 120 seconds, everything is fine. One, and only one, node in our cluster processes the file.
    But when the ZIP files are large, and our BPEL process takes 30 minutes to complete (i.e. longer than the 120 second polling frequency), we see a new instance of the BPEL process on soa_server1 start as expected, then second process instance start on our soa_server2 instance 120 seconds later.
    It's almost as if, if the entire BPEL process - which is kicked off by the HAFileAdapterMSSQL - does not complete within our polling frequency, then the file is not being blocked from other servers in our cluster picking it up and start processing it. Is there a way to "lock" the file with the first instance of the HAFileAdapterMSSQL that picks it up until it's completely finished with it?
    Has anyone encountered this?
    Thanks,
    Michael

    You need to define the below property in composite.xml file of your bpel. This will allow only one adapter active and another passive to pick up the file.
    <activationAgents>
    <activationAgent className="oracle.tip.adapter.fw.agent.jca.JCAActivationAgent" partnerLink="PickupFile/FTPConsumer">
    *<property name="clusterGroupId">BPELProcessNameCluster</property>*
    <property name="portType">FTP/FileConsumer_Message_ptt</property>
    </activationAgent>
    </activationAgents>
    Thanks,
    Vijay

  • FTP Adapter to read multiple files from a directory. Not through polling.

    Dear Friends,
    I would like to know is it possible to configure the FTP adapter in Oracle BPEL 10.1.3.4 to read multiple files (different names, same structure) from a given directory. I do not want the BPEL to do a polling. Instead when I submit the BPEL process it should read all files from the directory.
    I was looking at the option of Synchronous read but I am not able to specify wild card in the file name field. I do not know the file names at the time of reading.
    Thanks for your help!

    Hi,
    While you read the file, you can configure an adapter property in 'Receive'. This will store the filename, this filename can be used for sync read as the input parameter.
    1. Create a message type variable called 'fileheader'. This should be of type Inboundheader_msg (whatever relevant Receive activity).
    2. This variable will contain three parts - filename, FTPhost, FTPPort
    3. Copy this fileheader to 'Syncheader'.
    4. syncheader can be passed as an adapter proerty during sync read of the file.
    During Receive and Invoke, you need to navigate to 'Adapter' tab to choose the created message type variable.
    Let me know if you have further questions.
    regards,
    Rev

  • Problem in FTP adapter ( Duplicate)

    Hi all,
    We have a composite that query the events from Oracle on demand CRM. Event contains key column which is used to fetch all related values.
    Using FTP adapter, we are placing the file in SAP and also one copy using file adapter in our local server for our reference.
    Problem :
    SAP is receiving two files in their inbound folder at same time stamp for one transaction.
    But in our local server, we are receiving one file only.
    So we isolated the problem to FTP adapter.
    When we analyzed the process and its audit trail, everything looks fine and FTP operation is called one time only.
    We are clueless regarding this problem.
    Also same interface works well in Production instance. We even tried deploying new composite that is freshly downloaded from Production.
    We need this to fix this by Wednesday as UAT begins in Test environment and that needs this interface to work fine.
    We have clustered environment and 2 SOA servers.
    Please someone help us identifying the problem. Its very urgent
    Thanks,
    Sundar

    Hi it may be the problem with the environment. Try adding the property <property name ="singleton">true</property name> in the composite.xml for the FTP adapter or at the server level.
    Swami

  • FTP Adapter to poll multiple files (different formats)

    Hi,
    We have a requirement to poll and process multiple files from a given FTP location(either process all or reject all - reject if there is any failure in one of the files).
    Using FTP Adapter's Get File operation(Schema Opaque), we are able to read three different file formats and can get the file name(Using header variable FileName).
    And we are hoping to process the file contents based on the File Name that we get from the above step.
    1) How do we convert the file contents from Opaque to specific Schema (ex: file1.csv, file2.csv and file3.csv with different formats)?
    2) As the requirement is to process all the files at the same time, Can we use correlation in the poller process to route to single controller process(One instance of Controller process for all the files)?
    Any help would be much appreciated.
    Thanks...

    Thanks a lot for the quick answers.
    I've used the Java embed to convert Base64 content to String. And using 'translateFromNative' extension, I could convert it to the desired XML content.
    But I still have trouble in polling and processing all the files(file1.csv, file2.csv and file3.csv) at the same time using a single controller process.
    My requirement is to process all the three files at the same time(for any failures I have to compensate any/all of inserted records).
    I tried using Pick(with different OnMessage branches), but as they are polling the same location I could see only one OnMessage branch is getting fired resulting in multiple instances.
    May be I didn't understand your suggestion correctly, could you please elaborate on the possibility of processing multiple files at the same time?
    Thanks

  • How to stop the last rnto to be issue by the ftp adapter when downloading a file.

    The company that processes the ftp documents for a partner is a VAN and has a process where the ftp file sent is immediately moved to an archive upon download. The ftp adapter wants to rename the file after the download completes but the originally
    downloaded file is already gone and an error is returned.
    Is there a way to not issue the rnto or have the server process wait until the script is complete before moving the file.
    I don't have the time to write a custom ftp adapter, maybe a dotnet helper ftp process.
    Is there something simple  that can be done.
    Thanks
    Bico Bielich

    Maybe you can't if changing the Spool Folder doesn't change the behavior.
    Does the trading partner have or can they create a temp folder you can use?  You might even be able to create your own with a pre-command script.

  • FTP Adapter not picking flat file

    Hi,
    I am trying to upload a simple flat file using FTP adapter
    I have done all the configuraion setings & mapping program as well. But when i used the tcode SXMB_MONI for monitoring, it says "no message available".
    Plz help.
    Ragards,
    Rajat

    Hi,
    Check these~
    /people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
    /people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
    http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/frameset.htm
    http://help.sap.com/saphelp_nw04/helpdata/en/bc/bb79d6061007419a081e58cbeaaf28/content.htm
    /people/shabarish.vijayakumar/blog/2006/04/03/xi-in-the-role-of-a-ftp
    Mark Helpful Answers
    Hope this helps,
    Regards,
    Moorthy

  • Sender File Adapter stop processing all files

    Hello all,
    the file adapter pick up all files in the directory by default.
    if  a large number of files are in the directory then this could slow down the pi processing.
    is there any way to process only one file per polling??
    regards

    >
    Ralf Zimmerningkat wrote:
    > Hello all,
    > the file adapter pick up all files in the directory by default.
    > if  a large number of files are in the directory then this could slow down the pi processing.
    > is there any way to process only one file per polling??
    >
    > regards
    I do not have any proble if you have got the answer. BUT this blog says how to exclude the other files from the same folder.
    Your Case: For example, Your Sender CC wants to pick up file ABC.txt from /xyz dir, now suppose there are 10 thousand files of same name in the dir and you want ABC.txt should be picked up one by one, So how this blog is going to help you. Can you Plz explain to me and others too?
    @Sachin may be you can throw some light on this... may be I am missing something.

  • FTP Adapter to read 2 files(eg: readme.txt & readme.dummy)

    How do I specify FTP Adapter to only pick readme.txt only if there is a dummy file readme.dummy (0 byte) is in the folder?

    That's not possible.

  • How can ftp-adapter overwrite an existing file

    Hi,
    I have an ftp-adapter that I want to overwrite an existing file when publishing a new message. I want the receiving application to handle only the latest file (==state of an export)
    now my ftp-adapter logs an error if the file it wants to put already exists.
    Is there a parameter that can set this??
    thanks,
    Ton

    You can use the file.sender_customizer_class property in the adapter.ini to hook in your implemented FileSenderCustomizer class where you can use your own logic in the GenerateFileName method. This is a possibility to create a unique file name per run.
    Kind regards, hope it helps

  • Sender File adapter to process each file with time gap

    Hi All,
    I have a sender file adapter which is picking 2 files in a folder. I want to delay the processing of each file by 5 minutes. For ex: PI should process the first file, then wait 5 minutes and the process the next etc.  Is this achievable ?
    Is there a way  to create 2 sender agreements if I create 2 separate comm channels for each file .
    I am using PI 7.0
    Edited by: Dev Noronha on Sep 17, 2010 8:48 AM

    Hi Sarvesh...
    U r correct ... but i am nt wrong.... Just joking...
    S u r correct in normal cases..
    But this interface also involves BPM too.....
    Dev didnt mention the whole prblm in clear....
    The prblm is as following..
    When he runs the CC at sender , if u have multiple files, then every file will initiate a BPM instance.
    And in turn every BPM instance is waiting fr a message from PROXY....
    The proxy messages coming from the ECC are not able to go fr exact BPM instance..
    Eg: 2 Proxy message gng fr 1 BPM instance...etc..
    FYI , no correlation on the messages....
    Babu

  • FTP Adapter not writing the file in FTP directory

    We have desiged BPEL Process which will get data from Oracle and write in txt file in FTP directory.
    For last few days, we are getting following error when we invoke the BPEL Process:
    file:/u102/product/10.1.3.1/OracleAS_1/bpel/domains/default/tmp/.bpel_XXADS_INT033_DEL_EBS_OUT_1.0_0be42a99260084d9bd5104929a8ac1b2.tmp/DELFTPservice.
    wsdl [ Put_ptt::Put(opaque) ] - WSIF JCA Execute of operation 'Put' failed due
    to: Error saving control file.
    Error saving control file: "/u102/product/10.1.3.1/OracleAS_1/j2ee/home/fileftp/controlFiles/ZmbNdvlpVkaee+
    OddQzH2Q==/outbound/controlFile_ob.properties"
    ; nested exception is:
    ORABPEL-11080
    Error saving control file.
    Error saving control file: "/u102/product/10.1.3.1/OracleAS_1/j2ee/home/fileftp/controlFiles/ZmbNdvlpVkaee+
    OddQzH2Q==/outbound/controlFile_ob.properties"
    Please make sure that a valid control file exists.
    Can anyone help me to resolve this?
    Thanks,
    Hariharan Ramakrishnan

    I tried to redo the config objects but still the same issue is there. anyone has any idea

Maybe you are looking for