FTP Adapter to poll multiple files (different formats)

Hi,
We have a requirement to poll and process multiple files from a given FTP location(either process all or reject all - reject if there is any failure in one of the files).
Using FTP Adapter's Get File operation(Schema Opaque), we are able to read three different file formats and can get the file name(Using header variable FileName).
And we are hoping to process the file contents based on the File Name that we get from the above step.
1) How do we convert the file contents from Opaque to specific Schema (ex: file1.csv, file2.csv and file3.csv with different formats)?
2) As the requirement is to process all the files at the same time, Can we use correlation in the poller process to route to single controller process(One instance of Controller process for all the files)?
Any help would be much appreciated.
Thanks...

Thanks a lot for the quick answers.
I've used the Java embed to convert Base64 content to String. And using 'translateFromNative' extension, I could convert it to the desired XML content.
But I still have trouble in polling and processing all the files(file1.csv, file2.csv and file3.csv) at the same time using a single controller process.
My requirement is to process all the three files at the same time(for any failures I have to compensate any/all of inserted records).
I tried using Pick(with different OnMessage branches), but as they are polling the same location I could see only one OnMessage branch is getting fired resulting in multiple instances.
May be I didn't understand your suggestion correctly, could you please elaborate on the possibility of processing multiple files at the same time?
Thanks

Similar Messages

  • FTP Adapter to read multiple files from a directory. Not through polling.

    Dear Friends,
    I would like to know is it possible to configure the FTP adapter in Oracle BPEL 10.1.3.4 to read multiple files (different names, same structure) from a given directory. I do not want the BPEL to do a polling. Instead when I submit the BPEL process it should read all files from the directory.
    I was looking at the option of Synchronous read but I am not able to specify wild card in the file name field. I do not know the file names at the time of reading.
    Thanks for your help!

    Hi,
    While you read the file, you can configure an adapter property in 'Receive'. This will store the filename, this filename can be used for sync read as the input parameter.
    1. Create a message type variable called 'fileheader'. This should be of type Inboundheader_msg (whatever relevant Receive activity).
    2. This variable will contain three parts - filename, FTPhost, FTPPort
    3. Copy this fileheader to 'Syncheader'.
    4. syncheader can be passed as an adapter proerty during sync read of the file.
    During Receive and Invoke, you need to navigate to 'Adapter' tab to choose the created message type variable.
    Let me know if you have further questions.
    regards,
    Rev

  • I want my file adapter to poll multiple locations in soa 10g

    Hi All
    I had a requirement that "I want my file adapter to poll multiple locations in soa 10g".I came to know that in soa 11g it is possible.
    I want this to be done in soa 10g.
    plz help me.
    thanks,
    krishna

    You can have pick activity and have separate ftp adapter for each folder, but you will be using the same jndi in all pick activity.
    In that way you can have multiple ftp adapter but uses the same jndi by increasing the performance.
    User will be configured to a home location, example as below.
    say a ftp user "adminuser" is configured to a default folder c:/ftp_files
    You can create multiple folders under the same folder like below.
    c:/ftp_files/location_a
    location_b
    location_c
    location_d
    For each location have a separate ftp adatper, but all of them uses the same jndi while defining the path you have to change according to the above folder.
    Let me know how this goes.
    - It is considered good etiquette to reward answerers with points (as "helpful" - 5 pts - or "correct" - 10pts).
    Thanks,
    Vijay

  • FTP Adapter not polling

    Hi,
    We have a clustered environment in Oracle SOA 10.1.3.4 MLR#1. We are setting up 3 different bpel processes polling 3 different locations and using 3 different data source. When we deploy them none of the ftp polling is working. We looked at various blog and added property for ClusterId
    <property name="clusterGroupId">myBpelAdapterCluster</property>
    I also tried using a different clustergroupid for each of the bpel process.
    Does this clusterGroupId should be different for each BPEL process or can we use myBpelAdapterCluster for all 3. Please suggest me what may be the cause for the ftp adapter not polling.
    Thanks
    Jagan.

    I was contacted by our DBA team for an exception received while writing a file to a FTP location.
    Then i looked at the exception message and asked them to check the whether they are able to contact the ftp server using command prompt then they said the user password got expired.
    They reset the password and its working now.
    Am i missing something here :(
    Exception:
    WSIF JCA Execute of operation 'Put' failed due to: Error sending file to FTP Server.
    Unable to send file to server.
    ; nested exception is:
    ORABPEL-11429
    Error sending file to FTP Server.
    Unable to send file to server.
    Please ensure 1. Specified remote output Dir has write permission 2. Output filename has not exceeded the max chararters allowed by the OS and 3. Remote File System has enough space.
    Thanks,
    Vijay
    Edited by: veejai24 on 25-Jul-2012 07:10

  • FTP Adapter stops polling on updating descriptors in BPEL Console

    I have a bpel process activated by a file in a FTP dropzone. An FTP Adapter listens to this dropzone. I have set up a few preferences (Deployment descriptors) for this process. Once when I update any of these user defined preferences, ftp adapter stops polling the dropzone.
    Any idea why this happens?
    Workarounds?

    Hi Shishir,
    Bouncing the server working most of the times, which might not be possible all the time in case of production environments ;/
    Do you find any errors on the logs when the cube engine and activation loggers are set to DEBUG ?
    Could you please mail me your project to [email protected] ?
    Regards
    A

  • Sender file adapter not polling the file

    hi all,
    i have configured a filexifile scenario....
    but the file sender adapter is not polling the file at all....
    i dont c any message either in RWB or in SXMB_MONI
    i checked the adapter framework url at <i>http://<ximachine>;<port>/AdapterFramework</i>....and the status for the file adapter is green...
    but the message it gives there is
    <i>Sender Adapter v1014 for Party '', Service 'TASL_FILE_SENDER':
    Configured at 03:07:24 2006-02-02
    Up and running - no message processing until now
      last poll interval started 04:01:24 2006-02-02
      length 60,000 secs</i>
    y is the sender adapter not polling the file..
    i am using NFS as my File System....i gave the source directory as <i>d:/test_dir/</i>
    is this way of specifying the source directory on a windows machine correct...
    thanks
    pavan

    There is probably something wrong with the File Adapter.  You will need to go to the RunTime Workbench >> Component Monitoring >> Display >> Click on the Adapter Engine >> More information will display and click on the button 'Adapter Monitoring' >> A new window will display and click on the arrow next to your adapter engine.  This displays a list of adapters running on your system.  Green light means good; Red, you have a configuration problem.  Look at the error and try and resolve it.

  • Do I need FTP server to poll a file

    Hi,
    i am trying to do file to file scenario. I have technical system which is different than XI system. in this case my technical system has to be FTP server to send a file or not necessarily.
    I am trying to poll file from windows machine to XI system and send back the file again to windows system.
    I added my windows machine as technical system and created bunisess system.
    In C, i have my file.
    But, it is not polling at all. What to give source and target directory while configuring adapters.
    thanks,
    Srinivas

    Hi,
    i am trying to do file to file scenario. I have technical system which is different than XI system. in this case my technical system has to be FTP server to send a file or not necessarily.
    Yes, you need FTP connection in order to access file on 3rd system( Not XI)
    You need to create FTP  Username / password connection to your windows system. Then you can specify this in File adapter with FTP connection details.
    Also check the FTP root directory for username which you are going to use to access Windows system and specify path accordingly.
    Hope this will help.
    Nilesh

  • FTP adapter --- Not picking up files

    Hi,
    I have set up an FTP adapter in archive mode to read files from FTP server and process it while archiving a copy of it. I have set up Poll interval at 40 secs and retry interval also set up. It works great the first time . Processes the file and archives it. But when the same files comes in again in the FTP server, I see the foll. message in the adapter monitor "Error: Stopped due to error: com.sap.aii.adapter.file.ftp.FTPEx: inputdat.txt: No such file or directory: No such file or directory."..The file exists in the FTP server but its not processed..I am not sure what I am missing...
    -Teresa

    Hi Michal,
      I have timestamp set up for archive directory..So every run will create an archive file with timestamp..But the input filename remains the same..Archive functionality would remove the file inthe FTP server..So when the file comes again into the FTP server, the FTP adapter doesn't trigger automatically. Everytime I had to activate the IB for FTP adapter to trigger the process. I know this is not how XI-FTP adapter should work..Our scenario is we would receive weekly files into the FTP adpater with the same name. We need to archive each weekly file and also send it for further processing..I can't be activating the process manually ....I know something is going wrong but can't figure it out...:(..Any help is appreciated...:)
    -Teresa

  • 10.1.3.4 - ESB FTP adapter not processing the files in the input directory

    I created a process that reads from a logical inputDir. I migrated the ESB service to another box and created the same adapter connection etc. however nothing really happens in this new environment. In the opmn.log i see the following statements and no other info.
    2008-12-16 14:03:41,994> <INFO> <collaxa> <ServerManager::loadProcesses> Done loading processes for all domains
    <AdapterFramework::Inbound> Instantiating inbound part of Adapter Framework instance: OraESB
    <AdapterFramework::Inbound> Adapter Framework instance: OraESB - endpointActivation for portType=Get_ptt, operation=Get
    <AdapterFramework::Inbound> Creating new instance of Resource Adapter oracle.tip.adapter.ftp.FTPResourceAdapter
    <AdapterFramework::Inbound> Adapter Framework instance: OraESB - starting Resource Adapter oracle.tip.adapter.ftp.FTPResourceAdapter
    <FTP Adapter::Inbound> File/FTP Adapter started successfully.
    <FTP Adapter::Inbound> ENDPOINT ACTIVATION CALLED IN FTP ADAPTER
    <AdapterFramework::Inbound> Adapter Framework instance: OraESB - successfully completed endpointActivation for portType=Get_ptt, operation=Get
    <FTP Adapter::Inbound> Connection Created
    <FTP Adapter::Inbound> Connection Created
    The last message "Connection Created" keeps repeating, but no processing occurs. I tried increasing all the loggers to finest. but still nothing happens.
    any idea how to troubleshoot this ? the only difference in the environment is that the new environment has 10.1.3.4 MLR2 and the first one is just plain 10.1.3.4

    Make sure that you modified the oc4j-ra.xml file in the FtpAdapter directory and have put the correct hostname and username and password. The directory structure looks like this //some-directory/oc4j_soa/application-deployments/default/FtpAdapter/oc4j-ra.xml.

  • FTP Adapter not picking flat file

    Hi,
    I am trying to upload a simple flat file using FTP adapter
    I have done all the configuraion setings & mapping program as well. But when i used the tcode SXMB_MONI for monitoring, it says "no message available".
    Plz help.
    Ragards,
    Rajat

    Hi,
    Check these~
    /people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1
    /people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
    http://help.sap.com/saphelp_nw04/helpdata/en/e3/94007075cae04f930cc4c034e411e1/frameset.htm
    http://help.sap.com/saphelp_nw04/helpdata/en/bc/bb79d6061007419a081e58cbeaaf28/content.htm
    /people/shabarish.vijayakumar/blog/2006/04/03/xi-in-the-role-of-a-ftp
    Mark Helpful Answers
    Hope this helps,
    Regards,
    Moorthy

  • How to stop the last rnto to be issue by the ftp adapter when downloading a file.

    The company that processes the ftp documents for a partner is a VAN and has a process where the ftp file sent is immediately moved to an archive upon download. The ftp adapter wants to rename the file after the download completes but the originally
    downloaded file is already gone and an error is returned.
    Is there a way to not issue the rnto or have the server process wait until the script is complete before moving the file.
    I don't have the time to write a custom ftp adapter, maybe a dotnet helper ftp process.
    Is there something simple  that can be done.
    Thanks
    Bico Bielich

    Maybe you can't if changing the Spool Folder doesn't change the behavior.
    Does the trading partner have or can they create a temp folder you can use?  You might even be able to create your own with a pre-command script.

  • FTP Adapter to read 2 files(eg: readme.txt & readme.dummy)

    How do I specify FTP Adapter to only pick readme.txt only if there is a dummy file readme.dummy (0 byte) is in the folder?

    That's not possible.

  • FTP Adapter duplicate processing of files in Active-Active cluster env

    Hi All,
    We have single active-active cluster environment and we have configured all the HA configurations for Inbound and Outbound operations (except outboundDatasourceLocal). But we faced a situation that the FTP Adapter processed a file twice. This happened when there was a fail-over in oracle database in where SOA-INFRA schema is created.
    Please let me know if anyone faced similar issue and what would be the resolution for this duplication issue.
    Thanks in Advance.

    Hi Vernetto,
    Thanks for your reply.
    I too had opened a ticket with oracle and they are looking into the issue.
    can you please let me know what are the inbound and outbound operation configurations you have specified in the 'outbound connection pools'. Also is there any other specific property you set in jca file?
    one more thing is, we have configured outboundLockTypeForWrite to 'oracle' as we are using the oracle database. but i couldnt see any data in FILEADAPTER_IN or in FILEADAPTER_MUTEX tables. you said you could see data in FILEADAPTER_IN table. so is there any specific property requires to be set which i am missing?
    please suggest.
    Thanks.

  • FTP Adapter restrict polling frequency active time frame in a day

    Hi All,
    Is there anyway I can restrict FTP adapter polling frequency to be active during a particular time frame of the day. Say, my service should poll the incoming location for Sales order data for every hour during business hours of the day.
    Thanks,
    AG

    Hi
    SOA Suite 12c will expose Oracle ESS as the scheduler.
    ESS will allow you to schedule soa composites / OSB services etcand allow you to enable / disable them based on jobs, which is what you desire.
    12c SOA Suite is expected later this Summer.
    Cheers
    iain

  • How can ftp-adapter overwrite an existing file

    Hi,
    I have an ftp-adapter that I want to overwrite an existing file when publishing a new message. I want the receiving application to handle only the latest file (==state of an export)
    now my ftp-adapter logs an error if the file it wants to put already exists.
    Is there a parameter that can set this??
    thanks,
    Ton

    You can use the file.sender_customizer_class property in the adapter.ini to hook in your implemented FileSenderCustomizer class where you can use your own logic in the GenerateFileName method. This is a possibility to create a unique file name per run.
    Kind regards, hope it helps

Maybe you are looking for