10.1.3.4 - FTP adapter polling multiple servers

Is it possible to get files from multiple servers for a given BPEL or ESB service ? My source application writes to its local file systems in the exact same location, but 2 different servers. Is there anyway we can instruct the FTP adapter to poll both the servers ? or do we have to duplicate the call to poll the 2nd server ?

Don't think so. We have solved it by having one esb ftp-adapter to each server and route them together in the same routing service.

Similar Messages

  • How to configure FTP Adapter for multiple endpoints?

    Scenario: I have multiple ftp endpoints (5-15) and depending on some business logic, I have to send data to the right destination. With default ftp adapter configuration, I have to add a n adapter connection factory reachable via JNDI for each destination. But I want to read the different endpoints dynamically from e.g. a database and configure my ftp adapter at runtime. That's because the endpoints do change quite often.
    Interconnect had such a feature: FTP Sender: The FTP adapter supports sending to multiple FTP endpoints. This feature provides flexibility for sending messages to different remote FTP servers.
    Any ideas on that for SOA Suite?
    Thanks,
    Torsten

    For more documentation please send a mail to [email protected]

  • ESB: inbound file and outbound ftp adapter with multiple directories

    Basically I want to scan directories and write new files ftp directories. I could figure out how to do that for one directory. However I need to scan multiple directories and ftp upload files contained in those directories to corresponding ftp directories. Number of directories and their names are only known at run time. All directories are under one parent directory, both locally and the remote ftp site. We can assume all ftp directories exist.
    I could not figure out how to this. Is this possible at all? Directory names seem to be only specified at design time, for both inbound file adapters and outbound ftp adapters.
    Pranab

    Chris, I am not really sure this is the right place to ask this question. But hopefully you might have something in your armour to help me out.
    My requirement is to configure an inbound File/FTP adapter to read from a Directory which can be known only at runtime. A webservice call returns the file name and network path of the file to be read, but that happens only during the run time. I guess one way possible is, you configure a File/FTP Adapter with a logical name for directory and set the physical directory path using the endpoint property. But in that case, I should know the Physical directory @ deployment time.
    I would like to know whether it is possible to manipulate the Endpoint property of an ESB Service (SOAP Service/Routing Service/Adapter Service) during runtime.
    So is there any way to get the enpoint property configured during runtime??? Otherwise dO you recommend some other solution for this use case???
    Any help would be appreciated.
    -Sudheer

  • FTP Adapter polling lowercase or uppercase files using single adapter

    Hello All,
    I was wondering if we can use a single FTP Adapter to poll Lowercase or Uppercase files. For example either abc*.txt or ABC*.txt.
    Does the FTP adapter by default support this option, because its not working in my Case and if its supported does it depend on the FTP server settings/security.
    Help is much appreciated.
    Thanks
    Kris

    Hema wrote:
    How does it decide which files to pickup ? It will pick up files with modification dates more recent than the last processed file.
    sometimes it picks up all old files from FTP directoryIf it is picking up the same files, probably it is not being able to calculate the modification dates.
    That can be a configuration problem, take a look at this:
    http://docs.oracle.com/cd/E17904_01/integration.1111/e10231/adptr_file.htm#BABECEGD
    Note: We are not deleting already read files from the folderProbably, not a good thing to do. May you can archive them instead.
    Cheers,
    Vlad
    Give points - it is good etiquette to reward an answerer points (5 - helpful; 10 - correct) for their post if they answer your question. If you think this is helpful, please consider giving points

  • FTP Adapter batching multiple files in one send

    Hello,
    I'd like to set up a process in XI to allow me to group all files into one batch message and send the group all in one send every thirty minutes.  This is an FTP adapter.
    Do I need to work through a BPM to do this?  Is there a good blog or forum topic on this?
    Thanks,
    Matt

    That is exactly what I was looking for.  Thanks.
    I will test with the BPM and if the performance becomes and issue I will try your suggestions.
    Thanks,
    Matt

  • FTP adapter polling with NLST

    HI,
    I am trying to poll a directory for a particular file......but the default LISt command in adapter doesn't poll any thing..so tried using NLST command in jca file....now it polls and created BPEL instances fine but now the issue is it polls all the files and deleates all the files ignoring 'includeFiles' property..
    Can some one help me out if we can use NLST or how to make LIST command work.....remote ftp server is a windows server...
    Thanks

    Hema wrote:
    How does it decide which files to pickup ? It will pick up files with modification dates more recent than the last processed file.
    sometimes it picks up all old files from FTP directoryIf it is picking up the same files, probably it is not being able to calculate the modification dates.
    That can be a configuration problem, take a look at this:
    http://docs.oracle.com/cd/E17904_01/integration.1111/e10231/adptr_file.htm#BABECEGD
    Note: We are not deleting already read files from the folderProbably, not a good thing to do. May you can archive them instead.
    Cheers,
    Vlad
    Give points - it is good etiquette to reward an answerer points (5 - helpful; 10 - correct) for their post if they answer your question. If you think this is helpful, please consider giving points

  • BPEL Process with multiple file types using one FTP adapter is not working

    i created a bpel process which will fetch the files from remote location using FTP adapter.
    Now the process works for only one format or file type like *.xls.
    How can i use more than one file format in one FTP adapter.
    OR
    is there any other way to do it.
    file type assignation is 5th step in FTP adapter configuration.
    i have tried *.xls,*.csv and *.xls;*.csv and *.xls:*.csv by seperating with comman, colon, space... still not working.
    i read the documentation *.* will not work.. for one file format it's working fine.
    looking forward for reply as soon as possible.

    Are you positive that it is not working? I'm not sure how you can use one FTP adapter for multiple file types unless the underlying data is exactly the same format or you are processing it as opaque data. Sometimes when a FTP adapter chokes on a file with a bad structure it doesn't create a BPEL instance, it simply moves the bad file to a separate folder.
    So I assume you are using opaque as the data type instead of using an XSD element?
    That said, I don't think you can put two separate file types in the filter. Is it possible for you to do something like: CommonFileName*.* or do you have similar files with other extensions?
    I know the above probably isn't of much help, but I had so many problems with the FTP adapter and its lack of features that I am writing my own. Unfortunately that is a large undertaking and there isn't any good documentation of JCA resource adapter / BPEL PM integration.

  • FTP Adapter restrict polling frequency active time frame in a day

    Hi All,
    Is there anyway I can restrict FTP adapter polling frequency to be active during a particular time frame of the day. Say, my service should poll the incoming location for Sales order data for every hour during business hours of the day.
    Thanks,
    AG

    Hi
    SOA Suite 12c will expose Oracle ESS as the scheduler.
    ESS will allow you to schedule soa composites / OSB services etcand allow you to enable / disable them based on jobs, which is what you desire.
    12c SOA Suite is expected later this Summer.
    Cheers
    iain

  • How to change the JCA JNDI dynamically using FTP Adapter

    We have 5 FTP Servers, each having a directory to poll. We have created 5 CCI instances for these FTP Adapters in the FTPAdapter deployment. We created a BPEL process and using FTP Adapter to connect to above mentioned servers.
    Question: Customer's requirement is to use a single BPEL process to poll all these FTP Servers at a specified date and time. How can we connect dynamically to each FTP server at specified time.
    (OR)
    Is there any way to change the JCAJNDI dynamically in a FTP Adapter configuration ?
    I have seen that FTP Adapter POLL doesnt take any JCA JNDI/hostname/un/pwd/date/time dynamically.
    Regards
    Pavan

    Hi Pavan,
    It's possible to change the JNDI dynamically but only when you use put operation where you can control the JNDI name at the time of invoking the FTP Adapter as described in below link.
    Dynamic JNDI in FTP Adapter | jca.jndi property not picked by Adapter
    However, can you consider using BPEL process with SyncRead (and read files through all the JNDIs in a loop) and scheduling this BPEL process to a desired frequency?
    Regards,
    Neeraj Sehgal

  • What is the maximum filesize for a FTP Adapter?

    I have xml files with 1000's of records to read in. The file size can range anywhere from a few MB up to ~100MB. Most of them are about 50 MB.
    The FTP adapter works when I have a small file, but with larger ones it apparently times out. Once it runs into a big file like this, it won't process any more files until I restart the process. It doesn't show any faults or even any record of a running instance in the BPEL Console, so I have no idea specifically when it breaks. I uploaded a 10MB file to my ftp server and left it for a half hour, but nothing showed up, so I'm assuming it's broken rather than just taking a long time.
    What is the maximum file size for a FTP adapter? Can I change this somewhere? I looked in the ...\application-deployments\default\FtpAdapter\oc4j-ra.xml file but couldn't find any settings to change.

    Well no luck on my end and it doesn't look like anybody else has any ideas either. This thread Re: FTP Adapter, Java Embedding, ... says that if you can't get the functionality you need out of the default one, you should write your own FTP adapter in JCA. I looked at JCA and would like to write a simple polling adapter and then put all my FTP code in embedded java.
    Can somebody explain how I could achieve the basic FTP Adapter polling functionality in JCA? I'm having difficulty figuring out how to have an ongoing polling process without instantiating a BPEL process itself, like the existing FTP adapter does. I don't want to set off on writing my own adapter if it's going to be a much larger undertaking than I have time for.
    Also, is the source code open for the default FTP adapter? It would be great if I could just modify the few things I need to change rather than write one from scratch.

  • FTP Adapter with Runtime OS Command before Message Processing

    Hi PI Techies,
    I have a confusion in using Sender FTP Adapter with Runtime OS Command before Message Processing.
    Scenario is like this:
    Ftp Adapter has to pick a file from FTP server after it checks that a Blank Marker file exists on PI server AL11 directory say "tmp directory".
    For this I am using Runtime OS Command before Message Processing where a shell script will check the existence of Blank Marker file on PI server AL11 and if found , it exits the script and FTP Adpater will then pick the Actual Data File and Process it.
    Now Confusion:
    I am confused in technical execution of steps by FTP Adapter..
    Whether FTP Adapter polling initiates the Interface or Runtime OS command checking the File existence will initiate the Interface?
    May be its follish to you guys... but please answer ..
    Regards,
    Anurag

    Hi,
    I will take it other way as we need to process the Data File not Marker File ( its just for checking the Data File is completely written on FTP server).
    Other way mean " Will Poll for Data.txt File and if  found then Runtime OS Command will do connect to FTP and check if Marker File exists, if yes then delete the marker file and read the actual Data File for processing.
    Please let me know, if Marker File does not exists on FTP folder, will it still read the Data File or will it exit the Adapter execution?
    Your help is much appreciated.
    Regards,
    Anurag

  • SOA FTP Adapter Performance Optimization

    The application scenario is as below
    There is a remote FTP service which receives real-time XML files (may be 2 files per second). In my SOA 11g application, I am using FTP adapter to connect to the remote FTP server. The FTP adapter polls for new files based on the file creation timestamp and after processing, deletes the files. All good so far, no issues at all.
    However, there is a huge backlog in the files. How can improve or speed up the FTP adapter process to match or better the remote FTP file creation rate? Please note I am not doing much processing here, just perist the files to a database. The consuming application expects real-time file feed.
    There should be some configuration in SOA FTP adapter to optimize the performance and beat the file spitting FTP monster.
    Thanks

    However, the inbound FTP location receives around 30 files in a second max. How do I configure the FTP adapter to beat this rate. I looked through the document link and tried few trials
    MaxRaiseSize: 20
    SingleThreadModel: both true and false
    ThreadCount:20
    However, I still cannot beat the rate at which the files are put to this location. Please what configuration changes shhould I consider.
    Thanks
    Edited by: user5108636 on 17/10/2010 21:34

  • FTP Adapter to poll multiple files (different formats)

    Hi,
    We have a requirement to poll and process multiple files from a given FTP location(either process all or reject all - reject if there is any failure in one of the files).
    Using FTP Adapter's Get File operation(Schema Opaque), we are able to read three different file formats and can get the file name(Using header variable FileName).
    And we are hoping to process the file contents based on the File Name that we get from the above step.
    1) How do we convert the file contents from Opaque to specific Schema (ex: file1.csv, file2.csv and file3.csv with different formats)?
    2) As the requirement is to process all the files at the same time, Can we use correlation in the poller process to route to single controller process(One instance of Controller process for all the files)?
    Any help would be much appreciated.
    Thanks...

    Thanks a lot for the quick answers.
    I've used the Java embed to convert Base64 content to String. And using 'translateFromNative' extension, I could convert it to the desired XML content.
    But I still have trouble in polling and processing all the files(file1.csv, file2.csv and file3.csv) at the same time using a single controller process.
    My requirement is to process all the three files at the same time(for any failures I have to compensate any/all of inserted records).
    I tried using Pick(with different OnMessage branches), but as they are polling the same location I could see only one OnMessage branch is getting fired resulting in multiple instances.
    May be I didn't understand your suggestion correctly, could you please elaborate on the possibility of processing multiple files at the same time?
    Thanks

  • FTP Adapter to read multiple files from a directory. Not through polling.

    Dear Friends,
    I would like to know is it possible to configure the FTP adapter in Oracle BPEL 10.1.3.4 to read multiple files (different names, same structure) from a given directory. I do not want the BPEL to do a polling. Instead when I submit the BPEL process it should read all files from the directory.
    I was looking at the option of Synchronous read but I am not able to specify wild card in the file name field. I do not know the file names at the time of reading.
    Thanks for your help!

    Hi,
    While you read the file, you can configure an adapter property in 'Receive'. This will store the filename, this filename can be used for sync read as the input parameter.
    1. Create a message type variable called 'fileheader'. This should be of type Inboundheader_msg (whatever relevant Receive activity).
    2. This variable will contain three parts - filename, FTPhost, FTPPort
    3. Copy this fileheader to 'Syncheader'.
    4. syncheader can be passed as an adapter proerty during sync read of the file.
    During Receive and Invoke, you need to navigate to 'Adapter' tab to choose the created message type variable.
    Let me know if you have further questions.
    regards,
    Rev

  • I want my file adapter to poll multiple locations in soa 10g

    Hi All
    I had a requirement that "I want my file adapter to poll multiple locations in soa 10g".I came to know that in soa 11g it is possible.
    I want this to be done in soa 10g.
    plz help me.
    thanks,
    krishna

    You can have pick activity and have separate ftp adapter for each folder, but you will be using the same jndi in all pick activity.
    In that way you can have multiple ftp adapter but uses the same jndi by increasing the performance.
    User will be configured to a home location, example as below.
    say a ftp user "adminuser" is configured to a default folder c:/ftp_files
    You can create multiple folders under the same folder like below.
    c:/ftp_files/location_a
    location_b
    location_c
    location_d
    For each location have a separate ftp adatper, but all of them uses the same jndi while defining the path you have to change according to the above folder.
    Let me know how this goes.
    - It is considered good etiquette to reward answerers with points (as "helpful" - 5 pts - or "correct" - 10pts).
    Thanks,
    Vijay

Maybe you are looking for