FTP Adapter get complete files question

I'm using the FTP Adapter to poll for incoming files. I'm concerned that it may be possible for the FTP adapter to find a file whilst it's still being written, and therefore load an incomplete file. Does anyone know if the FTP adapter has any built in mechanism to prevent this happening, or do I need to explicitly work around this situation?

Problem solved - I've just found the 'Minimum File Age' parameter on the FTP Adapter wizard.

Similar Messages

10.1.3.4 - FTP adapter error while file get

I created an esb service that reads from a remote server and processes the file locally. It works fine in dev. When I migrated my esb flow to a test environment it is now throwing some error.
<AdapterFramework::Inbound> Adapter Framework instance: OraESB - successfully completed endpointActivation for portType=Get_ptt, operation=Get
<FTP Adapter::Inbound> Connection Created
<FTP Adapter::Inbound> Unable to list files from '/apps/EDI/Archive/OutBound/Customer' directory on 'corpapp10' server; FTP command[NLST] returned unexpected reply code : 550
<FTP Adapter::Inbound> Poller raising Alert for exception : ORABPEL-11430
Error in listing files in the remote directory.
Unable to list file in remote directory.
Check the error stack and fix the cause of the error. Contact oracle support if error is not fixable.
The dev remote server and the test remote server are different. I have done the obvious checks about server name, permissions, directory names etc. I can login to the server using windows ftp however when I go the inbound directory and type in ls, i get the following error - 550 Arguments too long. I have some 37000 files in the directory. ls -l works fine.
I switched the ftp adapter to poll a different directory which only has 1 file, but it still gives the same error. However in this case, the windows ftp is able to list the files using ls command.
any idea how i can make this work ?

i undeployed the esb project and deploying it again. Now even worse, nothing happens now. It has stopped polling at all. I just see the following message in the opmn.log, but none of the files get picked up.
<FTP Adapter::Inbound> Connection Created
<FTP Adapter::Inbound> Connection Created
<FTP Adapter::Inbound> Connection Created
To be sure, I deployed it to another environment (DEV) and it works ok there.

File size restriction on FTP Adapter (GET)

A customer has deployed a BPEL process that we had created that uses the FTP Adapter to download (GET) files. The customer is reporting that when they try to download a large file (about 800 MB in size), the process does not seem to kick in for more than one hour. At this point I don't know how good or bad the network speed is and how long a FTP download will take for a file of that size. But before looking into that, wanted to know if there is any restriction on how big a file can be for it to be downloaded by the BPEL FTP Adapter. If not, is there some way to find out what is wrong with the downloading or to know to progress of the FTP GET?
The user guide talks about increasing the value of transaction-config timeout in server.xml for the File Adapter. Is this applicable for FTP Adapter also and will it work if I increase this?
Thanks in advance for your attention.
Jay

Thanks for the pointer. The processes are deployed on a 10.1.3.5 instance.
Of the info I found in that article, only the following seemed applicable:
53.2.1 Setting Audit Levels from Oracle Enterprise Manager for Large Payload Processing
I can ask the customer to turn off auditing if it is on. But I am skeptical that this will resolve this issue.
The following seem to be applicable only to 11g version and I am not sure if they have any corresponding options in 10.1.3.5 (please let me know if I am mistaken):
1. 53.2.4 Using Adapter Support for Streaming Large Payloads
2. 53.2.6 Processing Large Documents in Oracle B2B
Section 53.3.1 Opaque Schema for Processing Large Payloads says the following:
There is a limitation when you use an opaque schema for processing large payloads. The entire data for the opaque translator is converted to a single Base64-encoded string. An opaque schema is generally used for smaller data. For large data, use the attachments feature instead of the opaque translator.
Based on your experience, has the FTP Adapter ever been used to download files of 800MB or larger size on a 10.1.3.5 instance? I would like to know if there is any insurmountable system limitation with this approach or is it just a question of proper configuration or is this a bug that the FTP adapter product team can look at. I assume the attachment feature is not available in 10.1.3.5.
The remaining sections don't seem applicable to the the customer scenario.
Can you please explain what ODI is?
Appreciating your input,
Jay

FTP Adapter pickup the file meanwhile the file is transfering

Hello,
we have a follow problem: We transfer some big files manually in a ftp directory. If the adapter connect the directory concurrent as we transfer the file, he'll pick up the incomplete file and processed this. The problem is now, we get an error message in XI Monitoring. After this, we put the file form archive directory (same server) in the "normal" directory and the ftp adapter pick up the file, all is okay. My question is: It is possible, you can create a check or a parameter setting, if the file is complete transferred, first then could start the ftp adapter.
Remark: We increase and decrease the polling parameter and we're teseted with changing the paramter connect mode, without success.
Thanks for your help.

Hi,
You can execute a shell script to change the file name of the completed file . So the job of script is to rename the complete file.And then give this file name in the File Adapter configuration.
Did you check the option of Read-Only Files ( if you are using NFS protocol) ? If so uncheck and try it..
Regards,
Moorthy

Configuring FTP adapter using .ppk file

Hi:
I am trying to configure FTP adapter in Weblogic for making a secured connection. My destination system provided a .ppk file, username and password to make a connection. I tried using both the Authentication Type PASSWORD as well as PUBLICKEY, but in both cases i am getting this error
<part name="summary">
<summary>Exception occured when binding was invoked. Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'FileListing' failed due to: JCA Binding Component connection issue. JCA Binding Component is unable to create an outbound JCA (CCI) connection. FileConsumer:FTP_ListFiles_out [ FileListing_ptt::FileListing(Empty,filelist) ] : The JCA Binding Component was unable to establish an outbound JCA CCI connection due to the following issue: Error in establishing a session with SSH Server.. Error in establishing a session with SSH Server.. Unable to establish a session with the server. Please ensure hostname and port specified to login to the server are correct. Please make sure that the JCA connection factory and any dependent connection factories have been configured with a sufficient limit for max connections. Please also make sure that the physical connection to the backend EIS is available and the backend itself is accepting connections. ". The invoked JCA adapter raised a resource exception. Please examine the above error message carefully to determine a resolution. </summary>
</part>
<part name="detail">
<detail>Too many authentication failures for testuser</detail>
And in SOA logs i am getting this below error
####<Apr 30, 2013 1:46:05 AM EDT> <Warning> <Connector> <[email protected]> <soa_server1> <orabpel.invoke.pool-4.thread-3> <<anonymous>> <BEA1-4A34E1F57560E2DF58E4> <43b21ccaefeebde3:1e7743d9:13dfccfff26:-8000-00000000008dee9f> <1367300765147> <BEA-190032> << eis/sftp/qwer > ResourceAllocationException thrown by resource adapter on call to ManagedConnectionFactory.createManagedConnection(): "BINDING.JCA-11447
Error in establishing a session with SSH Server..
Error in establishing a session with SSH Server..
Unable to establish a session with the server.
Please ensure hostname and port specified to login to the server are correct.
">
SOA Version: 11.1.1.6, Weblogic Version: 10.3.6
Regards
RK

As you suggested, you can write a custom adapter where you can do duplicate check, file move to duplicate directory and email notification.
But this is trying to cover many business processes under adapter functionality whose intend purpose is just to
work with a transport, speak the transmission protocol and
transfer the file.
Custom adapter:
But still you can do these functionalities in custom adapter.
For article, white papers and webcast for developing custom adapter refer this MSDN page:
Developing Adapters using the BizTalk Adapter Framework
You can still use BizTalk adapter wizard which gives you the template files including registry key required for registering the custom adapter. This may need Visual Studio
2005 to get the template project created. The export Visual Studio 2005 to your latest version to get the template for your latest version. And write your FTP library code in the placeholders.
Or refer the SDK for sample custom adapter and replace those custom functionalities to yours to make and update SDK samples work for you.
http://biztalkadapterwizard.codeplex.com/releases/view/3892
No to custom pipeline:
Your functionalities are not meant for custom pipeline processing. Pipelines are meant for preparing the received message for further processing or preparing the message/file to be sent out. Custom pipeline is not the correct place to write
your functionalities.
Try to isolate the functionalities and handle it different modules and don’t pack everything in custom adapter. For example, you can just use custom adapter
to FTP the file, if it’s a duplicate file transfer the file to different folder location. You can (or ask the team who own the FTP server) to send an email if the duplicate folder receives a file. This would improve the performance of the adapter.
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful by clicking the upward arrow mark next to my reply.

FTP adapter should send file as binary attachment

Hello,
we user XI 3.0 and want to implement the following scenario:
- FTP adapter has to read binary files (*.tif and *.xls)
- Receiver adapter is an ABAP proxy
We want to get the file content as attachment to the message or as binary string in the payload. Is it possible? I Think the FTP adapter can only handle the file content over as complete message payload and not as an attachment. File content conversion is not possible because we read non textual files. Do any adpater modules exist that could swap the payload to attachment? In my point of view the PayloadSwapBean can only handle the other way.
Any suggestions?
Thanks in Advance,
Daniel

Hello,
with the file adapter in NFS mode it is easy to attach one file as payload and further files as attachment.
But as I stated above we use the FTP mode (and we have no NFS server!). The binary file is read by the adapter and assigned to the message as main payload. The proxy inbound handling is not able to parse the payload because it will see it as application/xml.
I'm looking for one of the following solutions:
1) swap the content of the main payload to an attachment. This can be processed at the proxy
2) perhaps it is possible to change the mime type of the main payload to reflect the xls or tif content with the MessageTransformBean. But what has to be done at the proxy inbound side?
Best regards,
Daniel

FTP adapter not picking files

Hi
I trying to get files from a remote FTP server
but the FTP adapter configured is not able to pick up files from the remote folder
using
soa 11.1.1.3
filezilla as FTP server
+<Sep 5, 2011 5:32:56 PM GMT+05:30> <Error> <oracle.soa.b2b.transport> <BEA-00000+
+0> <[IPT_FileRecMonitorError] Error in ftp or file receiver monitor.>+
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using mcf
for credentials
FINE: Ftp Adapter Managed Connection Created
FINE: Ftp Adapter Adding Event Listener
FINE: Ftp Adapter Connection Created
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Wed Aug 31 1+
+9:40:00 GMT+05:30 2011] for [Aug 31 19:40], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Fri Sep 02 1+
+8:23:00 GMT+05:30 2011] for [Sep 02 18:23], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Fri Sep 02 1+
+8:33:00 GMT+05:30 2011] for [Sep 02 18:33], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Mon Sep 05 1+
+3:13:00 GMT+05:30 2011] for [Sep 05 13:13], time offset=[0]+
+FINE: Ftp Adapter Using locale=[null] for ftp server+
+FINE: Ftp Adapter FtpTimestampParserImpl::parseTimestamp returned [Mon Sep 05 1+
+3:45:00 GMT+05:30 2011] for [Sep 05 13:45], time offset=[0]+
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@8
+68852+
can someone help me on this
-Regards
adiKsystime

Hey Naresh
thanks for your earlier reply
but I have no luck yet
soa_server logs show
FINE: Ftp Adapter Clearing Event Listeners
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using apps
erver credentials
FINE: Ftp Adapter Managed Connection Created
FINE: Ftp Adapter Adding Event Listener
FINE: Ftp Adapter Connection Created
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@1
+47dc09+
FINE: Ftp Adapter The candidate set size in matchManagedConnection [1]
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using apps
erver credentials
FINE: Ftp Adapter Connection Created
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@1
d469b0
FINE: Ftp Adapter The candidate set size in matchManagedConnection [1]
FINE: Ftp Adapter FTPManagedConnectionFactory::getPasswordCredential using apps
erver credentials
FINE: Ftp Adapter Connection Created
FINE: Ftp Adapter Sending event: 1 with: oracle.tip.adapter.ftp.FTPConnection@1
+040f85+
FINE: Ftp Adapter FTPManagedConnection::destroy called, closing physical socket
and No luck yet in picking up the remote files
regards
adiKsystime

FTP adapter should take file path and name at runtime..

Hello All,
I have requirement of getting the file from remote machine into local machine..thinking FTP adapter should help me to do this..
I dont need to poll the remote directory. rather I will pass the exact path and name of the file to be fetched during runtime as an input to the bpel process.
How to configure the FTP Adapter to receive the file path runtiime and gets it to local machine.
Is it doable using ftp adapter..?
Thanks
Saikrishna

Hello Anne,
Thank you for the help.
I am not able to call a adapter partner link using invoke activity..I am facing variable type conflicts.
modified the
OutboundFtpHeaderType wsdl to take file name and directory as:
<complexType>
<sequence>
<element name="*fileName*" type="string"/>
<element name="*directory*" type="string"/>
</sequence>
</complexType>
Using Adapters tab of Invoke activity created a variable:
<variable name="outputVariable"
messageType="client:FTPadapterResponseMessage"/>
<variable name="*filePath*" messageType="ns2:OutboundHeader_msg"/>
Using Assign Activity, assigned the input varibales to the ftp outboundHeader variable:
<assign name="Assign_1">
<copy>
<from variable="inputVariable" part="payload"
query="/client:FTPadapterProcessRequest/client:*directory*"/>
<to variable="*filePath*" part="outboundHeader"
query="/ns2:OutboundFTPHeaderType/ns2:directory"/>
</copy>
<copy>
<from variable="inputVariable" part="payload"
query="/client:FTPadapterProcessRequest/client:*filename*"/>
<to variable="*filePath*" part="outboundHeader"
query="/ns2:OutboundFTPHeaderType/ns2:fileName"/>
</copy>
</assign>
Used the created variable in the invoke activity as a input paramater to the partner link:
<invoke name="Invoke_1" partnerLink="ftpAdapterTest"
portType="ns1:SynchRead_ptt" operation="SynchRead"
inputVariable="*filePath*" bpelx:inputHeaderVariable="filePath"/>
<reply name="replyOutput" partnerLink="client" portType="client:FTPadapter"
operation="process" variable="outputVariable"/>
I am getting an error in invoke activity:
Variable type does not match the input type.
Thanks
Saikrishna

FTP Adapter batching multiple files in one send

Hello,
I'd like to set up a process in XI to allow me to group all files into one batch message and send the group all in one send every thirty minutes. This is an FTP adapter.
Do I need to work through a BPM to do this? Is there a good blog or forum topic on this?
Thanks,
Matt

That is exactly what I was looking for. Thanks.
I will test with the BPM and if the performance becomes and issue I will try your suggestions.
Thanks,
Matt

Sender FTP Adapter - Archive faulty files not working

Hello,
We are on SAP PI 7.11 SP 06
We have a scenario where we are reading CSV files from a FTP location.
File Sender Adapter is polling the FTP location for CSV files, if there
is any error during FCC we need to move the faulty file under a
particular directory on FTP server.
Archive faulty files tick is click under the communication channel and
also the required directory is specified, but the functionality is not
working.
If there is a faulty file it is just adding a rejected prefix to the
file and keeping the file in the polling directory. It is not moving
the file in the rejected directory specified in the communication
channel.
Thanks & Regards,
Rahul Nawale

Are you trying to archive the file on the same FTP server or a different FTP server? Archiving the faulty file on the FTP server might not have expected results. And if you are trying to archive the file on a separate FTP server, it wouldn't probably be achieved using the simple file adapter functionalities.
The best way would be to archive the faulty files to an NFS location on your PI server (this will certainly work, even if it's FTP mode) and then use a separate script or PI interface (file tunneling) to move these files from PI server File System to FTP archive location.
Regards,
Suddhasatta

Ftp Adapter getting invoked more than once

Hello All,
I have an FTP polling on a remote server, the options that i chose are archive file after read. The problem is the bpel process is getting invoked more than once. If anyone encountered a similar problem, help is really appreciated.
Thanks
Krishna

Hi Krishna,
What release are you on? refer to metalink note: 730515.1
In 10.1.3.4 MLR#7 this works:
Add the below section within BPELProcess and replace the bits in upper case to suit your code:
    <activationAgents>
      <activationAgent className="oracle.tip.adapter.fw.agent.jca.JCAActivationAgent" partnerLink="PARNERLINKNAME">
        <property name="clusterGroupId">SOMEUNIQUEVALUE</property>
        <property name="portType">PARTNERLINK_PORTTYPE</property>
      </activationAgent>
    </activationAgents>regards,
Shanmu
http://www.prshanmu.com/articles/

FTP-Adapter reads filled file as empty file

Hi, well i have a FTP-Poll to a folder where a filled file is existing. the adapter takes it and put it into archive folder after saying that the content is transformed into XML (shown in CC-Monitoring).
Well the archive file i found but in Monitor there is no message. So where is the XML file?! actually it should be send to an IDoc-Adapter after content is transfomed! What is the problem??
I have done some other Scenarios like this and they work. I compared all the parameters but nothing seems to be wrong.
br Jens

Hello Jens,
In RWB , do the following and reply back the results.
Choose Message Monitoring
Messages from Component -- Adapter Engine from Database
Start
Choose your message and click display.
Go to Audit Log tab and verify the each step.
Finally tell whether u can see the following message in Audit Log <b>The message was successfully transmitted to endpoint http://host:port/sap/xi/engine?type=entry using connection AFW.</b>
Best regards,
raj.

FTP Adapter to Flat File - preventing blank lines

Hi,
I have the following D3L file, which I use to create a file of employee details:
<?xml version="1.0" encoding="US-ASCII"?>
<!DOCTYPE message SYSTEM "d3l.dtd">
<message name="employeeDetail" type="EmpRec" object="Employee">
<imparray id="AddressArrayType">
<struct>
<field name="EmpID">
<padstring length="8" padchar=" " padstyle="tail"/>
</field>
<field name="StreetName">
<padstring length="20" padchar=" " padstyle="tail"/>
</field>
<field name="EOL"><termstring endchar="\n" /></field>
</struct>
</imparray>
<imparray id="SalArrayType">
<struct>
<field name="EmpID">
<padstring length="8" padchar=" " padstyle="tail"/>
</field>
<field name="Salary">
<padstring length="10" padchar=" " padstyle="tail"/>
</field>
<field name="EOL"><termstring endchar="\n" /></field>
</struct>
</imparray>
<imparray id="EmpArrayType">
<struct>
<field name="EmpAddrArray"> <typeref type="AddressArrayType" /> </field>
<field name="EmpSalArray"> <typeref type="SalArrayType" /> </field>
</struct>
</imparray>
<struct id="EmpRec">
<field name="EmpArray"> <typeref type="EmpArrayType" /> </field>
</struct>
</message>
Basically, an employee can have multiple address entries, and multiple salary entries, and there are multiple employees.
The file produced is what I require, except where an employee has no address, but has a salary, or no salary, but has an address. In these cases, I get a blank line.
How do I prevent a blank line appearing - by changing the D3L file, or by doing a conditional copy when I map from common view to application view?
Anyone help? Thanks.

Hi Soumya,
You need to choose the FTP in the "transport protocol" option. Then in the FTP connection parameters choose the option Connection Security and assign the value "FTPS for control and Data Connection". Then the "Command Order" will show up below that option and you could leave the default value itself. If you are using Public private key certificates of X.509 then you could choose the option "Use x.509 certificate for client authentication" and assign the values to the "keystore" and "certificate & private key" fields.
Note: To use the FTP with SSL you need to add the CA certificate to the TrustedCAs keystore view.
Regards,
Vishnu.

Getting complete file path in Adobe Interactive Form

Hi All,
I have a requirement where I have a field ZPATH1 on Adobe Interactive Form. I am putting a BROWSE button and writing following JavaScript on CLICK event on this button for populating the chosen file path into field ZPATH1.
*Start of JavaScript
var sFile;
event.target.importDataObject(sFile);
var oFile;
oFile = event.target.getDataObject(sFile);
this.parent.parent.Sub_Form_Fields_Mass.ZPATH1.rawValue = oFile.path;
*End of JavaScript
1. event.target.importDataObject(sFile) --> Giving me the pop up to select the file.
2. this.parent.parent.Sub_Form_Fields_Mass.ZPATH1.rawValue = oFile.path; --> Putting the oFile path in field ZPATH1 on the form.
3. This way is only giving me the selected FILE NAME whereas I need the complete path.
I have tried below way also:
this.parent.parent.Sub_Form_Fields_Mass.ZPATH1.rawValue = even.target.path;
This function returns me the complete path but in URL form. It does not give me the presentation server path.
Please suggest me how to get the complete path of presentation server to the file.
Appreciation would be honored in form of points!!!
Regards,
Ashish

please post it here for quick response
and also search in adobe forums also for java script related.
http://www.adobe.com/support/forums/index.html

Getting complete file path in Acro Java Script

Hi All,
I have a requirement where I have a field ZPATH1 on Adobe Interactive Form. I am putting a BROWSE button and writing following JavaScript on CLICK event on this button for populating the chosen file path into field ZPATH1.
*Start of JavaScript
var sFile;
event.target.importDataObject(sFile);
var oFile;
oFile = event.target.getDataObject(sFile);
this.parent.parent.Sub_Form_Fields_Mass.ZPATH1.rawValue = oFile.path;
*End of JavaScript
1. event.target.importDataObject(sFile) --> Giving me the pop up to select the file.
2. this.parent.parent.Sub_Form_Fields_Mass.ZPATH1.rawValue = oFile.path; --> Putting the oFile path in field ZPATH1 on the form.
3. This way is only giving me the selected FILE NAME whereas I need the complete path.
I have tried below way also:
this.parent.parent.Sub_Form_Fields_Mass.ZPATH1.rawValue = even.target.path;
This function returns me the complete path but in URL form. It does not give me the presentation server path.
Please suggest me how to get the complete path of presentation server to the file.
Appreciation would be honored in form of points!!!
Regards,
Ashish

I don't recognize the tech - is it something related to BusinessObjects Enterprise?
Sincerely,
Ted Ueda

FTP Adapter get complete files question

Similar Messages

Maybe you are looking for