FTP adapter : file size

Hi,
I have a requirement to move file (unread) from remote server to local and capture the file size for logging purpose. I have modified my jca file to use FTPIoInteractionSpec and FTP working fine.
To get the file size, I tried using jca.ftp.size property but it returns null as response. Can you please suggest if there is any other way to get file size without reading the file?
            <bpelx:fromProperties>
                <bpelx:fromProperty name="jca.ftp.Size" variable="size"/>
            </bpelx:fromProperties>
Thanks in advance!

Hi,
It's looking like retrieving the file size is not supported by FTPIoInteractionSpec then...
You can try and the file listing operation to get the file size... It surely brings the file size for FileAdapter, but I've never tried with FtpAdapter, try and let us know please...
http://docs.oracle.com/cd/E28280_01/integration.1111/e10231/adptr_file.htm#BABEDEGC
Cheers,
Vlad

Similar Messages

Receiver FTP Adapter File Size Splitting

Hi,
I am receiving an IDoc from R/3 into XI.
I then map this IDoc into an xml file and use a receiver ftp adapter to drop the files onto a ftp server.
Is there anyway, that I can use the adapter to split the message interface into smaller files. For example, if I were to ftp the message interface into 1 file, the file size would be 1MB. I would like to split the 1 message interface into 4 x 250kb files without having to split the message interface?
Thanks,
Miguel

Hi,
If you split into 4 files each one should be a XML file right?
This is possible without BPM.
Go thro the blog:
/people/jin.shin/blog/2006/02/07/multi-mapping-without-bpm--yes-it146s-possible
Wat u need to do is make the target side 0..unbounded. If u have 100 records, Map some 25 records in first occurence, 25 in second and so on. This way u can reduce file size.
Regards,
P.Venkat

FILE and FTP Adapter file size limit

Hi,
Oracle SOA Suite ESB related:
I see that there is a file size limit of 7MB for transferring using File and FTP adapter and that debatching can be used to overcome this issue. Also see that debatching can be done only for strucutred files.
1) What can be done to transfer unstructured files larger than 7MB from one server to the other using FTP adapter?
2) For structured files, could someone help me in debatching a file with the following structure.
000|SEC-US-MF|1234|POPOC|679
100|PO_226312|1234|7130667
200|PO_226312|1234|Line_id_1
300|Line_id_1|1234|Location_ID_1
400|Location_ID_1|1234|Dist_ID_1
100|PO_226355|1234|7136890
200|PO_226355|1234|Line_id_2
300|Line_id_2|1234|Location_ID_2
400|Location_ID_2|1234|Dist_ID_2
100|PO_226355|1234|7136890
200|PO_226355|1234|Line_id_N
300|Line_id_N|1234|Location_ID_N
400|Location_ID_N|1234|Dist_ID_N
999|SSS|1234|88|158
I would need a the complete data in a single file at the destination for each file in the source. If there are as many number of files as the number of batches at the destination, I would need the file output file structure be as follows:
000|SEC-US-MF|1234|POPOC|679
100|PO_226312|1234|7130667
200|PO_226312|1234|Line_id_1
300|Line_id_1|1234|Location_ID_1
400|Location_ID_1|1234|Dist_ID_1
999|SSS|1234|88|158
Thanks in advance,
RV
Edited by: user10236075 on May 25, 2009 4:12 PM
Edited by: user10236075 on May 25, 2009 4:14 PM

Ok Here are the steps
1. Create an inbound file adapter as you normally would. The schema is opaque, set the polling as required.
2. Create an outbound file adapter as you normally would, it doesn't really matter what xsd you use as you will modify the wsdl manually.
3. Create a xsd that will read your file. This would typically be the xsd you would use for the inbound adapter. I call this address-csv.xsd.
4. Create a xsd that is the desired output. This would typically be the xsd you would use for the outbound adapter. I have called this address-fixed-length.xsd. So I want to map csv to fixed length format.
5. Create the xslt that will map between the 2 xsd. Do this in JDev, select the BPEL project, right-click -> New -> General -> XSL Map
6. Edit the outbound file partner link wsdl, the the jca operations as the doc specifies, this is my example.
<jca:binding />
        <operation name="MoveWithXlate">
      <jca:operation
          InteractionSpec="oracle.tip.adapter.file.outbound.FileIoInteractionSpec"
          SourcePhysicalDirectory="foo1"
          SourceFileName="bar1"
          TargetPhysicalDirectory="C:\JDevOOW\jdev\FileIoOperationApps\MoveHugeFileWithXlate\out"
          TargetFileName="purchase_fixed.txt"
          SourceSchema="address-csv.xsd"
          SourceSchemaRoot ="Root-Element"
          SourceType="native"
          TargetSchema="address-fixedLength.xsd"
          TargetSchemaRoot ="Root-Element"
          TargetType="native"
          Xsl="addr1Toaddr2.xsl"
          Type="MOVE">
      </jca:operation> 7. Edit the outbound header to look as follows
    <types>
        <schema attributeFormDefault="qualified" elementFormDefault="qualified"
                targetNamespace="http://xmlns.oracle.com/pcbpel/adapter/file/"
                xmlns="http://www.w3.org/2001/XMLSchema"
                xmlns:FILEAPP="http://xmlns.oracle.com/pcbpel/adapter/file/">
            <element name="OutboundFileHeaderType">
                <complexType>
                    <sequence>
                        <element name="fileName" type="string"/>
                        <element name="sourceDirectory" type="string"/>
                        <element name="sourceFileName" type="string"/>
                        <element name="targetDirectory" type="string"/>
                        <element name="targetFileName" type="string"/>
                    </sequence>
                </complexType>
            </element>
        </schema>
    </types>   8. the last trick is to have an assign between the inbound header to the outbound header partner link that copies the headers. You only need to copy the sourceDirectory and SourceGileName
    <assign name="Assign_Headers">
      <copy>
        <from variable="inboundHeader" part="inboundHeader"
              query="/ns2:InboundFileHeaderType/ns2:fileName"/>
        <to variable="outboundHeader" part="outboundHeader"
            query="/ns2:OutboundFileHeaderType/ns2:sourceFileName"/>
      </copy>
      <copy>
        <from variable="inboundHeader" part="inboundHeader"
              query="/ns2:InboundFileHeaderType/ns2:directory"/>
        <to variable="outboundHeader" part="outboundHeader"
            query="/ns2:OutboundFileHeaderType/ns2:sourceDirectory"/>
      </copy>
    </assign>you should be good to go. If you just want pass through then you don't need the native format set to opaque, with no XSLT
cheers
James

FTP Adapter File Size Limit

Hi,
Is there a limit on file size for FTP 'put' operation in BPEL/ESB FTP adapter for the file in ASCII format?
For File adapter polling the limit is 7 MB unless Debatching feature is used I think.
Thanks

There used to be but in 10.1.3.4 the restriction has been lifted but there are some restrictions. If you have File / Ftp input and File / Ftp out put you can use the MOVE functionality
http://download.oracle.com/docs/cd/E12524_01/relnotes.1013/e12523/adapters.htm#CHDHJGHG.
If you are using DB adapter this won't work and the 7MB file limit exists, although this is really streatching it. I wouldn't go above 1MB. Oracle Data integrator is a good option for this kind of pattern.
cheers
James

Soa 10g Ftp adapter file size

Hi,
I am using a ftp adapter to transfer files. I am placing a 9kb file but after the transfer at the destination I find the file transferred but the file size is 2.8kb. Please do suggest me the possible solution and the reason for this issue
Thanks

What 10g version do you have?
Try adding the following property to your outbound ftp wsdl file:
<partnerLinkBinding name="xxxxx">
*<property name="control.read.timeout">10000</property>*
</partnerLinkBinding>
(it's in milliseconds)
Arik

CRIO FTP transfer file size limit

Hi,
I generated a data file on my cRIO that is about 2.1 GB in size. I'm having trouble transferring this file off of the cRIO using FTP. I've tried windows explorer FTP, the built in MAX file transfer utility, coreFTP,and WinSCP. I am able to transfer other files on the cRIO that are smaller in size.
Is there an FTP transfer file size limit? Is it around 2 GB? Is there anything I can do to get this file off of the device?
Thanks!
Solved!
Go to Solution.

I am not making the FTP transfer programmatically through LabVIEW. Rather, I am trying to utilize the cRIO's onboard FTP server to make the file transfer using off the shelf Windows FTP file transfer applications. I generate the data file by sampling the cRIO's analog inputs and recording to the onboard drive. I transfer the file at some point after the fact; whenever is convenient.
To program the cRIO, I am using LabVIEW 2012 SP1 and the corresponding versions of Real-Time and FPGA. I am using a cRIO-9025 controller and 9118 chassis.
I do not get any error messages from any of the FTP clients I have tried besides a generic "file transfer failed".
I have had no issues transferring files under 2 GB using FTP clients. I have tried up to 1.89 GB files. The problem seems to only appear when the file is greater than 2 GB in size.
I have found some information elsewhere online that some versions of the common Apache web server do not support transferring files greater than 2 GB. Does anyone know what kind of FTP server the cRIO-9025 runs?

How to get outbound ftp adapter file name

All,
I am writing an ftp adapter sending out files. The file name is defined as po_%yyyyMMDD%.xml format. However, I need to save the filename into a database after each file is sent out. How could I get the filename after invoking this service? It is on soa 10.1.3.3.
I tried to create a filename variable based on outbound message type and pass that long in the invoke header. But cannot get the name back. Any idea?

Hi,
Go thro' the URL:
http://abhishek-soablog.blogspot.com
Cheers,
Abhi...

Sender FTP Adapter (file transfer w/o mapping)

Hello everyone!
Is there a way to configure a Sender FTP Adapter such that it simply picks up a file in an FTP folder then moves it to another FTP folder without changing any data (no mapping needed)?
I tried doing it, but the Sender Agreement requires you specifiy an Outbound interface (which is not needed in this case). Would anyone of you know a workaround to this?
Warm regards,
Glenn

Hi
Use dummy interface name. But that should be same in ID objects
Check this
How to send any data (even binary) through XI, without using the Integration Repository
Thanks
Gaurav
Edited by: Gaurav Bhargava on Oct 29, 2008 9:48 AM

No Service Error: FTP Adapter file write

Hi,
I am trying to write a file to a FTP server (Windows).
I am able to connect to the FTP through command prompt and put the files as well.
And to connect to FTP through IE, I had to uncheck "Use Passive FTP" under Tools-Internet Options-Advanced and then I was able to access folders successfully.
But through FTP adapter, I am getting No Service Error. Below is complete error message.
summary=<summary>Exception occured when binding was invoked.
Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'Put' failed due to: Error sending file to FTP Server.
Error sending file to FTP Server.
Unable to send file to server.
Please ensure 1. Specified remote output Dir has write permission 2. Output filename has not exceeded the max chararters allowed by the OS and 3. Remote File System has enough space.
The invoked JCA adapter raised a resource exception.
Please examine the above error message carefully to determine a resolution.
</summary>
,detail=<detail>No Service Error.
No Service Error.
No service available for host: 10.91.10.38
Check the error stack and fix the cause of the error. Contact oracle support if error is not fixable.
</detail>
,code=<code>null</code>}
Thanks

I was contacted by our DBA team for an exception received while writing a file to a FTP location.
Then i looked at the exception message and asked them to check the whether they are able to contact the ftp server using command prompt then they said the user password got expired.
They reset the password and its working now.
Am i missing something here :(
Exception:
WSIF JCA Execute of operation 'Put' failed due to: Error sending file to FTP Server.
Unable to send file to server.
; nested exception is:
ORABPEL-11429
Error sending file to FTP Server.
Unable to send file to server.
Please ensure 1. Specified remote output Dir has write permission 2. Output filename has not exceeded the max chararters allowed by the OS and 3. Remote File System has enough space.
Thanks,
Vijay
Edited by: veejai24 on 25-Jul-2012 07:10

FTP Adapter - file.sender.customizer_class

Hey,
Anyone has a working example on how to implement this class?
I have one class, and apparently, in its simplest form it could be something like this:
package slf.nask.FileSender;
import java.util.Date;
import oracle.oai.agent.adapter.sdk.Agent;
import oracle.oai.agent.adapter.sdk.AttributeObject;
import oracle.oai.agent.adapter.sdk.MessageObject;
import oracle.oai.agent.adapter.technology.FileSenderCustomizer;
import oracle.oai.agent.adapter.transport.TransportMessage;
public class SLFNaskFileSenderCustomizer implements FileSenderCustomizer {
     public static void main(String[] args) {
          System.out.println("Interconnect renaming facility!");
     public String generateFileName(Agent agent, String rule, String app,
               String partitition, Date time, MessageObject mobj,
               AttributeObject aobj) {
          return "MyFilename.xml";
     public void customizeTransportMessage(Agent agent,
               TransportMessage transportMessage, MessageObject mobj,
               AttributeObject aobj) {
But I keep running into an error when running the adapter. If i comment out this class, it works fine, but once this class is in, it keep getting a parseLong error.
Log entry:
TransportProperties.TransportProperties():ota.d3ls=agresso_customer.xml;file.sender.type=ascii;file.receiver.max_msgs_retrieved=30;file.receiver.exception_dir=file://localhost/R:\nask\errors;file.sender.customizer_class=SLFNaskFileSenderCustomizer;ota.type=D3L;file.sender.file_name_rule=NA%TIME%_3.c15;ota.send.endpoint=file://localhost/R:\nask\AgressoFTP\TEST;file.receiver.polling_interval=60000;
java.lang.NumberFormatException: 1240438527
4
     at java.lang.Long.parseLong(Long.java:319)
     at java.lang.Long.parseLong(Long.java:363)
     at oracle.oai.agent.common.logger.ErrorLogObserver.readNextLogObject(ErrorLogObserver.java:361)
     at oracle.oai.agent.common.logger.ErrorLogObserver.run(ErrorLogObserver.java:137)
     at java.lang.Thread.run(Thread.java:484)

Looks like the fault here, was the package. Leave it empty and it should be fine!

FTP Adapter File Polling does not raise error when FTP server is down

Hi All,
Thanks in advance.
I am polling for new files in a FTP Server. However, if the server is down there is no way for me to catch the fault to notify someone. I am using fault-policies but that never gets triggered when polling an unavailable FTP Server.
One option is to have a completely separate scheduled process (SOA or not) that tries to connect to the servers but I am trying not to go that route just to keep things manageable and within the realm of the process.
I am sure that I am not the only one polling for new files in a FTP Server, so I thought to pick your brain to tackle this scenario.
Thanks for taking the time to read this.

I was contacted by our DBA team for an exception received while writing a file to a FTP location.
Then i looked at the exception message and asked them to check the whether they are able to contact the ftp server using command prompt then they said the user password got expired.
They reset the password and its working now.
Am i missing something here :(
Exception:
WSIF JCA Execute of operation 'Put' failed due to: Error sending file to FTP Server.
Unable to send file to server.
; nested exception is:
ORABPEL-11429
Error sending file to FTP Server.
Unable to send file to server.
Please ensure 1. Specified remote output Dir has write permission 2. Output filename has not exceeded the max chararters allowed by the OS and 3. Remote File System has enough space.
Thanks,
Vijay
Edited by: veejai24 on 25-Jul-2012 07:10

Move file with ftp adapter

Hello everyone,
Should I move some files when they appear in a specific directory.
In particular, I have a SQL query that extracts the absolute file path list.
Then I move these files to another server.
How you can configure the process to periodically check the files?
Thanks in advance
Regards

Hi,
Follow the link posted by userN, just be aware that the sample code is not quite correct on the documentation.
This question was widely discussed in this thread
Re: FTP Adapter File Move Issue
Remember! It is considered good etiquette to reward answerers with points (as "helpful" - 5 pts - or "correct" - 10pts).
https://forums.oracle.com/forums/ann.jspa?annID=893
Cheers,
Vlad

File size restriction on FTP Adapter (GET)

A customer has deployed a BPEL process that we had created that uses the FTP Adapter to download (GET) files. The customer is reporting that when they try to download a large file (about 800 MB in size), the process does not seem to kick in for more than one hour. At this point I don't know how good or bad the network speed is and how long a FTP download will take for a file of that size. But before looking into that, wanted to know if there is any restriction on how big a file can be for it to be downloaded by the BPEL FTP Adapter. If not, is there some way to find out what is wrong with the downloading or to know to progress of the FTP GET?
The user guide talks about increasing the value of transaction-config timeout in server.xml for the File Adapter. Is this applicable for FTP Adapter also and will it work if I increase this?
Thanks in advance for your attention.
Jay

Thanks for the pointer. The processes are deployed on a 10.1.3.5 instance.
Of the info I found in that article, only the following seemed applicable:
53.2.1 Setting Audit Levels from Oracle Enterprise Manager for Large Payload Processing
I can ask the customer to turn off auditing if it is on. But I am skeptical that this will resolve this issue.
The following seem to be applicable only to 11g version and I am not sure if they have any corresponding options in 10.1.3.5 (please let me know if I am mistaken):
1. 53.2.4 Using Adapter Support for Streaming Large Payloads
2. 53.2.6 Processing Large Documents in Oracle B2B
Section 53.3.1 Opaque Schema for Processing Large Payloads says the following:
There is a limitation when you use an opaque schema for processing large payloads. The entire data for the opaque translator is converted to a single Base64-encoded string. An opaque schema is generally used for smaller data. For large data, use the attachments feature instead of the opaque translator.
Based on your experience, has the FTP Adapter ever been used to download files of 800MB or larger size on a 10.1.3.5 instance? I would like to know if there is any insurmountable system limitation with this approach or is it just a question of proper configuration or is this a bug that the FTP adapter product team can look at. I assume the attachment feature is not available in 10.1.3.5.
The remaining sections don't seem applicable to the the customer scenario.
Can you please explain what ODI is?
Appreciating your input,
Jay

Issue with FTP Adapter ListFiles files with spaces in the filename

Hi
I have an FTP adapter that does a ListFiles of all the files in a directory. It comes back and everything works fine however it removes all spaces from the filename meaning when I do the GET afterwards this fails as it is a different filename.
The filename is a0eQ0000000wJVdIAM~1~ technote316.TIF note the space between ~ and technote.
When a ListFiles is done I get the following request response in BPEL execution:
<messages>
<InvokeGetFilenames_FileListing_InputVariable><part name="Empty" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><empty xmlns="http://xmlns.oracle.com/pcbpel/adapter/ftp/CommonServices/SalesforceNotifcationServices/GetFileNameFromFTPServer"/></part></InvokeGetFilenames_FileListing_InputVariable>
<InvokeGetFilenames_FileListing_OutputVariable><part name="filelist" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><filelist size="1" xmlns="http://xmlns.oracle.com/pcbpel/adapter/ftp/CommonServices/SalesforceNotifcationServices/GetFileNameFromFTPServer"><file><directory>/salesforce/006Q0000007yKcd</directory><filename>a0eQ0000000wJVdIAM~1~technote316.TIF</filename><lastModifiedTime>1305507120000</lastModifiedTime><creationTime>0</creationTime><size>1906643</size></file></filelist></part></InvokeGetFilenames_FileListing_OutputVariable></messages>
This then follows with a GET that fails:
<messages><input>
<InvokeGETfile_SynchRead_InputVariable><part name="Empty" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><empty xmlns="http://xmlns.oracle.com/pcbpel/adapter/opaque/"/></part></InvokeGETfile_SynchRead_InputVariable></input><fault>
<bpelFault><faultType>0</faultType><remoteFault xmlns="http://schemas.oracle.com/bpel/extension"><part name="summary"><summary>Exception occured when binding was invoked.
Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'SynchRead' failed due to: No Data to process.
No Data to process.
File /salesforce/006Q0000007yKcd/a0eQ0000000wJVdIAM~1~technote316.TIF to be processed was not found or not available or has no content
The invoked JCA adapter raised a resource exception.
Please examine the above error message carefully to determine a resolution.
</summary></part><part name="detail"><detail>550 /salesforce/006Q0000007yKcd/a0eQ0000000wJVdIAM~1~technote316.TIF: No such file or directory</detail></part><part name="code"><code>550</code></part></remoteFault></bpelFault></fault><faultType>
<message>0</message></faultType></messages>
I'm guessing its some use of the jca.message.encoding I can't find anything that really explains this though. Just the http://download.oracle.com/docs/cd/E12839_01/integration.1111/e10231/adptr_propertys.htm link.
Any help would be greatly appreciated.
Thanks

Hi PG,
Is your private file in the form of Java Keystore (.jks)? I had used .ppk file and it was a success.
If it is .jks in your case, try using the same password for private key as of keystore file (.jks). I hope you're not supplying any PASSWORD in the Adapter properties.
Regards,
Neeraj Sehgal

Quality of service in Receiver file/ftp adapter (SAP PI 7.1)?

Hi,
    We are building an IDoc to File scenario in SAP PI 7.1, where a single incoming idoc will create three different output files. Also files must be created in target server in a specific order.
    Our first idea to ensure that files would be created following a specific order was that Message mapping (in Java) build target payload with all three files following expected sequence.
    In addition, receiver file/ftp adapter is setup with a dynamic variable to create each file with a different filename adding also timestamp.
    Testing the scenario, we see that three files are created in target server but when we sort them by creation date, it seems they don't follow always same sequence.
    Sometimes adapter creates File1, File2, File3; next time it created File2, File1, File3 and so on.
    Our problem is that files must be created always with a specific order and we cannot use BPM. Does anyone know if a receiver file/ftp adapter can be setup to create files following specific sequence (EOIO)?
    I know that sender file/ftp adapter can be setup with a quality of service, but I didn't find anything similar for Receiver file/ftp adapter.
    Suggestions will be welcome.
Kind Regards,
Aitor

Hi,
     First, thanks all of you for your quick answers. They were helpful because we learnt a new configuration setting.
     We tried your suggestions but they didn't really fix our problem.
     Finally interface has been re-designed and we will not have to apply this logic, so no issue from our side.
     However, let me continue with this topic in case that somebody else will have the same issue, then it will be able to review this thread.
     When adapter created the files in the target directory (windows server), files had the expected timestamp in each filename. However, if we sorted windows directory contents by "Date Creation", files were sorted different that timestamp shows in the filename.
     For example, adapter created following files:
File1_20090325-115117-169
File2_20090325-115117-174
File3_20090325-115117-180
     But when we sorted windows folder contents, files were sorted as follows:
File2_20090325-115117-174
File1_20090325-115117-169
File3_20090325-115117-180
     It seems that timestamp was pre-assigned by the adapter, but when adapter created the files, it did it with a temporary name and finally assigns the filename. If a file size was bigger than other, maybe it takes more time and windows creation date is higher.
     If so, it means that adapter is not following same instructions as itu2019s indicated in "maintain order at runtime" checkbox.
     Do you know if there is any way where we can push also the order in the adapter as we did in interface determination?
Regards,
Aitor

FTP adapter : file size

Similar Messages

Maybe you are looking for