Using JCA FTP and File Adapters to transfer files as attachments

Question

I am trying to develop a flow that picks a file up using the JCA FTP adapter and writes it using the JCA File Adapter. I can get this to work using opaqeElement but the issue I have is that the files that will be transferred are regularly very large > 1 GB and using the opaqueElement simply results in a OutOfMemoryException.
Reading the Adapter documentation it seems that Reading/Writing file as an attachment may be an answer. I therefore did the following.
. Created FTP Read and File Write adapters in JDeveloper
. Inmported this in to OEPE
. Created Proxy Service and Business Service and wired them together
The problem i am having is that even though there is no error and the file is being read on the FTP server, the resulting file only contains that attachment details, the file is not a copy of the file that was picked up from the ftp server.
I am assuming that this behaviour is not correct and that the file should be transferred in its entirity. Unfortunatly the documentation is not very detailed and I cannot find any examples on the internet.
Can anyone offer any advice or even better suggest where I can find an example.
Regards
My JCA adapters are as follows:
FileWriteAsAttachmentAdapter_file
<adapter-config name="FileWriteAsAttachmentAdapter" adapter="File Adapter"
     wsdlLocation="FileWriteAsAttachmentAdapter.wsdl"
     xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/HAFileAdapter"/>
<endpoint-interaction portType="Write_ptt" operation="Write">
<interaction-spec className="oracle.tip.adapter.file.outbound.FileInteractionSpec">
<property name="PhysicalDirectory" value="C:\fileserver\download\toprocess"/>
<property name="Append" value="false"/>
<property name="FileNamingConvention" value="attachment_%SEQ%.csv"/>
<property name="NumberMessages" value="1"/>
</interaction-spec>
</endpoint-interaction>
</adapter-config>
FileWriteAsAttachmentAdapter.wsdl
<wsdl:definitions
name="FileWriteAsAttachmentAdapter"
targetNamespace="http://xmlns.oracle.com/pcbpel/adapter/file/AtatchmentApp/Project1/FileWriteAsAttachmentAdapter"
xmlns:jca="http://xmlns.oracle.com/pcbpel/wsdl/jca/"
xmlns:wsdl="http://schemas.xmlsoap.org/wsdl/"
xmlns:tns="http://xmlns.oracle.com/pcbpel/adapter/file/AtatchmentApp/Project1/FileWriteAsAttachmentAdapter"
xmlns:imp1="http://xmlns.oracle.com/pcbpel/adapter/file/attachment/"
xmlns:plt="http://schemas.xmlsoap.org/ws/2003/05/partner-link/"
>
<plt:partnerLinkType name="Write_plt" >
<plt:role name="Write_role" >
<plt:portType name="tns:Write_ptt" />
</plt:role>
</plt:partnerLinkType>
<wsdl:types>
<schema targetNamespace="http://xmlns.oracle.com/pcbpel/adapter/file/attachment/" xmlns="http://www.w3.org/2001/XMLSchema"
elementFormDefault="qualified" >
<element name="attachmentElement" >
<complexType>
<attribute name="href" type="string" />
</complexType>
</element>
</schema>
</wsdl:types>
<wsdl:message name="Write_msg">
<wsdl:part name="body" element="imp1:attachmentElement"/>
</wsdl:message>
<wsdl:portType name="Write_ptt">
<wsdl:operation name="Write">
<wsdl:input message="tns:Write_msg"/>
</wsdl:operation>
</wsdl:portType>
</wsdl:definitions>
FtpGetAsAttachmentAdapter_ftp.jca
<adapter-config name="FtpGetAsAttachmentAdapter" adapter="FTP Adapter"
     wsdlLocation="FtpGetAsAttachmentAdapter.wsdl"
     xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/ftp/TlmsHAFtpAdapter"/>
<endpoint-activation portType="Get_ptt" operation="Get">
<activation-spec className="oracle.tip.adapter.ftp.inbound.FTPActivationSpec">
<property name="AsAttachment" value="true"/>
<property name="DeleteFile" value="true"/>
<property name="MinimumAge" value="300"/>
<property name="PhysicalDirectory" value="/ftp/tlms2atas"/>
<property name="Recursive" value="false"/>
<property name="FileModificationTime" value="FileSystem"/>
<property name="PollingFrequency" value="60"/>
<property name="FileType" value="ascii"/>
<property name="IncludeFiles" value=".*[_][0-9][0-9][-][0-9][0-9][-][0-9][0-9][_].*\.csv"/>
<property name="UseHeaders" value="false"/>
<property name="ModificationTimeFormat" value="dd/MM/yyyy HH:mm"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
FtpGetAsAttachmentAdapter.wsdl
<wsdl:definitions
name="FtpGetAsAttachmentAdapter"
targetNamespace="http://xmlns.oracle.com/pcbpel/adapter/ftp/AtatchmentApp/Project1/FtpGetAsAttachmentAdapter"
xmlns:jca="http://xmlns.oracle.com/pcbpel/wsdl/jca/"
xmlns:wsdl="http://schemas.xmlsoap.org/wsdl/"
xmlns:tns="http://xmlns.oracle.com/pcbpel/adapter/ftp/AtatchmentApp/Project1/FtpGetAsAttachmentAdapter"
xmlns:attach="http://xmlns.oracle.com/pcbpel/adapter/file/attachment/"
xmlns:pc="http://xmlns.oracle.com/pcbpel/"
xmlns:plt="http://schemas.xmlsoap.org/ws/2003/05/partner-link/"
>
<plt:partnerLinkType name="Get_plt" >
<plt:role name="Get_role" >
<plt:portType name="tns:Get_ptt" />
</plt:role>
</plt:partnerLinkType>
<wsdl:types>
<schema targetNamespace="http://xmlns.oracle.com/pcbpel/adapter/file/attachment/" xmlns="http://www.w3.org/2001/XMLSchema"
elementFormDefault="qualified" >
<element name="attachmentElement" >
<complexType>
<attribute name="href" type="string" />
</complexType>
</element>
</schema>
</wsdl:types>
<wsdl:message name="Get_msg">
<wsdl:part name="attach" element="attach:attachmentElement"/>
</wsdl:message>
<wsdl:portType name="Get_ptt">
<wsdl:operation name="Get">
<wsdl:input message="tns:Get_msg"/>
</wsdl:operation>
</wsdl:portType>
</wsdl:definitions>

Answer 1

System resources are finite and have a threshold limit for processing. The Oracle SOA Suite, dependent on system resources, also has certain size limitations, largely due to the underlying resources beyond which the system cannot process incoming requests.
For example, Oracle JCA Adapters can process large payloads but the Oracle BPEL PM consumes huge memory when processing large payloads, which can cause OutOfMemory conditions and affect the whole system.
You can try File ChunkedRead option.This will read your large CSV file in chunks so chances of memory out will be less. You can define your own chunk size.
This is a feature of Oracle File and FTP Adapters that uses an invoke activity within a while loop to process the target file. This feature enables you to process arbitrarily
large files. See below link's section "4.5.5 Oracle File Adapter ChunkedRead"
http://www.orastudy.com/oradoc/selfstu/fusion/integration.1111/e10231/adptr_file.htm#BABDIABG
Thanks,
Ashu