FTP Adapter, B2b and SOA performance Test

Hi All,
We have a requirement to processes Large XML files ranging from 1 MB to 200 MB. Our Flow is FTP Adapter picks the XML's Repeatable Nodes. BPEL Transforms and Loops thru each XML node and calls B2B Adapter in Each Loop. We are doing Advanced EDI batching to aggregate all the nodes in one XML to one EDI. Files upto 7 MB are working fine with FTP fileraise property= 1 and polling frequency=300s. Files with 14MB are failing with JTA transaction Time Out (Time Out Set=500s) and Server running in PROD mode. We are using SOA Suite 11.1.1.7 and HIPAA 834 Transactions. Is there a Payload size Limitation For FTP Adapter or SOA Suite? Do we need to Follow a different approach to achieve our functionality? Do we need to set any Performance parameters? Please share your thoughts.
Thanks In Advance!!!

Pl do not post duplicates - FTP Adapter, B2b and SOA performance Test

Similar Messages

FMW B2B and SOA: sync response architecture

Hi All,
I am facing some challenges on the B2B and SOA communication.
The architecture (inbound) that we are following is B2B send a message on the JMS queue to AIAB2BInterface which in turn forwards the message to the concerned BPEL process.
The issue is with developing synchronous functional acknowledgements to trading partners in a way that it not just says "B2B received this message" but also means that "this message has been successfully processed by the backend system"(so all the BPEL processes were successful). Though B2B would have received the message successfully but the associated BPEL processes might have failed.
So when I indicate success from B2B in the synchronous functional acknowledgement I want to indicate success in the backend systems also.
Currently we are implementing async functional acknowledgement to indicate success through the backend system for which the implementation is simple; we just have the BPEL process send a message back to B2B via AIAB2BInterface upon completion.
The only solution that I have come across is use of callouts which invokes a SOA sync BPEL composite as a web service and having the sync BPEL process return an acknowledgement back to B2B upon completion/error. But this way I am not using any of the existing JMS queues and the AIAB2BInterface. This is sort of rebuilding the B2B/SOA integration architecture that is being used.
Do we have any ideas/insights on how to implement synchronous functional acknowledgement while supporting the architecture( B2B-> AIAB2BInterface -> BPEL processes) that we are using for the B2B/SOA integrations?
Thanks in advance!

You may be interested in synchronous request-reply support in B2B adapter in PS5 (11.1.1.6) -
http://docs.oracle.com/cd/E23943_01/user.1111/e10229/app_synch_support.htm#sthref873
Regards,
Anuj

FTP Adapter: Inbound and Outbound flat files

Having lots of trouble trying to Send messages (via Subscribe event) with my FTP adapter, with this specific error:
Thu May 12 11:39:10 MDT 2005: Bridge { agent=oracle.oai.agent.client.AgentImpl@2f48d2 application=PAGOFTPAPP partition=null active=true #d3ls=1 } cannot handle OAI message of type newFacility.
I am successfully processing my flat file messages into OAI (via Publish event) and they are being properly written to the OAI_HUB_QUEUE. The message gets all the way to the Bridge, which posts the above error. Can anyone tell me how the Bridge attempts to determine what to do with the messages?
In creating the subscribe event I specified my desired D3L file as the application view, before doing the mapping. I then tried creating mappings at both the top (struct via ObjectCopy) and granular (fields via CopyFields) levels, and always get the same error.
Under "Modify Fields" for the subscribe event I confirmed that ota.isDL3=true and ota.d3lPath points to the D3L XML file that I used to specify the application view (and incidentally is the same one used to process the files that I am processing with the Publish event). I'm trying to get up to speed with OAI and my first test is simply to read in a tab-delimited file and turn around and write it back out to the same structure (but of course to a different target directory).
Much thanks for any assistance anyone can offer! Due to some kind of administrative hiccup we seem to have lost our iTAR capability and it's taking forever to get it back (of course at the worst possible time...)
Richard

Richard,
Not sure if you have found a way around this problem yet, but it sounds like you may have a mismatch bewteen iStudio and your D3L XML that's used to define and transform the message.
In the XML, name should be set to your iStudio defined 'event name', object should be set to the 'business object' and the type should be set to related 'App Data Type'.
As an example of a subscribed event
Subscribe(GLCosts.maintain_costs)
using an ADT called CostRecord...it's a good idea to name your message the same as the type when defining the Application view using the Subscribe Wizard, i.e. don't manually change anything.
So your message header in the D3L XML would look like this:
<message name="maintain_costs" type="CostRecord" object="GLCosts">
HTH
Nick

Installation of B2B and SOA as single installation

We need to install Oracle B2B and Oracle SOA Suite as part of a single installation on a single node. Please suggest appropriate versions and necessary patchsets to be applied.

Please refer http://www.oracle.com/technology/products/integration/b2b/pdf/B2B_SOA_Suite_Installation.pdf
Rgds,Ramesh

SSH reset exception via ftp adapter BPEL and ESB

In our BPEL project and our ESB project using FTP adapters everything starts off good connection. files moving, E.T.C. However whenever it pleases it will throw an SSH reset exception. I checked with the admin's of the server's we are connecting to. And they say there should be no reason why Ex. Permissions, connection time your allowed, E.T.C. I observed what happens as these files get picked up and dropped off. (I set up a little test env at home) We have three files moving. So everytime it polls it has to reconnect Just wanted to throw that in there i mean its obvious but. Anywho is there a setting in BPEL.xml or some ESB file that has the TTL for the connection to a server or something or is anyone encountered an SSH reset exception

Are you using Linux servers to run your SSHD? If so, this is a known problem not limited to the SOA Suite. It turns out that there are many issues with this even when you use e.g. Putty. Causes can range from network hardware to certain firewall implementations (masquerading issues). If there's a firewall in play, you might want to give it a try to see if the problem also occurs if you bypass it. IMHO you should try and verify if the connections keep alive 'outside' of the SOA Suite on the same host..
HTH,
Bas

Oracle MDS cache for B2B and BPEL performance Issue

Hi All,
We have xmx set to 4GB and we have set the b2b.mdsCache to 400 MB.
Our process runs as JMS --> B2B --> JMS --> Composite app(mediator and BPEL)--> OSB
In composite application in one of the step mediator publishes events to EDN.
Now when we dont have B2B MDS cache set to 400 MB, The composite process completes within a second
But when we have b2b mds cache in b2b-config.xml set to 400 MB then the composite app takes 20 sec to complete. when we analyzed this we found that mediator is taking 10 second to publish the even to EDN which inturn increasing the over all processing time as message is being published to END twice in this composite app.
Even subscribing to event is very slow almost 9 sec.
Env Details :
Soa 11.1.1.5 on linus 5.1, in dev mode with default settings
xms - xmx = 2GB - 4GB
We set the b2b.mdscache to 400 mb as per the Oracle doc as below:
A ratio of 5:1 is recommended for the xmx-to-mdsCache values. For example, if the xmx size is 1024, maintain mdsCache at 200 MB
Regards
SVS

Unfortunatly, the only way to tune the cach buffer chains latch is on the application side.
Look for ways to eliminate subqueries by replacing them with inline views and joins. Given the high fetch rate in the buffer cache, this would appear to be the problem.

SOA FTP Adapter Performance Optimization

The application scenario is as below
There is a remote FTP service which receives real-time XML files (may be 2 files per second). In my SOA 11g application, I am using FTP adapter to connect to the remote FTP server. The FTP adapter polls for new files based on the file creation timestamp and after processing, deletes the files. All good so far, no issues at all.
However, there is a huge backlog in the files. How can improve or speed up the FTP adapter process to match or better the remote FTP file creation rate? Please note I am not doing much processing here, just perist the files to a database. The consuming application expects real-time file feed.
There should be some configuration in SOA FTP adapter to optimize the performance and beat the file spitting FTP monster.
Thanks

However, the inbound FTP location receives around 30 files in a second max. How do I configure the FTP adapter to beat this rate. I looked through the document link and tried few trials
MaxRaiseSize: 20
SingleThreadModel: both true and false
ThreadCount:20
However, I still cannot beat the rate at which the files are put to this location. Please what configuration changes shhould I consider.
Thanks
Edited by: user5108636 on 17/10/2010 21:34

Stress and Performance test SAP NW EP7

Hi Experts,
Is there any application that we can use for stress/load and/or performance testing on
SAP NW7 EP7 SP15.
We are on Windows 2003/ Oracle 10g
Thanks,

Hi,
You can book a GoLive service as per your requirement.
Refer https://websmp107.sap-ag.de/supportofferings
Thank you,
Tilak

Dynamic file name creation using FTP adapter wired from a mediator

Hi All,
My Requirement is as follows....
Mediator is wired to Three FTP adapters to create three files.
File names are dynamic.
In the mediator those three routings, mappings and assignment for the directory and file name are being created.
But out of 3 files, 2 files are being created with the names mentioned during the FTP adapter configuration and the last one is being created
with the dynamic value.
Any help in this regard is highly thankful.
Thank you.
Srivatsasa.

Create a UDF in mapping taking counter from IDoc as input parameter
DynamicConfiguration conf = (DynamicConfiguration) container.getTransformationParameters().get(StreamTransformationConstants.DYNAMIC_CONFIGURATION);
DynamicConfigurationKey key = DynamicConfigurationKey.create("http://sap.com/xi/XI/System/File","FileName");
String totalFilename = "AAAA_" + counter;
conf.put(key,totalFilename);
return totalFilename;
Map output of this UDF to Top node at target.
you will not be able to see the result in test tab of mapping but it works end to end
Select Adapter Specific Message Attributes in receiver file adapter..here select filename checkbox

Issue with List Files option in FTP Adapter-

Hi All,
I am getting the following error when I am using the list files option inside FTP adapter. The soa Version I am using is 11.1.1.5
Exception occured when binding was invoked. Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'FileListing' failed due to: Error in listing files in the remote directory. Error in listing files in the remote directory. Unable to list file in remote directory. Please make sure that the ftp server settings are correct. ". The invoked JCA adapter raised a resource exception. Please examine the above error message carefully to determine a resolution.
I have configured FTP adapter successfully by giving the following details,
useSftp –
username –
password -
host -
port –
authenticationType –
preferredCipherSuite -
and it is working perfectly for getfiles option and it is reading files successfully, but it is throwing error when I am using list files option. I tried this option for listing the files that are in remote directory. Any Help would be appreciated.
Complete fault
<messages>
<input>
<Invoke1_FileListing_InputVariable>
<part name="Empty">
<empty/>
</part>
</Invoke1_FileListing_InputVariable>
</input>
<fault>
<bpelFault>
<faultType>0</faultType>
<bindingFault>
<part name="summary">
<summary>Exception occured when binding was invoked. Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'FileListing' failed due to: Error in listing files in the remote directory. Error in listing files in the remote directory. Unable to list file in remote directory. Please make sure that the ftp server settings are correct. ". The invoked JCA adapter raised a resource exception. Please examine the above error message carefully to determine a resolution. </summary>
</part>
<part name="detail">
<detail>No such file</detail>
</part>
<part name="code">
<code>null</code>
</part>
</bindingFault>
</bpelFault>
</fault>
<faultType>
<message>0</message>
</faultType>
</messages>
May 9, 2013 4:32:00
Edited by: BK574 on May 9, 2013 2:47 PM

Is this a bug in SOA suite?
Following are the properties inside JCA file
<adapter-config name="List" adapter="FTP Adapter" wsdlLocation="List.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/ftp/FTPService" UIincludeWildcard="*.*"/>
<endpoint-interaction portType="FileListing_ptt" operation="FileListing">
<interaction-spec className="oracle.tip.adapter.ftp.outbound.FTPListInteractionSpec">
<property name="PhysicalDirectory" value="*.*"/>
<property name="Recursive" value="true"/>
<property name="IncludeFiles" value="*.*"/>
</interaction-spec>
</endpoint-interaction>
</adapter-config>
Edited by: BK574 on May 10, 2013 6:30 AM
Edited by: BK574 on May 10, 2013 6:31 AM

File size restriction on FTP Adapter (GET)

A customer has deployed a BPEL process that we had created that uses the FTP Adapter to download (GET) files. The customer is reporting that when they try to download a large file (about 800 MB in size), the process does not seem to kick in for more than one hour. At this point I don't know how good or bad the network speed is and how long a FTP download will take for a file of that size. But before looking into that, wanted to know if there is any restriction on how big a file can be for it to be downloaded by the BPEL FTP Adapter. If not, is there some way to find out what is wrong with the downloading or to know to progress of the FTP GET?
The user guide talks about increasing the value of transaction-config timeout in server.xml for the File Adapter. Is this applicable for FTP Adapter also and will it work if I increase this?
Thanks in advance for your attention.
Jay

Thanks for the pointer. The processes are deployed on a 10.1.3.5 instance.
Of the info I found in that article, only the following seemed applicable:
53.2.1 Setting Audit Levels from Oracle Enterprise Manager for Large Payload Processing
I can ask the customer to turn off auditing if it is on. But I am skeptical that this will resolve this issue.
The following seem to be applicable only to 11g version and I am not sure if they have any corresponding options in 10.1.3.5 (please let me know if I am mistaken):
1. 53.2.4 Using Adapter Support for Streaming Large Payloads
2. 53.2.6 Processing Large Documents in Oracle B2B
Section 53.3.1 Opaque Schema for Processing Large Payloads says the following:
There is a limitation when you use an opaque schema for processing large payloads. The entire data for the opaque translator is converted to a single Base64-encoded string. An opaque schema is generally used for smaller data. For large data, use the attachments feature instead of the opaque translator.
Based on your experience, has the FTP Adapter ever been used to download files of 800MB or larger size on a 10.1.3.5 instance? I would like to know if there is any insurmountable system limitation with this approach or is it just a question of proper configuration or is this a bug that the FTP adapter product team can look at. I assume the attachment feature is not available in 10.1.3.5.
The remaining sections don't seem applicable to the the customer scenario.
Can you please explain what ODI is?
Appreciating your input,
Jay

Linkage Error in Mapping and Operation mapping testing for Synchronous in NWDS

Dear Experts,
Hope you all are doing fine..
I am working in a synchronous scenario Proxy via SAP PI 7.4 to JAVA Application supporting JSON.I wrote JAVA program to convert JSON to XML and while performing test for the JAVA mapping in response structure at Operation Mapping,I am receiving following error..
LinkageError at JavaMapping.load(): Could not load class: json2xml/bin/pack/EsrJson2Xml
java.lang.NoClassDefFoundError: json2xml/bin/pack/EsrJson2Xml (wrong name: pack/EsrJson2Xml) at
java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:735)
at java.lang.ClassLoader.defineClass(ClassLoader.java:716) at java.lang.ClassLoader.defineClass(ClassLoader.java:537)
at com.sap.aii.ib.server.mapping.execution.MappingLoader.findClass(MappingLoader.java:195)
at java.lang.ClassLoader.loadClass(ClassLoader.java:372) at java.lang.ClassLoader.loadClass(ClassLoader.java:313)
I followed some of discussions for the Linkagae error http://scn.sap.com/thread/1418477 but could not help..
Following are details of my NWDS and PI server:
SAP NetWeaver Developer Studio
SAP Enhancement Package 1 for SAP NetWeaver Developer Studio 7.3 SP10 PAT0000
Compiled the project with JAVA SE-1.6 as well as 1.5
SAP PO 7.4 Java Only , Release: NW731CORE_10_REL
SP: 05 JDK: jdk16 Latest Change: 353688
I have taken care to export all the Jar files used in NWDS to be exported and then imported as Archived files in PI server.
But could not see the 5 jar files in ESR. I hope there is some issue with name as can see in the log.Can the issue be solved?
How to test the Operation mapping for Synchronous Message in NWDS?
Regards
Rebecca

Dear Hareesh and Experts,
I resolved the issue by doing the below steps.
1. Downloaded the JDK5 and updated the Java console i.e. JRE 15.
2. I had created this project using the JAVA Compiler with JAVA SE1.6 initially. Changed this to 1.5 in the Properties of the Project.
3. Uploaded the project again in ESR Imported Archive.
The issue is solved.
Thanks a lot for all your inputs.

Configuration for ftp adapter in soa11g

hi,
I am new in soa11g,can anyone help me for how to configure ftp adapter in console, to use ftp adapter.
thanx and regards
prashant
Edited by: 857480 on 10-May-2011 02:55

thanxs,
but now i am getting exception like
BINDING.JCA-12563 Exception occured when binding was invoked. Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'Put' failed due to: JCA Binding Component connection issue. JCA Binding Component is unable to create an outbound JCA (CCI) connection. ftpDemo:put [ Put_ptt::Put(body) ] : The JCA Binding Component was unable to establish an outbound JCA CCI connection due to the following issue: BINDING.JCA-12510 JCA Resource Adapter location error. Unable to locate the JCA Resource Adapter via .jca binding file element <connection-factory/> The JCA Binding Component is unable to startup the Resource Adapter specified in the <connection-factory/> element: location='eis/Ftp/PrashantFtp'. The reason for this is most likely that either 1) the Resource Adapters RAR file has not been deployed successfully to the WebLogic Application server or 2) the '<jndi-name>' element in weblogic-ra.xml has not been set to eis/Ftp/PrashantFtp. In the last case you will have to add a new WebLogic JCA connection factory (deploy a RAR). Please correct this and then restart the Application Server Please make sure that the JCA connection factory and any dependent connection factories have been configured with a sufficient limit for max connections. Please also make sure that the physical connection to the backend EIS is available and the backend itself is accepting connections. ". The invoked JCA adapter raised a resource exception. Please examine the above error message carefully to determine a resolution.
plz help.
regards
prashant

Installing B2B with SOA suite 10.3.1

I have installed SOA suite 10.3.1 and Oracle XE as DB. Now, I want to install B2B, could anyone give me pointers as to where to download it from and how to go about the installation process. Thanks in advance

Hello,
The latest version of Oracle AS B2B is 10.1.2.0.2. Please download B2B from OTN Download site under Application server + Application Server 10g (10.1.2.0.2) + Application Server Integration(10.1.2.0.2).
Please let us know if you have any questions.
Also, you may be interested in taking a look at the Installation Best practices document for B2B and SOA suite in the following URL.
http://www.oracle.com/technology/products/integration/b2b/pdf/B2B_SOA_Suite_Installation.pdf
Rgds,Ramesh

SOA 10g: Dynamic Host Name and Port in FTP Adapter

Hello All,
I am using GET operation in FTP Adapter. I wanted to make Hostname,portName,Username and Password Dynamic.
Pls suggest how to achieve this in SOA 10g.
thanks,
Ab

or http://blogs.oracle.com/adapters/2010/04/changing_the_connection_factory_jndi_dynamically_in_ftp_adapter.html
the make the jndi dynamic, but you still have to setup all the jndi lookups before you can dynamically can change them

FTP Adapter, B2b and SOA performance Test

Similar Messages

Maybe you are looking for