Batching in sync read file adapter

Dear All,
Is there any way we can do batching in sync read file adapter ?
I am at SOA Server 10.1.3.4 MLR#5.
Please share if any information.
Best Regards
Arc

Hi:
An alternative is that , before u try to read it, u make a list directory, and search for ur file, if it is not in the list, then u don't read; otherwise, u do.
The list operation is part of the file adapter.
hope this helps
best

Similar Messages

Syn read file adapter throwing exception when file is not present directory

Hi Team,
Requirment is to check for a file is present in a soa directory .If present delete the existing and write a new one.
Syn read file adapter is throwing errors when file is not present in the directory soa local.
Any paramter we can add to skip this exception.
any help is appreciated.
Thanks all
Swetha H.

Hi:
An alternative is that , before u try to read it, u make a list directory, and search for ur file, if it is not in the list, then u don't read; otherwise, u do.
The list operation is part of the file adapter.
hope this helps
best

JSP Batch uploading and reading file.

Hi,
I am not really sure if this is even possible but i was thinking of doing a upload option for my client base on a template design.
The client will be using the template to keep in data and upload it to the system.
The system will then read the data from the template and process it. Normally should be just to update the database.
But I have no idea where to start this from and how should the system read the data from the template.
Please advice.

sry i was typing that post half away.
What i meant was :
1. Client will have the ability to upload a set of data keyed into a template provided
2. The system that received the template file (eg. Excel Format). Read the file and insert the data into the database.
Instead of the Client entering all the data via the add record option (which only add one record at a time).

ESB/File Adapter - XML files containing multiple messages

Hi,
In all the examples on file adapters I read, if files contain multiple messages, it always concerns non-XML files, such as CSV files.
In our case, we have an XML file containing multiple messages, which we want to process separately (not in a batch). We selected "Files contain Multiple Messages" and set "Publish Messages in Batches of" to 1.
However, the OC4J log files show the following error:
ORABPEL-12505
Payload Record Element is not DOM source.
The Resource Adapter sent a Message to the Adapter Framework which could not be converted to a org.w3c.dom.Element.
Anyone knows whether it's possible to do this for XML files?
Regards, Ronald

Maybe I need to give a little bit more background info.
Ideally, one would only read/pick-up small XML documents in which every XML document forms a single message. In that way they can be processed individually.
However, in our case an external party supplies multiple messages in a single batch-file, which is in XML format. I want to "work" on individual messages as soon as possible and not put a huge batch file through our ESB and BPEL processes. Unfortunately we can not influence the way the XML file is supplied, since we are not the only subscriber to it.
So yes, we can use XPath to extract all individual messages from the XML batch-file and start a ESB process instance for each individual message. But that would require the creation of another ESB or BPEL process which only task is to "chop up" the batch file and start the original ESB process for each message.
I was hoping that the batch option in the File adapter could also do this for XML content and not only for e.g. CSV content. That way it will not require an additional process and manual coding.
Can anyone confirm this is not supported in ESB?
Regards,
Ronald
Message was edited by:
Ronald van Luttikhuizen

High Availability File Adapter in OSB

If you use the JCA FileAdapter in OSB, it is necessary to use the eis/HAFileAdapter version, to ensure that only one instance of the adapter picks up a file; you must then configure a coordinator, by setting the
controlDir, inboundDataSource, outboundDataSource, outboundDataSourceLocal, outboundLockTypeForWrite
parameters.
controlDir refers to the filesystem, the others to the DB
This document http://www.oracle.com/technetwork/database/features/availability/maa-soa-assesment-194432.pdf says
"Database-based mutex and locks are used to coordinate these operations in a File Adapter clustered topology. Other coordinators are available but Oracle recommends using the Oracle Database."
Using a Oracle Database as coordinator means using RAC, otherwise no HA.
I wonder if anybody has been successful setting up HAFileAdapter without using a DB?
If DB is required, I am considering using the good old "native" OSB File Poller, since it doesn't require complicated setup to be run in a cluster... but I don't want to use MFL, I would rather use the XSD-based Native Format. Here comes the second question:
Is it possible to use the nXSD translator using the OSB Native File Poller - instead of the JCA Adapter?
Thank you so much for your help - it will be rewarded with "helpful/answered" points .
pierre

I wonder if anybody has been successful setting up HAFileAdapter without using a DB?
I have not tried it but I think there are several options available invlucing writing your own custom mutex. Please find the details in Oracle File and FTP Adapters High Availability Configuration section on this link
http://download.oracle.com/docs/cd/E14571_01/core.1111/e10106/ha_soa.htm#sthref434
Is it possible to use the nXSD translator using the OSB Native File Poller - instead of the JCA Adapter?
When you create a JCA Adapter based Proxy Service to read the files, the nXSD translation happens before the proxy service is invoked. JCA Engine first reads the data, translates using nXSD and then invokes the Proxy with the translated content. (You can verify this easily by creating a JCA based file read service and open the test console for it in sbconsole, it will show you XML request instead of native).
So you can not read the text content using File Transport of OSB and then calling nXSD directly or calling an nXSD based Proxy Service.
HOWEVER, you certainly can use file and nXSD in a combination if thats what you want.
1. Create a Synchronous Read File Adapter with an nXSD created for it
2. Create a Business Service for that Synchronous Read JCA in OSB
3. Create a File Transport based service in OSB which will read the content of file and then call the Business Service to again read the content (which will include the translation using nXSD defined in step one to convert the content to XML).
So basically you will need to read the file twice! Once using File Transport Proxy service (which will take care of polling in cluster) and then using Sync Read JCA based business service(which will do nXSD translation). To reduce the impact of reading the file twice you can use trigger files. File Proxy to read trigger file and and invoke JCA business service to read the actual file for that trigger.
Another alternative can be to create a similar class as present here(http://blogs.oracle.com/adapters/entry/command_line_tool_for_testing) but instead of writing a file it will just return the translated content. Call this class with native content from the File Transport proxy using a Java Callout to do the translation.

SOA Suite 11g File Adapter End Of Line problem

I am using a file adapter to read(using an NXSD to convert from flat file to XML) a file do some filtering and then write the file in the original format using the same NXSD.
The records in my file are separated by End Of Line. i.e. each line is one record.
I created a fixed length NXSD and it picks up '${eol}' as the cellSeparatedBy attribute.
When I read the file, it reads fine for both Unix(LF) and PC(CR+LF) formats. But when I write it automatically takes unix format most probably because the server is running on a Unix machine.
Now the problem is that when I receive a flat file in PC format, the output comes as Unix format. The end system can not process it.
So, I tried using '
' (Equivalent to CR+LF) instead of '${eol}' as the value of attribute cellSeparatedBy. With this it is not able to read the file at all, if I keep it only '
' then it reads. It seems that while reading FIle Adapter automatically converts the file to Unix format first and then reads it with unix EOL.
As a work around I separated the NXSD for read and write, keep read NXSD with '${eol}' while keeping write NXSD as '
' then my problem is solved but now I have two NXSDs to maintain.
What I want to know is if there is a way I can use the same NXSD and still be able to write the file in PC format. May be some attribute or switch in NXSD which I dont know of to control the value of ${eol}?

Hi Daniel,
you can try to use this adapter module:
localejbs/SAP XI Sample/ConvertCRLFfromToLF
http://help.sap.com/saphelp_nw04/helpdata/en/32/43d84072378031e10000000a1550b0/content.htm
Hope this help.
Francesco

File Adapter Write missing files

Hello
I have some trouble with a bpel process containing a file adapter that should write files to disk. Each bpel-process is started when a read file adapter reads a new matching file (*.xml).
I have tested the process with a few files (5-20) and a new process is started for each file, and at the end of the process a new file is written to disk by the file adapter (Write). But when I am testing with a large number of files (40-50 files) something strange happens.
A new process is started for each file, but it looks like the file adapter that should write files to disk is not capable to handle the pressure. 10-20% of the processes doesnt complete as expected. In the BPEL Console everything looks ok, it seems like the File Adaper has written a file to disk, no error is trown. But when I look in the directory the file is not there...
Has this something to do with performance? Is there any parameters or settings I can tune to make the file adapters work better? Sometimes it also looks like the file adapter (read) doesnt manage to start a new process for each incomming file even if they are deleted and archived...

I ran into a similar issue. As a workaround we ended up just using java to write the files out. When the File Adapter attempts to write out a file it first writes that file to a temp file and then copies that to the appropriate directory.
I believe that when two or more threads were attempting to write at the same time the write was failing for one (but appearing to work in the console logs). I think a race condition may be created when two threads attempt to write using the File Adapter for access to the temp file. I contacted my oracle rep about it but they are always pretty worthless so I havent ever heard anything back concerning the issue.

Problem Using File adapter(Urgent)

Hi,
I have a simple ESB service where I have one Read File adapter for reading a file and other Write file adapter to write the same file to a folder.
I was able to deploy it to ESB instance successfully.
But when I put a file to read ESB is throwing
"OracleASjms/ESBDeferredTopic" error.
Can any one please help me.
Thanks
Rao.

We would be able to help you better if you provided the full error stack as this is very generic.
Generally the most common issue with the file adapter is permissions, make sure the SOA suite owner is able to read and write on the directory and the file.
otherwise post the error stack which may identify the real cause.
cheers
James

How to test File Adapter from EM Console

Hi All,
I have one issue with File Adapter where I am trying to implement a simple BPEL process. Below are the steps;
1. I have created an empty BPEL process and then add a read file adapter to the left side which will read from a file aa.txt which is present in D:\work folder. File is having data like XXXX,YYYY,ZZZZ. (I have used Native builder for schema generation)
2. Then I have added Write file adapter on the right side which will write to an other file bb.txt.
Then I have rebuild and deploy this on weblogic SOA server but on the EM console I am not able to test it as Test button is disabled. Then how to test this scenario? Also I tried testing by placing a new file aa1.txt in the same directory with some content. Logically it should be picked up and then write it to the bb.txt but it is not happening.
Can anyone please help me in this as how to troubleshoot it.
Thanks
RJ

Thanks for the reply.
So if i understood correctly it means that we cannot test it using EM console as we have read adapter on the left side because of which we have not exposed it as SOAP service. When we put any file in the D:\XXX then automatically read adapter will pick that up and create one instance in the EM console and then write adapter will write it into the destination file?
But in our case no instance is getting created in the EM console even when I am copying a file to the directory. Below is the read_file.jca
<adapter-config name="Read" adapter="File Adapter" wsdlLocation="Read.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/FileAdapter" UIincludeWildcard="rj*.txt"/>
<endpoint-activation portType="Read_ptt" operation="Read">
<activation-spec className="oracle.tip.adapter.file.inbound.FileActivationSpec">
<property name="DeleteFile" value="false"/>
<property name="MinimumAge" value="0"/>
<property name="PhysicalDirectory" value="D:\mywork"/>
<property name="Recursive" value="true"/>
<property name="PollingFrequency" value="60"/>
<property name="IncludeFiles" value="rj.*\.txt"/>
<property name="UseHeaders" value="false"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
Please help as why it is not getting picked up?
Regards
RJ

How to get file name using File adapter Sync read

Hi All,
I am using SOA 10.1.3.3 and JDEV 10.1.3.3.
I have an async bpel process.
I have to read file name in this process... so i have used file adapter sync read operation.
How can we get the file name with out payload using sync read.
For normal read (Inbound Spec)we have UseHeaders="true" property.
Is there any property for sync read to read the file name.
Please help me
Regards
PavanKumar.M
Edited by: [email protected] on Oct 27, 2009 11:23 PM

Hi Eric,
The info in the link provided by you is for a normal read.
I need to read he file name using Sync read operation.
Regards
PavanKumar.M

File Adapter sync reading error

I am getting the following error trying to read a pdf file using file adapter
<assign name="Assign2">
<copy>
<from variable="receiveInput_process_InputVariable" part="filename"/>
<to variable="file"/>
</copy>
<copy>
<from variable="receiveInput_process_InputVariable" part="filename"/>
<to variable="Invoke1_SynchRead_InputVariable" part="filename"/>
</copy>
</assign>
<invoke name="Invoke1"
inputVariable="Invoke1_SynchRead_InputVariable"
outputVariable="Invoke1_SynchRead_OutputVariable"
partnerLink="ReadBomFile" portType="ns7:SynchRead_ptt"
operation="SynchRead" bpelx:invokeAsDetail="no">
<bpelx:inputProperty name="jca.file.FileName"
variable="file"/>
</invoke>
<assign name="Assign1">
<copy>
<from variable="receiveInput_process_InputVariable" part="filename"/>
<to variable="replyOutput_process_OutputVariable" part="filename"/>
</copy>
<copy>
<from variable="Invoke1_SynchRead_OutputVariable" part="opaque"/>
<to variable="replyOutput_process_OutputVariable" part="filestream"/>
</copy>
</assign>
error i am getting
<messages>
<input>
<Invoke1_SynchRead_InputVariable>
<part name="filename">
<filename xsi:type="xsd:string">Bom.pdf</filename>
</part>
</Invoke1_SynchRead_InputVariable>
</input>
<fault>
<bpelFault>
<faultType>0</faultType>
<bindingFault>
<part name="summary">
<summary>Exception occured when binding was invoked. Exception occured during invocation of JCA binding: "JCA Binding execute of Reference operation 'SynchRead' failed due to: null". The invoked JCA adapter raised a resource exception. Please examine the above error message carefully to determine a resolution. </summary>
</part>
<part name="detail">
<detail>null</detail>
</part>
<part name="code">
<code>null</code>
</part>
</bindingFault>
</bpelFault>
</fault>
<faultType>
<message>0</message>
</faultType>
</messages>
Thanks
Thomas

Hi,
You have use the attribute quotedBy... By default, the specified string is &quot; ("). If your data includes this character, you must override this default even if the field is not quoted.
For example:
{code}
<element name="field" type="string" nxsd:style="terminated" nxsd:terminatedBy=";" nxsd:quotedBy="<"/>
{code}
Read this...
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/nfb.htm#CHDBBECG
Cheers,
Vlad

Can I stop batch reading, if any error comes in a batch, in File Adapter

Hi All,
I am reading files in batches of 100 lines as there are 1000 records. Can I stop further reading of records from a file, If any error comes in any batch.
e.g. If my file adatpter is readinf 101 lines, if any error comes in this line, then it should stop reading line 102 and so on.
Regards

Hi Vikas,
I am not sure what you mean exaclty by stop reading - would you be fine if the other lines are rejected till end of file, if an error is encountered?
Then you can achieve that by ensuring that your schema does not have nxsd:uniqueMessageSeparator="${eol}" in the schema element.
http://download-west.oracle.com/docs/cd/B31017_01/integrate.1013/b28994/adptr_file.htm#CACEGBFD
I am not entirely sure if that would be a good design decision though.
Regards,
Shanmu.
Edited by: sthiagar on Feb 5, 2010 9:23 PM

Read from a config file in File Adapter in SOA Suite 11g

I want to read from a config file in order to determine whether to archive or delete the file after processing using file adapter in SOA Suite 11g. How do i do that.

only part i replied on was the part of how to read a file
but i think in your case you could do the next
use the sync file adapter to read in the file during your process
based on this content you set a variable "myOutputDirectory"
then create a file adapter (write) which will store the file on file system
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#CIACICFD
4.3.2.2.5 Specifying a Dynamic Outbound File Name
and use that (jca.file.Directory) property to store the file either on the archive location or the delete location

Synchronous Read in File Adapter

Hi,
Could you please explain one example scenario for Synchronous Read in File Adapter?
Thanks,
kpr

This is end to end case
Assume u have file coming from 2 differnt source in 2 differet inbound file adapter you can read this at a same time and do assign,transform etc in bpel and send one file to next process for further processing. in this type of scenario we use a Sync file read
Note: the 2 files come at same time to inbound file adapter.

Need file adapter polling with read operation to be triggered by a BPEL without using synchronous read

The scenario is:-
Web Service Client -->input-->BPEL-->if input valid-->trigger file adapter with read operation--> receive file
i am not able to stop the polling until it is required to trigger the polling.
As soon as i deploy the composite the file adapter starts polling without waiting for input.
Since i am using two receive activities, the second one which is suppose to receive file from file adapter is always showing pending state. (asynchronous callback)

Hi there,
IMHO the traditional read is used only as inbound operation, that means
that it starts polling the input folder as soon as the composite gets
deployed - which is the same you are experiencing.
In your case you need an outbound operation that needs to be invoked at
a certain moment. I don't know what are the reasons not to use sync
read, but this is the only outbound read operation supported by the
adapter. If you can not use the sync read, then you would have to design
some custom solution where you call a web service or EJB for instance
that reads the desired files.
Another option I can think of, though have not use personally is using
the adapters programatically in Java - take a look at this blog post as
it seems related to this topic -
https://technology.amis.nl/2012/01/22/using-the-oracle-weblogic-technology-adapters-with-custom-java-message-driven-bean-mdb-triggered-by-file-adapter-part-of-the-story/.
Hope this helps,
A.

Batching in sync read file adapter

Similar Messages

Maybe you are looking for