File Batching in OSB

Hi ,
I have a requirement in OSB project where I need to merge files before sending it to target application.
For some reason we prefer not to maintain either queue/directory/file server to save incoming files.
Target application will poll the final merged file from the queue which is placed at the end of the process where we store all the files for Target system.
Can some one please suggest me the best and clean way to deal with this situation?
Thanks,
Harika.

I have a Scenario like this OSB should insert in the table and and SOA should update in the same table
I have 2 database tables "main" table has columns (rid,rname) and the "reporting" table has id,message,updatemesage
I used file adapter JCA to create a Proxy Service and created a BPEL One way process in SOA to insert the data in the database "main" table in batches
Using that BPEL Endpoint URI WSDL, i created a business service and that business service is used in publish to insert the data in the database "main" table
and used a Database adapter JCA to create a business service and using publish i need to insert id,message in "reporting" table and i need to update"reporting" table last column using BPEL the last column is "update message"
I completed till inserting the id,message in "reporting" table using OSB and stuck up how to update the same "reporting' table column from SOA(not from OSB)
Can anyone help me out--->its urgent

Similar Messages

Re: OSB - How to put multiple files via a osb ftp business service?

I have been trying to create an ftp business service to transfer files to a remote machine. I select that the service should support any XML document (since I am only sending XML). Then, I specify the remote server directory like so:
ftp://hostname:port/directory
I take the rest of the default settings. However, when I use the business ftp service by testing it in the console, it just hangs. I can successfully ftp to the server and send files from the OSB server command line to the remote server in question. So, it isn't a problem with our network or a misconfiguration of ftp. Has anyone successfully used the ftp business service in OSB? If so, how do I configure it properly? Thanks much

Have you checked server logs? Enable message tracing in operational settings and check the logs to find out where it is getting stuck.
Regards,
Anuj

File attachment in OSB

Hello,
I need your help in dealing with File attachments in OSB using JCA integration.
My requirement is Read file as attachment with File Adapter and write to a remote location with FTP adapter.
I successfully created the business and proxy services to do so and it can transfer the file to new location too. But in the remote server I see the attachment reference instead of original file contents.
InputFile:
customer_1234.txt
asldfkjsadf
akdshfksajdh
aksjdfafasdf
output file in remote server:
cust_1234.txt
<?xml version="1.0" encoding="UTF-8" ?><attachmentElement href="-1172596423/cust_12345.csv_1351025265000" xmlns="http://xmlns.oracle.com/pcbpel/adapter/file/attachment/"/>
so my question is how to get the contents of the file in the remote location instead of its reference when file attachment option is used. what could be in either business or proxy service to get it correctly.
Thanks,
Nex.

Hi,
You need an assign to extract the content of the attachment into a variable before passing it to the business service.
http://docs.oracle.com/cd/E23943_01/admin.1111/e15867/context.htm#i1103309
As an alternative, see if this sample can help you... It's a totally different approach though...
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#BABJBIAD
Cheers,
Vlad

File adapter in OSB

Hi ,
I am trying to use file adapter in OSB. My intention is the OSB should write a file in a specified location in my sytem. I have configured the Business Service with Messagin service in (general tab), request msg as text and response msg as none in(messagin tab), protocol as file in (transport tab), prefix as AddUser suffix as *.txt* in (file transport tab).
whenever i give input in proxy service it writing the file at the specified location, but the issue is,it writes the file name as AddUser3225734920456246193--12c3763f.132dd1769a3.-7f5b.txt . i dont need this part(AddUser3225734920456246193--12c3763f.132dd1769a3.-7f5b) in file name which is written. can anyone tell me how i can solve this?
Any help is appreciated.
thanks

Hi,
We can go with transport JCA FILE for file writing into the specified location.
Create a file adapter in jdeveloper with all specified things like (file name,physical path location and schema).This creates the jca and wsdl file in jdevloper copy this to eclipse(OEPE) and later u can create business service based on jca file in eclipse.Or else in osb sbconsole copy import related jca and wsdl files and create business service based on this.This process wil create file in particular location with name specified in the jca file in particular location.....

How to use Oracle File Adapter in OSB

We are trying to use File Adapter in OSB 11g. Is it supported in this version? If yes then some one can specify a document which contains File Adapter - OSB integration steps.

according to the ESB JCA transport:
[ESB JCA|http://download.oracle.com/docs/cd/E14571_01/doc.1111/e15866/jca.htm#i1106345]
http://download.oracle.com/docs/cd/E14571_01/doc.1111/e15866/jca.htm#i1106345
there is only these adapters:
_25.2.1 Adapter Support_
The Oracle Service Bus JCA transport lets you interact with the following JCA-compliant adapters:
Oracle Adapter for Oracle Applications
Oracle JCA Adapter for AQ
Oracle JCA Adapter for Database
Oracle JCA Adapter for Files
Oracle BAM Adapter (Business Activity Monitoring)
PeopleSoft (Oracle Application Adapters 10g)
SAP R/3 (Oracle Application Adapters 10g)
Siebel (Oracle Application Adapters 10g)
J.D. Edwards (Oracle Application Adapters 10g)
See the following guides for more information on Oracle adapters:
I wanna use FTP Adapter and MQ Adapter in Oracle ESB 11.1.1.3, can we make it?

High Availability File Adapter in OSB

If you use the JCA FileAdapter in OSB, it is necessary to use the eis/HAFileAdapter version, to ensure that only one instance of the adapter picks up a file; you must then configure a coordinator, by setting the
controlDir, inboundDataSource, outboundDataSource, outboundDataSourceLocal, outboundLockTypeForWrite
parameters.
controlDir refers to the filesystem, the others to the DB
This document http://www.oracle.com/technetwork/database/features/availability/maa-soa-assesment-194432.pdf says
"Database-based mutex and locks are used to coordinate these operations in a File Adapter clustered topology. Other coordinators are available but Oracle recommends using the Oracle Database."
Using a Oracle Database as coordinator means using RAC, otherwise no HA.
I wonder if anybody has been successful setting up HAFileAdapter without using a DB?
If DB is required, I am considering using the good old "native" OSB File Poller, since it doesn't require complicated setup to be run in a cluster... but I don't want to use MFL, I would rather use the XSD-based Native Format. Here comes the second question:
Is it possible to use the nXSD translator using the OSB Native File Poller - instead of the JCA Adapter?
Thank you so much for your help - it will be rewarded with "helpful/answered" points .
pierre

I wonder if anybody has been successful setting up HAFileAdapter without using a DB?
I have not tried it but I think there are several options available invlucing writing your own custom mutex. Please find the details in Oracle File and FTP Adapters High Availability Configuration section on this link
http://download.oracle.com/docs/cd/E14571_01/core.1111/e10106/ha_soa.htm#sthref434
Is it possible to use the nXSD translator using the OSB Native File Poller - instead of the JCA Adapter?
When you create a JCA Adapter based Proxy Service to read the files, the nXSD translation happens before the proxy service is invoked. JCA Engine first reads the data, translates using nXSD and then invokes the Proxy with the translated content. (You can verify this easily by creating a JCA based file read service and open the test console for it in sbconsole, it will show you XML request instead of native).
So you can not read the text content using File Transport of OSB and then calling nXSD directly or calling an nXSD based Proxy Service.
HOWEVER, you certainly can use file and nXSD in a combination if thats what you want.
1. Create a Synchronous Read File Adapter with an nXSD created for it
2. Create a Business Service for that Synchronous Read JCA in OSB
3. Create a File Transport based service in OSB which will read the content of file and then call the Business Service to again read the content (which will include the translation using nXSD defined in step one to convert the content to XML).
So basically you will need to read the file twice! Once using File Transport Proxy service (which will take care of polling in cluster) and then using Sync Read JCA based business service(which will do nXSD translation). To reduce the impact of reading the file twice you can use trigger files. File Proxy to read trigger file and and invoke JCA business service to read the actual file for that trigger.
Another alternative can be to create a similar class as present here(http://blogs.oracle.com/adapters/entry/command_line_tool_for_testing) but instead of writing a file it will just return the translated content. Call this class with native content from the File Transport proxy using a Java Callout to do the translation.

File batching - publish in batch of 50

hi
My input file contains 500 records, we can use file batching to publish records in order of one. one record will be transformed at a time and inserted in to the database. if i want to publish records in order of 50, whether while loop is the only way to control the transform activity one at a time. this while loop is decreasing the performance. is it possible to handle this in the XSD schema file. I am using fixed length file as my input. please advice.
Thanks
partha

In xsl you may use a for-each to assign the same mappings for each element in the collection to the elements in the database collection.

File Adapter in OSB 11g

Hi
I am using a File Adapter created to read a file using OSB 11.1.1.3.0. But after i publish that osb project, i am getting the below warning and file is not been polled by the proxy.
####<Feb 23, 2011 10:08:30 AM IST> <Warning> <JCA_FRAMEWORK_AND_ADAPTER> <wipro-e16351a68> <AdminServer> <[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'> <weblogic> <> <dcc2d8a908de630a:59887477:12e50cc23d3:-7ff2-0000000000000084> <1298435910015> <BEA-000000> <PollWork::run exiting, Worker thread will die>
After 600 secs i could see StuckThread error in server.
####<Feb 23, 2011 10:15:01 AM IST> <Error> <WebLogicServer> <wipro-e16351a68> <AdminServer> <[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <dcc2d8a908de630a:59887477:12e50cc23d3:-7ff2-0000000000000092> <1298436301203> <BEA-000337> <[STUCK] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "601" seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@dd20cd", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
     java.lang.Object.wait(Native Method)
     oracle.tip.adapter.file.inbound.FilesToProcess.dequeueToProcess(FilesToProcess.java:101)
     oracle.tip.adapter.file.inbound.ProcessWork.run(ProcessWork.java:269)
     weblogic.work.ContextWrap.run(ContextWrap.java:41)
     weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
Please help what is going wrong in my approach.
Thanks,
Sesha

I even tired creating a new WM thread and assigned to this proxy.
I have chosen MaxThreadsConstraint option with Maximum of 5 concurrent thread.
Also i have enabled Ignore Stuck Threads in that WM thread.
Now i dont see any thread stuck in the server log, but sametime the file is not been picked by the Proxy which means the error is suppressed alone from displaying in logs..
Thanks,
Sesha

File Protocol in OSB Clustered Environment

Hi ,
I have a OSB Server in a Clustered Environment ....
Here Admin Server is in Machine1
Managed Server1 is in Machine 2
Managed Server2 is in Machine 3
so both the Managed Servers are put in a Cluster
I have Access to Machine1 Unix Box where the Admin Server is Installed ...I can get the File only in this Location and have to Read the Same from here , So i was planning to Use File Protocol for Polling the Message from Admin Server .Since OSB has option for Selecting only the Managed Server , I would request suggestions how i can Read the Data from this Admin Server by using File Protocol .

have you used "service type" as "Messaging Service" ? that should give you all the options you need

File batching in SOA 11g for records which has parent-child relation

Hi,
We have a requirement to read a huge file and process to DB. We use AIA and Syncread operation to read the file.
Huge file with more than 40K lines are getting Transaction timeout and current transactiontimeout was set to 5 min in Server.
I would like to know the option to batch / chunk the records without increasing the transaction timeout setting in Server.
Input File is a fixed length file has a Header and Trailor. SubHeader lines do not have any count like how many lines are associated with it. Only option to relate DetailLine with its subheader is some Reference number.
Schema used is native schema builder and the file has structure like below.
10 123123 123 -- Header
20 10 *123* 123 -- SubHeader1
20 20 *123* 456 -- Detail1
20 20 *123* 789 -- Detail2
20 20 *123* 890 -- Detail3
20 10 *234* 567 --SubHeader2
20 20 *234* 789 --Detail1
20 20 *234* 741 --Detail2
90 9 123321 --Trailor
Regards,
Dheepika.K

Hi,
Thanks for your reply. I just emailed the screen shot to your email . Please verify and let me know your comment.
Regards,
Kiran Konjeti

Problem with File Adapter in OSb

Hi All,
I have a scenario where I need to read 2 data files based on a trigger file.Ex: ABC.TRG file should poll ABC1.DATA and ABC.2 DATA files from the same directory.If by any chance,If the second data file is not read, I need to rollback the first one also.I just need to pass only metadata of my .DATA files.I am able to do one .TRG file and one .DATA file in OSB. But I am struck with processing 2 different DATA files and one TRG file.I have tried like this:Using read operation I created a proxy service and in my message flow ,using service callout I tried to get metadata of .DATA files (I used synchread for this JCA) .But when I use service callout, I was not able to get metadata of my .DATA files.
Any help would be appreciated.
Thanks,
PK.

Can you try this :
<getWidgetsResponse>
          <getWidgetsResult>
for $widget in $yourwidgetresponseelement/widgets/widget
return
<widget>
<widgetnumber> { data($widget/widgetnumber) }</widgetnumber>
<widgetclass> { data($widget/widgetclass) }</widgetclass>
</widget>
          </getWidgetsResult>
</getWidgetsResponse>
          or change the
          { data($widget/widgetnumber) }</widgetnumber> }
{ data($widget/widgetclass) }</widgetclass> }
in
          $widget/widgetnumber
               $widget/widgetclass
Good luc.
havent tested it, but should be something like this

Maximum file size that OSB can handle for JMS

Hi,
We have a requirement to process 60MB xml files over JMS in Oracle Service Bus. While prototyping this we are facing heap space errors.
Can somebody let me know what is the maximum file size that we can process? The scenario is as below.
JMS --> OSB --> JMS --> OSB --> JMS
Thanks

if you don't need to access the entire content of the message, you can try using content streaming
(see this OSB - Iterating over large XML files with content streaming discussion)
See also here http://download.oracle.com/docs/cd/E13159_01/osb/docs10gr3/userguide/context.html#wp1110513 for best practices.
Otherwise I have noticed myself that OSB is very hungry in memory when loading large messages. I had trouble even with a 5 MB binary file being loaded - this would take 500 MB RAM. in these cases I would rather look for ETL tools such as Oracle Data Integrator or Open Source Pentaho.

Maximum input payload size(for an XML file) supported by OSB

Hey Everyone,
I wanted to know, what is the maximum payload size that OSB can handle.
The requirement is to pass XML files as input to OSB and insert the data of the XML files in the oracle staging tables. The OSB will host all the .jca,wsdl, xml, xml schema and other files required to perform the operation.
The hurdle is to understand, what is the maximum XML file size limit, that OSB can allow to pass through without breaking.
I did some test runs and got the following output,
Size of the XML file: OSB successfully read a file of size, 3176kb but failed for a file of size 3922kb, so the OSB breakpoint occurs somewhere between 3-4 MB, as per the test runs.
Range of number of Lines of XML: 102995 to 126787, since OSB was able to consume a file with lines (102995) and size 3176kb but broke for a file with number of lines (126787) and size 3922kb.
Request to please share your views on the test runs regarding the OSB breakpoint and also kindly share the results, if the same test has been performed at your end.
Thank you very much.

Hey Everyone,
I wanted to know, what is the maximum payload size that OSB can handle.
The requirement is to pass XML files as input to OSB and insert the data of the XML files in the oracle staging tables. The OSB will host all the .jca,wsdl, xml, xml schema and other files required to perform the operation.
The hurdle is to understand, what is the maximum XML file size limit, that OSB can allow to pass through without breaking.
I did some test runs and got the following output,
Size of the XML file: OSB successfully read a file of size, 3176kb but failed for a file of size 3922kb, so the OSB breakpoint occurs somewhere between 3-4 MB, as per the test runs.
Range of number of Lines of XML: 102995 to 126787, since OSB was able to consume a file with lines (102995) and size 3176kb but broke for a file with number of lines (126787) and size 3922kb.
Request to please share your views on the test runs regarding the OSB breakpoint and also kindly share the results, if the same test has been performed at your end.
Thank you very much.

Add a Cue marker to 500 files (batch)

Hello,
I want to add a Cue marker (at 00:00:00.200, ie after 200 milliseconds) on 500 .wav files, with Adobe Audition.
How can I do this in batch processing ?
Thanks!
PS : I use both Audition and Soundforge. Do you know if there is an official forum for SoundForge where lots of users are ? (similar to this forum here!). I tried with SoundForge, but impossible : The BATCH PROCESSING option doesn't propose Marker edition. Does it exist with Audition ?

I haven't tried this, but if it's possible at all it will be by creating a favourite that adds a marker to a file, and nothing else, and using this favourite as part of the batch process.
But like I said - I have no idea whether this will work or not. What I do know though is that it's the only option you've got within Audition.for doing anything like this. Cuelisttool, the other option I wondered about, won't do this as it stands either - but you could try emailing its creator and asking him whether he could add it as a feature, as it sounds potentially useful.

How to write non-XML data to a file using an OSB FTP Routing?

Hi --
Situation ... I need to write non-XML data to a file using FTP. A proxy service retrieves XML and transforms it with XSLT to CSV format, then gives it to a Biz service to file it out, using FTP. Simple.
Problem ... OSB sends the contents of $body to any service it calls. Because $body is a SOAP document, it has to contain XML. So therefore I have to put my CSV data into an XML element, in order to put it into $body; and this inner element then gets written to the file, which I don’t want. But if I don't enclose my CSV content in a tag, I get "Unexpected CDATA encountered" trying to assign it to a variable.
There has to be away around this!
Thanks for your help.
John Taylor

Solved. Steps:
-- Transform the XML to CSV using an XSL transform. Put the CSV data inside enclosing XML elements, and use a Replace action to put the XML element + CSV contents back into *$body*.
-- Define an MFL transform that only knows about the enclosing XML elements. Use a delimiter of "\n" (hard return).
-- Route from the proxy service to a Biz service that has Service Type = Messaging Service and Request Message Type = MFL; specify the MFL transform, which will receive the incoming *$body* variable, strip off the enclosing XML element within it, and pass the CSV contents to the FTP service.
Edited by: DunedainRanger on Nov 29, 2011 9:03 AM

File Batching in OSB

Similar Messages

Maybe you are looking for