How to find EOF in BPEL File adapter

Hi All,
I am using file adapter in BPEL(SOA 11G) to read a csv file. The CSV file is very large so we have are processing the files in batched of 20000 records.I am inserting the records form CSV file to a staging table and after that I am invoking a concurrent Program for further processing.This is working fine and BPEL is initiating no of instances based on the file size.
The issue here is, I want to submit the concurrent program only once when all the records are stored in staging table, I mean to say the BPEL Process should process the file in batches and then insert them in to the staging table. Once all the records from the file are stored in the table, then only the Concurrent Program should get submitted.
I am using DB Adapter for invoking a PL/SQL API and from there we are submitting concurrent Program.
Please help me on this to solve this.
Thanks!

It is possible to register a Java Listener class, which can/will be invoked, when a last batch in the file, is read. Code for invoking the concurrent Program can be written in side this class.
Refer to following document on how to register the Java Listener class
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#CACJBIGD
Moreover, as an alternate to the above approach, chunk read interaction specs can be implemented along with the Sync File Read for your scenario( However,This will be a whole re-write, considering your current approach. Good News is, there is full-fledged example readily available for this in oracle docs).
Here is the link if you would like to implement the Chunk Read.
http://docs.oracle.com/cd/E23943_01/integration.1111/e10231/adptr_file.htm#BABJFCBH
Mark the posting appropriately as "hlepful" or "correct answer", if your issue is solved.

Similar Messages

How to have Secure Connection for File Adapter.Pls help

Hi All,
For File to File Scenario
How to have Secure Connection for File Adapter.
Pls send links/blogs explaining this scenario.
Regards

hi rich
go through these links
FTPs connection failed - error ".. certificate rejected by ChainVerifier"
Re: What is SFTP, FTI channels
http://help.sap.com/saphelp_erp2005/helpdata/en/e3/94007075cae04f930cc4c034e411e1/frameset.htm
http://help.sap.com/saphelp_erp2005/helpdata/en/bc/bb79d6061007419a081e58cbeaaf28/frameset.htm
FTPS implementation question.
http://help.sap.com/saphelp_nw04s/helpdata/en/43/0e16bfd7b021aee10000000a1553f6/frameset.htm
Server certificate rejected by ChainVerifier:FTPS server(Points Guaranteed)
/people/krishna.moorthyp/blog/2007/07/31/sftp-vs-ftps-in-sap-pi
File adapter
thanks
Kunaal

How to find out web content files linked in folio through scripting

Hi all,
Please suggest me, how to find out web content files linked in folio through scripting.
Regards,
Moorthy

@Moorthy – can you tell us a bit more? By mentioning "folio", I think you are referring to Adobe Digitial Publishing Suite (ADPS or short: DPS). If yes:
1. Do you want to analyze Folio files *.folio and get the linked web content files?
2. Or do you want to check an InDesign file with an overlay and check what files are linked as web content?
3. Or something else?
Where is your base problem?
Packaging the InDesign files and copy/relinking the web content files after the packaging process?
Uwe

How to find that which flat file is belongs to which application server?

How to find that which flat file is belongs to which application server?

Hi,
Search im www.sap-img.com, you will get most of answers.
Jogdand M B

How to make BPEL File Adapter read only new files?

Hello
we have BPEL processes that define to run from bpel component - file adatper-
when a file come into location that it is path on the linux server . the bpel start run when "File Adapter" bpel component recognize that new file come to the location. its PollingFrequency define to 5. property name="DeleteFile" value="false" so the files remaine there.
we want to migrate the bpel to new SOA version so we did export and deploy to new SOA Domain.
the location of the file adapter is the same.
but when the BPEL processes deployed its start to run for all the files that are in this location- that the file adapter define on .
even the original soa tooks those files and start the BPEL processes for each one of them. also the new SOA that we did deploy to the BPEL processes take those files even if they are very old.
we want the file adatper we take only new files . the start point is the time when we do deploy to the process so if we do deploy in 10:00 am we dont want this bpel will take files from 9:00 or earlier time
Please help , how we can do this?
Thanks

thank you
do you kno hat the value means in the example:
Java mon amour: File Adapter metadata with SOA Suite
<property name="jca.file.LastModifiedTime" value="1293041258635">
what should I rite for read only the files that are only neer then yesterday?

How To split large message using File Adapter

Hello everyone,
Here is my scenario FTP > XI > BI.
I got 2 questions:
(1) I am getting large message around 70 MB file.
    How we can split the message into multiple files 10 MB each before processing the file into XI?
(2) Is there is any way we can find out size of file which is on FTP without contacting FTP admin?
    through XI before processing the file?
Thanks
Vick

hi vick,
check the blog
Zip or Unzip your Payload with the new PayloadZipBean module of the XI Adapter Framework
Working with the PayloadZipBean module of the XI Adapter Framework
SAP XI acting as a (huge) file mover
The specified item was not found.
Managing bulky flat messages with SAP XI (tunneling once again) - UPDATED
The specified item was not found.
regards
kummari

How to Write a PDF using File Adapter

Hi All,
Can anyone please let me know how to create a PDF file at the receiving end using a File Receiver Adapter. The source is an XML file. The scenario is as follows.
XML-File ---> XI --->PDF-File.
Any help would be highly appreciated.
Thanks in Advance
Anil.

hi ,
if u r using pi7.1 you can use agents concept.
please find the links.
http://help.sap.com/saphelp_nwpi71/helpdata/en/43/fc39c16bfb025ee10000000a1553f7/frameset.htm
How to get started using Conversion Agent from Itemfield
More on the SAP Conversion Agent by Itemfield
Integrate SAP Conversion Agent by Itemfield with SAP XI
Conversion Agent a Free Lunch?
How to get started using Conversion Agent from Itemfield
https://websmp102.sap-ag.de/~sapdownload/011000358700001090982006E/ConvAgentDocSP16.zip
https://websmp102.sap-ag.de/~sapdownload/011000358700004921152005E/ConversionAgent.pdf
XI: Generate PDF file out of file adapter
XI: Read data from PDF file in Sender Adapter
The specified item was not found.
regards,
navneet

How to handle blank line in File adapter

Hi,
I am using a file adapter with CSV as input file. If I have a blank line in CSV file, BPEL is failing read it, no instance is created and file is archieved.
Please let me know how to handle this issue.
Thanks

Hi Yatan,
I am already using rejectedMessageHandlers, I am on 10.1.3.3.
Here's my bpel.xml
============
<?xml version = '1.0' encoding = 'UTF-8'?>
<BPELSuitcase>
<BPELProcess id="EmpAddressUpdABCSImpl" src="EmpAddressUpdABCSImpl.bpel">
<partnerLinkBindings>
<partnerLinkBinding name="ReadFile">
<property name="wsdlLocation">ReadFile.wsdl</property>
<property name="rejectedMessageHandlers">file://E:/HRARCHIVE/BadData</property>
</partnerLinkBinding>
<partnerLinkBinding name="InsertAddressUpd">
<property name="wsdlLocation">InsertAddressUpd.wsdl</property>
<property name="retryInterval">60</property>
</partnerLinkBinding>
</partnerLinkBindings>
<configurations>
<property name="sensorLocation">sensor.xml</property>
<property name="sensorActionLocation">sensorAction.xml</property>
</configurations>
<activationAgents>
<activationAgent className="oracle.tip.adapter.fw.agent.jca.JCAActivationAgent" partnerLink="ReadFile">
<property name="portType">Read_ptt</property>
<property name="rejectedMessageHandlers">file://E:/HRARCHIVE/BadData</property>
</activationAgent>
</activationAgents>
</BPELProcess>
</BPELSuitcase>
Someone told me that this can be achieved by changing the native schema, I tried many options but no result. Please suggest me.
-- Shirish

ESB or BPEL file adapter and special characters

Hi,
We have a scenario where we import rows from .csv file through an ESB project into a database. We use the file adapter for this. There appears to be a problem with special characters (like é). Both in the ESB control (with variable tracking) and in the database, they appear as upside down questionmarks (¿). I've tried doing the same with a BPEL project (file adapter as client PL) and in the BPEL console, I also see strange characters instead of the expected special characters (diamond shaped characters, like ♦ to be precise).
I can't find anything about character sets of character set conversions in the documentation. What am I missing?
Regards,
Arjan

see
http://download-west.oracle.com/docs/cd/B31017_01/inte
grate.1013/b28994/nfb.htm#CIAEFBHHI've looked into the properties mentioned. They are set when you go through the wizard. Everything is set to UTF-8, which should provide me with all special characters I need.
BPEL does the exact same thing, so I'm starting to believe that the problem really is with the file adapter.
Regards,
Arjan

How to find EOF in RandomAccessFile

hi all,
How can we find the end of file while using RandomAccessFile. Can some one help me out on this...
Thanks in advance...

CeciNEstPasUnProgrammeur wrote:
I'm not sure what you want - asking for length()-1? What exactly are you looking for? Java handles EOF markers transparently, you won't come across one.Well, "getFilePointer" returns the offset at which the next write would start, so "getFilePointer" >= "length" will mean you are at (at least the current) EOF.

How to transform data received from file adapter

hi',
I am reading the data from XML file using file adapter, now I want to write the same contents which I have read from this file to a different/new XML file, the issue is I am unable to perform a transform here, when I use a transform with source element as the output of the file read and target as the input to the new file it is writing an empty file,
I have checked the audit trail which showsme that the transform is empty.
please tell me how can I transform the element which I have received from one file to make them as input to next file
thanks
Yatan

thanks James for input, this is my XML and XSD files
XML file:
<?xml version="1.0" ?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"
xmlns="http://www.example.org"
targetNamespace="http://www.example.org"
elementFormDefault="qualified">
<emp>
<name>yatan</name>
<age>28</age>
</emp>
</xsd:schema>
XSD File:
<?xml version="1.0" encoding="windows-1252" ?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"
xmlns="http://www.example.org"
targetNamespace="http://www.example.org"
elementFormDefault="qualified">
<xsd:element name="readfile">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="name" type="xsd:string"/>
<xsd:element name="empid" type="xsd:string"/>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:schema>
I am reading XML file, I will describe my process.
1.) File adapter>read operation ---> receive activity
2.) Transform > source(receive input variable) <--->target(Invoke input variable)
3.) File adapter > write operation ---> invoke activity
Now when I am deploying this process it is sucessfully completing and able to read the file.
when I check the audit trail receive activity shows XML data but when I check the transform it
shows empty as below, however the write activity is performed which creates a xml file but no values in the elements
transform in audit trail
<Invoke_1_Write_InputVariable>
-<part xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" name="readfile">
-<readfile xmlns:ns0="http://www.example.org" xmlns="http://www.example.org">
<ns0:name/>
<ns0:empid/>
</readfile>
</part>
</Invoke_1_Write_InputVariable>
this is the code for my .bpel file
<?xml version = "1.0" encoding = "UTF-8" ?>

<process name="ReadXMLFile2"
targetNamespace="http://xmlns.oracle.com/ReadXMLFile2"
xmlns="http://schemas.xmlsoap.org/ws/2003/03/business-process/"
xmlns:xp20="http://www.oracle.com/XSL/Transform/java/oracle.tip.pc.services.functions.Xpath20"
xmlns:bpws="http://schemas.xmlsoap.org/ws/2003/03/business-process/"
xmlns:ns4="http://xmlns.oracle.com/pcbpel/adapter/file/FileReadSync/"
xmlns:ids="http://xmlns.oracle.com/bpel/services/IdentityService/xpath"
xmlns:ldap="http://schemas.oracle.com/xpath/extension/ldap"
xmlns:xsd="http://www.w3.org/2001/XMLSchema"
xmlns:client="http://xmlns.oracle.com/ReadXMLFile2"
xmlns:ora="http://schemas.oracle.com/xpath/extension"
xmlns:hwf="http://xmlns.oracle.com/bpel/workflow/xpath"
xmlns:ns1="http://xmlns.oracle.com/pcbpel/adapter/file/ReadFile/"
xmlns:ehdr="http://www.oracle.com/XSL/Transform/java/oracle.tip.esb.server.headers.ESBHeaderFunctions"
xmlns:ns3="http://www.example.org"
xmlns:ns2="http://xmlns.oracle.com/pcbpel/adapter/file/WriteFile/"
xmlns:bpelx="http://schemas.oracle.com/bpel/extension"
xmlns:orcl="http://www.oracle.com/XSL/Transform/java/oracle.tip.pc.services.functions.ExtFunc">

<partnerLinks>
<partnerLink myRole="Read_role" name="ReadFile"
partnerLinkType="ns1:Read_plt"/>
<partnerLink name="WriteFile" partnerRole="Write_role"
partnerLinkType="ns2:Write_plt"/>
</partnerLinks>
<variables>
<variable name="Receive_1_Read_InputVariable"
messageType="ns1:readfile_msg"/>
<variable name="Invoke_1_Write_InputVariable"
messageType="ns2:readfile_msg"/>
</variables>


<sequence name="main">
<receive name="Receive_1" partnerLink="ReadFile" portType="ns1:Read_ptt"
operation="Read" variable="Receive_1_Read_InputVariable"
createInstance="yes"/>
<assign name="Transform_1">
<bpelx:annotation>
<bpelx:pattern>transformation</bpelx:pattern>
</bpelx:annotation>
<copy>
<from expression="ora:processXSLT('Transformation_3.xsl',bpws:getVariableData('Receive_1_Read_InputVariable','readfile'))"/>
<to variable="Invoke_1_Write_InputVariable" part="readfile"/>
</copy>
</assign>
<invoke name="Invoke_1" partnerLink="WriteFile" portType="ns2:Write_ptt"
operation="Write" inputVariable="Invoke_1_Write_InputVariable"/>
</sequence>
</process>

BPEL File Adapter Logical Path Issue

I am trying to write the BPEL Error Messages using a file adapter. But I could not parameterize the logical directory. I need a solution of changing it in the BPEL console after deploying it
I am Invoking a FileAdapter Web service using logical direcotry, in the FileService partnerlink I set the file_loc property with type"LogicalDirectory" and set the value to " D:/BPEL_Errors" etc. This is working fine but except in the BPEL Console I could not edit it, All the Partner Link properties seems to be read only and not editable. I tried creating a user property for the BPEL process which can be editable but How do I refer this user property in partner link since I cannot use XPATH expression there?.
I guess this should be a very generic problem all I am looking for is parameterizing the File Location. Any Ideas?
Thanks,
Chitra

Thanks James. It would be really nice if the first option works, do you have any idea why its not editable. I am having the following in bpel.xml
<partnerLinkBinding name="FileService">
<property name="wsdlLocation">FileService.wsdl</property>
<property name="BPEL_LOG">D:\JDeveloper\jdev\mywork\BPEL_LOG</property>
When I deploy the above, In the console I see BPEL_LOG as non editable field. Is am doing anything wrong?.
Regarding the second option , I guess you are talking about modifying the Outbound message header by adding a new property called directory, as mentioned in the following link.
http://download.oracle.com/docs/cd/B31017_01/integrate.1013/b28994/adptr_file.htm#CACFFAHI
Since there are many bpel processes which use the fileservice, I need to edit the fileAdapterOutboundHeader.wsdl in multiple places. Please let me know whether I can make the first option to work

How to find out the Trace file

Hi Dba's
I need to find out the trace file with the Request id. how can i find out it?
Thanks

There are many ways to create a trace file in the apps. Pl provide details on how you enabled trace, as that will determine where the trace file is created.Concurrent requests trace files are always created under USER_DUMP_DEST directory.

How to set DEBUG severity for File adapter in J2SE AE

Hi,
Can anyone help me in setting the severity level to DEBUG for file adapter?
I have tried to set in logging.properties file as given below,
formatter[Trace]         = TraceFormatter
formatter[Trace].pattern =%24d [%t] %-6s %l - %m
log[Trace] = FileLog
log[Trace].pattern     = swb_%g.log
log[Trace].limit     = 2000000
log[Trace].cnt          = 5
log[Trace].formatter     = formatter[Trace]
com.sap.aii.messaging.adapter.severity = DEBUG
logging components
#com.sap.aii.axis.logs = +log[Trace]
#com.sap.aii.axis.severity = DEBUG
#org.apache.axis.logs = +log[Trace]
#org.apache.axis.severity = DEBUG
Please correct me if I have did anything wrong and sugest me hot to set the DEBUG level as soon as possible.
Best Regards,
Soorya

Hi Sejoon,
when we changed the host of XI server in one of our projects one of the things we had to change was the exchange profile entries
http://server:port/exchangeProfile/index.html
to see how your adapter engine is configured
http://server:port/sld
SLD -> Content Maintenance
then
Subset: landscape description
Class: XI Adapter Framework
buth check the exchange profile entries first
Regards,
michal

How to add fault handling for file adapter??

Hi guys I am new to SOA technology ,I have one scenario in file adapter ,when file adapter reads a file from directory .If file is there then read the file data else it can give user defined exception that the file is not there .How can i write user defined exception in SOA?? Give me any ideas please.............
Thanks in advance..

So, you want to (1) Fetch the data from these 3 type of files and (2) Also, store the payload data of the file, which is in XML format, into the same database tables ?
If this is the requirement.. then, I would say, you could :
(1) Read files using file adapter, but not as opaque.. Define schemas conforming to the file structures. In that way, you'll always have the file data read in the form of XML.
(2) Fetch relevant data from such XML payloads of files and insert into database tables. Then, insert the XML payload into WHO column. You might have to convert the xml data into blob/clob before inserting.
Job done !

How to find EOF in BPEL File adapter

Similar Messages

Maybe you are looking for