Oracle database Adapter polling in OSB Cluster

Hi,
I have OSB 11g with two nodes. I have a database adapter that polls a table after every 30 seconds and perform logical delete on the rows read. I came across interesting situation. When one node is up and PollingInterval=30, it works okay and polling is done right after 30 seconds but when both nodes are up the PollingInterval property doesnt work as expected.
First node will poll after 24 seconds and then second node will again poll after 6 seconds (node1+node2=30 seconds in total).
and After i restart the servers the first node is polling at 18 sec and second node is polling at 12 sec (node1 +node2=30 sec), so different polling intervals.
How does it determines the first server should poll at 24 or 18 sec and second node should poll at 6 or 12 sec?
I would like to know is there any property or configuration required to poll the table for each node for every 15 seconds (node1(15sec)+node2(15sec)=30 sec)?
Please help me, It is very urgent?
Thanks
Rajesh.

Hi,
If any one has the same issue, please let me know.
Also if you know the solution, can you please update here, it's very helpful for me.
Thanks,
Rejesh.

Similar Messages

DB adapter polling in OSB

1. In a clustered environemnt, we need to use "Distributed polling" in DB adapter to make sure the multiple cluster instances are not polling for the database at the sametime. If "Distributed polling" can achieve that, what is the need to have singleton property set for the DB adapter in the composite.xml
2. For achieving DB adapter polling in osb, we need to create the adapter in bpel and then export them to osb project. In such OSB project, where do we set the singleton property ?

Thanka Ananth.
I assume active-passive cluster setup means,
there will be a cluster with only one osb or bpel managed server (active cluster)
There wil be another cluster with only one osb or bpel managed server (passive cluster).
so when there is some data inserted into the database, there will be only one managed server (available on active cluster) will be available to poll for the recored. Passive man server does not poll for this record. I assume this is the default behaviour. If such is the case, then what is the use of setting this singleton property ?

Oracle database Adapter starts up even before the BPEL services & errors

Here is the scenario:
We have an Oracle database adapter in an ESB service polling a table & then invokes a BPEL service.
During startup, the database adapter is loaded first & polls data & immediately invokes the BPEL which is not even loaded still & errors.
Is there a way to avoid this.
Any help would be great.

All three of your errors seem to be pointing to a configuration gap between
* the JNDI name used by the SOA composite to obtain a JCA connection in the soa-infra engine
* the ConnectionFactory configuration used by the DbAdapter process that then connects to the JDBC connection pool managed by the WebLogic server
* the actual JDBC connection from WebLogic to your database
You've indicated the JDBC connection layer from WebLogic to the database has been verified so the following things should be checked:
* access the WebLogic console of your domain and verify the DbAdapter application is deployed and active on the server hosting your soa-infa SOA engine
* click on the DbAdapter entry and go to the Configuration tab and the Outbound Connections sub-tab
* expand the tree under javax.resource.cci.ConnectionFactory and verify your JNDI name within the SOA composite is listed (it probably looks something like eis/db/yourdbname)
* click on that JDNI name and verify on the subsequent screen that the JDBC connection pool name is present under dataSourceName or xADataSourceName
* verify your SOA composite is using eis/db/yourdbname as the reference in its database service --- it CANNOT use the JDNI name of the JDBC connection pool managed by WebLogic cuz composites run inside the soa-infra engine which uses JCA connections to get out of the soa-infra engine to the rest of the world
Hope that helps

Oracle DB Adapter Polling

I have a scenario where i am using DB Adapter for polling records from oracle database and doing a logical delete.After reading the records i am writing the records to a xml file.Now if the BPEL fails while the writitng the records the records are still marked as read in the database and rollback does not happen.Since the file adapter is non-transactional adapters i cannot make it part of the same transaction.How can i handle this situation.
Thanks
Nitin
Edited by: 876573 on Aug 2, 2011 11:35 PM

Hi Manish,
Can you copy paste your .jca file?
I think the problem is with the name 'pollingStrategy'. Verify if the property used in the .jca file is PollingStrategy (Use Capital 'P').
Regards,
Neeraj Sehgal

Jdev Database Adapter - polling updated rows

Hello, I have a question reguarding the polling strategy available in the database adapter.
I set it up and it works great with new inserted rows in the table.
However, it doesn´t capture the updated rows!
For instance, i have the following table:
ID - NAME - AGE
1 -John- 21
2 -Mary- 25
When I insert a new row, it is captured by comparing the last captured ID in the sequencing file.
ID - NAME - AGE
1 -John- 21
2 -Mary- 25
3 -Cindy- 20 <--------- New row
But when i UPDATE an already existing row, it doesnt load the changed row!
ID - NAME - AGE
1 -John- 26 <----------- Age changed, but polling doesnt recognize it!
2 -Mary- 25
3 -Cindy- 20
Is there a way to get this to work? Should I set an special option? Thank you very much.
Im using jdeveloper 11g.

Hi John, it depends on which type of polling strategy you are using to poll the new/updated records. You must have the necessary previleges to add the special field and creat triggers or your db team must have.
i.Physical delete polling strategy: Cannot capture the UPDATE operations on the table.This because when the adapter listens to the table, when ever a record is polled, that record is deleted after the polling process. After polling the records, if it is not deleted, then the adapter knows that it’s a updated one but here when a record is polled, it is deleted. So when an adapter encounters a record, it’s a new record to the adapter though the record is updated before the polling cycle). So physical delete cannot capture UPDATED records.
ii. Logical delete polling strategy: The logical delete polling strategy updates a special field of the table after processing each row (updates the where clause at runtime to filter out processed rows).The status column must be marked as processed after polling and the read value must be provided while configuring the adapter. Modified where clause and post-read values are handled automatically by the db adapter.
Usage:
<operation name="receive">
<jca:operation
ActivationSpec="oracle.tip.adapter.db.DBActivationSpec"
PollingStrategyName="LogicalDeletePollingStrategy"
MarkReadField="STATUS"
MarkReadValue="PROCESSED"
This polling strategy captures the updated records only if triggers are added.This is because when the record is polled, its status is updated to 'PROCESSED'. To capture this record if its updated, its status has to be 'UNPROCESSED'. So a trigger has to be added to update the status field to 'UNPROCESSED' whenever the record is updated. Below is the example.
Ex:
CREATE OR REPLACE TRIGGER nameOftrigger_modified
BEFORE UPDATE ON table_name
REFERENCING NEW AS modifiedRow
FOR EACH ROW
BEGIN
*:modifiedRow.STATUS :='UNPROCESSED';*
END;
In this example, STATUS is the special field(of the polling table). When the record is updated, the trigger gets fired and updates the STATUS field to 'UNPROCESSED'. So when the table is polled, as this record's status is Unprocessed, this record ll be captured during polling.
Other polling strategeis like "Sequencing Table Last Updated","Sequencing Table Last-Read Id" Polling strategy,etc also can be used to capture the updated records. In these strategies also, you need to add the triggers like the above. These need an extra helping table also to poll.
Logical delete polling strategy is good enough to poll the updated records.
Hope this helps.
Thank you.

Database Adapter Poll doubt

My requirement is, when ever a new recored inserted to CREDITCARDINFOPARENT table need to insert the same record to CREDITCARDINFORESULT;
desc CREDITCARDINFOPARENT;
Name Null? Type
SNO NUMBER
SSN NOT NULL VARCHAR2(15)
FIRST_NAME VARCHAR2(30)
LAST_NAME VARCHAR2(30)
CCNUMBER NOT NULL VARCHAR2(20)
CREDITRATING NUMBER
STATUS NOT NULL VARCHAR2(20)
CCNumber is my primary key
desc CREDITCARDINFORESULT;
Name Null? Type
NO NUMBER
SN NOT NULL VARCHAR2(15)
FIRSTNAME VARCHAR2(30)
LASTNAME VARCHAR2(30)
CCNUMBER VARCHAR2(20)
CRATING NUMBER
CCSTATUS NOT NULL VARCHAR2(20)
CCNUMBER is Foreign Key.
I tried Poll DB adapter example in the following way
Created a project with "Composite with Mediator"
under exposed services I dragged DB Adapter
Service Name-> Example Service
Step 4 of 13 -> selected Poll or Changed Records in a table
step 5 of 13 -> imported 2 tables (CREDITCARDINFOPARENT, CREDITCARDINFORESULT)
step 6 of 13 -> displayed the Relationships
step 8 of 13 -> After Read -> selected Update a Sequencing Table
step 9 of 13 -> Sequencing Table: CREDITCARDINFORESULT
     Sequence Name Field: CCNUMBER
     Sequence Value Field: STATUS
     Sequence ID Field: CCNUMBER
step 10 of 13 -> Polling Options: SQL
          Pre Polling SQL:
SELECT STATUS FROM CREDITCARDINFORESULT WHERE (CCNUMBER = 'CREDITCARDINFOPARENT')
Polling SQL:
SELECT SNO, SSN, FIRST_NAME, LAST_NAME, CCNUMBER, CREDITRATING, STATUS FROM CREDITCARDINFOPARENT WHERE ((STATUS = 'VALID') AND (CCNUMBER > #STATUS)) ORDER BY CCNUMBER ASC
After Read SQL:
UPDATE CREDITCARDINFORESULT SET STATUS = #STATUS WHERE (CCNUMBER = 'CREDITCARDINFOPARENT')
step 11 of 13 ->Define Selection Criteria:
          Parameters:ccno
          SQL: SELECT SNO, SSN, FIRST_NAME, LAST_NAME, CCNUMBER, CREDITRATING, STATUS FROM CREDITCARDINFOPARENT WHERE ((STATUS = 'VALID') AND (CCNUMBER > #STATUS)) ORDER BY CCNUMBER ASC
Under External Services : I dragged DB Adapter and i selected Perform an Operation on a table as Insert Only. and I imported CREDITCARDINFORESULT
I deployed the the Project. Project depolyed successfully;
under EnterpriseManager command prompt I got
<Jun 29, 2010 2:25:46 PM IST> <Warning> <oracle.soa.adapter> <BEA-000000> <JCABinding=> ExampleProject JNDI lookup of 'eis/DB/soademodatabase' f
ailed due to: Unable to resolve 'eis.DB.soademodatabase'. Resolved 'eis.DB'>
<Jun 29, 2010 2:25:46 PM IST> <Error> <oracle.soa.adapter> <BEA-000000> <JCABinding=> ExampleProject Error while performing endpoint Activation:
BINDING.JCA-12561
JCA Resource Adapter location error (WebLogic).
Unable to locate the JCA Resource Adapter via .jca binding file element <connection-factory/>
The JCA Binding Component is unable to startup the Resource Adapter specified in the <connection-factory/> element: location='eis/DB/soademodata
base'.
The reason for this is most likely that either
1) the Resource Adapters RAR file has not been deployed successfully to the WebLogic J2EE Application server or
2) the JNDI <jndi-name> setting in the WebLogic JCA deployment descriptor has not been set to eis/DB/soademodatabase. In the last case you might
have to add a new 'connector-factory' entry (connection) to the deployment descriptor.
Please correct this and then restart the WebLogic Application Server
>
I confugired the Connection factory properly; I checked at DB Adapter -> Configuration -> Outbound Connection Pools -> xADataSourceName -     jdbc/soadeoDatabase
when I checked at JNDI tree I dont have any value under it.
in Firefox EM, when I clicked on Example Project Test button is disabled. and I inserted one record to CREDITCARDINFOPARENT; but CREDITCARDINFORESULT table is not updated.
can any body help me in this?
Please let me know whether I follwed correct procedure or not?
If I am wrong, please provide me the correct steps.
Thanks in Advance.

This error is usually raised if there is no outbound pool connections with the "eis/db/soademodata" name in the database adapter.
First create a data source to the database in the JDBC Resources.
Next in Weblogic server console --> Deployments --> DBAdapter --> Configurations --> Outbound Pool Connections --> create a new outbound pool connection with the name "eis/db/soademodata".
Now update the "xADataSourceName" property of this connection pool with the JNDI name of the datasource created in the first step.
Regards,
KSN Pavan
Edited by: KSN Pavan on Jun 30, 2010 2:51 AM

Database Adapter Polling problem

Hi All,
The polling option is processing all the rows in a table at a time instead of using polling frequency. I have used an option of update a field (logical delete) where I have initialized unread value='N' and read value='Y'. Now ,the problem is i have to poll a single row from the table for every 60 seconds ( second row should be processed only after 60 seconds), but all the rows are processing at a same time. Can somebody let me know what could be the problem?
The options that I set in db adapter are:
Polling Frequency: 60 seconds
Database &rows per XML Document: 1
Database Rows per transaction: 1
JDBC options , Query & Timeout: 60
Thanks,

Hi Vlad,
please find the jca file
<endpoint-activation portType="PollEvent_ptt" operation="receive">
<activation-spec className="oracle.tip.adapter.db.DBActivationSpec">
<property name="DescriptorName" value="PollEvent.HolxSrEventData"/>
<property name="QueryName" value="PollEventSelect"/>
<property name="MappingsMetaDataURL" value="PollEvent-or-mappings.xml"/>
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MarkReadColumn" value="PROCESSED_FLAG"/>
<property name="MarkReadValue" value="Y"/>
<property name="MarkUnreadValue" value="Yes"/>
<property name="PollingInterval" value="60"/>
<property name="MaxRaiseSize" value="1"/>
<property name="MaxTransactionSize" value="1"/>
<property name="NumberOfThreads" value="1"/>
<property name="ReturnSingleResultSet" value="false"/>
<property name="SequencingColumn" value="INCIDENT_ID"/>
<property name="DelayCommit" value="true"/>
</activation-spec>
</endpoint-activation>

How to configure Oracle database in a failover zone cluster

Setup: Oracle database and zone configured on highly available local filesystems.
Two node cluster.
Oracle database running inside the zone.
Note: I dont have a zone cluster.
1. I need to make the zone and the oracle database highly available.
2. Can I configure the Oracle Data service directly to run in the zone or will it involve creating sczsh_config script to do the same.
I have been going through the guides and searching over the net, but haven't found any help so far. Its so much simpler to configure this environment in Veritas cluster. Hope I find some help here.
TIA,
Sudhir

The Oracle Solaris Cluster concepts guide has some information on which zone model to choose:
http://docs.oracle.com/cd/E18728_01/html/821-2682/gcbkf.html#scrolltoc
When managing a Solaris zone with the HA Zones agent, the cluster basically regards the non-global zone as a blackbox.
As such you can either start the Oracle database as part of the runlevel/SMF startup of the non-global zone, or you can use the sczsh or sczsmf component and use your own scripts to start, probe and stop the Oracle database.
Usage of the standard HA Oracle data service is not supported in combination with the HA Zones agent.
If you require a more fine grained control of services running in non-global zones, why not setup a zone cluster and then having HA Oracle failover the Oracle database between non-global zones?
Regards
Thorsten

Database Adapter Polling, Instances in Running State

Hello All,
I have a composite in which the database adapter is a service (polling a table in SQL Server). Sometimes, when instances gets created, like 2 instances are being in a running state and not being completed at all. we terminated the instances last 2 times, and this scenario is being repeated again. If i click the instance which is running, i can only see the service which says it is completed, no BPEL component is being seen, can anyone faced this issue before ? why this is happening ?
Please help....
Naresh

Could you provide more insight on how you wired the adapter and BPEL process inside the composite? What does the BPEL look like? You could add a BPEL component that persists some stuff just for test purposes. That could give you more feedback from the console.
hth,
Peter Paul

Database Adapter Polling 100 large size messages at one time.

We have a BPEL process which polls a header & detail table on a Oracle DB.
Typically we are having a scenario that we have around 1000 detail line items for each header.In the night when we start the process we have around 100 such headers each having 1000 detail lines.
We have configured the adapter in following way.Hence according to us having MaxRaiseSize="1" will create individual instace for each row that adapter fetches.is that correct?
We do get one instace per header in console.
Currently when we run the interface with 3 headers + each having 3000 details BPEL works fine.
But when i increase the load to have 50 headers + each having 3000 details , i dont see messages coming to BPEL console & also BPEL goes down & comes up on its own.
While i was monitoring it i saw that invoke_message table in dehydration store was fetching the records from messages from DB & gradually creating rows in the table & after like 30 mins it stopped we were getting internal server error on BPEL console and then it comes up on its own after some time & again rows are added in the invoke_message.
Althoug out of 100 instances that i think i should get, i see just 2 created in spam of almost 2 hrs.
My question is how can make this processing faster ? can configure something in DB adapter liek increase numberofthreads or something wich willmake the processing faster?
Any idea how BPEL works in this scenario?
Appreciate if someone can help me in this regard.
Thanks
**<binding name="DBRMSTransferPoll_binding" type="tns:DBRMSTransferPoll_ptt">*
*<pc:inbound_binding/>*
*<operation name="receive">*
*<jca:operation*
ActivationSpec="oracle.tip.adapter.db.DBActivationSpec"
DescriptorName="DBRMSTransferPoll.XxlcbTsfHdrV"
QueryName="DBRMSTransferPoll"
PollingStrategyName="SequencingPollingStrategy"
SequencingFieldName="LAST_UPDATE_DATETIME"
SequencingFieldType="java.sql.Timestamp"
SequencingTableNameFieldValue="TSF_HDR_V"
SequencingTableName="SEQUENCING_HELPER"
SequencingTableNameFieldName="TABLE_NAME"
SequencingTableValueFieldName="LAST_READ_DATE"
MaxRaiseSize="1"
MaxTransactionSize="unlimited"
PollingInterval="5400"
NumberOfThreads="1"
DelayCommit="false"
PollForChildUpdates="true"
ReturnSingleResultSet="false"
MappingsMetaDataURL="DBRMSTransferPoll_toplink_mappings.xml" />
*<input/>*
*</operation>*
*</binding>**

The issue you are facing is memory. SOA Suite is not really designed to handle large payloads because of this issue.
What I would do in the first instance is shorten the frequency so you are only selecting a small number of rows at a time. This may not have an impact because the data maybe produced via a batch program so you will always get these large volumes.
What you could do is just select the header still using the MaxRaiseSize="1" so you get just one instance per header but then you select the lines via a db adapter in the BPEL process.
The other option is to have some other mechanism that invokes the process with the full payload, e.g. setup a DB schedule that runs PL/SQL selects the data and places it on a AQ.
cheers
James

Database Adapter Polling

I am using Jdeveloper 10.1.3.1.0 to do the database polling. The adapter polls two tables joined by the foreign key.Then it will update the status code as logic deletion. However, when I tried to set the database rows per xml document to 1 on step 10 of 11 of the polling options. However, when I tried to set database row per transaction to 50, it won't allow me. My understanding is that this 50 will set the database commit every 50 records. The wizard basically stopped there. Only after I changed it to unlimited, it proceeded.Can anybody help me?

Hi,
The triggering instances will not depend on the Database rows/transaction but will only depend on the Database rows/xml document.
Database rows/transaction is internal to the DB and the DB adapter.
If u keep Database rows/transaction as 200 and no. of rows/ xml document as 100 and 1000 rows are to be processed, then it will create 10 instances.
However if you have 1000 rows for processing DB adapter will run a cursor in a loop to pick up 200 rows from the 1000
rows 5 times (this is a batch setting between DB and the DB adapter and will distribute the load of picking 1000 rows at a time into 5 transactions) and then these 200 rows will be distributed into 2 BPEL instances of 100 rows (this is a batch setting between DB adapter and BPEL).
Hope this clarifies.
With Regards,
Harshwardhan

Database Adapter - Polling updated rows

Hello, I have a question reguarding the polling strategy available in the database adapter.
I set it up and it works great with new inserted rows in the table.
However, it doesn´t capture the updated rows!
For instance, i have the following table:
ID - NAME - AGE
1 -John- 21
2 -Mary- 25
When I insert a new row, it is captured by comparing the last captured ID in the sequencing file.
ID - NAME - AGE
1 -John- 21
2 -Mary- 25
3 -Cindy- 20 <--------- New row
But when i UPDATE an already existing row, it doesnt load the changed row!
ID - NAME - AGE
1 -John- 26 <----------- Age changed, but polling doesnt recognize it!
2 -Mary- 25
3 -Cindy- 20
Is there a way to get this to work? Should I set an special option? Thank you very much.
Im using jdeveloper 11g.

Hi John,
I guess you're talking about BPEL? If so, try the BPEL forum for a better response.
Best,
John

Database Adapter Polling - Setting arguments in runtime

Hi!
I have a bpel-process with a DB-adapter that polls a table for new records every 10 second. I have a Where clause for the Select query, that reacts on all new records where the first argument (a field in the table) is equal to the second argument that is a literal value that will be hardcoded in the adapter.
But in the future it might be possible that the second argument might change and I want to be able to edit that without redeploying the process. Is there anyway I could set the second argument as a parameter and change it in run-time, as a property in the BPEL console for example?

DB Adapter does not have possibility to change toplink mappings in runtime :-(
But maybe you can move this adapter to separate process (or even to ESB flow)which will be responsible just for receiving the data from DB and this process will call your main process. In future you will change just this small process and not the main one. Could be a workaround.

Error! Oracle Database Adapter Ignoring Spaces

I have a custom sql which concats values -
select firstName||' '||lastName from person;
It works in SQL Developer but not with the DB Adapter. Is there a way to tell the adapter to accept whitespaces?

So I realized that the Audit Flow does not show the exact representation of the database output variable, but when written to a file the spaces are present.

OSB DB Adapter Polling Issue

Hello Everybody,
Requirement
I am doing DB Adapter polling in OSB.I have a db adapter which polls order table whenever there is a record with status='N'.The OSB component is on single node of Weblogic Server.
1.The db adapter picks the order data with status='N' in the proxy service
2.It transforms to webservice xsd
3.Invokes a webservice.
4.The webservice returns acknowledgement number.
5.The order table should be updated with status 'Z' and attribute1=acknowledgement number
OSB Service Design
1.Proxy service calls business service to poll the order table
2.Converts the payload to the xsd format required by target
3.Invokes the webservice on target
4.Receives acknowledgement number
5.calls a plsql procedure which updates all the records within this batch with the acknowledgement number and status='Z'
My configurations in db adapter
Logical delete option in db adapter.
Unread Value :'N'
Read Value : 'A'
Polling frequency : 300 seconds
no of databse rows per XML document : 10
Database rows per transaction : 10
Issue
1.My process after getting the acknowledgement number it updates the status with Z and attribute1=acknowledgement number.At the of this transaction I am seeing that the status is being updated by
the adapter to 'A' based on read value.I want the read value only to be updated initially but as soon as my OSB process picks it for further processing it should not update again.How can i prevent
the status from getting updated to 'A'.
2.I have 40 records in order table.Per the database rows per transaction it should process 10 records at a time and for each batch of 10 i should get one acknowledgement number.Instead i see that
all the 40 records are updated with the same acknowledgement number.Kindly help as to how I can resolve this situation.
Thanks & Regards,
Radha

Hi Arik,
I tried setting the property(idempotent) in jca file of the polling adapter and it gave me below error.Kindly help
<adapter-config name="EBS_FETCHDATA" adapter="Database Adapter" wsdlLocation="EBS_FETCHDATA.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/DB/newebs" UIConnectionName="EBS" adapterRef=""/>
<endpoint-activation portType="EBS_FETCHDATA_ptt" operation="receive">
<activation-spec className="oracle.tip.adapter.db.DBActivationSpec">
<property name="DescriptorName" value="EBS_FETCHDATA.XxcmfOtmOrderHdrIfaceTmp"/>
<property name="QueryName" value="EBS_FETCHDATASelect"/>
<property name="MappingsMetaDataURL" value="EBS_FETCHDATA-or-mappings.xml"/>
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MarkReadColumn" value="OTM_INTERFACE_STATUS"/>
<property name="MarkReadValue" value="A"/>
<property name="MarkUnreadValue" value="N"/>
<property name="PollingInterval" value="60"/>
<property name="MaxRaiseSize" value="10"/>
<property name="MaxTransactionSize" value="300"/>
<property name="NumberOfThreads" value="1"/>
<property name="ReturnSingleResultSet" value="false"/>
<property name="idempotent" value="false"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
---------------------ERROR---------------
Invalid JCA transport endpoint configuration, exception: javax.resource.ResourceException: BINDING.JCA-12532 Cannot set JCA WSDL Property. Error while setting JCA WSDL Property. Property setIdempotent is not defined for oracle.tip.adapter.db.DBActivationSpec Please verify the spelling of the property.
Thanks,
Radha

Oracle database Adapter polling in OSB Cluster

Similar Messages

Maybe you are looking for