Database Poller issues in Clustered env

Hi,
I am running Oracle BPEL 10.1.3.4 on top of Weblogic version 9.x in a clustered env. I created a simple database poller BPEL process (for target table in Oracle database) with below parameters:
Max Raise Size: 1
Max Transaction Size: 2
Polling Interval:30
Distributed Polling is enabled
All other BPEL engine and domain level parameters have default values.
In my clustered env two instances of database poller BPEL process are running on diff nodes. Now I populated my table with 1000 records in one go. According to parameters I expect:
- In each polling interval max 2 record will be processed by database poller BPEL process running on single node. And there will be 2 instances of this bpel process as max raise size is 1. Same I expect for database poller BPEL process running on another node. So overall 4 records should be processed in each polling interval and 4 instances of BPEL processes should be visible in BPEL console. But in actual its always 2.
Is I am missing something here? Won't the load balancer distributes records to BPEL processes on both nodes equally?
Also then I raise Max transaction size to higher value e.g. 20. But in this case after processing nearly 1/3 rd of records, the BPEL process stopped picking up any further records. Is there any known issue where Adapter stops picking any further database records if transaction size limit is higher?
thanks
Ankit
Edited by: AnkitAggarwal on 22-Feb-2010 03:36

Hi Ankit,
I have Oracle BPEL env11.1.1.2.0 clustered over 2 nodes.
I am facing a similar issue. In my scenario I have Bpel (with DB poller) and its deployed on the cluster. And I am connected to DB via Multi data source (MDS-1) with only one datasource (DS-1) configured in it.
So whenever I update the table which is being polled, in some cases I have TWO instances and in some cases I have ONE Instance running. My requirement is to have only one instance running every time the DB poller is initiatied.
Kindly help me out.
Thank You
Best Regards
Prasanth

Similar Messages

Cache Event polling S_NQ_EPT in Cluster Env.

Hi,
How to use event polling mechanism in Clustered Env to purge cache ? It works fine in non - clustered env.
I'm getting errors -
2009-12-16 15:40:45
[55003] The cache polling SELECT query failed for table S_NQ_EPT.
2009-12-16 15:40:45
[nQSError: 17001] Oracle Error code: 933, message: ORA-00933: SQL command not properly ended
at OCI call OCIStmtExecute.
[nQSError: 17010] SQL statement preparation failed.
2009-12-16 15:40:45
[55005] The cache polling delete statement failed for table S_NQ_EPT.
Anything special we have to do ?
Thanks,
Ayaps

Here's the resolution:
Hdr: 6877602 N/A ADMIN_TOOL 10.1.3.3.2 IMPORT PRODID-2025 PORTID-289
Abstract: INCORRECT SCHEMA WHEN IMPORTING THE EVENT POLLING TABLE
*** JOKENNE 03/10/08 01:47 am ***
script in 10.1.3.3.2 we are getting the following error in the NQServer.log
file:
"[56001] The cache polling event table UET has an incorrect schema."
After some investigation on a Paint.rpd file we found that this occurs when
we import the schema using an OCI connection i.e. File > Import > From
database > OCI
When we import using ODBC 3.5 option it works fine.

Database polling performance issues

I am using Database polling to detect database changes for OLTP application.
my doubts are
1) will it affect performance of OLTP application
2) If so what would be the impact on OLTP application
3) How we can improve performance
4) any link to get more idea about this.

1) will it affect performance of OLTP application
No IT WONT AFFECT BECAUSE oltp Aapplication has
Transactions that involve small amounts of data
* Indexed access to data
* Many users
* Frequent queries and updates
* Fast response times
2) If so what would be the impact on OLTP application
N/A
3) How we can improve performance
Do not poll the table for 30 secs interval poll for atleast 45 secs intervals
4) any link to get more idea about this.
N/A

Distributed Polling Not working for Sybase Database poller Proxy

I am using a Proxy service which is polling records from a sybase database. When I tried to deploy this proxy in a clustered environment I noticed sometimes it is polling the same record twice. So I tried to enable distributed polling in my proxy by adding *<lock-mode>lock-no-wait</lock-mode>* in my topplink_mapping.xml file. But activating this change resulted error in the log file stating "Incorrect syntax near 'NOWAIT'".
Later on I found out that it is a known issue ...for reference check [http://www.oracle.com/technetwork/middleware/docs/aiasoarelnotesps5-1455925.html|http://www.oracle.com/technetwork/middleware/docs/aiasoarelnotesps5-1455925.html] with bug # 13405718.
So I am stuck here...and no solution yet.
Any suggestion??

You can Emulate AQ functionality for any Non-Oracle Database where sometimes the *Clustered DB-Adapter[Poller]* polls the same record more than once.
Say, you need to poll 'status' column of table 'A' for a status 'POLL_IT'
1. Create a Table 'DUMMY_AQ' matching required column signatures from table 'A'
2. Create a Trigger on table 'A' for copying the row content on Insert or Update for status 'POLL_IT' in to 'DUMMY_AQ' table;
3. Poll DUMMY_AQ with Row Level Read lock & Delete On Read , that way it will is ensured that so that only One Instance of your Clustered DB Adapter can have visibility to any newly inserted row having status 'POLL_IT' .

DB Adapter Polling Issues - causing DB Locks

Hi Experts,
I am working on project in SOA Suite 11.1.1.6 environment.
In my project I have used DB Polling which has following settings
<property name="DescriptorName" value="XXXXXXXXXXX"/>
<property name="QueryName" value="XXXXXXXXXXXXXXXXXXXXX"/>
<property name="MappingsMetaDataURL" value="XXXXXXXXXXXXXXXXXXXX.xml"/>
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MarkReadColumn" value="PROCESS_FLAG"/>
<property name="MarkReadValue" value="P"/>
<property name="MarkUnreadValue" value="Y"/>
<property name="PollingInterval" value="20"/>
<property name="MaxRaiseSize" value="1"/>
<property name="MaxTransactionSize" value="10"/>
<property name="NumberOfThreads" value="1"/>
<property name="ReturnSingleResultSet" value="false"/>
The problem is when I update 25 records, the last 5 records are not getting processed and its just stuck there. It just shows DB Adapter Instance in the Composite Instance and the record is locked.
I am using Multi DataSource configuration with 3 Load Balancing Database Instances on SOA Clustered Environment. I have DISTRIBUTED POLLED flag checked in the DB Poller Adapter
If I update records less than 20, the polling frequency then its working fine. If I update more than 20 then its causing issue of locks.
Thanks in Advance

Hi All,
Issue resolved by setting the <property name="NumberOfThreads" value="1"/> value to 10
Thanks

XI adapter polling issue & JDBC / DB2 driver connection timeout properties

Hello Group,
We have a long running issue with our XI 7.0 system running on iseries. (V5R3) The issue occuring is that our XI adapters stop polling and the only resolution is to restart the J2EE engine or to resart the adapter framework services.
We have had several OSS messages open on this subject for over a year and are going round in circles with the a number of different SAP consultants.
The one topic that we keep coming back to is that we are being asked to set DB2 driver connection timeout properties. We are using the toolbox driver and have upated to the latest JTopen driver, but have not managed to find any inofrmation on how to set the timeout parameter. Does anyone know where the timeout parameter set?
Has anyone experienced polling issue like this before and how did you resolve?
SAP referred to the SAP note 1078420 - XI/PI JDBC Adapter: Setting JDBC driver properties for DB which is for Oracle, but this will give an idea of what timeout parameters SAP are asking about.
Extract of the note is below:-
Symptom
This note gives an option to set JDBC driver properties while acquiring a DB connection. When connecting to DB using JDBC adapter there are instances
where DB connection take a long time to establish connection. Some times call made to Driver will hang permanently. Setting driver properties would resolve this problem.
More Terms
Connection timeout, time out, query timeout
Cause and Prerequisites
Solution
In the advanced mode table section of sender channel and receiver channel configurations, we can set driver properties for each DB connection. Any
such property would have to contain prefix 'driver:'(with out quotes) For example, for Oracle Database JDBC thin driver 10.2.0.3 version, the
property oracle.jdbc.ReadTimeout helps to set read timeout while reading from the socket. Also for setting login time out in Oracle, we use
oracle.net.CONNECT_TIMEOUT. To set these two properties use as follows:
driver:oracle.jdbc.ReadTimeout 1000
driver:oracle.net.CONNECT_TIMEOUT 1000
(The TimeOut Driver properties like ReadTimeout and CONNECT_TIMEOUT are in milliseconds)
Refer to your DB documentation/ JDBC driver documentation on this. Please note that properties can vary from each driver version. For instance, some
of properties of Oracle JDBC thin Driver 10.2.0.3 properties may not be present in older version drivers. Please contact DB vendor for the complete
list of driver properties. In addition to above, we also provide another parameter for query time out.
sqlquerytimeout (prefix 'driver:' is not required) is the parameter that is to be used for SQL query time out. This is case-sensitive and should be
configured as positive integer value in seconds(greater than 0).
Any help on this would be much appreciated.
With regards,
Steven

Hello,
I am not talking about the XI timeouts. But the timeouts which can be used to get the connection timeouts for DB2/AS400 databases.
So please provide that information.
THanks,
soorya

Can we put multiple Database Polling within the asynchronous process

Hi,
Can we put multiple Database polling within the the same asynchronous BPEL process.
There will be multiple Receive activities to receive the data from the poller.
Saptarishi

Hi Peter,
I am using 10.1.3.4 and cannot use ESB/mediator.
For the 2nd option,
I have tried to put multiple receive's to poll data from a table but it does not work(it waits at the 2nd Receive). Let me try to elaborate the issue a bit.
I have created a table for polling.
The table has 3 columns :- transaction_id, status, is_read
is_read is kept to implement the logical delete strategy of DB polling.
What I need to do is to maintain a single instance of BPEL to maintain a transaction(which is uniquely identified by transaction_id).
The BPEL should track the different stages of the transaction, i.e whenever a new row is inserted in the table with the updated status for a transaction, it must find the correct instance(by co-relating the transaction_id) and go to the next step (wait for the next receive activity) until all the steps of the transaction is completed.
In the code, I created a correlation set consisting of transaction_id(only). The property transaction_id has an alias to the inbound variable's payload.
In the first Receive, I checked the "create instance" checkbox. Also the correlation set is initialized.
From next Receive onwards the correlation set is checked.
The polling frequency is 5 secs.
The first Receive works fine and the process is instantiated. But it waits at the 2nd Receive indefinitely.
It will be very helpful if you can try this once. If you feel this is not the right approach, please guide me.
Thanks and Regards,
Saptarishi

Database Poller to start the control flow

I am relatively new to BPEL/SOA. I need your help in the design process
I have a design as following:
I have to essentially bring data from DB2 database into Siebel. On the Siebel side I have the Webservices created.
1. rowid, tablename, isTheRowProcessed, timestamp.is the structure of my polling table's structure.
The tablename column will tell me which application table has been updated/inserted with new data.
2. The Database Poller will poll the Polling table every minute and see there is a new row. The BPEL will read the tablename column and fetch the name of the table.
3. Depending on the name of the tablename, a specific Web Service will be invoked which will insert the data into the Siebel system.
for example, if the new row is:
10 TableA NotRead 8/19/2012 10:10:10
The poller should the read above and make it "10 TableA Read 8/19/2012 10:10:10"
Then WebServiceA should be invoked with some data.
Here is My question:
Should it be Async BPEL process or Synchronous process that should have the Poller?
Will Poller kick start sub BPEL processes?

I have a DB poller which has only one row (always just one row) and the Poller would update flag to N from Y.
The DBPoller is set to run every two seconds. I have a flag that is initially set by human to Y. The Poller will flip the value of the flag to N (from Y) and initiate a one-way BPEL process and if the BPEL process will set the Flag back to Y if successful. If the BPEL process fails then the BPEL process will leave the value of the flag to N and the BPEL process sends a mail to the users about the failure. The users after fixing the issue (may be some of the Web Services called by the BPEL are unavailable), will set the flag to Y and the process will continue.
The above intention is supposed to create create an instance id only after entire BPEL is executed. The poller is configured to execute every 2 seconds.
instance_id starttime BPEL Execution time
1 5:00:00 30 seconds
2 5:00:02 20 seconds
3 5:00;04 25 seconds
The above is the scenario is my current execution.
I thought that the second instance would start at 5:00:30 because the flag value would be N from 5:00:00 to 5:00:30 and the BPEL process would set the flag's value to Y at the end of execution of the BPEL process (instance 1). But, to my surprise 2nd instance is starting at 5:00:02 (just because the poller is configured to run every 2 seconds). Even if the poller is configured to run every 2 seconds the poller should not create BPEL process because the Poller at 5:00:02 should see the flag value of N (The poller should only create an instance if the flag's value is Y).
Please clarify this behavior.

Urgent help needed; Database shutdown issues.

Urgent help needed; Database shutdown issues.
Hi all,
I am trying to shutdown my SAP database and am facing the issues below, can someone please suggest how I can go about resolving this issue and restart the database?
SQL> shutdown immediate
ORA-24324: service handle not initialized
ORA-24323: value not allowed
ORA-01089: immediate shutdown in progress - no operations are permitted
SQL> shutdown abort
ORA-01031: insufficient privileges
Thanks and regards,
Iqbal

Hi,
check SAP Note 700548 - FAQ: Oracle authorizations
also check Note 834917 - Oracle Database 10g: New database role SAPCONN
regards,
kaushal

HWF UI work list not loading in BPM worklist page (on clustered env)

hello - Please reply directly as I am not on this alias.
My SOA project (BPEL+HWF) is successfully deployed on the clustered env successfully.
My BPEL process runs fine. But my HWF_UI taskflow fails to load on the browser (IE and Firefox, same error)
I can see the composite & UI ear(enterprise app) on EMConsole & AdminConsole, and all configs/ settings looks ok.
During execution, the work item pops up on the BPM worklist, but when I click on the work-item, the HWF_UI component is not loading....
Not Found
The requested URL /workflow/DOO_Simulation_ProjectUI/faces/adf.task-flow was not found.
How do I overcome this or get some meaningfull error info.? The log files donot tell much..
Caused By: oracle.adf.controller.ControllerException: ADFC-12002: The ADF Controller is unable to pop the top-level ADF unbounded task flow from the page flow stack.
at oracle.adfinternal.controller.state.PageFlowStack.pop(PageFlowStack.java:184)
Another question:
How do I test if my HWF task flow component (UI) is installed & working / executing properly? any error logs/ error level settings?
Edited by: ssondur on Apr 5, 2013 4:17 PM

It is deploying correctly, the worklist app displays my instance. Btu when I click on my worklist item, the UI does not load or display. Below is the browser error and logfile error messages.
-----Browser error-----
Not Found
The requested URL /workflow/DOO_Simulation_ProjectUI/faces/adf.task-flow was not found.
---Log file message---------
Caused By: oracle.adf.controller.ControllerException: ADFC-12002: The ADF Controller is unable to pop the top-level ADF unbounded task flow from the page flow stack.
at oracle.adfinternal.controller.state.PageFlowStack.pop(PageFlowStack.java:187. No
8. No customization to env or app. This is a user defined (but standard) BPEL process deployed. The same app works fine on my local laptop & SOA env

Database performance issue (8.1.7.0)

Hi,
We are having tablespace "payin" in our database (8.1.7.0) .
This tablespace is the main Tablespace of our database which is dictionary managed and heavily accessed by the user SQL statements.
Now we are facing the database performance issue during the peak time (i.e. at the month end) when no. of users use to run the no. of large reports.
We have also increased the SGA sufficiently on the basis of RAM size.
This tablespace is heavily accessed for the reports.
Now my question is,
Is this performance issue is because the tablespace is "dictionary managed" instead of locally managed ?
because when i monitor the different sessions through OEM, the no. of hard parses is more for the connected users.
Actually the hard parses should be less.
In oracle 8.1.7.0 Can we convert dictionary managed tablespace to locally managed tablespace ?
by doing so will the problem will get somewhat resolve ? will it reduce the overhead on the dictionary tables and on the shared memory ?
If yes then how what is procedure to convert the tablespace from dictionary to locally managed ?
With Regards

If your end users are just running reports against this tablespace, I don't think that the tablespace management (LM/DM) matters here. You should be concerned more about the TEMP tablespace (for heavy sort operations) and your shared pool size (as you have seen hard parses go up).
As already stated, get statspack running and also try tracing user sessions with wait events. Might give you more clues.

Database polling process

I have created a bpel database polling process to process a single table and use a logical update (mark a column as processed). The table will contain many unprocessed records at any time. I have setup the polling interval 5 Sec and records unlimited for each polling interval and in the process i am calling a stored procedure to insert same data into another database.
My doubts
But It fetches only one record and different instance is created for every Row. Is it normal process?
Why it takes only record after using unlimited option?
why i am asking this means i don't want to call stored procedure for each and every record.
I'm using MS SQL Server 2005.
any one pls let me know what is happening inside.

Depends on how you define performance. DBs are generally designed for this kind of load so you then need to look at the middleware. The concern I always have is how big can this message get. If it can potentially grow big, I would say over 10MB then you could run into trouble if you haven't tuned for that, 1 10MB file could hang your whole system if not tuned (extreme case to make a point). If you have it running row by row it may take more time but they will go though. Without knowing more about your environment I can't comment too much more, e.g. patterns, hardware, load etc.
Also polling isn't the most effective way long term to invoke a message. If the table is going to grow large I would look at partitioning as that select statement will deteriorate over time as you don't delete the records once read. ( I'm just trying to give you things to think about it may not be relevant your your site)
cheers
James

JMS bridge is not working in clustered env

          We have set up a JMS bridge between WLS7SP3 and WLS8.1. It works very well in
          stand alone server env (testing env). However, we cannot get it to work on clustered
          env (preprod env). Anyone has experienced working with clustered env? If so,
          please help!
          Thanks.


I forgot to say, we are using WLS8.1 SP1
          "Pete Inman" <[email protected]> wrote in message
          news:[email protected]...
          > If you are in a clusterd environment and you deploy a bridge to the WHOLE
          > cluster it does not work and will not find the adapter. If you deploy to
          the
          > INDIVIDUAL cluster members it will work.
          >
          > We have a cluster with 4 managed servers, deploy to whole cluster - no
          > bridge working, deploy to Server1,2,3,4 bridges work fine.
          >
          > I have a case logged with BEA on this topic.
          >
          > "Tom Barnes" <[email protected]> wrote in message
          > news:[email protected]...
          > > "Not working" is too little information. I suggest
          > > that you start with the messaging bridge FAQ. There is
          > > a link to it here:
          > >
          > > http://dev2dev.bea.com/technologies/jms/index.jsp
          > >
          > > Then post with traces, exceptions, configuration, etc, if
          > > you are still having trouble.
          > >
          > > Tom, BEA
          > >
          > > jyang wrote:
          > >
          > > > We have set up a JMS bridge between WLS7SP3 and WLS8.1. It works very
          > well in
          > > > stand alone server env (testing env). However, we cannot get it to
          work
          > on clustered
          > > > env (preprod env). Anyone has experienced working with clustered env?
          > If so,
          > > > please help!
          > > >
          > > > Thanks.
          > >
          >
          >

Database consistency issue..

Hi.
SCCM 2012 English, RTM
For unknown reason the DR link broke between CA and primary.
It says Site Replication status both way Active, but data replication is mixed. Parent to child Global data - failed and child to parent site data failed. Child to parent global - Active. Replication link analyzer performs several checks and then informs
- Database consistency issues detected for site XXX. (parent). Skiping rule - shows different replication groups which are failed. I tried to replicate those, but nothing changed.(according to following article last step)
http://blogs.msdn.com/b/minfangl/archive/2012/05/16/tips-for-troubleshooting-sc-2012-configuration-manager-data-replication-service-drs.aspx
Any more ideas?

Now i have read more about DRS and SCCM 2012 and get in state where 2 from 3 replications are active.
Mainly with puting relevatnt pub files to RCM.BOX. But global data replication from CAs to PRI is still failed. No idea ....
More related articles:
http://blogs.technet.com/b/sudheesn/archive/2012/10/21/drs-initialization-in-configuration-manager-2012.aspx
http://anoopcnair.com/2012/06/20/sccm-configmgr-2012-site-to-site-replication-sql-data-replication-service-replication-configuration-management-sql-service-broker-replication-groups-and-manual-sync/
And one more thing - do not know it is related or not
Severity Type Site code Date / Time System Component Message ID Description
Error Milestone XXX 12/14/2012 10:34:29 AM server.domain.local SMS_POLICY_PROVIDER 620 Microsoft SQL Server reported SQL message 547, severity 16: [23000][547][Microsoft][SQL Server Native Client 10.0][SQL Server]The INSERT
statement conflicted with the FOREIGN KEY constraint "ResPolicyMap_PolicyAssignment_FK". The conflict occurred in database "CM_XXX", table "dbo.PolicyAssignment", column 'PADBID Please refer to your Configuration Manager documentation, SQL
Server documentation, or the Microsoft Knowledge Base for further troubleshooting information.
It is jaming replication ? and how fix DB inconsistency detected by Replication Link analyzer ?

Any place I can find Oracle database known issues

Hi
Is there any place I can find Oracle database known issues list for specified release?
Thanks

Specifically, see MOS Docs
555579.1 - 10.2.0.4 Patch Set - Availability and Known Issues
738538.1 - 11.1.0.7 Patch Set - Availability and Known Issues
HTH
Srini

Database Poller issues in Clustered env

Similar Messages

Maybe you are looking for