Database polling process

I have created a bpel database polling process to process a single table and use a logical update (mark a column as processed). The table will contain many unprocessed records at any time. I have setup the polling interval 5 Sec and records unlimited for each polling interval and in the process i am calling a stored procedure to insert same data into another database.
My doubts
But It fetches only one record and different instance is created for every Row. Is it normal process?
Why it takes only record after using unlimited option?
why i am asking this means i don't want to call stored procedure for each and every record.
I'm using MS SQL Server 2005.
any one pls let me know what is happening inside.

Depends on how you define performance. DBs are generally designed for this kind of load so you then need to look at the middleware. The concern I always have is how big can this message get. If it can potentially grow big, I would say over 10MB then you could run into trouble if you haven't tuned for that, 1 10MB file could hang your whole system if not tuned (extreme case to make a point). If you have it running row by row it may take more time but they will go though. Without knowing more about your environment I can't comment too much more, e.g. patterns, hardware, load etc.
Also polling isn't the most effective way long term to invoke a message. If the table is going to grow large I would look at partitioning as that select statement will deteriorate over time as you don't delete the records once read. ( I'm just trying to give you things to think about it may not be relevant your your site)
cheers
James

Similar Messages

BPEL polling process open new connection every time it poll for data.

Hi All,
I've created a BPEL process that with a database polling process for an AS400 table and the log is showing the BPEL process is opening a new connection every second. Is there a way to create a polling process that will only use one connection and keep the connection open.

This is dependent on the SOA Server configuration not your service. To change that login to EM console and find appropriate configuration entries in administration tab of your OC4J instance.
Unfortunately I don't know exactly which one (or more that one) is responsible in your case. I didn't trouble about that ever before, for me it can be even million connections as far as it is working smoothly.

Can we put multiple Database Polling within the asynchronous process

Hi,
Can we put multiple Database polling within the the same asynchronous BPEL process.
There will be multiple Receive activities to receive the data from the poller.
Saptarishi

Hi Peter,
I am using 10.1.3.4 and cannot use ESB/mediator.
For the 2nd option,
I have tried to put multiple receive's to poll data from a table but it does not work(it waits at the 2nd Receive). Let me try to elaborate the issue a bit.
I have created a table for polling.
The table has 3 columns :- transaction_id, status, is_read
is_read is kept to implement the logical delete strategy of DB polling.
What I need to do is to maintain a single instance of BPEL to maintain a transaction(which is uniquely identified by transaction_id).
The BPEL should track the different stages of the transaction, i.e whenever a new row is inserted in the table with the updated status for a transaction, it must find the correct instance(by co-relating the transaction_id) and go to the next step (wait for the next receive activity) until all the steps of the transaction is completed.
In the code, I created a correlation set consisting of transaction_id(only). The property transaction_id has an alias to the inbound variable's payload.
In the first Receive, I checked the "create instance" checkbox. Also the correlation set is initialized.
From next Receive onwards the correlation set is checked.
The polling frequency is 5 secs.
The first Receive works fine and the process is instantiated. But it waits at the 2nd Receive indefinitely.
It will be very helpful if you can try this once. If you feel this is not the right approach, please guide me.
Thanks and Regards,
Saptarishi

Database Poller issues in Clustered env

Hi,
I am running Oracle BPEL 10.1.3.4 on top of Weblogic version 9.x in a clustered env. I created a simple database poller BPEL process (for target table in Oracle database) with below parameters:
Max Raise Size: 1
Max Transaction Size: 2
Polling Interval:30
Distributed Polling is enabled
All other BPEL engine and domain level parameters have default values.
In my clustered env two instances of database poller BPEL process are running on diff nodes. Now I populated my table with 1000 records in one go. According to parameters I expect:
- In each polling interval max 2 record will be processed by database poller BPEL process running on single node. And there will be 2 instances of this bpel process as max raise size is 1. Same I expect for database poller BPEL process running on another node. So overall 4 records should be processed in each polling interval and 4 instances of BPEL processes should be visible in BPEL console. But in actual its always 2.
Is I am missing something here? Won't the load balancer distributes records to BPEL processes on both nodes equally?
Also then I raise Max transaction size to higher value e.g. 20. But in this case after processing nearly 1/3 rd of records, the BPEL process stopped picking up any further records. Is there any known issue where Adapter stops picking any further database records if transaction size limit is higher?
thanks
Ankit
Edited by: AnkitAggarwal on 22-Feb-2010 03:36

Hi Ankit,
I have Oracle BPEL env11.1.1.2.0 clustered over 2 nodes.
I am facing a similar issue. In my scenario I have Bpel (with DB poller) and its deployed on the cluster. And I am connected to DB via Multi data source (MDS-1) with only one datasource (DS-1) configured in it.
So whenever I update the table which is being polled, in some cases I have TWO instances and in some cases I have ONE Instance running. My requirement is to have only one instance running every time the DB poller is initiatied.
Kindly help me out.
Thank You
Best Regards
Prasanth

Database Poller to start the control flow

I am relatively new to BPEL/SOA. I need your help in the design process
I have a design as following:
I have to essentially bring data from DB2 database into Siebel. On the Siebel side I have the Webservices created.
1. rowid, tablename, isTheRowProcessed, timestamp.is the structure of my polling table's structure.
The tablename column will tell me which application table has been updated/inserted with new data.
2. The Database Poller will poll the Polling table every minute and see there is a new row. The BPEL will read the tablename column and fetch the name of the table.
3. Depending on the name of the tablename, a specific Web Service will be invoked which will insert the data into the Siebel system.
for example, if the new row is:
10 TableA NotRead 8/19/2012 10:10:10
The poller should the read above and make it "10 TableA Read 8/19/2012 10:10:10"
Then WebServiceA should be invoked with some data.
Here is My question:
Should it be Async BPEL process or Synchronous process that should have the Poller?
Will Poller kick start sub BPEL processes?

I have a DB poller which has only one row (always just one row) and the Poller would update flag to N from Y.
The DBPoller is set to run every two seconds. I have a flag that is initially set by human to Y. The Poller will flip the value of the flag to N (from Y) and initiate a one-way BPEL process and if the BPEL process will set the Flag back to Y if successful. If the BPEL process fails then the BPEL process will leave the value of the flag to N and the BPEL process sends a mail to the users about the failure. The users after fixing the issue (may be some of the Web Services called by the BPEL are unavailable), will set the flag to Y and the process will continue.
The above intention is supposed to create create an instance id only after entire BPEL is executed. The poller is configured to execute every 2 seconds.
instance_id starttime BPEL Execution time
1 5:00:00 30 seconds
2 5:00:02 20 seconds
3 5:00;04 25 seconds
The above is the scenario is my current execution.
I thought that the second instance would start at 5:00:30 because the flag value would be N from 5:00:00 to 5:00:30 and the BPEL process would set the flag's value to Y at the end of execution of the BPEL process (instance 1). But, to my surprise 2nd instance is starting at 5:00:02 (just because the poller is configured to run every 2 seconds). Even if the poller is configured to run every 2 seconds the poller should not create BPEL process because the Poller at 5:00:02 should see the flag value of N (The poller should only create an instance if the flag's value is Y).
Please clarify this behavior.

SAPINST failed step "Install Oracle Database (post processing)"

i will install ep6.0 with oracle database 9.2.0.4 on sun solaris.
the SAPINST failed at the step "Install Oracle Database (post processing) with follow error.
the oui - installer (runinstaller) finished sucessfully.
ERROR 2004-08-31 16:05:17
CJS-00084 SQL statement or script failed. DIAGNOSIS: Error message: ORA-01501: CREATE DATABASE failedORA-01101: database being created currently mounted by some other instance
Disconnected from Oracle9i Enterprise Edition Release 9.2.0.4.0 - 64bit Production
With the Partitioning optionJServer Release 9.2.0.4.0 - Production. SOLUTION: See ora_sql_results.log and the Oracle documentation for details.
no user is logged on the Database. Database is not running (is shutdowned and unmounted). No Oracle process is running.
pleas help.
thanks
armin hadersbeck

Hi Armin,
We're going to install EP 6 stack3 with Oracle 9.2.0.4 and Solaris 9. We have exactly the same error as you during sapinst.
How do you solved that ?
Thanks a lot for your help,
Regards from Mexico,
Diego

OSB polling process

Hi
I have a requirement where i need to create an OSB process which connects to a DB,executes a sql query at regular intervals. In other words a polling process which executes every 5 min
Can some one suggest me how to go about it.
Thanks in advance
Vamsi

Use "Poll for new or changed records in a table" operation of DB adapter. Please refer below post to know how to use JCA DBAdapter with OSB 11g -
http://guidoschmutz.wordpress.com/2010/08/08/oracle-service-bus-11g-and-db-adapter-a-different-more-integrated-approach/
Regards,
Anuj

Database creation process hangs

I am manually creating a database on Windows 2k3 server using Oracle 11 r2. Using the Database Configuration Assistant to create a database, the process hangs for hours.
I figured out and triedthe following:
1. I have attempted using the GUI tool more than once to create the database and each time it hangs.
2. Using the scripts have been created using the with configuration tool, I manually attemped to create database. -- I have attempted more than once.
3. The database creation process hangs while running the EXECRM.SQL file that is called by the CATPCNFG.SQL which is called by CATPROC.SQL which is called by CreateDBCatalog.sql
3. The EXECRM.SQL file hangs on the following statement EXECUTE DMBS_RMIN.INSTALL;
I'm not sure why the PL/SQL packag is hanging at this point. Any help is appreciated.
Thanks,
Sheila

I was able to create the databases prior to installing Enterprise Manager Grid control. I deleted the databases to re-create so they would be registered with Enterprise manager. Once I install Enterprise manager the creation process hung. I have also installed Essbase and Oracle/Hyperion Enterprise Performance Management Suite on the server. I'm trying to do some research on these BI tools.
I'm tempted to uninstall Essbase and the Hyperion producst along with Enteprise Manager and start from scratch to test to see if I can create a database without these other products.

Database polling performance issues

I am using Database polling to detect database changes for OLTP application.
my doubts are
1) will it affect performance of OLTP application
2) If so what would be the impact on OLTP application
3) How we can improve performance
4) any link to get more idea about this.

1) will it affect performance of OLTP application
No IT WONT AFFECT BECAUSE oltp Aapplication has
Transactions that involve small amounts of data
* Indexed access to data
* Many users
* Frequent queries and updates
* Fast response times
2) If so what would be the impact on OLTP application
N/A
3) How we can improve performance
Do not poll the table for 30 secs interval poll for atleast 45 secs intervals
4) any link to get more idea about this.
N/A

RE Kill Database Refresh Process

Hi All ,
I have instiated the Database Refresh process in Htperion Workspace , but now i want to stop it can any body let me know how i can stop the Database Refresh process. Please its urgent .I have this issue in production
Regards
Advabce Thanks

Log into EAS and right click the essbase server > edit sessions.
Cheers
John
http://john-goodwin.blogspot.com/

Database Statistics Process slowed down

Hi Experts
The Database Statistics Process usually used to take about 2000-3000sec. Now for the past few days i am observing that the database statistic is taking 5000-6000sec.
I have checked the job logs of both the jobs, there is no difference as such.
Please let me know what could be the reason for which it is taking so much of time these days.
Regards
Akshay Chonkar

Hi,
Check in.
http://help.sap.com/saphelp_nw04/helpdata/en/80/1a6473e07211d2acb80000e829fbfe/content.htm
and look into your InfoCueb data size and % also.
See the sequence:
http://help.sap.com/saphelp_nw04/helpdata/en/bb/bdd69f856a67418962d74bfd7bd8af/content.htm
Thanks
Reddy
Edited by: Surendra Reddy on Apr 10, 2009 7:32 AM

Monitoring/debug the database connection process

Hi,
I am trying to define a new database connection using the JDBC-ODBC Bridge (trying to connect to a legacy apps), and keep getting an error message from the ODBC driver manager, which work perfectly fine outside the JDev environment.
Is there a way for me to monitor/debug the database connection process, prior to a successful test connection, in order for me to find out exactly where/what the problem is?
Thanks for the help,
Arie.

Repost

Any major differences of exadata database, listener, processes than regular RAC environment?

I would like to ask for any input regarding any major differences of exadata database, listener, processes than regular RAC environment.
I know now the exadata not only have SCAN listener, but a lot other listeners. can expert here provide more details?
Thanks

We will use zfs to do backups, is that possible for the initiband listener to communicate with ZFS? where I can find documents for zfs?
The SDP (Infiniband) Listener is for client connections connecting to the database on Exadata over the SDP protocol on the Infiniband network. You should use the Infiniband network to connect the ZFS to Exadata and mount the ZFS shares to the Exadata compute nodes using DNFS; but this doesn't use the SDP listener because there is no database connection originating from the ZFS you are just backing up your databases to it. See the "Oracle ZFS Storage: FAQ: Exadata RMAN Backup with The Oracle ZFS Storage Appliance (Doc ID 1354980.1)" MOS note for good information and references regarding backing up from Exadata to ZFS.
Plus how do I know we have exalogic? I dont think we have one, but is there a way to check to be sure?
Exalogic is another of Oracle's engineered systems. It contains integrated compute, network and storage - similar to Exadata - but is used for running application environments, specifically for fusion middleware (e.g. Weblogic) applications, instead of databases. It uses a ZFS storage appliance for the storage, as opposed to the storage cells on Exadata, and for virtualized environments uses the Exalogic Elastic Cloud software. You would know if you have one.
So basically after oracle engineer installed onecommand and created sample database, as oracle dba, we can dbca to create a database just like regular RAC environment? There is nothing specific on exadata perspective?
Yes... Oracle on Exadata is still the same RDBMS - same Oracle Enterprise edition with the RAC option. The Exadata difference comes with the hardware integration and the storage cell software... the database software is the same.
Another question is do I have to configure exadata specific parameters in order for all those features of smart scan, storage index, comrpession, etc work?
Some Exadata features are mostly "black box" and work without any configuration others may take some configuration or tuning to take advantage of. For example, storage indexes are created dynamically on the storage cells... there is not much you can do to control them. For smart scans you need full table/index scans with direct path reads. So you need to tune for direct path reads. HCC requires setting up your tables/partitions to compress at one of the HCC compression levels and using direct path loads.

Database polling adapter within an asynchronous BPEL process

Hi,
I have a requirement to poll a database table withing an asynchronous process. The reason I want to use a receive within an asynchronous BPEL is because the process needs to be notified many times thru polling. So might need many receive activities.
I have developed a process as described below :-
1. Created an asynchronous process.
2. Created a Database adapter for polling a table. Logical delete strategy is being used.
3. Have put a receive activity from the DB Adapter created.
4. Created a correlation set consisting of a single property(String)
5. Created a property alias to refer to
a. the input string of the asynchronous process. (unique for this process)
b. the input from the database adapter (unique for this process)
I initiate this process from the console. Then I inserted a record the table with proper inputs.
But the BPEL waits indefinitely at the receive activity.
When I try to poll the table from an empty BPEL process, it works perfectly fine.
Could someone please help me here.
Thanks in advance
Saptarishi

Hi,
Could someone pls answer this query.
Regards,
Saptarishi

Database Polling in Jdev

Hi,
I have created BPEL process that continuously polling on View present on database at certain interval.
here i am using logical delete operation while polling for new or changed records so that will update certrain field on table.
but my view has only Read permission(Not want to change this) so i can't update the field that's why this polling functionality is not working after deploy on BPEL console.
so can anyone will help me on how i can fire only select query with specified interval of time to read the view data only? is there anyother way around to fire select query at certain interval without updating?
your help will be appreciated.
Thanks
Sagar

I'm not yet familiar with 11g - so forgive me if this is not valid in that release. But for 10.1.3 ...
Another option - if you can't (or just don't want to) affect data in the DB is to use some other mechanism to kick off your BPEL process on a regular time interval - and then just do a normal inbound select operation against your table to search for records to process.
I've been trying out a new scheme - where I use a file adapter as the polling mechanism to kick off the BPEL process (using a polling interval of maybe a minute). The file on the server that its polling for can be anything - as I don't actually use the contents of the file in the process. At the end of the BPEL process, I use another file adapter to place a new file in the polling directory - to be found by the polling file adapter on the next polling cycle. You could also accomplish this in other ways - but this seemed like a pretty simple way to kick off a BPEL process on a regular time interval.
Just an idea ...
I do wish BPEL had a simple way to schedule a process to invoke itself on a set interval. Perhaps in a future release? Or even in 11?
Rod

Database polling process

Similar Messages

Maybe you are looking for