DB Adpter polling issues

Hi All,
Here i want poll 20,000 the records per minute and sent Siebel service . so what configuration can i do for MaxRaiseSize ,MaxTransactionSize,PollingInterval,etc....and my PollingStrategy is "Delete the row(s) that were Read" in single active node. how do i solv this issue please any body help on it .
Thank you,
Ram

Hi Ram,
Performance tuning is an interesting experience... You will have to experiment and monitor to see what works for your case...
The following doc will give the basic directions...
http://docs.oracle.com/cd/E28280_01/core.1111/e10108/adapters.htm#BABDJIGB
Cheers,
Vlad

Similar Messages

XI adapter polling issue & JDBC / DB2 driver connection timeout properties

Hello Group,
We have a long running issue with our XI 7.0 system running on iseries. (V5R3) The issue occuring is that our XI adapters stop polling and the only resolution is to restart the J2EE engine or to resart the adapter framework services.
We have had several OSS messages open on this subject for over a year and are going round in circles with the a number of different SAP consultants.
The one topic that we keep coming back to is that we are being asked to set DB2 driver connection timeout properties. We are using the toolbox driver and have upated to the latest JTopen driver, but have not managed to find any inofrmation on how to set the timeout parameter. Does anyone know where the timeout parameter set?
Has anyone experienced polling issue like this before and how did you resolve?
SAP referred to the SAP note 1078420 - XI/PI JDBC Adapter: Setting JDBC driver properties for DB which is for Oracle, but this will give an idea of what timeout parameters SAP are asking about.
Extract of the note is below:-
Symptom
This note gives an option to set JDBC driver properties while acquiring a DB connection. When connecting to DB using JDBC adapter there are instances
where DB connection take a long time to establish connection. Some times call made to Driver will hang permanently. Setting driver properties would resolve this problem.
More Terms
Connection timeout, time out, query timeout
Cause and Prerequisites
Solution
In the advanced mode table section of sender channel and receiver channel configurations, we can set driver properties for each DB connection. Any
such property would have to contain prefix 'driver:'(with out quotes) For example, for Oracle Database JDBC thin driver 10.2.0.3 version, the
property oracle.jdbc.ReadTimeout helps to set read timeout while reading from the socket. Also for setting login time out in Oracle, we use
oracle.net.CONNECT_TIMEOUT. To set these two properties use as follows:
driver:oracle.jdbc.ReadTimeout 1000
driver:oracle.net.CONNECT_TIMEOUT 1000
(The TimeOut Driver properties like ReadTimeout and CONNECT_TIMEOUT are in milliseconds)
Refer to your DB documentation/ JDBC driver documentation on this. Please note that properties can vary from each driver version. For instance, some
of properties of Oracle JDBC thin Driver 10.2.0.3 properties may not be present in older version drivers. Please contact DB vendor for the complete
list of driver properties. In addition to above, we also provide another parameter for query time out.
sqlquerytimeout (prefix 'driver:' is not required) is the parameter that is to be used for SQL query time out. This is case-sensitive and should be
configured as positive integer value in seconds(greater than 0).
Any help on this would be much appreciated.
With regards,
Steven

Hello,
I am not talking about the XI timeouts. But the timeouts which can be used to get the connection timeouts for DB2/AS400 databases.
So please provide that information.
THanks,
soorya

OSB DB Adapter Polling Issue

Hello Everybody,
Requirement
I am doing DB Adapter polling in OSB.I have a db adapter which polls order table whenever there is a record with status='N'.The OSB component is on single node of Weblogic Server.
1.The db adapter picks the order data with status='N' in the proxy service
2.It transforms to webservice xsd
3.Invokes a webservice.
4.The webservice returns acknowledgement number.
5.The order table should be updated with status 'Z' and attribute1=acknowledgement number
OSB Service Design
1.Proxy service calls business service to poll the order table
2.Converts the payload to the xsd format required by target
3.Invokes the webservice on target
4.Receives acknowledgement number
5.calls a plsql procedure which updates all the records within this batch with the acknowledgement number and status='Z'
My configurations in db adapter
Logical delete option in db adapter.
Unread Value :'N'
Read Value : 'A'
Polling frequency : 300 seconds
no of databse rows per XML document : 10
Database rows per transaction : 10
Issue
1.My process after getting the acknowledgement number it updates the status with Z and attribute1=acknowledgement number.At the of this transaction I am seeing that the status is being updated by
the adapter to 'A' based on read value.I want the read value only to be updated initially but as soon as my OSB process picks it for further processing it should not update again.How can i prevent
the status from getting updated to 'A'.
2.I have 40 records in order table.Per the database rows per transaction it should process 10 records at a time and for each batch of 10 i should get one acknowledgement number.Instead i see that
all the 40 records are updated with the same acknowledgement number.Kindly help as to how I can resolve this situation.
Thanks & Regards,
Radha

Hi Arik,
I tried setting the property(idempotent) in jca file of the polling adapter and it gave me below error.Kindly help
<adapter-config name="EBS_FETCHDATA" adapter="Database Adapter" wsdlLocation="EBS_FETCHDATA.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/DB/newebs" UIConnectionName="EBS" adapterRef=""/>
<endpoint-activation portType="EBS_FETCHDATA_ptt" operation="receive">
<activation-spec className="oracle.tip.adapter.db.DBActivationSpec">
<property name="DescriptorName" value="EBS_FETCHDATA.XxcmfOtmOrderHdrIfaceTmp"/>
<property name="QueryName" value="EBS_FETCHDATASelect"/>
<property name="MappingsMetaDataURL" value="EBS_FETCHDATA-or-mappings.xml"/>
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MarkReadColumn" value="OTM_INTERFACE_STATUS"/>
<property name="MarkReadValue" value="A"/>
<property name="MarkUnreadValue" value="N"/>
<property name="PollingInterval" value="60"/>
<property name="MaxRaiseSize" value="10"/>
<property name="MaxTransactionSize" value="300"/>
<property name="NumberOfThreads" value="1"/>
<property name="ReturnSingleResultSet" value="false"/>
<property name="idempotent" value="false"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
---------------------ERROR---------------
Invalid JCA transport endpoint configuration, exception: javax.resource.ResourceException: BINDING.JCA-12532 Cannot set JCA WSDL Property. Error while setting JCA WSDL Property. Property setIdempotent is not defined for oracle.tip.adapter.db.DBActivationSpec Please verify the spelling of the property.
Thanks,
Radha

Database Poller issues in Clustered env

Hi,
I am running Oracle BPEL 10.1.3.4 on top of Weblogic version 9.x in a clustered env. I created a simple database poller BPEL process (for target table in Oracle database) with below parameters:
Max Raise Size: 1
Max Transaction Size: 2
Polling Interval:30
Distributed Polling is enabled
All other BPEL engine and domain level parameters have default values.
In my clustered env two instances of database poller BPEL process are running on diff nodes. Now I populated my table with 1000 records in one go. According to parameters I expect:
- In each polling interval max 2 record will be processed by database poller BPEL process running on single node. And there will be 2 instances of this bpel process as max raise size is 1. Same I expect for database poller BPEL process running on another node. So overall 4 records should be processed in each polling interval and 4 instances of BPEL processes should be visible in BPEL console. But in actual its always 2.
Is I am missing something here? Won't the load balancer distributes records to BPEL processes on both nodes equally?
Also then I raise Max transaction size to higher value e.g. 20. But in this case after processing nearly 1/3 rd of records, the BPEL process stopped picking up any further records. Is there any known issue where Adapter stops picking any further database records if transaction size limit is higher?
thanks
Ankit
Edited by: AnkitAggarwal on 22-Feb-2010 03:36

Hi Ankit,
I have Oracle BPEL env11.1.1.2.0 clustered over 2 nodes.
I am facing a similar issue. In my scenario I have Bpel (with DB poller) and its deployed on the cluster. And I am connected to DB via Multi data source (MDS-1) with only one datasource (DS-1) configured in it.
So whenever I update the table which is being polled, in some cases I have TWO instances and in some cases I have ONE Instance running. My requirement is to have only one instance running every time the DB poller is initiatied.
Kindly help me out.
Thank You
Best Regards
Prasanth

Polling issue in File Adapter scenario

Hello Experts,
I have a scenario where in I am using a batch command to rename a file before processing it using "run operating system command before message processing". The command works fine and renames the file, but the issue is that it does not process the renamed file in the same polling interval.
In next polling interval the file is processed as expected.
Can you please let me know the reason why this might be happening?
Thanks.

Hi Ravi,
First the file is picked and then the pre-message processing OS command is executed and then the message is processed. Processing of the message is not dependent on whether the OS command gets executed successfully or not. Basically, PI issues the OS command and then processes the message.
So if you have renamed the file using OS command it should be picked up in the subsequent interval.
Hope it helps!
Cheers,
Anand

DB Adapter Polling Issues - causing DB Locks

Hi Experts,
I am working on project in SOA Suite 11.1.1.6 environment.
In my project I have used DB Polling which has following settings
<property name="DescriptorName" value="XXXXXXXXXXX"/>
<property name="QueryName" value="XXXXXXXXXXXXXXXXXXXXX"/>
<property name="MappingsMetaDataURL" value="XXXXXXXXXXXXXXXXXXXX.xml"/>
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MarkReadColumn" value="PROCESS_FLAG"/>
<property name="MarkReadValue" value="P"/>
<property name="MarkUnreadValue" value="Y"/>
<property name="PollingInterval" value="20"/>
<property name="MaxRaiseSize" value="1"/>
<property name="MaxTransactionSize" value="10"/>
<property name="NumberOfThreads" value="1"/>
<property name="ReturnSingleResultSet" value="false"/>
The problem is when I update 25 records, the last 5 records are not getting processed and its just stuck there. It just shows DB Adapter Instance in the Composite Instance and the record is locked.
I am using Multi DataSource configuration with 3 Load Balancing Database Instances on SOA Clustered Environment. I have DISTRIBUTED POLLED flag checked in the DB Poller Adapter
If I update records less than 20, the polling frequency then its working fine. If I update more than 20 then its causing issue of locks.
Thanks in Advance

Hi All,
Issue resolved by setting the <property name="NumberOfThreads" value="1"/> value to 10
Thanks

DB Polling Issue (last read date strategy)

I am using a DB polling adapter, using the Last read date strategy.
I have an issue when error is occured.. Here is the scenario..
Polling table name: bpel_poll
polling fields: table_name and last_read_date..
insert into bpel_poll values( 'TEST_TABLE', 4/21/08 10 AM )
Now the bpel picked up 100 records at 10:30 AM (after 30 mins). all the BPEL instances are errored out because of some issue in some activity.
At the end When the 100 instances errors out, the polling table is updated with the current date ie 4/21/08 10:30 AM.
There is no way to reprocess the 100 records that are failed becoz the last read date is changed and will never pickup previous 100 records.
I don't know if this is bug or expected behavior. I would assume the BPEL will keep the last read date as 10 AM instead of 10:30 AM as all instances failed..
Is there any way to achieve this? if not How can we reprocess the failed records?
please help..

I believe the point of the DBPolling is that once a record is successfully read then depending on the strategy that has been implements either a sequence or value in a table will be updated with a specfied value. Hence logically delete it so it is not picked up by another run of the process.
I.e if you ran the process and it took a long time before the DB was polled again then it would potentially re-process the same records twice.
Not sure if I fully understand the problem. When I have used a Polling strategy I tend to ensure I use a BPEL_STATE column to allow me to re-process records that have errored.

DB adapter polling issue-urgent

Hi ,
I am trying to poll for new or changed records from DB table using a DB adapter. I used a DB adapter with Poll for new or changed records in a table operation type and used a bpel process to write the changed records in a file adapter(using write file oeration). whenever i update a record or insert a new record it is not polling the chnaged record and instance is not getting created for the composite.
Pls find below the .jca file of my Db adapter,
<adapter-config name="pollDB" adapter="Database Adapter" wsdlLocation="pollDB.wsdl" xmlns="http://platform.integration.oracle/blocks/adapter/fw/metadata">
<connection-factory location="eis/DB/SOADemo" UIConnectionName="SOADemo" adapterRef=""/>
<endpoint-activation portType="pollDB_ptt" operation="receive">
<activation-spec className="oracle.tip.adapter.db.DBActivationSpec">
<property name="DescriptorName" value="pollDB.Studentdb"/>
<property name="QueryName" value="pollDBSelect"/>
<property name="MappingsMetaDataURL" value="pollDB-or-mappings.xml"/>
<property name="PollingStrategy" value="LogicalDeletePollingStrategy"/>
<property name="MarkReadColumn" value="DOB"/>
<property name="MarkReadValue" value="PROCESSED"/>
<property name="MarkReservedValue" value="LOCKED"/>
<property name="MarkUnreadValue" value="UNPROCESSED"/>
<property name="PollingInterval" value="5"/>
<property name="MaxRaiseSize" value="1"/>
<property name="MaxTransactionSize" value="10"/>
<property name="NumberOfThreads" value="1"/>
<property name="ReturnSingleResultSet" value="false"/>
</activation-spec>
</endpoint-activation>
</adapter-config>
can anyone pls help me in this issue?
thanks & regards,
Ayyadurai.M

Sometimes the messages get rejected if they are not compliant with schema even before coming to the SCA Infrastructure, the rejected messages for the database adapter will be stored in the following location....
Let's say if your composite name is TestDBPolling, and if the messages for that composite are rejected, they will be stored under the following location...
C:\Oracle\Middleware\home_11gPS2\user_projects\domains\domain1\rejmsgs\soa_server1\TestDBPolling
This is on my local machine...
Let me know whether that helped you...
Thanks,
N

Adobe Connect audio and polls issues

Hello Everyone,
When I'm using Adobe Connect I have these problems (always).
* Sound cuts in and out.
* (Not Responding) comes up for polls (or any time I'm interacting with the Group or Host).
I have a Compaq Laptop with Window 7/ Windows Explorer 9 / Adobe Flash Player 11.3
Please help this is urgent!
Thank you.

It sounds like a network issue. You say you have connected in different locations, did you connect in a location where others were not having the issue? Could your IT staff work with you to identify why you may be having connectivity issues?
If everyone was experiencing the problem, then I'd be inclined to say it was an issue with your Connect account, but being isolated to you, it seems like the problem may be local. Sometimes wireless routers get overwhelmed in busy environments, and may cause some individuals to see temporarily lost connectivity. Other times it may just be a wireless router going bad. If you are hard wired, then it may be router that is beginning to fail. Be sure that when you test other locations, you are connecting to different hardware.
Since you are running the add-in, I don't believe the browser should make any difference.

DB Adapter Polling Issue

Hi All,
I am working on a scenario something like this:
I am polling an Oracle table and when certain flag is 'Y', I am selecting the record(s) and calling an external service. Then depending on the response from the external service, again updating the the same table which I am polling.
As I have clustered environment, I am using distributed polling and polling strategy is logical delete. But it seems DB adapter is keeping some lock on the table for distributed polling, that's why I am not able to update the polled table.
Please provide me some solution how to overcome the iisue.
Thanks,
Maitrayee

Hi Ram,
DbAdapter is transactional and it should not delete failed records...
Ref docs here...
http://docs.oracle.com/cd/E28280_01/integration.1111/e10231/adptr_db.htm#BABCIICF
Cheers,
Vlad

WCF-Sql Addapter polling issue

Hi All,
I am getting the following error when receive location is started.
System.Data.SqlClient.SqlException (0x80131904): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding. --->
System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out at System.Data.SqlClient.SqlConnection.OnError(SqlException exception
I have set the open,close, receive time out to 10, But still I can see this issue.
Please let me know your suggestions.
Thanks in Advance.

As the error says, SQL is not responding within the configured time or your query takes longer time to complete.
You can do the following:
Increase the timeout and see whether longer time to execute the query and waiting for the response helps.
Get the actual query being constructed/executed against SQL Server and try to execute this query in Query Analyser to see what happens.
Try to disable MSDTC in
Send Port by setting UseAmbientConnection to "false" and use "transaction
= false". See this helps.
Check any locking related issue is blocking your query.
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful.

Polling issues

Hi All,
Is there any limitation of specifying the query type in polling process?
Suppose I have two tables RESOURCESID, resourceId, modified_date, polling_flag and USERSID, userId, user_info. No relationship is defined between tables in database.
.And I want query something like this...
SELECT R.ID, R.modified_date, U.user_info from RESOURCES R, USERS U WHERE R.resourceId=U.userId and R.ID in http://.... some other query having groupby clause
Can I do that? If yes then how and if no then what is the alternate for this.
Thanks.

I want to create a query like the below type
SELECT opportunity_id, OPP_LAST_MODIFIED_DT FROM sf_opportunity_INTF A
WHERE OPP_LAST_MODIFIED_DT > (sysdate-1) and isprocessed ='N'
and OPP_LAST_MODIFIED_DT = (SELECT max(OPP_LAST_MODIFIED_DT) FROM sf_opportunity_INTF B
WHERE B.opportunity_id = A.opportunity_id and B.isprocessed = A.isprocessed)
This query may be incorrect. But I want something like this.

MSSQL Polling Issue with SAO 10.1.3.5

Hi All,
We have an BPEL Process which is polling MSSQL table and it was working fine and suddenly it stopped working and when we saw the domain logs we got error as
ORABPEL-11624
DBActivationSpec Polling Exception.
Query name: [GetEmailData], Descriptor name: [GetEmailData.XfrSetEmployeeEmailAddress]. Polling the database for events failed on this iteration.
If the cause is something like a database being down successful polling will resume once conditions change. Caused by ORABPEL-00000
JTS transaction was marked rollback only.
and after inserting the mcf properties we got the below error
<AdapterFramework::Inbound> Delivery Thread 'JCA-work-instance:Database Adapter-14 performing unsynchronized post() to localhost
Can anyone please help me out in this.
Thanks,
Nagaraju D

Im having the same problem. There is any solution or patch?? Please help!

WLS 92MP1: Application Poller issue Too many open files

Hi,
We have a wls92mp1 domain on linux AS4(64bit) with Sun jdk 1.5.0_14. It contains only Admin server where we have deployed the application. Over a period of time the server start showing up below message in the logs. We have not deployed the application from autodeploy directory. And the file "/home/userid/wls92/etg/servers/userid_a/cache/.app_poller_lastrun " is available in the location, still it throws FileNotFoundException.
<Error> <Application Poller> <BEA-149411> <I/O exception encountered java.io.FileNotFoundException: /home/userid/wls92/etg/servers/userid_a/cache/.a
pp_poller_lastrun (Too many open files).
java.io.FileNotFoundException: /home/userid/wls92/etg/servers/userid_a/cache/.app_poller_lastrun (Too many open files)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at java.io.FileWriter.<init>(FileWriter.java:73)
at weblogic.management.deploy.GenericAppPoller.setLastRunFileMap(GenericAppPoller.java:423)
Any help regarding this would be highly appreciated.
Thanks.

Hi,
By above seeing in error, this error code (BEA-149411) describe the following
149411: I/O exception encountered {0}.
L10n Package: weblogic.management.deploy.internal
I18n Package: weblogic.management.deploy.internal
Subsystem: Application Poller
Severity: Error
Stack Trace: true
Message Detail: An I/O exception denotes a failure to perform a read/write operation on the application files.
Cause: An I/O exception can occur during file read/write while deploying an application.
Action: Take corrective action based on the exception message details.
i think it helps u.
-abhi

BPEL FTP poller issue

Hi All,
BPEL 10.1.3.4 - 2 Nodes
I have a BPEL FTP poller which polls and initiates new process.
Since we have two nodes, its creating two instances very time we drop the file.
How do I prevent the duplication or make the poller work in only one node?
Thanks,
Ravi

Hi Ravi,
You have to make adapter singleton to prevent this race condition.
Have a look at this link
http://soa-bpel-esb.blogspot.com/2010/01/how-to-set-up-singleton-adapter-in.html

DB Adpter polling issues

Similar Messages

Maybe you are looking for