Advanced Queuing between 2 databases

Hi,
We want to use Oracle Advance Queuing to send a message from a source Database (transactional) to a Reporting database
On a particular event on a record in the source database, we want to enqueue the record's code on a Queue in the target database, where the dequeuing will happen and some processing will take place for each code retrieved.
Do we need to set up the Advanced Queuing software on both DBs?
- Can we just have 1 queue on the target DB and get the source Database to enqueue records to it? How will the source DB will be given access to the queue?
- Or do I really need to have a queue on each Database and use propagation?
Thanks in advance for your help.
Rgds

Tony,
thanks very much for your precious advice.
I like your suggestion of having one queue, it keeps the infrastruture simple.
Have I got the option of having this single queue either at the source or the target DB?
Maybe let me summarise more precisely what I am trying to achieve: we want to copy a complex data structure on the Source DB to a simplified/flatter data structure on the reporting DB.
An event on a row on the main table on the source DB triggers the copy.
We are thinking of enqueing of the record's id to the queue (So app on the source DB will have to enqueue)
and when dequeuing each message , a stored procedure will read the data structure for this record id and child tables and insert the relevant data to the report data structure on the target DB.
So with one queue, it seems that there are 3 options, not sure which is best. The idea is to have minimum impact on the source DB
1. Queue at the target DB. Source DB enqueues message remotely (is this possible? can't find any documentation about this?). Message is dequeued at the target and the proc (at target) reads from the source with DB link and writes the new data to the target
2. Queue at the source DB. Source DB enqueues message locally, an application on the target DB dequeues the message and the procedure (at target) reads from the source with DB link and writes the new data to the target DB.
3.Queue at the source DB. Source DB enqueues message locally, an application on the source DB dequeues the message and the procedure (at source) reads data from the source and writes the new data to the target using a DB link
3. seems having the most impact on performance of the source db?
In all case I don't think I can avoid a DB link in the sored proc (one way or the other) as the data structures are a too complex to be passed through the queue....
What do you think?
Thanks
Philippe

Similar Messages

Can you use streams replication to replicate an advanced queue?

We need to be able to support failover of an Advanced Queue between a primary database instance and one or more alternate instances. To insure consitancy across the multiple-database instances, every enqueued and dequeued message must be replicated in the event of a failure on the primary node. TAF is used to automatically failover the App to an alternate database instance. Without getting into the details, Data Guard/Standby/RAC are NOT options.
Questions:
Is replication of an Advanced Queue supported via Streams Replication?
Are there guidlines/recommendations on how this should be done/setup?

No. AQ is not supported by Oracle Streams. User defined and Sys.AnyData are not supported types.
You can create AQ propagation process from source to backup site. But you will need to dequeue both sites simultaniously.
Or you can create schadow table (

Propagation between queues in Oracle Advanced Queuing

We would like to connect two queues that reside in different database schemas/instances.
We try to use the propagation feature of Oracle to achieve this.
The queue-type is the same for both queues.
Enqueuing is done with a recipient list in order to set multiple local subscribers for the messages that are put onto the queue.
We would like to propagate between queues without changing the applications that write to originating queue and the other applications that read from the target queue.
During our research we only found ways where we need to change the application that writes onto the queue, which is not acceptable for us. Also the list of subscribers needs to be different based on the message.
Therefore I have the following question:
- is there a way to set up propagation between queues in a way where we don't need to modify the sending application?
- if not, is there a different way to connect two queues via a subscriber/consumer?

Oracle8i for Linux does have AQ, although I haven't evaluated it
yet. If you're still having trouble with the install, make sure
you get the patch. A quicker and easier way to get Oracle8i up
cheaply for evaluation is to download the NT version. I'm
evaluating Oracle8i for both Linux and NT and the NT version is
more stable.
I would really appreciate hearing about your experiences with AQ
on Oracle8 (8.0.4.3). I have several projects that we have been
considering using AQ with. Please send me an email and tell me
what problems / work-arounds you found.
Christian Schroeder (guest) wrote:
: Hello,
: I still haven't managed to install 8i completely
: (files with zero-length, wrong permissions, wrong JVM, ...),
: anyway... -))
: We are using Oracle Advanced Queuing under 8.0.4.3 on AIX in
: a project at my company and I wondered if AQ is in 8i for
Linux?
: I really would like to evaluate it at home, since the AIX
: AQ version has some bugs and restrictions which I really need
to
: get around.
: My idea is to get 8i for AIX, but I wouldn't buy it if the
: queuing is still unstable.
: The 8.0.4 documentation states that one will get AQ in the
: Enterprise Edition with message-type 'RAW' and the Objects
Option
: will add full functionality if also purchased. I didn't find
: any comments on AQ in the installation guide.
: Regards,
: Christian
null

Can you setup Advanced queueing between 2 databases using SQL*net connection

Hi experts,
Is it possible to setup AD between 2 databases without using DBlink? I know we can use Java program to do that. Unfortunately, I have no experience in Java.
Our version databases is 10g
Thanks in advance
Hieu

Following are the different options available.
Interfaces to Advanced Queuing
You can access Advanced Queuing functionality through the following interfaces:
PL/SQL using DBMS_AQ, DBMS_AQADM,andDBMS_AQELM. Refer to the Oracle9i Supplied PL/SQL Packages and Types Reference.
Visual Basic using Oracle Objects for OLE. Refer to the Online Help for Oracle Objects for OLE.
Java using the oracle.AQ Java package. Refer to the Oracle9i Supplied Java Packages Reference.
Java Message Service (JMS) using the oracle.jms Java package. Refer to the Oracle9i Supplied Java Packages Reference.
Internet access using HTTP, HTTPS, and SMTP
For java references you can refer to below URL
http://docs.oracle.com/cd/B10500_01/appdev.920/a96609/arj_aq.htm#1005399
I believe no one will provide you fully written code here. You can get help from this forum,

Weblogic JMS bridge between Weblogic and oracle Advanced Queue

Hi,
We are facing some issues when we are trying to integrate with Oracle AQ JMS through Weblogic.
We have configured a Foreign AQ server which points to the oracle Advanced Queue and we are trying to create a Weblogic JMS bridge between AQ and weblogic. The bridge works perfectly if create the connection factories and bridge destinations with NonTX mode. The issue is with XA mode. Also we have deployed the Resource adaper for XAResource to use XA transactions.
No help is available for the exception on google too :)
Following is the exception we are getting.
<An error occurred in bridge "aqjmsbridge" during the transfer of messages (javax.resource.ResourceException: Failed to setup the Resource Adapter Connection for enlistment in the transaction, Pool = 'eis/jms/WLSConnectionFactoryJNDIXA', javax.transaction.SystemException: start() failed on resource 'eis/jms/WLSConnectionFactoryJNDIXA': XA_OK
javax.transaction.xa.XAException: method start should not be called on weblogic.transaction.internal.IgnoreXAResource
at weblogic.jms.foreign.IgnoreXAResourceImpl.start(ForeignAQIntegration.java:260)
at weblogic.connector.security.layer.AdapterLayer.start(AdapterLayer.java:513)
at weblogic.connector.transaction.outbound.XAWrapper.start(XAWrapper.java:466)
at weblogic.transaction.internal.XAServerResourceInfo.start(XAServerResourceInfo.java:1184)
at weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerResourceInfo.java:1117)
at weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerResourceInfo.java:275)
at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:516)
at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:443)
at weblogic.connector.transaction.outbound.XATxConnectionHandler.enListResource(XATxConnectionHandler.java:118)
at weblogic.connector.outbound.ConnectionWrapper.invoke(ConnectionWrapper.java:218)
at $Proxy59.receive(Unknown Source)
at weblogic.jms.bridge.internal.MessagingBridge.processMessages(MessagingBridge.java:1427)
at weblogic.jms.bridge.internal.MessagingBridge.beginForwarding(MessagingBridge.java:1002)
at weblogic.jms.bridge.internal.MessagingBridge.run(MessagingBridge.java:1079)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
.).>
Will appriciate any help for the above.
Thanks and Regards,
Navin

Maybe this if of any help:
- Re: Help with creating AQ JMS
or
- Re: AQ Weblogic integration - JMS-107: Operation not allowed on Connection

Queries on Advanced Queuing in Oracle Database

Hi All,
We are new to Advanced Queuing.
We have a requirement wherein we need to implement Oracle AQ.
However upon some R&D, we got the basic idea of AQ.
But we would like to know on a broad level,
i.     The Purpose of enabling/Using AQ
ii.     Basic understanding on the different components of AQ like Creating Payload, Enqueue, Dequeue messages
iii.     Some high level understanding of the API’s – Which to use when and the purpose
iv.     Challenges faced
v.     Possible issues and Resolutions.
If anyone can help us with the above questions, it would be of great help.
Regards,
Shruti

Michael Ferrante (Oracle) wrote:
Enable at least level 2 tracing in the console. You should see an exchange occur every 2 seconds (2000ms). If you do not see this then your MAX_WAIT is not being read. To enable trace level 2, open the console and left click in the text area of it. Then press the number 2 on the keyboard just above the letters Q and W. Do not use the number pad, as this will not work.If enable Level 2 in JavaConsole, nothing is written there. However, when the level 3, then every 2 seconds is displayed in the console this line:
network: Connecting http://localhost:7001/forms/lservlet;jsessionid=LvhyQ0QNg5KkJ17vnch3pQSMT6Z00B16yVr7m64npFKTKp1pBBjv!656070063 with proxy=DIRECTI changed the file formsfeb.cfg, set MaxEventWait = 5000. All restart, And a similar message is displayed every 5 seconds in the console.
network: Connecting http://localhost:7001/forms/lservlet;jsessionid=r31zQ0TLpHxK3kjBqMBk0tvYf9hn6wn6sGpKRppTvSX1f70pv0GS!571608984 with proxy=DIRECT
network: Connecting http://localhost:7001/ with proxy=DIRECT

Oracle Advanced Queuing - Propagation problem - 11g

Hi,
I have a problem when propagation messages between queues. When the message is propagated, it stays on the source queue with READY state.
I have created two queues on 11g with a propagation rule that any message from queue A are sent to queue B. My problem is that the message from the source queue stays in the source queue even after propagation, which isn't what I was expecting. The problem doesn't occur if the queues are on a different database. This problem only happens if the queues are on the same database.
the script I use is this:
For USERB (which has the destination queue)
create type EVENT_MESSAGE as object (
eventsource VARCHAR2(30),
eventname VARCHAR2(255),
eventid NUMBER(19,0),
message CLOB
DECLARE
an_agent sys.aq$_agent;
BEGIN
-- create the publish/subscribe queue table
dbms_aqadm.create_queue_table(
queue_table => 'DESTINATION_QUEUE_TABLE',
queue_payload_type=>'EVENT_MESSAGE',
sort_list => 'ENQ_TIME',
message_grouping => DBMS_AQADM.NONE,
multiple_consumers=>true
-- create the queue
dbms_aqadm.create_queue(
queue_name => 'DESTINATION',
queue_table => 'DESTINATION_QUEUE_TABLE',
queue_type => DBMS_AQADM.NORMAL_QUEUE,
max_retries => 5
dbms_aqadm.create_aq_agent(agent_name =>'DEQUEUE_AGENT');
an_agent := sys.aq$_agent('DEQUEUE_AGENT', null, null);
dbms_aqadm.enable_db_access(
agent_name => 'DEQUEUE_AGENT',
db_username => 'USERB'
dbms_aqadm.add_subscriber(
queue_name => 'DESTINATION',
subscriber => an_agent,
queue_to_queue => FALSE,
delivery_mode => DBMS_AQADM.PERSISTENT
-- start the queues
dbms_aqadm.start_queue('DESTINATION');
END;
For USERA
create type EVENT_MESSAGE as object (
eventsource VARCHAR2(30),
eventname VARCHAR2(255),
eventid NUMBER(19,0),
message CLOB
BEGIN
-- create the publish/subscribe queue table
dbms_aqadm.create_queue_table(
queue_table => 'SOURCE_QUEUE_TABLE',
queue_payload_type=>'EVENT_MESSAGE',
sort_list => 'ENQ_TIME',
message_grouping => DBMS_AQADM.NONE,
multiple_consumers=>true
-- create the queue
dbms_aqadm.create_queue(
queue_name => 'SOURCE',
queue_table => 'SOURCE_QUEUE_TABLE',
queue_type => DBMS_AQADM.NORMAL_QUEUE,
max_retries => 5
-- start the queues
dbms_aqadm.start_queue('SOURCE');
-- create the propagation
dbms_aqadm.add_subscriber(queue_name => 'SOURCE',
subscriber => sys.aq$_agent('DEQUEUE_AGENT','USERB.DESTINATION',null),
queue_to_queue => true);
dbms_aqadm.schedule_propagation(queue_name => 'SOURCE',
start_time => sysdate,
latency => 25,
destination_queue => 'USERB.DESTINATION');
END;
When I enqueue a message to the source on USERA with this:
declare
rc binary_integer;
nq_opt dbms_aq.enqueue_options_t;
nq_pro dbms_aq.message_properties_t;
datas EVENT_MESSAGE;
msgid raw(16);
begin
nq_pro.expiration := dbms_aq.never;
nq_pro.sender_id := sys.aq$_agent('ENQUEUE_AGENT', null, null);
datas := AGEAS_EVENT_MESSAGE('message','eventname',1,null);
dbms_aq.enqueue('SOURCE',nq_opt,nq_pro,datas,msgid);
end;
The message is propagated to the destination queue, no problem, but the message state on the source queue is kept as ready. I would have expected it to be marked as processed and disappear from the queue table.
When I look at the AQ$_SOURCE_QUEUE_TABLE_S the I see these records:
     QUEUE_NAME     NAME     ADDRESS     PROTOCOL      SUBSCRIBER TYPE
     SOURCE     (null)     "USERB"."DESTINATION"@AQ$_LOCAL     0     1736
     SOURCE     DEQUEUE_AGENT     "USERB"."DESTINATION"     0     577
Can anyone help?

I was talking about following oracle documentations:
Oracle Database 11g: Advanced Queuing (Technical Whitepaper)
Streams Advanced Queuing: Best Practices (Technical Whitepaper)
Oracle Streams Advanced Queuing and Real Application Clusters: Scalability and Performance Guidelines (Technical Whitepaper)
They are available at.. http://www.oracle.com/technetwork/database/features/data-integration/default-159085.html

Advanced Queues Snapshot too old error

I am using the advanced queues to submit work for parallel processes running through the Oracle Job Queue.
I have attempted running anywhere from 1 to 5 simultaneous processes (in addition the the process which submits them to the Oracle job queue and populates the advanced queues) and I am getting sporadic Snapshot too old errors when the other processes are attempting to dequeue. The Advanced queues are populated before the other processes are submitted to the job queue, so I don't see that there could be conflicts between one process enqueuing while another is dequeuing.
The reason I am attempting this is to try and gain some performance by running processes in parallel.
Has anyone else had problems like this? Is this a bug in Oracle 8.1.6? Is there a parameter setting I need to adjust? Are there any suggestions for getting around this problem?

I don't know what version of the database you are running? I'm only using 8.1.7.4. But where I come from, you add datafiles to the tablespace, not the rollback segment.
alter tablespace rollback
add datafile '<blah, blah>'
size 147m
autoextend on next 100m maxsize 2047m;
Make sure that you have a suitable number of rollback segments that are well-sized extents. But mostly, listen the Tom Best, and try and introduce some best practices (no pun intended) to reduce the likelihood of this situation arising.

JMS Interface to Advanced Queuing

I want to use the Advanced Queuing features from Java. The rub: I am doing a queue-to-queue message transfer between JMS servers (Swift & Oracle).
What would help me get the the next step is this: I am looking at the SampleUtilities.java file included with the Java Message Service sample programs available at http://java.sun.com/products/jms/docs.html
In this class, there is a method called getQueueConnectionFactory() that returns a QueueConnectionFactory object. I need to add provider-specific code in this method.
Any ideas what the provider-specific code should be? If there is anybody who as made the standard set of sample programs work, perhaps you could post your changes to SampleUtilities.java?
Thanks in advance.
-best-darr-

It's important to note the difference between "Oracle9i" and "Oracle9iAS". Much of the AQ documentation is in the Oracle9i documentation set, not the Oracle9iAS set. That is, it's documented in the database documentation, not the application server documentation.
There is certainly some in the AS documentation, but I had to see the database documentation to get some details.

Advanced queuing ...regarding

Hi...
I have to work on project which deals with advanced queuing...
I gone through the docs ...but i couldn't understand fully...can anyone help in this aspect my questions are
what i have to configure in my system?(software)
how i have to move?
please help me with an example..
thanxs in advance.

Oracle AQ is used as a means of asynchronous communication between two (or more) Oracle databases.
Instead of communicating directly to the remote DB within your online application, you post a message into a local AQ queue (which would already have been setup for queue propagation) and Oracle takes care of making sure that it is made available at the destination (remote) AQ queue (it handles remote server not available and other transient errors automatically).
Once the message appears at the remote queue, it could be read and appropriate action performed (as indicated by message contents).

Transfer whole schema between databases

Hi,
I have a question on how to move an entire schema between two databases which are of the same version and patchset.
I identified the possible methods as follows:
1) Using exp/imp or expdp/impdp, but that's quite slow on larger schemas and the transported data might not be physically the same as on the source database (indexes are rebuilt, tables get loaded with data again....).
2) Using transportable tablespaces. This is fast, the physical data layout is the same as on the source database, but unfortunately only the objects in the transported tablespace get transferred. Schema objects like PL/SQL packages, private synonyms, functions.... and grants aren't transferred since they are stored in the SYSTEM tablespace.
Is there any other way to move a schema between databases? Maybe some combination of expdp/impdp (transfer of user object definitions stored in the SYSTEM tablespace like PL/SQL code, view definitions, etc.) and transportable tablespaces (transfer data segments like tables, indexes....)
From what I know RMAN can't do that since the smallest "logical object" it can restore/recover is the whole tablespace with tablespace point in time recovery.
Thanks in advance for any answer.
Regards,
Jure

user633661 wrote:
Hi,
I have a question on how to move an entire schema between two databases which are of the same version and patchset.
I identified the possible methods as follows:
1) Using exp/imp or expdp/impdp, but that's quite slow on larger schemas and the transported data might not be physically the same as on the source database (indexes are rebuilt, tables get loaded with data again....).
2) Using transportable tablespaces. This is fast, the physical data layout is the same as on the source database, but unfortunately only the objects in the transported tablespace get transferred. Schema objects like PL/SQL packages, private synonyms, functions.... and grants aren't transferred since they are stored in the SYSTEM tablespace.
Is there any other way to move a schema between databases? Maybe some combination of expdp/impdp (transfer of user object definitions stored in the SYSTEM tablespace like PL/SQL code, view definitions, etc.) and transportable tablespaces (transfer data segments like tables, indexes....)
From what I know RMAN can't do that since the smallest "logical object" it can restore/recover is the whole tablespace with tablespace point in time recovery.
Thanks in advance for any answer.
Regards,
JureIf you have only one business schema, then you may go with duplication of database.
Otherwise, you can go with Schema Based Replication with Streams or as you said combination of expdp/impdp and transport.

Request for Comments and Experiences with Streams Advanced Queuing

Hi,
I would like to get some feedback about what your experiences with Streams Advanced Queuing. What do you like about it? What don't you like? How do you use it? What features would you love to see in it? Please post to the forums. Thanks!

I love the new homeless Instant Client! I wish we had it years ago. Some comments:
1) The MS ODBC administrator GPF's (blows up) when trying to configure a new data source using the new Oracle IC drivers. Have to hand-edit the registry.
2) I heartily agree with the request that the new client install without requiring the normal Oracle installer. It's just too bloated for easy deployment. I'd rather hand install the files than to have to use that. Also, .zip not .jar please.
3) Need better documentation on the connection string options. It took me 3 weeks to figure out that what used to be scott/tiger@mydb is now scott/[email protected]:1524/mydb.xxx.yyy (it's looking for the GLOBAL_NAME, not the SID and TNSPING won't show you that! Doh!)
4) Please let us specify a range of ports (e.g. :1521-1524) and let it figure out where the SID is on that machine. We move ours around and don't want to update hundreds of clients with hardcoded command lines.
5) Maximum backward compatibility, please! It's not easy moving all those Oracle apps to 8.1.7.4+ databases, yet, but my old OCI client programs should not have to care. I don't want to have 2 SQL*net driver stacks on my PC's.
Thanks -- I'll be watching for new features.

Advanced queue in Oracle9i Standard Edition One

Hi,
Is advanced queuing available in the Standard Edition One for 9i?
Thanks,
Gloria

Hi!
i think, that the SE One is only an edition for 10g. in 10g and 9i advanced queuing is included in every available edition. Please refer to:
http://www.oracle.com/technology/products/database/oracle10g/pdf/twp_general_10gdb_product_family_0104.pdf
and
http://www.oracle.com/technology/products/oracle9i/pdf/9idb_rel2_prod_fam.pdf
hope tat helps
AndrÃ©

Dequeue from Advanced Queue

Hi All,
I have used the DBMS_AQ package provided dequeue functionality for dequeuing msgs from my advanced queue. Now there is a job which dequeue the items from this queue and sends out email. Now what is happening is the job picks up an item from the advanced queue for dequeuing and sends out email, but the item which is picked up still remains in the queue and is not dequeued. As the job runs every minute and polls the queue, it again picks up the same queue item and sends the email. This process repeats for 5-6 times and then the queue message expires. My requirement is that, the job should dequeue the item from the queue and just send email once. Please can anyone suggest what could be the solution to this problem?

10g is not a version number it is a marketing label that applies equally to 10.1.0.2 and 10.2.0.4 and a lot of versions in between.
That said I know this demo I wrote works in all versions of 10.2:
http://www.psoug.org/reference/aq_demo1.html
Compare it to what you are doing.

Advanced Queue - Timezone Configuration

Dear Reader
If I create an advanced queue with the command "dbms_aqadm.create_queue_table", an entry in the table "system.aq$_queue_tables" results.
However, what is not clear to me is why the TIMEZONE column of this table is populated with 00:00, since this value neither correspond to the "dbtimezone" nor to the "sessiontimezone"?
"select dbtimezone, sessiontimezone from dual" returns
+02:00, CET
Thanks and regards,
Ulrik
P.S.
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit
Edited by: user10371214 on 16.11.2010 02:32

not that i know of. all server upgrades are pushed into the "Advanced" configuration. The only way to get a "Standard" configuration is to erase & install...

Advanced Queuing between 2 databases

Similar Messages

Maybe you are looking for