GoldenGate : Why to read all the Redo or Archive, can't we skip ??

Hi All,
I have a big doubt if anyone can give clarity. The scenario is :- In my environment data is flowing from Oracle to Oracle but Huge transactions in Millions and we use this tool basically to improve LAG when we get data for reporting.
Now let's say I have database user A which is doing some temporary transaction on source for couple of hours but it is HUGE and generating lot of archives AND we don't want to flow any data from the transaction being performed by user A - so we use EXCLUDEUSER A parameter.
Now during same time if any other user say B is performing some operation in one table - we want it to flow, So it is flowing normally BUT the main problem is LAG increased like anything cause GoldenGate is now reading all the redo or archives which of no use and data is flowing very slowly :( :(
My point was will it be also possible that I don't want my GoldenGate to read any redo log or archives if the user A is performing operation and read only those archives if user B or any other user is performing some operation. This will improve the LAG cause even though we ignore the particular user, It is still going to read all the redo or huge archives generated by user A or user B or whatever in sequence, Please correct me if I am wrong ?
I suppose goldengate is going to read all the transaction regardless of A or B user. Only it will ignore the A and process transaction of B.
I know it reads in sequence but can't it read specific archives which is useful instead of reading all.

Hi Steven,
Thanks for your reply.
I agree with you that "normal" mode of GoldenGate is to capture changes and replicate them and Ofcourse I want it to capture any changes but I don't want it to pass through reading all the archives if I am ignoring one user who is performing HUGE temporary transaction and generating huge archives.
It is going to slow down all the other small transaction changes cause it is passing through all those archives also which is of NO use. Do you mean that "Integrated mode" of new Goldengate version will work in that case ?
Please help, I really need this information. It will help everyone.

Similar Messages

Why doesn't iMessage show when the message is read, all the time?

Why doesn't iMessage show when the message is read, all the time?

It depends on the recipients settings, whether they have read receipts set to on or off. If they have it off, you will not be notified of the actual time they read your message.

Where all the redo/archive log volume come from?

Hi,
I have a database with a size of around 50G. Thats not very much, but the crazy thing is that this database has a redo log volume per day that is nearly equal the size of the database:
-- Daily View
SQL> SELECT TRUNC(completion_time) AS time, ROUND(SUM(blocks * block_size)/1024/1024,2) AS size_mb, ROUND(SUM(blocks * block_size)/1024/1024/1024,2) AS size_gb FROM v$archived_log GROUP BY TRUNC(completion_time) ORDER BY 1 DESC;
TIME          SIZE_MB    SIZE_GB
2013-02-03    49599.7      48.44
2013-02-02   50104.63      48.93
2013-02-01   54466.36      53.19
2013-01-31   52935.41      51.69
2013-01-30   51596.85      50.39
-- Hourly View
SQL> SELECT TRUNC(completion_time,'HH24') AS time, ROUND(SUM(blocks * block_size)/1024/1024,2) AS size_mb, ROUND(SUM(blocks * block_size)/1024/1024/1024,2) AS size_gb FROM v$archived_log GROUP BY TRUNC(completion_time,'HH24') ORDER BY 1 DESC;
TIME          SIZE_MB    SIZE_GB
2013-02-03 23     160.68        .16
2013-02-03 22     163.73        .16
2013-02-03 21     195.65        .19
2013-02-03 20    4492.44       4.39
2013-02-03 19      176.3        .17
2013-02-03 18     4259.8       4.16
2013-02-03 17     226.99        .22
2013-02-03 16    5465.64       5.34
2013-02-03 15     166.47        .16
2013-02-03 14     165.05        .16
2013-02-03 13     253.33        .25
2013-02-03 12    9568.93       9.34
2013-02-03 11     391.14        .38
2013-02-03 10    9585.36       9.36
2013-02-03 09     160.02        .16
2013-02-03 08      200.1         .2
2013-02-03 07     166.66        .16
2013-02-03 06     267.45        .26
2013-02-03 05     309.26         .3
2013-02-03 04    1486.87       1.45
2013-02-03 03   11106.77      10.85
2013-02-03 02      318.1        .31
2013-02-03 01     147.47        .14
2013-02-03 00     165.47        .16
2013-02-02 23     160.17        .16
2013-02-02 22     159.25        .16
2013-02-02 21      205.9         .2
2013-02-02 20    4473.27       4.37
2013-02-02 19     124.64        .12
2013-02-02 18    4364.69       4.26
2013-02-02 17     295.02        .29
2013-02-02 16    5415.06       5.29
2013-02-02 15     166.22        .16
2013-02-02 14     166.83        .16
2013-02-02 13      84.62        .08
2013-02-02 12    9905.55       9.67
2013-02-02 11     418.31        .41
2013-02-02 10    9548.78       9.32
2013-02-02 09     166.51        .16
2013-02-02 08     204.88         .2
2013-02-02 07     167.37        .16I know that every database change produces redo, but why that much?
Is there a way to investigate further where all the redo information comes from?
Every 2 hours redo is backed up to tape.
There are no significant batches, shaking and shuffling the data around all the time.
Nearly all changes in this database is happening through user inputs.
Database is 11gR2 on Redhat 5.6.
Thanks
941743
Edited by: 941743 on 04.02.2013 15:32
Edited by: 941743 on 04.02.2013 15:33

I am afraid there is no easy and direct way to pull the answer from the data dictionary.
But with some work, you can get to the bottom of this.
This query shows you how much redo is used by the sessions in your system currently:
select a.sid , a.value from v$sesstat a, v$statname b
where a.statistic# = b.statistic#
and b.name = 'redo size'Unfortunately, I am not aware of a AWR view (license required!) that corresponds to v$sesstat, so it would not be easy to look back and see which session generated the redo.
One way is to troubleshoot the problem online, using a utility such as snapper- http://blog.tanelpoder.com/2010/03/22/oracle-session-snapper-v3-10/ . See which sessions generate most redo and see what SQL they are running at that time.
The other way is to create your own “repository”. Sample V$SESSION, v$sesstat , v$statname and possibly V$SQL frequently (every few seconds) and record how much redo and what SQLs are running by each session. Once you gather enough data, look which sessions had the biggest “redo size” delta and what SQL were they running at that time.
Iordan Iotzov
http://iiotzov.wordpress.com/

I have Elements 11. Sometimes, if I edit a photo in Elements Editor, the date gets changed to the current date. Why does that happen? It doesn't happen all the time, so I can't isolate the cause. Any ideas?

I have Elements 11. Sometimes, if I edit a photo in Elements Editor, the date gets changed to the current date. Why does that happen? It doesn't happen all the time, so I can't isolate the cause. Any ideas?

I have Elements 11. Sometimes, if I edit a photo in Elements Editor, the date gets changed to the current date. Why does that happen? It doesn't happen all the time, so I can't isolate the cause. Any ideas?

Not able to Read All the Message in the Topic

Hi Al,
i am new to JMS. I have implemented publish-subscribe model. Topic as a destination.
I want to read all the message available for particular topic. is there any way to get this?..
like in the Queue, QueueBorrower used to read all available messages in the queue.
Thanks
Raj

It depends on what you mean by "what messages are available on the topic".
if you want to know what messages would be delivered to a new consumer on the topic, then you can simply create a consumer yourself. Each messages on a topic is delivered to all subscribers, so by creating a consumer yourself you won't be interfering with the delivery of messages to other consumers. (That's not possible with queues which is why the queue browser is provided).
If you want to know what messages are "persisted in the topic" then there's not really such a concept. Messages sent to a topic are only persisted in individual durable subscriptions created for individual clients. If there are no durable subscriptions when messages are not persisted. The JMS APi doesn't provide a way to browse the messages saved in an individual durable subscription. It could, but it doesn't.
Nigel

Reading all the files from Application Server in a specific folder

Hi,
I want to read all the files present in a folder on Application Server ( AL11 ). My problem is that I do not know the name of the file but I know the folder path where files are present.
I need to go to this folder and pick up all the files present in this folder and then process these files in my program.
Can any one help me in this!
Regards,
Lalit

You can use a call to
C_DIR_READ_START'
and
CALL 'C_DIR_READ_NEXT'
Regards,
John.

I just got my new iPhone4 set up today and it has pulled in every email that is in my desk top as being unread. Yet I have read all the emails. Still the iPhone thinks they are unread. Does anyone know how I can delete all of these at one time?

I just got my new iPhone4 set up today and it has pulled in every email that is in my desk top as being unread. Yet I have read all the emails. Still the iPhone thinks they are unread. Does anyone know how I can delete all of these emails at one time from the phone?

I have taken it back to the Apple store genius bar, but they say they don't see anything wrong. Well unless you use it all day and experience the problems when they happen, you wont see anything wrong. But there are lots wrong with it. But this would be the same store as I purchased the phone. And they backed up my old Iphone 4, but were not able to get anything to load back onto my new phone. So, I lost pretty much everything. But over time, some of my contacts have started showing up, although i am still missing over 800 of them.

I have read all the questions regarding the "Can't send photo using iMessage".

I have read all the questions regarding the "Can't send photo using iMessage". I followed everything and check everything that was in it. It's still the same. I am still not able to send a photo. It started happening last week. It was fine before that. There is no error message.
It will try to send but it will get stuck just before it sends
and the red ! will appear with the "Not Delivered" status.
When i tap on the !, it just says "This iMessage was not delived".
No other message or photo is sending as the same time as the photo.
I did reset it, I checked the email address, removed it as well. Turned it off then back on. Signed out and signed back in. Wi-Fi strength is very good. iOS is 6.0.1. I checked for updates, it is up-to-date I also checked a link http://support.apple.com/kb/TS2755. It did not help at all.
What's wrong?!?!?!?!

It is not a matter of reconsidering the decision. There are unsolveable technical problems with trying to run a program such as Firefox on Blackberry OS. We would need Blackberry to distribute a tool similar to Android's NDK to run on Blackberries.

I have my Dad's apple ID etc, but he has an iphone and i have an Ipod Touch then on IMessage i can read all the messages he recieves and sends and he can read all the messages i send and recieve how do i stop this?

Hi
I have my Dad's apple ID etc, but he has an iphone and i have an Ipod Touch then on IMessage i can read all the messages he recieves and sends and he can read all the messages i send and recieve how do i stop this? But i still want to send messages to him.
Thank You

. You do not need a seperate Apple ID. One one device you just need to go to Settings>Messages and add another/different Messaging email address and delete the common Apple ID address. Also see:
MacMost Now 653: Setting Up Multiple iOS Devices For Messages and FaceTime

Read all the files in a folder over and over again

I want to develop an application that reads all the files in a folder, and once its done reading those files it reads all the files again.
The purpose for this application is to read all the files in a folder that are continuously being stored in that folder, so that when a new file is created, that file is also read by the application. I then need to compare the date and time in which the file was created to the actual date and time of the system, so that way I can get the most recent file, and then I will do other operations with this file.
The thing is that I know how to read all the files in a directory, but I don't know how to cycle through those files again, in order to look for the most recent one, and I don't know how to make the comparison of the time stamps, because I need a precision of one second in the system time and the time the file was created.
Can someone please help me?
Thanks in advance!
Solved!
Go to Solution.

I think that I just went the wrong direction.
What I wanted to do in the first place, was to rename and overwrite every new file in a directory with the same name and file extension, so that every new file overwrites the old file. The thing is that the list folder only lists the files the first time and then keeps on telling me there are no files to be read even though there are new files.
What I need now is a way to overwrite the old files with the same name, and keep searching for every new file that is going to be stored in the directory.
I will leave the code that I have right now, so that you can tell me what do I need to modify in order to read every new file that's going to be created in that directory.
Thanks in advance for your help!
Attachments:
Overwrite Files.vi ‏12 KB

Any function module to read all the values in Tcode-PPQD?

Hi all
Is there any function module to read all the values in Tcode-PPQD (Display Qualifiaction Catalog).
and any idea what tables are involved to get these values like parent and child relationship?
Thanks in advance.
Murali.

Murali,
you can use the following..
data: w_sobid type sobid, "Qualification ID
      w_objid type objid. "Qualification Catalog
select objid into w_objid
              up to 1 rows
              from HRP1001
             where otype = 'QK'
               and plvar = '01'
               and istat = 1
               and risgn = 'B'
               and relat = '030'
               and endda ge sy-datum
               and begda le sy-datum
               and sclas = 'Q'
               and sobid = w_sobid.
endselect.
if sy-subrc eq 0.
write: / w_objid,w_sobid.
endif.
Regards,
Suresh Datti

Read all the hype, but is Lion really worth getting unless you need to link up several devices???

Read all the hype, but is Lion really worth getting unless you need to link up several devices?? e.g. is it worthwhile for a standalone iMac??

There's a million places on the 'net where you can find opinons on that (have a look here, for example http://applehelpwriter.com/2011/08/01/os-x-lion-10-7-%E2%80%94-the-jurys-verdict / ) and at least several long running threads on this forum too dealing with various opinions.
As for me, I've reverted to Snow Leopard.

Function module to read all the views of material data

Dear all ,
       Is there any function module to read all the views of material data ?
       Like we have MATERIAL_MAINTAIN_DARK for updating all the views of material data , I need a function module to read all the views of material master.
Thanks & Regards
Shivanand

Hello,
Check these BAPI'S
<b>BAPI_MATERIAL_DISPLAY          Display Material
BAPI_MATERIAL_GET_DETAIL       Determine Details for a Material</b>
Regards,
Vasanth

Function Module To read all the Files in a Given UNIX directory.

Can anyone provide me with a FUNCTION MODULE which reads all the files available in a UNIX directory?
I have the UNIX directory given. I need to find all the files available in that particular Directory so that I can choose and process accordingly. Probably I can store all files in an Internal Table.
Thanks in advance.
Sunil

Hi Nick,
Thankyou very much for the response.
The Function Module /SAPDMC/LSM_F4_SERVER_FILE is interactive wherein we can select only one file.
But my requirement is I need to collect (probably in an internal table) all the files exixting in the given UNIX directory.
Can you please find in that direction. I would be very grateful.
Thanks.
Sunil

When I copy and paste from one source material to another within adobe reader, all the words are in one sentence. I have to take extra time to separate the words using the space bar. Can this be fix?

When I copy and paste from one source material to another within adobe reader, all the words are in one sentence. I have to take extra time to separate the words using the space bar. Can this be fix?

Hi Bernie,
Are you trying to copy and paste from a pdf to another pdf?
Regards,
Rave

GoldenGate : Why to read all the Redo or Archive, can't we skip ??

Similar Messages

Maybe you are looking for