Which column changed? - ... or TARGET_COLMAP$ for Golden Gate

Hi all,
I have created something similar to CDC using Golden Gate, with all the changes in the source table inserted into a target table with operation marker @GETENV("GGHEADER","OPTYPE")
It is all good up to this point.
Now, I need to know which particular column(s) has changed and store this information and I cannot find any way of achieving it.
I need some sort of change marker, something similar to TARGET_COLMAP$ in CDC.
Is it possible in Golden Gate to figure out what column has changed?
Cheers!

Please, move this question into the Database general forum. CDC had nothing to do with Database Migration Assistant for Unicode.
-- Sergiusz

Similar Messages

V$views for golden gate

Hi,
I came across these views that were introduced in rdbms 11.2, but these views don't get populated though I have gg running on the server.
v$goldengate_capture
v$goldengate_message_tracking
v$goldengate_transaction
Any idea how to enable metric collection for these views?
Thanks
AbbY.

Hi,
As you would be on 10g or higher version of the Oracle, you can use dbms_xplan.display_cursor or display_awr function to check the explain plan.Find the sql_id for the particular sql and check the plan
Read http://download.oracle.com/docs/cd/B13789_01/appdev.101/b10802/d_xplan.htm#998179
HTH
Anand
Edited by: Anand... on Oct 19, 2010 11:27 PM

Golden gate installatiom

hi frenz...
I'm trying to install golden gate on oracle 11g but when i try to run the script @/oradata/gg/marker_setup.sql it asks for golden gate schema.. after entering schema name the command prompt does'nt show anything plzz tell me wheres the prob in my installation?

Hi;
For your issue i suggest close your thread here as changing thread status to answered and move it to Forum Home » System Management and Integration » GoldenGate which is GG dedicated forum site.
Regard

Golden gate installation

hi frenz...
I'm trying to install golden gate on oracle 11g but when i try to run the script @/oradata/gg/marker_setup.sql it asks for golden gate schema.. after entering schema name the command prompt does'nt show anything plzz tell me wheres the prob in my installation?

Hi Ashish,
Do you see output in the marker_setup_spool.txt which is created while running the marker_setup.sql.
Thanks,
Kamal.

Golden Gate, DBFS and SUN ODM

Gents,
DBFS - way of storing files as LOBS - cool feature, no bullet proof POCs yet. POC that I worked on got .78TB/hour to load data using external table, Oracle advertised 5TB/hour.
There has been recommendation flowing around on using DBFS for storing "Golden Gate Trail/Checkpoint files"
1. As we know, golden gate files are "Transient" and needs to be deleted once redo changes are applied.
2. Assuming DBFS is setup within Exadata (storage servers, lets say 14-FULL RACK).
3. ASM will do its own job of managing (striping and mirroring)
??Questions??
A. What is the advantage of using DBFS on Exadata shared servers than storing shared NFS, to me, Golden gate files are transient and it will be waste of shared storage and performance impact due to ASM overhead of managing transient files on Exadata boxes?
B. If we decide to store Golden Gate files on exadata, can we just store them on shared exadata server as regular files ?
C. ASM specific, can we just conditionally bypass stripping and mirroring for "Golden Gate Transient Files"?
D. ACFS Vs DBFS, why DBFS is better than ACFS ? (requirement specific question assuming I just want to store transient files for a period of time)
Thanks
-Dhaval

munno wrote:
ASM Clustered File System is supported on SUN ODM unless somebody comments on how ACFS is different than what Oracle says below.
http://www.oracle.com/technology/products/bi/db/exadata/pdf/exadata-technical-whitepaper.pdf
Please look into this pdf, page number 11.
Here is the text from page 11
Oracle Automatic Storage Management (ASM) is used as the file system and volume manager for
Exadata. ASM virtualizes the storage resources and provides the advanced volume management
and file system capabilities of Exadata. Striping database files evenly across the available Exadata
cells and disks results in uniform I/O load across all the storage hardware. The ability of ASM to
perform non-intrusive resource allocation, and reallocation, is a key enabler of the shared grid
storage capabilities of Exadata environments.
"Automatic Storage Management (ASM) != ASM Cluster File System (ACFS)
That's the difference. Exadata uses ASM, but it does not support ACFS, only DBFS.
Regards,
Greg Rahn
http://structureddata.org

Install oracle golden gate 11.1.1.0 for oracle9i on RedHat AS3 U6 issue

Hi expert,
I need install Oracle golden gate base on below combination:
GG version: 11.1.1.0 (x64)
OS version: Redhat AS3 UL6 (x64)
Oracle version: 9.2.0.8 (x64)
I set the .bash_profile for oracle as below:
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/9.2.0
export GGATE=/software/ogg
export PATH=$PATH:$ORACLE_HOME/bin:$GGATE
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:$GGATE
However, after installation, when I run ggsci, it show below error message:
ggsci: error while loading shared libraries: libstdc++.so.6: cannot open shared object file: No such file or directory
I searched the libstdc++.so.6 in the server and found one in /lib64/ssa/libstdc++.so.6, I changed the LD_LIBRARY_PATH as:
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:$GGATE:/lib64/ssa/
then this time it has below error:
ggsci: /lib64/ssa/libstdc++.so.6: version `GLIBCXX_3.4' not found (required by ggsci)
ggsci: /lib64/ssa/libstdc++.so.6: version `GLIBCXX_3.4' not found (required by /software/ogg/libxerces-c.so.28)
my question:
1. Is GG 11.1.1.0 supported on RHEL AS3 U6? From oracle official website, it seems only the EL 4 UL7+ or EL 5 UL3+ are supported.
2. If it's supported, how to resolve above error?
Many thanks for your help.

Hi,
I think GG version: 11.1.1.0 (x64) supports only oracle 10g and 11g databases.
Try GG version: 10.4.0.19 (x64) for oracle 9.2.0.8
Thanks.

How to Sort Dimension in Pivot Table via Order Column which is changing like Factual values

Hi,
Recently in of our product offerings we got stuck on this following question:
How to Sort Dimension based on the Order Value which Keeps Changing with Factual Values??
We have a data source laid out as (example)
In the above the “Order” columns are changing per
Company/(DimensionA) for DimesnsionB.
Instead what we want is: (But only if we can get the following result without putting the “Order” Column in the “Values” Section.
If there are any configurations that we can make to our power pivot model for the similar data set so that the
DimesnionB in this case can be sorted by the Order column, would be greatly helpful to us.
Sample File:
http://tms.managility.com.au/query_example.xlsx
Thanks
Amol

Hi Amol,
According to your description, you need to sort dimension members in Pivot Table via order column, and you don't want the order column show on the Pivot table, right?
Based on my research, we can sort the data on the Pivot table based on one of the columns in that table, and we cannot sort the data based on the columns that not existed on the Pivot table. So in your scenario, to achieve your requirement, you can
add the column to pivot table and hide it.
https://support.office.com/en-gb/article/Sort-data-in-a-PivotTable-or-a-PivotChart-report-49efc50a-c8d9-4d34-a254-632794ff1e6e
Regards,
Charlie Liao
TechNet Community Support

Golden Gate for mysql5.5 extract is Abended,and not error in the file

Dear All,
golden gate for mysql5.5 to oracle 11g,extract is Abended ,but there didn't have error in the log , And sometimes the successful extraction some records;
extract :
EXTRACT EXT_M1
TRANLOGOPTIONS AltLogDest /mydata/mysqllog/binlog/binlog.index
SOURCEDB [email protected]:16052, USERID mama,PASSWORD mama
sqlexec "set names gbk;"
EXTTRAIL dirdat/m1
Dynamicresolution
TABLE mama.merchants_member_card_customer;
datapump:
EXTRACT DPRD_M1
SOURCEDB [email protected]:16052, USERID mama,PASSWORD mama
RMTHOST 192.168.2.57, MGRPORT 7089, compress --COMPRESSUPDATESETWHERE
RMTTRAIL /home/oracle/goldengate/dirdat/m1
NOPASSTHRU
TABLE mama.merchants_member_card_customer;
GGSCI>>info all
Program     Status      Group       Lag at Chkpt Time Since Chkpt
MANAGER     RUNNING
EXTRACT     RUNNING     DPRD_M1     00:00:00      00:00:01
EXTRACT     ABENDED     EXT_M1      00:11:49      00:01:56
REPORT:
GGSCI>>view report ext_m1
                  Oracle GoldenGate Capture for MySQL
      Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230
Linux, x64, 64bit (optimized), MySQL Enterprise on Apr 23 2012 05:23:34
Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
                    Starting at 2013-09-29 18:38:08
Operating System Version:
Linux
Version #1 SMP Wed Jun 13 18:24:36 EDT 2012, Release 2.6.32-279.el6.x86_64
Node: M46
Machine: x86_64
                         soft limit   hard limit
Address Space Size   :    unlimited    unlimited
Heap Size            :    unlimited    unlimited
File Size            :    unlimited    unlimited
CPU Time             :    unlimited    unlimited
Process id: 6322
Description:
**            Running with the following parameters                  **
2013-09-29 18:38:08 INFO    OGG-03035 Operating system character set identified as UTF-8. Locale: zh_CN, LC_ALL:.
EXTRACT EXT_M1
TRANLOGOPTIONS AltLogDest /mydata/mysqllog/binlog/binlog.index
SOURCEDB [email protected]:16052, USERID mama100,PASSWORD ****************
sqlexec "set names gbk;"
Executing SQL statement...
2013-09-29 18:38:08 INFO    OGG-00893 SQL statement executed successfully.
EXTTRAIL dirdat/m1
Dynamicresolution
TABLE mama100.merchants_member_card_customer;
2013-09-29 18:38:08 INFO    OGG-01815 Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON) anon free: munmap
    file alloc: mmap(MAP_SHARED) file free: munmap
    target directories:
    /home/goldengate/dirtmp.
CACHEMGR virtual memory values (may have been adjusted)
CACHESIZE:                               64G
CACHEPAGEOUTSIZE (normal):                8M
PROCESS VM AVAIL FROM OS (min):         128G
CACHESIZEMAX (strict force to disk):     96G
Database Version:
MySQL
Server Version: 5.5.24-patch-1.0-log
Client Version: 6.0.0
Host Connection: 192.168.2.46 via TCP/IP
Protocol Version: 10
2013-09-29 18:38:08 INFO    OGG-01056 Recovery initialization completed for target file dirdat/m1000000, at RBA 1295, CSN 000086|000000065228677.
2013-09-29 18:38:08 INFO    OGG-01478 Output file dirdat/m1 is using format RELEASE 11.2.
2013-09-29 18:38:08 INFO    OGG-01026 Rolling over remote file dirdat/m1000000.
2013-09-29 18:38:08 INFO    OGG-00182 VAM API running in single-threaded mode.
2013-09-29 18:38:08 INFO    OGG-01515 Positioning to begin time 2013-9-29 06:26:18.
**                     Run Time Messages                             **
2013-09-29 18:38:08 INFO    OGG-01516 Positioned to Log Number: 86
    Record Offset: 65223906, 2013-9-29 06:26:18.
2013-09-29 18:38:08 INFO    OGG-01517 Position of first record processed Log Number: 86
    Record Offset: 65223906, 2013-9-29 06:26:18.
TABLE resolved (entry mama100.merchants_member_card_customer):
TABLE mama100."merchants_member_card_customer";
Using the following key columns for source table mama100.merchants_member_card_customer: id.
2013-09-29 18:38:08 INFO    OGG-01054 Recovery completed for target file dirdat/m1000001, at RBA 1316, CSN 000086|000000065228677.
2013-09-29 18:38:08 INFO    OGG-01057 Recovery completed for all targets.
ggsevt:
2013-09-29 18:38:08 INFO    OGG-00963 Oracle GoldenGate Manager for MySQL, mgr.prm: Command received from GGSCI on host localhost (START EXTRACT EXT_M1 ).
2013-09-29 18:38:08 INFO    OGG-00975 Oracle GoldenGate Manager for MySQL, mgr.prm: EXTRACT EXT_M1 starting.
2013-09-29 18:38:08 INFO    OGG-00992 Oracle GoldenGate Capture for MySQL, ext_m1.prm: EXTRACT EXT_M1 starting.
2013-09-29 18:38:08 INFO    OGG-03035 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Operating system character set identified as UTF-8. Locale: zh_CN, LC_ALL:.
2013-09-29 18:38:08 INFO    OGG-00893 Oracle GoldenGate Capture for MySQL, ext_m1.prm: SQL statement executed successfully.
2013-09-29 18:38:08 INFO    OGG-01815 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON) anon free: munmap
    file alloc: mmap(MAP_SHARED) file free: munmap
    target directories:
    /home/goldengate/dirtmp.
2013-09-29 18:38:08 INFO    OGG-00993 Oracle GoldenGate Capture for MySQL, ext_m1.prm: EXTRACT EXT_M1 started.
2013-09-29 18:38:08 INFO    OGG-01056 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Recovery initialization completed for target file dirdat/m1000000, at RBA 1295, CSN 000086|000000065228677.
2013-09-29 18:38:08 INFO    OGG-01478 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Output file dirdat/m1 is using format RELEASE 11.2.
2013-09-29 18:38:08 INFO    OGG-01026 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Rolling over remote file dirdat/m1000000.
2013-09-29 18:38:08 INFO    OGG-00182 Oracle GoldenGate Capture for MySQL, ext_m1.prm: VAM API running in single-threaded mode.
2013-09-29 18:38:08 INFO    OGG-01515 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Positioning to begin time 2013-9-29 06:26:18.
2013-09-29 18:38:08 INFO    OGG-01516 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Positioned to Log Number: 86
    Record Offset: 65223906, 2013-9-29 06:26:18.
2013-09-29 18:38:08 INFO    OGG-01517 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Position of first record processed Log Number: 86
    Record Offset: 65223906, 2013-9-29 06:26:18.
2013-09-29 18:38:08 INFO    OGG-01054 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Recovery completed for target file dirdat/m1000001, at RBA 1316, CSN 000086|000000065228677.
2013-09-29 18:38:08 INFO    OGG-01057 Oracle GoldenGate Capture for MySQL, ext_m1.prm: Recovery completed for all targets.
2013-09-29 18:38:09 INFO    OGG-01054 Oracle GoldenGate Capture for MySQL, dprd_m1.prm: Recovery completed for target file /home/oracle/goldengate/dirdat/m1000002, at RBA 1435, CSN 000086|000000055512672.
2013-09-29 18:38:09 INFO    OGG-01057 Oracle GoldenGate Capture for MySQL, dprd_m1.prm: Recovery completed for all targets.

GGSCI>>info ext_m1 showch
EXTRACT    EXT_M1    Last Started 2013-09-29 18:38   Status ABENDED
Checkpoint Lag       00:11:49 (updated 00:12:05 ago)
VAM Read Checkpoint 2013-09-29 18:26:18.665841
Current Checkpoint Detail:
Read Checkpoint #1
VAM External Interface
Startup Checkpoint (starting position in the data source):
    Timestamp: 2013-09-29 18:26:18.665841
Recovery Checkpoint (position of oldest unprocessed transaction in the data source):
    Timestamp: 2013-09-29 18:26:18.665841
Current Checkpoint (position of last record read in the data source):
    Timestamp: 2013-09-29 18:26:18.665841
Write Checkpoint #1
GGS Log Trail
Current Checkpoint (current write position):
    Sequence #: 0
    RBA: 917
    Timestamp: 2013-09-29 18:30:55.655570
    Extract Trail: dirdat/m1
CSN state information:
CRC: 20-82-1D-34
CSN: Not available
Header:
Version = 2
Record Source = A
Type = 8
# Input Checkpoints = 1
# Output Checkpoints = 1
File Information:
Block Size = 2048
Max Blocks = 100
Record Length = 20480
Current Offset = 0
Configuration:
Data Source = 5
Transaction Integrity = 1
Task Type = 0
Status:
Start Time = 2013-09-29 18:38:08
Last Update Time = 2013-09-29 18:38:08
Stop Status = A
Last Result = 0

Golden gate for sybase

I have Sybase aSE source and want to use the GOLDEN gate replication to capture the change and put it to flat file or Netezza.
Can GOLDEN gate would be able to do this.
Thanks

Yes you can. See http://docs.oracle.com/cd/E14571_01/integrate.1111/e12644/ogg.htm for more details. For flatfile, use the GoldenGate extract parameter FORMATASCII. There are also other flat file formats, FORMATSQL,FORMATXML.

How to use Golden Gate for ETL purpose

Hi Oracle Gurus, i have a situation where i am thinking to replace our oracle PL/SQL package with Golden Gate to process our ETL.
I mean we use PL/SQL package, which has several procedures and functions in it and we process our application data using this package to transform that data for our downstream clients.
I was just wondering how we can achieve this using golden gate? Any suggestions will be appreciated.
Thanks a lot :)

Hi Annamalai
We have a ETL login in our local database, and ETL processed data is pulled by our down stream clients, We are seeing that current ETL is not capable enough to execute such a huge load. So we wanted to port our raw data to secondary database and run ETL login on secondary database and to parallelize it accordingly.
I was just thinking, can we use ETL logic inside OGG parameters, so we can load transformed data to secondary database. So no need of running ETL in secondry database. May be i sound little foolish, but just a thought.
Thanks
Abhi

Changing date format for some of the date columns in a subject area

Hi,
I have a requirement to change the date format for some of the date columns to dd-mon-yyy for only a particular subject area. Is there a feature available in the RPD which can help me do this?
In Answers - Column Properties for a Particular column of a report, we can save the style and formatting as system wide default for the particular column or the data type, but that applies across subject areas.
I tried with the config files too , but that too applies to all suject areas.
Thanks in Advance,
Gaurav

Why don't you create 2 logical column derived from same date physical col and then change the format for one logical column and use it in Subject Area ?

Record column level changes of table for audit.

Hi Experts,
I need suggestion on recording column level changes in table for internal aduit purposes, our company policy does not allow us to enable CDC and CT on database levels so I am looking for whar are other the best ways for doing the same ?
I know we can use triggers and OUTpUT clause to record the changes on tables but Is there any other light weight solution for recording changes on transactions tables which very gaint tables.
Seeking your guidnace on solution side ?
Shivraj Patil.

OUTPUT should be the best choice for your case as this would be much lighter than Trigger.

Golden gate monitoring script for struck processess

Hi Folks,
The requirement is to get an email if any of the golden gate process struck on particular RBA for long time, even there are many tails file to be replicated.
The status of the process is running and there is no lag.
Thanks,
Anand T.

1005886 wrote:
Hi Folks,
The requirement is to get an email if any of the golden gate process struck on particular RBA for long time, even there are many tails file to be replicated.
The status of the process is running and there is no lag.
Thanks,
Anand T.
Of course, you can use GoldenGate "monitor" (part of the GG "management pack"), which has this functionality. Optionally, if you're already using EM, use GG monitor + EM integration. See: Management Pack for Oracle GoldenGate
Otherwise, you have other options: query the status of running processes using ggsci; or, configure GG to write reports (to dirrpt/{name}.rpt) with the info you need; and/or generate warning messages (to ggserr.log), and periodically parse these files for the relevant info. See the GG Admin guide, "Monitoring Oracle GoldenGate Processing".
As an example using ggsci from a script:
$ echo 'info myextr showch' | ./ggsci | egrep 'Checkpoint|RBA'
Checkpoint Lag       1:24:07 (updated 00:00:07 ago)
Log Read Checkpoint File dirdat/tc000000
                     2014-01-23 06:14:41.000000 RBA 4338
Current Checkpoint Detail:
Read Checkpoint #1
Startup Checkpoint (starting position in the data source):
    RBA: 0
Current Checkpoint (position of last record read in the data source):
    RBA: 4338
Although, configuring GG to report lag warnings, and then using scripts to monitor ggserr.log would be simpler & more flexible.

TS3276 I have recently had a problem with one of my hotmail accounts, some sort of virus sending random emails to people in my address book. Hotmail advised me to change my password for that account, which I did. Why won't mail recognise the new password?

I have recently had a problem with one of my hotmail accounts, some sort of virus sending random emails from my address book. Hotmail advised me to delete all contacts and change the password for that account, which I did on my laptop running windows XP. The change was successful and I was able to send and receive emails with no problem. I then had to change the account password on my iPhone 4s, which I did and it too was successful but when I came to change the password on my iMac, running the latest version of Lion it would not recognise the new password. I have tried to remove the account details and re-install but every time I go to add new account my old details are in the box. This is very frustrating as I use my iMac for all my profects and I need to access my email. Please help.

hi guys,
I had already deleted all reference to the hotmail account in question from the keychain access app, I have also tried to delete and re-instal the account details from within mail. The icon in the side bar dissapears but when I go to Add Account, the old account details are in the new account box. I then input my new password but am told that the server does not recognise it. If I access hotmail via google on the iMac I can get into my account with no problems. I am thinking there must be some other form of security system within the mac software that is blocking the new password. This is driving me nuts. I have been trying to resolve this for the last two days. Thank you for your advise anyway.

My MacBook Pro keeps making copies of a document that I am trying to save. I don't want to duplicate the file. I only want to save it on both my hard drive and my external hard drive. I do not want to change its name for every save, which the computer see

My MacBook Pro keeps making copies of a document that I am trying to save. I don't want to duplicate the file. I only want to save it on both my hard drive and my external hard drive. I do not want to change its name for every save, which the computer seems insistent on doing. Help!!

11lizzyp wrote:
can't be saved because the file is read-only.
I did not create the file to be read-only. I created to be able to continue to add to it as I work on it.
More on versions here:
http://support.apple.com/kb/ht4753
local snapshots:
http://support.apple.com/kb/HT4878
Sounds like a permissions problem ie read only.
If running repair permissions from your DiskUtility.app does not sort it,
Someone should jump in here with erudite and concise fix.

Which column changed? - ... or TARGET_COLMAP$ for Golden Gate

Similar Messages

Maybe you are looking for