OLTP to OLTP data porting

Hi ,
I have to start new data porting project which is having new source system in sybase and target DB in oracle uisng Oracle Ware House Builder.
The source and Target Data models are not the same.
Can any one guide me about how to approach to data port between these two DBs in terms of:
1.What are the major steps to follow to achieve this ?
2.What all the intermediate DBs i need to mainitain?
3.What are the key issues on which i need to focus?
Is there any other things i need to focus on this.
Please guide me here
Regards
Rajesh

OWB_Rajesh wrote:
Hi DarthVader,
I am very thankful to you for your guidence here.
i have quick point to say about the below one:
*3. Yes - Yyour load strategy will define this. I assume that you only want to load the data that has been added/modified so do tabfles in source(sybase) tell you what data has been modified/isnerted since the last run, are there history tables in sybase which logs this information if not then you will need to sit with the guys who understand the source data and pick up only modified data and you should maintain a history table at target(oracle) end to know what is the last date/time for which you have fetched the data so your next run should get everything from sybase which has been modified/inserted after the last fetch date.*
here i have to pull 5 years of source data from sybase where they are using the old system which was developed using
Sybase and Powerbuilder and planning to replace this with new system which was built now in .Net and Oracle.
the both data models are differing at source as well target so i need to pull data directly from Sybase to Oracle then they start working with this new system by decommsiong the old one.
Hope i am clear about what i need to do as part of Data Porting activity.
As i need to pull 5 years of data from source to target which includes Historical data,Do i need to maintian AUDIT tables?
Also what kind mapping excericse i need to do as Source(Sybase) and Target (Oracle) are differing in their data structures or Meta Data.
As part of Tool selection which one is the best tool in OWB and OMWB?
Can you please tell me what are all the major business questionnair i need to focus when i sit with end users?
Regards
RajeshThis is a one time exercise of getting historic data and would not require audit tables unless you intend to do it for a 10 million records at a time. I dont know what volume is involved here but if we are taling about few milion rows(around 50 million) then you can do this using owb provided your infrastructure,heardware and mapping is well tuned.
Your mapping should only have target load type of "insert" all the times , do not create indexes on target table. first load the data and then create index on target oracle tables.
not sure if it is wise to export large amount of data over the network if not then you will have to dump the datafrom sybase into a csv or flat file and then use external tables or sqlloader to import the data into oracle.
unbderstanding the type of data(attributes) and amount of data from source is very crucial.
Do not create any Pk/FK /triggers on target as this can slow down the process of load. I am assuming that the source tables are constrained.
For migration i dont think u need to ask any business question except why do you want to port all 5 years data into oracle. Can you not port last two years data into oracle for MI or any other reason and leave the rest in sybase, the statutory requirements will only be to have the data secure irrespective of the system for 6,8 or 10 years.
You might want to explore these before you start porting the data.
Hope this helps

Similar Messages

  • Reference Data Ports

    I have an ECC remote system set up and running fine in MDM.  I created another remote system, but don't want to manually create all of the LT_ reference data ports.  Is there a way to copy (and then edit) them or some way to import them with some automation?
    Thanks,
    Keith

    Hi Keith,
    the copy of a remote system requires some more steps than copying the ports only. Each Import and Syndication port consists of a remote system specific map, too. So the steps are:
    1) Create a new remote system
    2) Import all Import and Syndication maps for the new remote system
    3) Create the ports
    Unfortunately there is no button that is doing this job automatically (I'd like to have one, too)...
    If you are on MDM 7.1, you could try the following:
    1) Export the repository schema using the Transport mechanism in Console.
    2) Open the XML in any XML editor (e.g. XML Spy)
    3) Locate the remote system you want to copy.
    4) Copy and add the "new" remote system to the schema XML
    5) In the "new" remote system, adjust all occurances of the remote system code and name to the desired new values. Check the XML elements:
    - RemoteSystem, attribute code
    - Name
    - InboundPort: attribute importMap consists of the remote system code and the actual import map name
    - InboundPort -> Name: the SAP standard content carries the system type (e.g. ERP) as part of the port name; you have to change this as the port name must be unique!
    - OutboundPort: attribute syndicatorMap consists of the remote system code and the actual syndicator map name
    - InboundPort -> Name: the SAP standard content carries the system type (e.g. ERP) as part of the port name; you have to change this as the port name must be unique!
    - SyndicatorMap -> Map -> RemoteSystems -> Item: attribute agency_code contains the remote system code
    Ensure that the remote system code is always the same!
    6) Locate the portSequence attribute of the Repository element. Add your new ports accordingly.
    7) Save the XML.
    8) Import the schema XML to your repository using the transport mechanism in Console. You should see your new remote system including all items (maps, ports). Check the import result carefully and accept the changes.
    Best regards
    Michael

  • What does data-port mean in IDSM2

    Hello,
    When configuring IDSM2 in Cat6K, there is a command with parameters of data port:
    # monitor session 1 destination intrusion-detection-module 9 data-port 1
    What does the data-port mean? does it mean the monitoring interface 7 or 8?
    Thanks,
    -Alejin

    Data-port is the sensing interface.
    For CAT OS, port 7 and 8 are the sensing interfaces, and
    For IOS, data port 1 and 2 are the sensing interfaces.
    Here is the URL for your reference:
    http://www.cisco.com/en/US/docs/security/ips/7.0/configuration/guide/cli/cli_idsm2.html#wp1210166
    Hope that answers your question.

  • Error : Can't open local data port

    Hello:
    I�d like present this problem to yours:
    I am executing two files Client/Server into my own PC, using two DOS console different, this one to Client an another to Server.
    I got this error:
    Output of the CLient (DOS Console of the client)
    C:\RUN\EX14>java AVReceive2 1.1.9.147/45300
    - Open RTP session for: addr: 1.1.9.147 port: 45300 ttl: 1
    - Waiting for RTP data to arrive...
    - Waiting for RTP data to arrive...
    - A new participant had just joined: mpalacios@mpv
    - Waiting for RTP data to arrive...
    - Waiting for RTP data to arrive...
    Output of the Server (DOS Console of the Server)
    C:\RUN\EX14>java AVTransmit2 file:/c:/run/format/au/drip.au 1.1.9.147 45300
    Track 0 is set to transmit as:
    ULAW/rtp, 8000.0 Hz, 8-bit, Mono, FrameSize=8 bits
    Error : Can't open local data port: 45300
    Well, 1.1.9.147 is the IP address of my PC.
    So, What�s the problem?
    If you need of the rest of code, please say me.
    Thanks.
    Angel.

    Well, I am agree with you, but I have this code in the Transmit File (Server):
    * Use the RTPManager API to create sessions for each media track of the processor.
    private String createTransmitter() {
         // Cheated. Should have checked the type.
         PushBufferDataSource pbds = (PushBufferDataSource)dataOutput;
         PushBufferStream pbss[] = pbds.getStreams();
         rtpMgrs = new RTPManager[pbss.length];
         SessionAddress localAddr, destAddr;
         InetAddress ipAddr;
         SendStream sendStream;
         int port;
         SourceDescription srcDesList[];
         for (int i = 0; i < pbss.length; i++) {
         try {
              rtpMgrs[i] = RTPManager.newInstance();     
    //The local session address will be created on the
    // same port as the the target port. This is necessary
    // if you use AVTransmit2 in conjunction with JMStudio.
    // JMStudio assumes - in a unicast session - that the
    // transmitter transmits from the same port it is receiving
    // on and sends RTCP Receiver Reports back to this port of
    // the transmitting host.
              port = portBase + 2*i;
              ipAddr = InetAddress.getByName(ipAddress);
              localAddr = new SessionAddress( InetAddress.getLocalHost(),
                                       port);
              destAddr = new SessionAddress( ipAddr,
                                  port);
              rtpMgrs.initialize( localAddr);
              rtpMgrs[i].addTarget( destAddr);
              System.err.println( "Created RTP session: " + ipAddress + " " + port);
              sendStream = rtpMgrs[i].createSendStream(dataOutput, i);          
              sendStream.start();
         } catch (Exception e) {
              return e.getMessage();
         return null;
    When I use this Files (Client/Server), between diffrent PCs into LAN, eg, Client (One PC) and Server (Another PC), but I used:
    This One PC: (IP Address PC = 1.1.9.150)
    C:\run\ex14\java AVTransmit2 file:/c:/run/format/audrip.au 1.1.9.147 45300
    Another PC:(IP Address PC = 1.1.9.147)
    C:\run\ex14\java AVReceive2 1.1.9.147/45300
    That�s work right!
    So, what�s happen?

  • RTP Cannot open local data port

    Hello,
    I'm about to learn JMF. So I tried the example code from the sun JMF documentation(example10-1; code is appended).
    The code compiles without errors but when I run it, I alway get the following error:
    streams is [Lcom.sun.media.multiplexer.RawBufferMux$RawBufferSourceStream;@b9b538 : 1
    sink: setOutputLocator rtp://192.168.0.6:49150/audio/1
    java.io.IOException: Can't open local data port: 4800
            at com.sun.media.datasink.rtp.Handler.open(Handler.java:139)
            at Send.<init>(Send.java:60)
            at Send.main(Send.java:71)
    What does that mean and what causes that kind of exception?
    Thanks in advance.
    MfG
    Michael
    ****Code starts here****
    class Send {
       public Send() {
          AudioFormat format = new AudioFormat(AudioFormat.LINEAR, 8000, 16, 1);
          Vector devices = CaptureDeviceManager.getDeviceList(null);
          System.out.println("DEBUG: CaptureDeviceManager returned "  + devices.size() + " devices");
          CaptureDeviceInfo di = null;
          Processor p = null;
          if(devices.size() > 0)
          di = (CaptureDeviceInfo) devices.elementAt(0);
          else
          System.exit(-1);
          System.out.println("Found: " + di.toString());
          try {
          p = Manager.createProcessor(di.getLocator());
          } catch(Exception e) {
         e.printStackTrace();
         System.exit(-1);
    p.configure();
    TrackControl tracks[] = p.getTrackControls();
    p.setContentDescriptor(new ContentDescriptor(ContentDescriptor.RAW));
    boolean encodingOk=false;
    for(int i=0; i < tracks.length; i++) {
         if(!encodingOk && tracks[i] instanceof FormatControl) {
         if( ( (FormatControl)tracks[i] ).setFormat(new AudioFormat(AudioFormat.GSM_RTP, 8000, 16, 1))==null )
         tracks.setEnabled(false);
         encodingOk = true;
         else
         tracks[i].setEnabled(false);
    } //for
    if(encodingOk) {
         p.realize();
         DataSource source = null;
         try { Thread.sleep(1000); } catch(InterruptedException e){}
         try {
         source = p.getDataOutput();
         } catch(NotRealizedError e) {
         System.out.println("*** ERROR: Cannot realize");
         //System.exit(-1);
         try {
         String url = "rtp://192.168.0.6:49150/audio/1";
         System.out.println(url);
         MediaLocator m = new MediaLocator(url);
         DataSink sink = Manager.createDataSink(source, m);
         sink.open();
         sink.start();
         } catch(Exception e) {
         System.out.println("*** ERROR: ");
         e.printStackTrace();
         System.exit(-1);
    } // if
    public static void main(String[] args) {
    new Send();

    Hello,
    I tried to change the port number to 22222, 66666 and 49150. With the same effekt. I found out that when I run the program for the first time after a reboot I get these errors:
    javax.media.NotConfiguredError: getTrackControls cannot be called before configured
    at com.sun.media.ProcessEngine.getTrackControls(ProcessEngine.java:285)
    at com.sun.media.MediaProcessor.getTrackControls(MediaProcessor.java:107)
    at Send.<init>(Send.java:29)
    at Send.main(Send.java:71)
    Exception in thread "main" javax.media.NotConfiguredError: getTrackControls cannot be called before configured
    at com.sun.media.ProcessEngine.getTrackControls(ProcessEngine.java:285)
    at com.sun.media.MediaProcessor.getTrackControls(MediaProcessor.java:107)
    at Send.<init>(Send.java:29)
    at Send.main(Send.java:71)
    I have to quit the program with Ctrl-c. The next time I run it I get the IOException as described above :( .
    MfG
    Michael

  • How to read value of row x from data port while measuring

    Hello,
    i am quite new at Diadem and just did some easy stuff and Tutorials.
    For a project I have the following situation/problem:
    I save many measured values at the data port during the measuring itself. For a "stop-condition" of the DAC/Measurement i have to compare two values:
    1) the current, measured value (time: t1)
    2) the measured value at 0.5 * t1 (that means at the half of the time), which is sored at the data port.
    This comparison has to be done all few seconds (with the same clock the values are getting "saved" at the data port).
    Would be great if anyone knows how to solve.
    Thanks a lot in advance.

    Hi Student5088,
    I used a Copy-Block to create a delay for a certain number of values (time) of a signal. With that you can continuously compare signal at T1 with Signal at T1*0.5.
    Greetings
    Walter
    Attachments:
    Compare.DAC ‏28 KB

  • IDSM-2 data-ports

    Hi,
    I have taken over managing a 6500 IDSM-2 implementation, as far as I can see it has been configured in
    Promiscuous  Mode with a single virtual sensor assigned to both data ports 0/7 & 0/8.
    The switch has been configured with the following commands:
    intrusion-detection module 8 management-port access-vlan 507
    intrusion-detection module 8 data-port 1 access-vlan 507
    monitor session 66 source vlan 501 - 509 , 518 - 520 , 601 - 613
    monitor session 66 destination intrusion-detection-module 8 data-port 2
    can anyone tell me why the second command utilsed data port 1 and the bottom command utilises data port 2, is this valid and recommended?
    Thanks
    D

    So a little bit about IDSM architecture.
    IDSM has one management or command and control port (gig0/2) and 2 data ports (gig0/7 & gig0/8)
    These ports on IDSM connect to the 6500 over the backplane.
    IDSM Gig0/7 connects to Data-port 1 on 6500.
    IDSM Gig0/8 connects to Data-port 2 on 6500.
    The configuration involves two things:
    1. Configuring IDSM (Date, Time, Assigning virtual sensors to interfaces, signature tuning etc...)
    2. Configuring 6500 to send traffic to IDSM.
    Are you planning to put the IDSM in promiscuous or inline mode ?
    The configuration on the 6500 is different for both the modes.
    Configuration:
    intrusion-detection module 8 management-port access-vlan 507
    This puts the management port in vlan 507
    intrusion-detection module 8 data-port 1 access-vlan 507
    Puts data-port 1 in vlan 507. This is typically done in inline mode.
    monitor session 66 source vlan 501 - 509 , 518 - 520 , 601 - 613
    monitor  session 66 destination intrusion-detection-module 8 data-port 2
    This is a span configuration which is sending a copy of the data from the vlans to data-port 2.
    This is done when IDSM operates in promiscuous mode.
    So in your case, the correct configuration on 6500 to send traffic to IDSM depends which mode you want the IDSM to run in.
    Please check the link below which will explain how to configure 6500 for promiscuous or inline mode IDSM configuration.
    http://www.cisco.com/en/US/docs/security/ips/7.0/configuration/guide/cli/cli_idsm2.html
    Let me know if you have any questions.
    - Sid

  • Help me ! "can not open local data port"

    I have successfully ended the previous transmit,but wen I began a new transmit,it failed. It printed "can't open local data port ",why?
    Is it telling that the port is still in use???
    And how can I solve this problem?
    Anyone help me?
    Thanks very much,
    yyc

    Hi,
    this problem occurs when You try to open the same port twice time, You can solve it by opening other port.

  • Cannot create the RTP Session: Can't open local data port

    Hi,
    I'm trying to connect to two webcams simultaneously in the order:
    MediaLocator inputLocator1 = new MediaLocator("rtp://hostname1:8000/video");
    MediaLocator inputLocator2 = new MediaLocator("rtp://hostname2:8000/video");
    But I get this during the second connection:
    Cannot create the RTP Session: Can't open local data port: 8000
    And I can't see the video from hostname2.
    I did a check via netstat, and it seems that both mycomputer is receiving the video from both hostname1 & hostname2:
    TCP mycomputer:3236 hostname1:8000 ESTABLISHED
    TCP mycomputer:3264 hostname2:8000 ESTABLISHED
    TCP connections to both host were established!! But why can't I see the video of hostname2???? I've thought of 2 possible reasons why I cannot see the video of hostname2:
    1. Is this set of local data port maintained by Java? i.e It's not the same as the TCP port 8000 that I see in mycomputer's netstat. If yes, Java has assigned its local data port 8000 to hostname1, so it fails to reassign that port 8000 to hostname2 while hostname1 is still connected. Any other way to fix this apart from changing the portnumber of hostname2?
    2. It has to do with the custom.jar? I've read in an article somewhere in the forum that the custom.jar has to be customized (using JFMCustomizer) to receive video from two hosts with the same portnumber. Can someone elaborate the necessary boxes to check in the JFMCustomizer?
    Thanks much,
    Rach

    After all this while, I finally figured out the problem. In my code, I use MediaLocator to code the receiver and the transmitter. E.g.:
    MediaLocator inputLocator1 = new MediaLocator("rtp://hostname1:8000/video");
    player1 = Manager.createPlayer(inputLocator1)
    MediaLocator inputLocator2 = new MediaLocator("rtp://hostname2:8000/video");
    player2 = Manager.createPlayer(inputLocator2)
    Manager would complain "Cannot create the RTP Session: Can't open local data port: 8000" because port 8000 is already used up by player1, i.e.:
    mycomputer:8000 maps to hostname1:8000
    mycomputer:8000 cannot re-map to hostname2:8000
    To work around this, I'll need to use SessionAddress. SessionAddress provides the flexibility to do an independent local port mapping, e.g.:
    mycomputer:5000 maps to hostname1:8000
    mycomputer:5002 maps to hostname2:8000
    Rach

  • Adtran with voice and data port

    I have an ADTRAN (remote location) with a voice and data port (internet). Does the ethernet port plugs into a serial or ethernet interface?
    The provider is telling me to plugg it into a hub...I've never heard of that and was curious if anyone has implemented this configuration before.

    Options are limited but include.
    1. Get a new SIM card from AT&T and reset your voicemail, see if that helps.
    2. Reset your iPhone (holding down the top button and home button for ~10 seconds until the Apple logo appears on the screen).
    3. Restore your iPhone. If restoring from backup does nothing then next try restore as new and start over.
    4. If nothing else works then call Apple or go to an Apple store and they will replace it.

  • Intrusion-detection-module 7 data-port 2: Capture not allowed on a SPAN destination port

    Hi all
    I have 2 switches Cat6509E. each with IDSM module
    I have on first switch this commands
    intrusion-detection module 7 data-port 1 capture
    intrusion-detection module 7 data-port 2 capture
    intrusion-detection module 7 data-port 1 capture allowed-vlan 4,6,16,17,66
    intrusion-detection module 7 data-port 2 capture allowed-vlan 68,70,74,134,145
    And when I trying to put the same on second switch I will get this error message
    Intrusion-detection-module 7 data-port 2:  Capture not allowed on a SPAN destination port
    What does it mean?
    Output "sh monitor" is the same on both switches
    Session 1
    Type                   : Service Module Session
    Modules allowed        : 1-9
    Modules active         : 1,7
    BPDUs allowed          : Yes
    Session 2
    Type                   : Local Session
    Source VLANs           :
        Both               : 4
    Destination Ports      : analysis-module 8 data-port 1
    Peter

    Hi Peter,
         The first switch that you mention is configured (judging from the "intrusion-detection" commands) to use the VACL capture method of sending traffic to the IDSM-2 for inspection.  You can read about this method here:
    http://www.cisco.com/en/US/docs/security/ips/7.0/configuration/guide/cli/cli_idsm2.html#wp1030828
    In short, you configure a VACL to define the traffic you want to capture and apply it to the appropriate VLANs.  When traffic matches the VACL, it's copied to the IDSM-2 ports that have been configured with the "intrusion-detection module 7 data-port 1  capture" commands.
    On the second switch it appears that there is a monitor session setup SPANing traffic to the IDSM-2 port.  This is an alternative method of sending trafic to the IDSM-2 for inspection and is mutually exclusive with the VACL method on a particular IDSM-2 interface.  You can read about the SPAN method here:
    http://www.cisco.com/en/US/docs/security/ips/7.0/configuration/guide/cli/cli_idsm2.html#wp1030816
    This method, in short, simply involves configuring a SPAN session with the IDSM-2 interface as the desination.
    You'll need to choose one method or the other for configuring the second switch.  If you want it to match the configuration on the first switch, simply remove the monitor (SPAN) session that's currently configured.
    Best Regards,
    Justin

  • IDSM data port status down

    Dear all,
    I am facing strange problem with 6500 IDS module.Management port of IDSM is up and Data port 2 Operational Mode: down.When i check traffic on this port it is one way only.I can able to ping IDSM management IP but when i try to telnet it given only banner after that it hang.
    Will i need to reset IDS module to solve this problem.Is there any other way to solve this problem.
    THanks & Regards
    SAM

    Thanks for your reply,
    Actually we did not make any changes in configuration.This is working configuration.We can able to ping IDS IP , but when try to telnet i got banner of IDS but does not allow me to give any commands.
    I am little bit confused about data port of IDS.Operation mode of IDSM is down.
    MSFC_SW#sh intrusion-detection module 8 data-port 2 sta
    Intrusion-detection module 8 data-port 2:
    Switchport: Enabled
    Administrative Mode: trunk
    Operational Mode: down
    Administrative Trunking Encapsulation: dot1q
    Negotiation of Trunking: Off
    Access Mode VLAN: 1 (default)
    Trunking Native Mode VLAN: 1 (default)
    Trunking VLANs Enabled: NONE
    Pruning VLANs Enabled: 2-1001
    Capture Mode Enabled
    Capture VLANs Allowed: 1-150
    Vlans allowed on trunk:none
    Vlans allowed and active in management domain: none
    Vlans in spanning tree forwarding state and not pruned:
    none
    Administrative Capture Mode: Enabled
    Administrative Capture Allowed-vlans: 1-150
    MSFC_SW#
    MSFC_SW#sh intrusion-detection module 8 data-port 2 traffic
    Intrusion-detection module 8 data-port 2:
    Specified interface is up line protocol is down (monitoring)
    Hardware is C6k 1000Mb 802.3, address is 000f.905c.6407 (bia 000f.905c.6407)
    MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
    reliability 255/255, txload 1/255, rxload 1/255
    Encapsulation ARPA, loopback not set
    Keepalive set (10 sec)
    Full-duplex, 1000Mb/s
    input flow-control is off, output flow-control is unsupported
    Last input never, output never, output hang never
    Last clearing of "show interface" counters never
    Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
    Queueing strategy: fifo
    Output queue: 0/40 (size/max)
    5 minute input rate 0 bits/sec, 0 packets/sec
    5 minute output rate 2350000 bits/sec, 2355 packets/sec
    0 packets input, 0 bytes, 0 no buffer
    Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
    0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
    0 input packets with dribble condition detected
    21555252761 packets output, 3201907351815 bytes, 0 underruns
    0 output errors, 0 collisions, 3 interface resets
    0 babbles, 0 late collision, 0 deferred
    0 lost carrier, 0 no carrier
    0 output buffer failures, 0 output buffers swapped out
    MSFC_SW#
    This is interface status in MSFC.
    Hope now you can understand my problem.
    TIA
    SAM

  • Disable Data Port Connections

    I have a WRT54G2 setup in the company. I want the unit to be used for wireless access only. I would like to disable the data port connections that are not being used.
    Has anyone done this before or know of how to do so?

    I thought of causing damage to those ports too. Maybe lLightly crazy glue in a few male RJ45's is another thought I had.
    Thanks again GV!
    Daniel

  • Cable for Excite AT305 USB Data port?

    What cable do I need to get be able to use the UBS data port on my tablet? I see an HDMI one in accessories, and I have the charging cable, but I don't see for the data USB port. I need to know which cable to ask for and where I can get one.
    Solved!
    Go to Solution.

    I had a really hard time finding a micro usb OTG cable anywhere locally (Future shop, Best Buy, specialty computer stores, etc). These cables freely available on the web, but I didn't want to go through the hassle of ordering and shipping a cable just to connect to the usb port and confirm that it works as advertised. The usb host was critical for me. The solution was to follow the recommendation in the following review: http://www.mobiletechreview.com/tablets/Toshiba-Excite-10.htm The reviewer recommended purchasing a Sony Tablet S usb adapter cable, as it is the easiest to find. So I went to my local Sony store and there it was: http://store.sony.com/webapp/wcs/stores/servlet/ProductDisplay?catalogId=10551&storeId=10151&langId=... Oh, and the USB host works great.

  • Streaming OLTP to a Data Warehouse

    I am currently working on a project to use Streams to capture changes from a highly normalized OLTP DB and propagates them to a separate DB that will be in the form of a flat data warehouse design. Streams seems to provide great potential to make the reporting from the warehouse near real-time and to avoid the typical nightly ETL through staging tables. Conceptually, I�d like to have a capture process on the source, have an apply process with a DML handler (changes table name, owner, deletes unnecessary columns, and adds columns of queried data) that re-enqueues the LCR at the source, a propagation process that sends the user defined LCR generated by my DML handler package and finally an apply process at the destination site to populate the data.
    I have several components of this process working but I can�t get it all to come together. The capture process and apply with the DML handler is no problem. But once the message is re-enqueued the trouble begins. It seems like the message is propagating based on the events and bytes propagated displayed in dba_queue_schedules but I never see the LCR hit the destination queue. Is there something specific that needs to be created since this is now a �user-defined� LCR? The apply process on the destination was created with the apply_captured parameter set to false so I though that this would be enough. Do I need to create a special agent to handle this or create a subscriber for the queue? Any help would be greatly appreciated.
    Thanks,
    Bill

    Thanks for suggesting where to look, Patricia. I don�t have any errors in the error queue, I do have data being propagated as indicated by the DBA_QUEUE_SCHEDULES view, there are no errors associated with the propagation and my apply process is running on the destination side. However, I�m not seeing any messages being read from the queue on the destination side. The V$STEAMS_APPLY_READER view has a state of �DEQUEUE MESSAGES� but the total_messages_dequeued = 0. I guess this makes sense since I never see any data being populated in the strmadmin.streams_queue_table in the destination database. I assume that if the data was propagating correctly I�d see an entry here since my source apply process uses a DML handler to re-enqueue the lcr for propagation thus making it a non-captured event?
    Any suggestions of what to look for next?

Maybe you are looking for

  • How to concatenate the values in single row with images or colours

    hi all, i am apex 4.2, i tried to execute a plsql query for the values concatenate two values into same column example in my table i am having teachers list one can teach two or three subjects in table i am saving like teacher_id               teache

  • Support for RAW Video and Image Sequences

    Being a stills photographer who moved into video some years back, I'm very interested in the direction Lightroom is going with regards to video support. I haven't tried it yet but I wondered if LR4 supports Red R3D files? And would it perhaps support

  • Menu works on Mac but not in DVD player...any idea why?

    I created a DVD using IDVD6. The burn process, etc. seemed to go fine. When I stick the DVD in the DVD player, the menu does come up but I am only allowed to press play. I am not able to click to the other button (scene selection), however I am able

  • Preordered album won't download.

    An album I preordered a few weeks ago was released on the 17th but I've gotten no e-mail regarding downloading it and haven't been charged for it. I know I could probably cancel the preorder, but the preorder price was cheaper and came with a few bon

  • How can I tell how many shutter actuations my EOS 5D Mark II has had?

    Is it possible to determine how many shutter actuations my Canon EOS 5D Mark II camera has had?