Best way to do near real-time ?

Hello,
What is the best way to do some near real-time to transfer data from:
an Oracle DB to another Oracle DB: Streams, CDC + ETL, ... ?
any DB to an Oracle DB ?
The idea is to load a DWH in near real-time.
Thanks in advance for your answers.

DR Google
http://www.orafaq.com/node/957
1. Physical Standby Database
Standby database is called “physical” if the physical structure of stand by exactly matches with stand by structure. Archived redo log transferred from primary database will be directly applied to the stand by database.
2. Logical Standby Database
Stand by database is called “logical”, the physical structure of both
databases do not match and from the archived redo log we create SQL statements then these statements will be applied to stand by database.
Basically your second database is a logical (ETL) copy of your main db updated via archive logs. it is not an easy thing to set up, but if you manage to get it right, its probably the least amount of maintenance over time.

Similar Messages

  • Best practice for Near Real time with Oracle

    Hi,
    We plan to run a scenario to demonstrate DS ability for real time or near real time scenario.
    We identified different solutions and we are trying to choose the most appropriate :
    - Oracle 11g + Sybase Replication server + Data Services
    - Oracle 11g + Data services : real time jobs ( xml messages )
    - Oracle 11g + Data Services : CDC scenario
    I need to load data into a SAP Sybase IQ database : is there any known issue with one of the previous solution ?
    The challenge is to load a set of 10 tables, for more than 5 millions rows,
    Thanks for your advices,
    Guillaume

    Hi!
    Didn't anyone have this requirement for migrations? I have tested with the mysql select into file clause. Seems to work for simple data types - we're now testing with blobs...
    Markus

  • Can JMSPriority be used to distinguish between real-time, near real-time workloads?

    IHAC that needs to throttle work passed to a backend system, i.e. limit
              the # of concurrent requests, as well as prioritize between different
              kinds of workloads including real-time, deferred real-time
              (asynchronous) and batch.
              I'm proposing to use a pool of MDBs reading of a single JMS queue. The
              max-free-beans-in-pool would be used to limit the concurrent access to
              the backend system.
              Can JMSPriority be used to distinguish between the different kinds of
              workloads? (real-time, near real-time and batch)
              How is the JMSPriority used when consuming messages from a queue in WLS
              JMS? Are messages dequeued in strict priority order or is there an
              algorithm to ensure lower priority messages are periodically consumed,
              i.e. to ensure they are not starved-out? Or do you have to create a
              message selector to dequeue based on priority?
              Is the an appropriate use of JMSPriority or should I set-up dedicated
              JMS queues for each of the different workload types?
              Cheers
              Simon
              

              Tom,
              How do you create custome connection factories in JMS? And also how can u
              change the MessageMaximum to 0? I thought the minimum is 1 and that u can only
              change in the config.xml file??
              Any code snippets on how to write custom connection factories would be helpful.
              Thank You,
              Sankas
              Tom Barnes <[email protected]> wrote:
              >Hi Simon,
              >
              >Answers in-line.
              >
              >Simon Pearce wrote:
              >
              >> IHAC that needs to throttle work passed to a backend system, i.e. limit
              >> the # of concurrent requests, as well as prioritize between different
              >> kinds of workloads including real-time, deferred real-time
              >> (asynchronous) and batch.
              >>
              >> I'm proposing to use a pool of MDBs reading of a single JMS queue.
              >The
              >> max-free-beans-in-pool would be used to limit the concurrent access
              >to
              >> the backend system.
              >>
              >> Can JMSPriority be used to distinguish between the different kinds
              >of
              >> workloads? (real-time, near real-time and batch)
              >>
              >> How is the JMSPriority used when consuming messages from a queue in
              >WLS
              >> JMS? Are messages dequeued in strict priority order or is there an
              >> algorithm to ensure lower priority messages are periodically consumed,
              >> i.e. to ensure they are not starved-out?
              >
              >To get priority sorting you must configure the destination to sort by
              >priority.
              >It sorts FIFO by default.
              >
              >In addition, you may want to tune-down the pipe-line size between
              >the JMS server and the MDB (create a custom connection factory, and
              >set MessagesMaximum to 0, default is 10), as the pipe-line is unsorted
              >and consequently messages will not "jump ahead" of each-other in the
              >pipe-line.
              >
              >> Or do you have to create a
              >> message selector to dequeue based on priority?
              >
              >No.
              >
              >>
              >>
              >> Is the an appropriate use of JMSPriority or should I set-up dedicated
              >> JMS queues for each of the different workload types?
              >
              >The latter, as long the app can tolerate concurrent execution of all
              >workload
              >types due to having an MDB per queue. The latter will perform better
              >than selectors,
              >and you won't have to worry about the unsorted pipe-line.
              >
              >>
              >>
              >>
              >> Cheers
              >>
              >> Simon
              >
              >Tom, BEA
              >
              

  • Best way to monitor the ON time of something in a minute ?!

    Greetings everybody,
    I first have to thank everybody offers help to others here.
    I have a question regarding the Best way to monitor the ON time of something in a minute.
    Say I have an On/Off switch that I want to know how many seconds that it was ON in the last minute (say) .. and reports that to a file or database each minute. So every minute I send a report to the DataBase with the number of seconds the switch was ON in the last minute.
    I already made a solution, But it's not that good I think and there is a problem there .. Please check my VI as it describes the solution more than my words here.
    Any comment is appreciated.
    Thanks in advance.
    Ayman Mohammad Metwally
    Automation Engineer
    Egypt - Cairo
    Attachments:
    On timet.vi ‏127 KB

    Hello Ayman,
    I attached a changed version of your vi. It uses two parallel loops.
    The communication is made via local variable and controled by a flag.
    Just have a look to get the idea.
    You can do the communication also on different ways like queues...
    Best regards,
    GerdW
    CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
    Kudos are welcome
    Attachments:
    OnTime 2.vi ‏37 KB

  • What is the best way to update the delivery time?

    Hi All,
    One of the tasks I have in my job is to updste purchase orders with information found in the orderconfirmation we receive. In the order screen, ME22N, you can change the date in the item, where you have all positions listed. But you can also change it in the tab classifications.
    What is the best way to update the delivery time?
    Best Regards
    Praveen

    Hi
    It may userfull to you
    If you change the delivery date after you have send the PO, then the statistical delivery date is still containing the old delivery date., as long the order is not send this date is changed together with the delivery date.
    Vendor evaluation is performed based on statistical delivery date.
    So if you are responsible for a date change, then you change both dates, that the vendor does not get bad points. but if the vendor cannot deliver at the wished dates, then you change the delivery date only, that all people in your company and MRP run can rely on the new delivery date, but your vendor is evaluated against the old date, because of his fault.
    regards
    Madhu

  • Would MobiLink be the appropriate tool for syncing servers which collect near real-time data?

    I have a situation which appears to be similar to the some MobiLink configurations, but with only a few large clients.In my case, there would be 5 to 10 remote clients (each with SQL Anywhere) and a central database. Administration and configuration would be done mostly from the central database, but each client also includes a near real time data collection application. The customer would like to have that data available in the consolidated database. In the worst case, there could be about 50MB of data received from each client in a burst each 15 minutes. Fortunately the consolidated site doesn't have a tight time constraint, its data could be up to 15-30 minutes behind. The clients don't need (or want) to see each other's collected data.
    I would like to know if MobiLink would be a good choice for this situation. The only other viable alternative I've found so for is the keep the collected data at the remote clients and access it only on demand. And naturally, there's no money in the project for an enterprise level solution.
    FYI: My company has on OEM license for SQL Anywhere.  We usually just have an application with SQL Anywhere at each site to collect data from the local equipment. This project is for a Fortune 500 company that want's to be able to monitor everything from the corporate office.
    John

    Hi John,
    You should start writing down a few numbers including network speed and hardware specifications of client and server machines. In the worst scenario, you would have 15 clients synchronizing concurrently 750 MB of data in 15 minutes. And on top, there is your real time data collection application that could work while the synchronization is in progress.
    You should also workout, how many connections to the consolidated database you will have in addition to Mobilink server and if these connections can create contentions.
    The key factors influencing Mobilink performance are listed here DocCommentXchange
    and you can tune the performance (more details in the link below)
    DocCommentXchange
    DocCommentXchange
    Mirco

  • Best way to setup ATV with Time Capsule?

    I just got an ATV for Christmas and I'm looking for the best way to set it up. I keep all my movies and music on my Time Capsule and have my iTunes reference it on my MacBook. When I first hooked up the ATV it only recognizes my media half the time and takes a rediculous amount of time loading any video. Does anyone have any suggestions on a better way to do this? If I connect a network car from my time capsule to ATv will this speed things up? Any info is appreciated.

    The Time Capsule still has to talk to the iTunes Host over the network so actually yes the faster gigabit speed still does come into play. So one point to you too.
    In my opinion though, the Time Capsule disk sharing feature lacks in speed because the processor in the Time Capsule is slow compared to using a real computer and that's true for almost any NAS device. Also, the Time Capsule is designed to put the hard drive to sleep way more often than on a computer so you often have to wait until the hard drive spins up when you want to use it.
    If it is at all possible, use a USB hard drive externally attached directly to your computer for best performance if you need more storage. The NAS solution wasn't fast enough for me either so I switched to hanging a hard drive off my desktop Mac and have been happy ever since. Of course, if you use a laptop this won't be as practical of a solution.
    Then again, I just realized you said it takes a "ridiculous" amount of time so that sounds more like a network issue than anything else. If you are fine with how long it takes for your Macbook to stream media attached to your Time Capsule then the Apple TV shouldn't be that much different.
    Message was edited by: newagemac

  • What is the best way of creating a one-time backup using DPM 2012R2?

    Hello,
    Due to some severe tape issues, we have lost a lot of our long-term storage data.
    I schedule a recovery point on our servers every Friday, once a week.  We retain this data for the 64 weeks (the maximum amount of versions DPM allows.)
    Management needs me to put one recovery point from each month to tape (preferably from the beginning of each month.)
    From the DPM console, I have been manually searching each server and running a recovery job from each "short term" recovery point we still have in the system.   I am recovering this data to a large disk array that I'm using as a staging
    area.  My intention is to take this data and put it onto tape using DPM and leave it there forever (20 years.)
    Since the space on the array is limited, I can only recover a few months at a time before having to delete the recoevered data to make way for the next group.
    The way DPM works it seems you must have a protection group for every backup job you run;  so if I have to repeat this process 8 times, I'll end up with 8 different protection groups all assigned to the host running the staging array.  NOTE: 
    the host running the staging array will be wiped in the near future.
    What would be the best method to carry this task out ?
    This forum post is similar, but doesn't address all these additional groups created:
    https://social.technet.microsoft.com/Forums/en-US/f379740c-4507-4a82-b275-c95e3e968b57/dpm-2012-r2-perform-one-time-backup?forum=dataprotectionmanager
    Any assistance would be welcome!
    Matthew J. Fazio

    Hi,
    What you can do is protect the staging server by using a single share - lets call it STAGING for simplicity.
    Perform your first set a restores and restore to the staging share, you can create meaningful subdirectories one for each data source you are restoring.  
    Now protect the STAGING share using DPM - protect using long term to tape only, Frequency yearly, and set retention policy for 20 years. 
    Perform an ad-hoc backup (right-click the data source and create recovery point to tape)
    When that completes, delete the sub-directories under the staging share and then repeat the process of restoring more data then backing up the same share.  When you are all done, you can remove the protection group, but maintain the tape backups
    so they will be available for restores. 
    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT]
    This posting is provided "AS IS" with no warranties, and confers no rights.

  • What is the best way to set up my time capsule with Existing Uverse

    Hello,
    I have read through some of the threads regarding the co-existence of Uverse and a time capsule. But it all seems very advanced to me. Here is what I'm wanting to do.
    I currently have Uverse. I have the box in my living room attached to a wall outlet, via Ethernet. I have 3 TVs, all with Uverse boxes. Wirelessly, I have several devices connected to the Wifi at any given time. An iMac, 2 iPads, a MacBook Air, 3 iPhones, Apple TV, an XBox and 2 smart TVs.
    So my Uverse Wifi pretty much stinks. It's not bad right in the livingroom where the box is, but in my bedroom and office it's pretty poor. When I try to watch Apple TV in the bedroom I end up watching a lot of spinning as it waits to connect:(
    I was told at the Apple Store that a time capsule could help with that in addition to creating a back up of my computers. Excellent! So I purchased it. But here is my issue. My main iMac, the newest computer with the most up to date software, is in my office. But my Uverse equipment is in the living room with the TV. So do I have to hook up an Ethernet cable to both the Uverse AND my computer from the Time Capsule? Because they are rooms away from each other:( Is ther any way someone can take me through this step by step like setup for dummies?:) I would be so grateful!
    Thanks!!

    So do I have to hook up an Ethernet cable to both the Uverse AND my computer from the Time Capsule?
    I'm not sure that I understand everything that you want to do and where devices will be located.
    The Time Capsule must connect to the "main" Uverse router using a permanent, wired Ethernet cable connection. An Ethernet cable can be run up to 300+ feet with virtually no loss, so you should be able to locate the Time Capsule wherever you want.....unless you have a very large estate.
    If you want the Time Capsule to strengthen the wireless signal provided by the Uverse router, then the Time Capsule must be located in the area where you need that additional signal strength.
    If I understand your post correctly, you plan to install the Time Capsule in the office? When you do this, you can configure the Time Capsule to create a wireless signal that uses the exact same wireless network name and password as the Uverse wireless network.
    That will provide a much stronger signal for your Uverse wireless network in the office area. Hopefully, the bedroom that you mention is close to the office, so it will pick up the stronger wireless signal from the Time Capsule.
    The iMac in the office can connect to the Time Capsule using another short Ethernet cable connection, or the iMac can connect using wireless.  A wired connection is always preferred, if possible.
    At this point, I guess the first question would be.......
    Do you have a location for the Time Capsule that will be close to the office....and...the bedroom where you want a stronger wireless signal?

  • Best way to implement a countdown timer for a turn based LCCS game

    Hello,
    I am trying to build a turn based game and sketching out the high level map, so I can focus my efforts towards the direction I should be digging.
    One thing I have not seen much in the sample apps is how a turn based game is best handled.
    For example, a countdown timer. Should it be a shared property? Or a Baton which is supposed to manage workflows and has a timeout property?
    Or, should I forget those two, and time this on the server, although if it would become popular keeping track of all the times in the rooms would cost an arm and leg. Would love to hear some best practices on this.

    good idea.
    Which one or all of them?
    Once you eliminate the impossible, whatever remains, no matter how improbable, must be the truth. - "Sherlock holmes" "speak softly and carry a big stick" - theodore roosevelt. Fear leads to anger, anger leads to hate, hate leads to
    suffering - Yoda. Blog - http://www.computerprofessions.co.nr

  • Best Way to Connect my REAL electric guitar to my computer? Please Help

    Anyone know how to Connect my REAL electric guitar to my computer? Please Help, thanks!

    HippeeBoy wrote:
    Anyone know how to Connect my REAL electric guitar to my computer? Please Help, thanks!
    http://www.ikmultimedia.com/stealthpedal/features/
    I'd previously purchased the Stealthplug by IK and really liked it. I wanted a wah/volume and got the Stealth Pedal. The current promo going through the end of December is a 4 for 1 special. If you by a qualifying product from IK, you will receive free downloads of IK Software. The free downloads are not partial or limited version of IK stuff but +full versions+.
    http://www.ikmultimedia.com/NewsDisplay.php?Id=2373
    For instance, I bought the Stealth Pedal packaged with AmpliTube Metal for $199. Once I registered the software and pedal, the registered user area you now have access to as a registered IK customer makes available the full software version of other IK stuff. For me, I downloaded AmpliTube Jimi Hendrix, Ampeg SVX and AmpliTube 2. Each full version is worth about $200 ( http://www.sweetwater.com/c707--IKMultimedia--Virtual_Instruments_Guitar_andBass ).
    So, anyway, a good deal for lots and lots of amps and an interface. I've had the Stealthplug since March and just got the pedal last week so I'm still breaking that in. However, very sturdy feeling and worked very well.
    Sure, it's $200 but you get tons of amps and I have to say (so far), they sound pretty good too. I haven't been through all of them much less even started on the Ampeg Bass stuff but I'd still be comodrtable considering myself an IK fanboy.....

  • How to carry out real-time or near real-time alerts?

    I just wonder when the source audit data transfer to audit vault server, does it done by Refreshing the Warehouse , or another process? Refreshing the Warehouse seems only normalize the raw audit data into the data warehouse. And can we control the frequency of transfering source audit data from soucre to audit valult server ?

    I was traced into transfering audit data from source to audit vault server, and found that it's very quickly to get the new audit data from source db into the audit vault server's table named avsys.av$rads_flat, it's almost realtime, but I have no idea about which process has done this, which process? how to control the frequecy ?
    Although the server has gotten the new audit data into the avsys.av$rads_flat, the warehouse still cann't get the new audit data whatever I refreshed the warehouse via Audit Vault Console or using command "avctl refresh_warehouse -wait" until 24 hours later. user579967 seems has the same problem, it really frustrated me. Is there anyone knows how ?

  • Outbound message in Near Real Time - in CC&B V2.1

    Greetings,
    In CC&B V2.1, I am trying to send an outbound message from CC&B to an external Webservice.
    The process was as follows:
    1-Configured a Business object based on F1-OUTMSG Maintenance Object
    2-Create a new outbound message type based on the previous BO
    3-Created a new XAI sender with based on "OUTMSGSNDR" XAI class with HTTP URL pointing to the external webservice
    4-Created a new external system and linked the outbound message type to it.
    5-Created a plug-in script to insert a record into table F1_OUTMSG after forming the XML message
    Now when the records are inserted into F1_OUTMSG, the default XAI Receiver (F1OUTNNDMSG based on XAILOCAL executer ID) shipped with the system is failing with a "Null pointer exception".
    I am supposing when a record is inserted into table F1_OUTMSG with Pending status, the receiver will pick it and send it to sender specified in the external system configuration.
    Where did I go wrong in the above process?
    Thanks in advance
    AK

    Hi,
    Thanks for the response. I applied the change, but still same error happens when I refresh the Receiver.
    Where could other configuration error be?
    Thanks

  • Best practice for real time requierement

    All,
    I am trying to find out what is the best practice for reporting against real time data ?
    is it while using
    1 - webi against universe/bex query on the top of hybrid cubes ?
    2 - Crystal report directly against the ECC data ?
    3 - using another solution such as Data Fedrator ? or something different ?
    I am looking to know if anyone got such req and also to share their experience 
    did they get some huge challenge against hybrid cubes ?
    Thanks in advance for your help
    Philippe

    Well their first requierement was to get real time data .. if i am in Xcelsius and click refresh then i want it to load my last data ..
    with live office , i can either schedule a crystal report and get the data delayed or use the option from live office to make iterfresh as right now .. is that a correct assumption ?
    I was talking about BW, just in case they are willing to change the requierement to go from Real time to every 5 min
    Just you know we are also thinking of the following option:
    1 - modify the virtual provider on the  CRM machine to get all the custom fields needed for the Xcelsius Dashboard
    2 - Build some interactive report on the top of these Virtual Provider within CRM
    3 - get the link to this report , it is one of the Report feature within CRM
    4 - design and build your dashboard on the top of it
    5 - EXport your swf file to the cRM web ui
    we are trying to see which one is the best one
    Philippe

  • Best way to Replace OLD Time Capsule with a new one

    What is the best way to replace an old Time capsule with a new Time Capsule in an existing wireless network?

    IMHO..
    Start over..
    Put the new TC in place and configure .. completely differently to the old one. That means you have to go around and reset everything to connect if you use wireless.. and you should forget all the old configuration beforehand.
    You can of course try and slip it in using identical names and identical settings.. but the computers are not fooled.. the BSSID is different. And other issues tend to arise.
    Use naming that is short, no spaces and pure alphanumeric.
    See Pondini post C9 here.
    http://pondini.org/TM/Troubleshooting.html
    It may take more time to start with.. depending on how many devices you have.. but in the end, you can get much less problems out the other side.. which are extraordinarily hard to diagnose and fix..
    But that is IMHO.. others are welcome to dispute that and may find a full swap using old settings copied to a file and copied back to the new TC work fine.
    There are any number of posts around about doing just that.
    I will post one if I see it..
    I do confess to being a bit of a purist when it comes to this stuff.. but then I used to do computer support and trying to fix the messes people got themselves into .. inevitably they tried to cut corners.. instead of doing the setup from scratch.

Maybe you are looking for

  • DNG Profile Editor: Can't create profile from JPG file

    Guys, could you tell me why DNG Profile Editor fails to create color table using 4 colored circles ? It says "Unable to check white balance using gray patches. Please use the four color circles to identify the four corner patches of the chart and try

  • Problem using getCurrent() and setCurrent()

    In the following code snippet: public class MyMidlet extends MIDlet {    public void startApp() {       Display.getDisplay(this).setCurrent(new Form("")));       System.out.println("" + Display.getDisplay(this).getCurrent())); }my application prints

  • Panasonic PV-GS180

    Video camera not on the capture device list. This is a DV camera and Elements should run this from the capture window. Is there a driver for this camera I can download? Thanks! Jeff

  • Keep getting a restart warning!

    On a 1.5GB MBP, I have recently got the "You need to restart your computer'  warning which comes on a message with 5 languages on a slowly dropping tinted backdrop over the whole screen. I think it happened while on 10.5.8 once yesterday, and ironica

  • How Do I Use Secondary Addresses in Code?

    I'm using the dpib32.pas library and none of the code examples I've come across clue me in as to how the secondary GPIB address comes into play. I'm not sure how to even set it for a communication since the Send call refers to one address: procedure