Data replication in real time
For security reasons, we have two Oracle 9.i database servers (Windows Server 2003 as O/S):
We have a database server A in our internal network, which is our Intranet, too.
We have a database server B, out of our Intranet but in our internal network, which can be accessed through Internet and any Internet user with a certain password can insert, update or delete records.
Both database servers A and B have the same structure, but their data is different. Database A can be accessed from our Intranet and its records can only be updated for our Intranet users. Database B is only available for Internet users (out of our Intranet) and they also can update its records.
**We need that both databases have the same data at any time.**
Is it possible to REPLICATE in real time both database servers? Is there any set up or configuration that we must follow to achieve that?
Thanks in advance!
If you want absolute transactional consistency, you have to have one system go down if the other goes down. You can configure multi-master replication to replicate data synchronously, but that requires that the two databases participate in the same distributed transaction, so any commit will incur the overhead of the two-phase commit protocol. If either one of the databases cannot commit the transaction, the transaction could not be committed.
Most folks go with an asynchronous replication scenario, since that allows the two databases to be very closely aligned data-wise, has a lower overhead, and does not have the same availability limitations.
I would strongly advise against it, but you could build your own replication system that attempted to repeat the transaction on the other system and, if it failed, queued the request until the other system was available. Theoretically, this would allow you to have a transactionally consistent system when both databases were up and to allow one system to continue processing if the other were down. Practically, though, I wouldn't consider this a viable approach unless the alternatives were hugely unsatisfactory, you have gobs of cash, time, and programmers to throw at the problem, and you are willing to deal with significant administrative headaches for the next few years as you go through the first few releases.
Justin
Distributed Database Consulting, Inc.
http://www.ddbcinc.com/askDDBC
Similar Messages
-
Can we use the AdventureWorks2008R2 data for the real time project.
Hi,
In our project we are trying to do the data scrambling on First name, last name and middle name...
In the regular practice we use to update the names as
First Name = FN+<PERSON_SNO>
Last Name = LN+<PERSON_SNO>
Middle Name = MN+<PERSON_SNO>
The Problem is the names are not looking realistic, so I thought of applying some logic and updating our PERSON table names based on Person.Person table in adventure works.
My question is can we use the AdventureWorks2008R2 data for the real time project. Is there any cop right issue.
Someone please help me solve this issue.
Thanks
Karthikeyan Jothi.Please read this link content:
Adventure Works Sample Site
sqldevelop.wordpress.com -
RMAN in active data guard with real time apply ON without a catalog DB
I would like to know whether I can take RMAN backups (both level 0 & incremental) in active data guard with real time apply ON without a catalog database. version is 11.2.0.3.2. Will it make difference in the control file of standby syncing with primary? Can I use these backups on primary to restore and recover the database(including control file backup)?
Thank you very much msberg. Could you please answer the below queries as well?
Should I cancel Real Time Apply before starting RMAN?
Will it make difference in the control file of standby syncing with primary? Is it possible to use these backups on primary to restore and recover the database(including control file backup)? If possible, how will I do that? -
How to read updated data from a real-time generated file?
I have a question:
I want to read the 10 mostly updated data from a real time generated data file. The data in this file is accumulated. how can i read mostly recently data to an applet? and further to using this data to draw a real-time graph? pls help
kelvin t.l. tseHi,
I think there is no "typical" way. You will have to define a convention on how the new data are stored into the file, so as to know how to accessthem. If new data are simply put at theend of your file, you may use a RandomAccessFile to read only those lines that interest you (the 1 final lines).Otherwise, you should at least know how the data file is written.
You can know if thedata file has been modified with the File.lastModified() method. This retrurns a long value corresponding to the date and hour the file was last modified. Store that value ito you appl. and perdiodically (use a Thread), compare that value with the value returned by lastModief(). If both value are NOt equal, then the file has been updated
it's all a question of knowing how the data are stored into the datafie generated.
Be also aware that you will probably have problem when your java appl. tries to read the file at the same time it is updated by the other application. I guess when theother application writes data into the file, you will not be able to read it. So, use try{} catch statements and first check to see if you can read the file with File. canRead(). If not, simply delay the reading process by asking a Thread.yield() or Thread.delay (1000)...
vincent -
Reading data from the Real-Time Infocube
Hi,
I am using the FM RSDRI_INFOPROV_READ_RFC to read the data from the Real time Infocube..
But it reads only the Closed request. Is there anyway to read the open request data from real-time infocube via program.
Please suggest.
Regards,
MeiyHi,
I would assume that the function module can read the data only if its available for reporting.
May be you can try the following: You can close the request during the function module execution time and then reopen it. Not sure if this is possible.
Bye
Dinesh -
How can I extract the data from a Real-time Execution Trace ".log" file?
I would like to get the data for the traces from the Real-time Execution Trace toolkit ".log" file to read in Excel and generate a report.
Hi Chuck,
Have you tried reading it into a text or binary file first and then generating a report using the Report Generation VIs?
Ipshita C.
National Instruments
Applications Engineer -
Error while data loading in real time cube
HI experts,
I have a problem. I am loading data from a flat file.The data is loading correctly till the DSO but when i am trying to load it into the cube it is giving an error.
The cube is a real time cube for PLANING. I have chnaged the status to allow data loading but still the DTP is giving an error.
It shows an error "error while extracting from DataStore" and some RSBK 224 ERROR and rsar 051 error.What was the resolution to this issue. We rae having the same issue only with external system (not a flat file). We get the RSAR 051 with a return code of 238 error message, like it is not even getting to the rfc connection (DI_SOURCE). We have been facing this issue for a while and even opened up a message with SAP.
-
SQL server, data retrieval in real time?
Hi, I am trying to write a simple java program that will connect to a SQL database and retrieve inputted data. Ideally, I would like it to be outputted in some format, possibly string.. XML, it really doesn't matter to me. I really would like it to be in real time though (ie. when new data is inputted, the data is immediately outputted to the screen). Could someone point me in a direction? I am not really that good with programming, some sample code would be helpful. Thank you in advance.
Well, to start with, the programmer at the user interface end, can tweak their code a little, but in reality, you are not going to impact the function of the DB very much unless you have adm rights in the DB and can do opimizations on it according to what your users need--such as indexes and physical ordering data.
That said, your going to JDBC to connect to the DB or the JDBC/ODBC bridge. Look up the form and optimizations of sql select queries for your choosen DB. -
How to replicate data between Oracle db and SQL server dbs in real time?
Hello,
Anyone has idea that what tool we can use to do data replication in real time between Oracle and SQL sever or Oracle and Sybase or Sql server and Sybase?
This is topic is brought by a project manager?
I only know Oracle to Oracle dbs by streams or GoldenGate.
Thanks
JerrySince GoldenGate's bread and butter was (and is) replicating data between heterogeneous data sources, and since Oracle has purchased GoldenGate, that would seem like a natural place to start.
Beyond that, it depends on the architecture you want and how you define "real time." Just about any ETL tool on the market, whether Oracle's ODI or OWB or any number of third party products (Informatica, DataStage, etc) can handle "trickle feeds" from various data sources to a database target of your choosing. Different tools will have different sorts of integration with the source database, many will require that a bunch of triggers are created to track changes on the source systems.
If you want Oracle to control the replication process (which doesn't really make sense if we're talking about replication from a non-Oracle database to another non-Oracle database), you can use the Oracle Transparent Gateway products to create database links from Oracle to the non-Oracle databases and query data on the source database periodically.
Justin -
Error "cannot load request real time data targets" for new cube in BI 7.
Hi All,
WE have recently upgarded our SCM system from 4.1 to SCM 7.0 which incorporated BI 7.0.
I am using BI 7.0 for first time and ahve the following issue:
I ceated a new infocube and data source of flat file and succesfully created transformation, and Data Transfer Process. Everything looked fine. I added flat file and checked preview and could see data. Now when I start job to load data in infocube the follwing error is shown "cannot load request real time data targets".
I checked cube type in setting in infcune is shows as Standard. When I doube clicked on error the following message showed up
You are trying to load data into a real-time InfoCube using a DTP.
This is only possible if the correct load settings have been defined for the InfoCube.
Procedure
In the object tree of the Data Warehousing Workbench, call Load Behavior of Real-Time InfoCube from the context menu of the InfoCube. Switch load behavior to Transactional InfoCube can be loaded; planning not allowed.
I did not understand what it is meant and how to set changes. Can someone advice and follow me through.
Thanks
KVHi Kverma,
Real-time InfoCubes can be filled with data using two different methods: using the transaction for entering planning data, and using BI staging, whereby planning data cannot be loaded simultaneously. With Real time cube you can select the method you want to use for update as
Real Time data Target can be loaded With Data; Planning not allowed &
Real Time data Target can be Planned; Data loading not allowed
You can change this behaviour by right clicking on cube and selecting Change real time load behaviour and select first option. You will be able to load the data then
Regards,
Kams -
How can I save/write data on the hard disc of the Real-Time System?
I would like to acquire huge size of data via LabView Real-Time System.
Since data is so huge, I am now thinking that it might be good idea to
write/save data on the hard disc of the Real-Time System first and then
transfer the data file to a data processing PC using FTP etc.
If you know how to save/write data on the hard disc of the Real-Time System
(Ver. 7.1), please let me know.
Thanks,Just to add to Aitortxo's good answer,
Since you have only one Drive ( C:\) on your RT, just keep monitering the availible disc space.
After every few set of file writes keep transferring Backups delete these files, so that you keep C:\ drive space for running your applications.
Regards -
Inserting Data from Oracle to SQL Server on the Real Time Basis.
Hi Everyone,
I need to insert data from Oracle to SQL Server on the Real Time basis, we have to fetch data from oracle approx 20 tables, and each table has more than 30 Fields. I need to fetch data in every 15 mins.
I have created a job using SQL SERVER Agent by writing insert queries for all the tables with conditions that no rows will be inserted which is already in SQL. note that this job is taking only 1 min to execute.
But in this way our SQL Server getting hanged and it giving problems to other application running in the SQL SERVER.
So i m requesting all of you that what is the best way to insert huge amount of data on the real time basis.
Thanx in Advance.1) Create Linked server
2) insert data using openquery and set job in sql agent
3) run job after 15 minutes -
RDA(real time data aquasation)
can anyone pl. tel me how the process goes in RDA(real time data Aquasation) means no steps internally.
Hi,
Real-Time Data Acquisition u2013BI 2004
Real-time data acquisition supports tactical decision-making. It also supports operational reporting by allowing you to send data to the delta queue or PSA table in real-time.
You might be having complex reports in your BI System, which helps in making decisions on the basis of data of your transactional system. Sometimes (quarter closure, month end, year ending...) single change in the transactional data can change your decision, and its very important to consider each record of transactional data of the company at the same time in BI system as it gets updated in the transactional system.
Using new functionality of Real-time Data Acquisition (RDA) with the Net Weaver BI 2004s system we can now load transactional data into SAP BI system every single minute. If your business is demanding real-time data in SAP BI, you should start exploring RDA.
The source system for RDA could be SAP System or it could be any non-SAP system. SAP is providing most of the Standard Data Sources as real-time enabled.
The other alternative for RDA is Web Services, even though Web Services are referred for non-SAP systems, but for testing purpose here I am implementing Web Service (RFC) in SAP source system.
Eg will be a production line where business wants information regarding defective products in the real time so that production can be stopped before more defective goods are produced.
In the source system, the BI Service API has at least the version Plug-In-Basis 2005.1 or for 4.6C source systems Plug-In 2004.1 SP10.
Refer:
Real-Time Data Acquisition -BI@2004s
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
http://help.sap.com/saphelp_nw2004s/helpdata/en/42/f80a3f6a983ee4e10000000a1553f7/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3db14666-0901-0010-99bd-c14a93493e9c
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3cf6a212-0b01-0010-8e8b-fc3dc8e0f5f7
http://help.sap.com/saphelp_nw04s/helpdata/en/52/777e403566c65de10000000a155106/content.htm
https://www.sdn.sap.com/irj/sdn/webinar?rid=/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
Regards
Tg -
WHAT IS REAL-TIME DATA ACQUISITION AND
WHAT ARE REAL TIME QUERIES AND
DEAMON UPDATE AND HOW DO WE EXTRACT AND LOAD DATA
Please Explain in detail.....
regards
GURUHi,
Real-Time Data Acquisition BI 2004s
Real-time data acquisition supports tactical decision-making. It also supports operational reporting by allowing you to send data to the delta queue or PSA table in real-time.
You might be having complex reports in your BI System, which helps in making decisions on the basis of data of your transactional system. Sometimes (quarter closure, month end, year ending...) single change in the transactional data can change your decision, and its very important to consider each record of transactional data of the company at the same time in BI system as it gets updated in the transactional system.
Using new functionality of Real-time Data Acquisition (RDA) with the Net Weaver BI 2004s system we can now load transactional data into SAP BI system every single minute. If your business is demanding real-time data in SAP BI, you should start exploring RDA.
The source system for RDA could be SAP System or it could be any non-SAP system. SAP is providing most of the Standard Data Sources as real-time enabled.
The other alternative for RDA is Web Services, even though Web Services are referred for non-SAP systems, but for testing purpose here I am implementing Web Service (RFC) in SAP source system.
Eg will be a production line where business wants information regarding defective products in the real time so that production can be stopped before more defective goods are produced.
In the source system, the BI Service API has at least the version Plug-In-Basis 2005.1 or for 4.6C source systems Plug-In 2004.1 SP10.
Real-Time Data Acquisition -BI@2004s
http://help.sap.com/saphelp_nw2004s/helpdata/en/42/f80a3f6a983ee4e10000000a1553f7/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3db14666-0901-0010-99bd-c14a93493e9c
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3cf6a212-0b01-0010-8e8b-fc3dc8e0f5f7
http://help.sap.com/saphelp_nw04s/helpdata/en/52/777e403566c65de10000000a155106/content.htm
https://www.sdn.sap.com/irj/sdn/webinar?rid=/library/uuid/230d95df-0801-0010-4abb-ace1b3d197fd
Thanks,
JituK -
How to write data from query into Real time cube?
Hi All,
Can anyone explain me step by step how to write data into a real time cube from front end queries.
Thanks in advanceHi
You can do this using Integrated Planning
You need to create a aggregation level on the Real Time infocube and can create Planning function/sequence, Variables if needed.
Then you can create query on this aggregation level and you can make the keyfigures Input ready in property pane and you can change the data and save it into cube.
Please find below help link which clearly explains step by step about Integrated Planning like creating input ready queries etc.,
http://help.sap.com/saphelp_nw70ehp1/helpdata/en/43/0c033316cd2bc4e10000000a114cbd/frameset.htm
Regards
Ravi
Maybe you are looking for
-
hi folks Any one know of any db package that takes sql and puts xml tags around it like the XMLELEMENT in 9i. I am working on 8i db. Cheers Tappies
-
Text Frame Auto-Size bug? Right margin changes?
Here is a rounded textbox with an inset of 4, vertical align center. I'm turning Auto-Size on, so the right edge grows as the text in the box gets longer. Width only, adjust only the right edge (that alignment UI is messed up BTW if any Adobe UX peep
-
Problem opening Canon 5D Mark II raw files
Adobe support has started a case file #181481276 on my problem. I recently had my hard drive replaced so I had to reload my photoshop elements 7. It wouldn't open the Canon 5D Mark II raw files so I downloaded the latest raw plug-in 5.5 for PSE 7.
-
How does the JFileChooser checks file permissions?
how to check whether the given folder is having read access or write access. So as to through exception if the folder is having read-only access.
-
I updated my iphone 4 4.3.3 and after updating my phone id not opening
i updated my iphone 4 version 4.3.3 and after updating its not opening plz tell me what to do