I need options for data replication within production db and dimensional db

Hi,
I'm looking for options on how to solve this issue. We've 2 databases, one is our production, operative database, used by around 400 users at a time, and another one, which is our dimensional model of the same info, used to obtain reports. We also have a lot of ETL's (extract, transform and load) processes running every night to update the dim model.
Mi problem is that we have some online reports, and nowadays, we're getting data from the operational database, causing a performance issue in online operations. We want to migrate this reports to the dimensional model, and we're trying to find the best options for doing this.
Options that we're considering are ETL's process running continuously every XX minutes, materialized views, ETL's on demand, and others.
Our objective is to minimize performance issues on transactional database.
We're using Oracle 8i (yes, the oldie one) and Reporting Services as report engine (reports just run a pkg to get data).
Any option is welcome.
Thx in advance.
Regards,
Adrian.

The best option for you if the performance is the
most important is ORACLE STREAMS. Also is the most
complex but the final results are very goodsAgreed. As User12345 points out, though, that requires Oracle 9.2 or higher.
Another option is the materialized views with Fast
Refresh , that need the materialized view logs in
the master site.
The first load is expensive but if you refresh each
15 minutes the cost is not high.I'd be careful about making that sort of statement. The overhead of both maintaining materialized view logs (which have to be written to synchronously with the OLTP transactions and which impose an overhead roughly equivalent to a trigger on the underlying table) and doing fast refreshes every 15 minutes can be extensive depending on the source system. One of the reasons that Streams came about was to limit this overhead.
For refresh i execute a cron shell that run the
DBMS_MVIEW.REFRESH package. my experience with group
refresh not was goodWhat was your negative experience with refresh groups? I've used them regularly without serious problems. Manual refreshes of individual materialized views against an OLTP system would scare the pants off me because you'd inevitably end up with transactionally inconsistent views of the data (i.e. child records would be present with no parent record, updates that affect multiple tables would be partially replicated until the next refresh, etc). Trying to move that sort of inconsistent data into a different data model, and trying to run reports off that data, would seem highly challenging at a minimum. Throwing everything into a single refresh group so that all the materialized views are transactionally consistent, or choosing a handful of refresh groups for those tables that are related to each other, seems like a far easier way to build a system.
Justin

Similar Messages

Best option for data replication

Hello:
II am trying to understand the pros of cons of using snapshots, materialized views or replication to maintain data concurrency between a primary table and its copy in another database.
In addition, there are tables dependent on this copy in the other database.
1. Using materialized Views: Use this to keep the two tables in sync. Have triggers on this materialized view to handle inserts/updates/deletes to the primary table.
My question is if I do a full refresh, does it drop all the rows and reinsert? In that case, would it fail due to referential integrity? For instance, if a row is deleted in the primary table and if that row is referenced in the dependent tables, it would fail, wouldn't it?
2. Is Snapshot an option? I still have the same question as above.
3. If 1 and 2 are not options, do I have to replicate the data?
Thanks for your advice.

You can have triggers on a materialized view (or on the table that is the source for the materialized view). It's relatively rare that you ought to have triggers on a materialized view, but it is certainly possible. If the goal is to have triggers that handle referential integrity, though, that can be rather dangerous in general.
I would tend to argue that a parent table and all its child tables ought to exist in a single database. Having a parent table in one database and child tables in another that refer to a materialized view, while possible, is a design that will generally overcomplicate life. If you mean that that there will be a parent table and child tables on the master site that will be replicated using materialized views on the destination site, then you'd just need a refresh group.
If you do a full refresh, the mechanism depends on whether the materialized view is in a refresh group. If it is, Oracle will delete all the rows and re-insert. If it is not, Oracle will truncate the rows and re-insert.
Justin

Select-options for date field.

Hi all,
i need to give select options for Date field.How can i give that.
Thanks & Regards
Ravi.

Hi Ravi,
Use the Component WDR_SELECT_OPTIONS to include select options in Web Dynpro ABAP. Follow these steps:
1. In your Component , "Used Componet" tab add Component WDR_SELECT_OPTIONS . Component Use can be any name that you want to give, eg SELECT_OPTIONS
2. Go to the View where you want to include the Date Select Options. I am assuming that you already have an Attribute of Type DATS in your context.
3. View: Properties Tab:Create Controller Usage and select
SELECT_OPTIONS     WDR_SELECT_OPTIONS
SELECT_OPTIONS     WDR_SELECT_OPTIONS     INTERFACECONTROLLER
4. View Layout Tab:Include a View Container. In this view container we will show the Date Select Options.
5. View Attributes Tab: Create Following two attributes:
M_HANDLER type IF_WD_SELECT_OPTIONS
M_WD_SELECT_OPTIONS type IWCI_WDR_SELECT_OPTIONS
6: View Methods Tab: Create a method eg CREATE_SELECTION_SCREEN. Call this method in the WDDOINIT of the view.
7:CREATE_SELECTION_SCREEN: Write following Code:
* Data Declaration
data:
        lt_range_table TYPE REF TO DATA.
data:
        lr_componentcontroller TYPE REF TO IG_COMPONENTCONTROLLER,
        lr_componentusage TYPE REF TO IF_WD_COMPONENT_USAGE.
* Execution
* Create Used Component
lr_componentusage = wd_this->wd_cpuse_select_options( ).
if LR_COMPONENTUSAGE->HAS_ACTIVE_COMPONENT( ) is initial.
    lr_componentusage->create_component( ).
endif.
* Get pointer to interface controller of select options
wd_this->M_WD_SELECT_OPTIONS = wd_this->wd_cpifc_select_options( ).
* initialize selction screen
wd_this->M_HANDLER = wd_this->M_WD_SELECT_OPTIONS->init_selection_screen( ).
* Create Range Table for: Date
CALL METHOD WD_THIS->M_HANDLER->CREATE_RANGE_TABLE
    EXPORTING
      I_TYPENAME     = 'DATS'
    RECEIVING
      RT_RANGE_TABLE = lt_range_table.
* Add Selection Field for: Date
CALL METHOD WD_THIS->M_HANDLER->ADD_SELECTION_FIELD
    EXPORTING
      I_ID                         = '<name of date attribute in the context>'
*      I_WITHIN_BLOCK               = MC_ID_MAIN_BLOCK
*      I_DESCRIPTION                =
*      I_IS_AUTO_DESCRIPTION        = ABAP_TRUE
      IT_RESULT                    = lt_range_table
*      I_OBLIGATORY                 = ABAP_FALSE
*      I_COMPLEX_RESTRICTIONS       =
*      I_USE_COMPLEX_RESTRICTION    = ABAP_FALSE
*      I_NO_COMPLEX_RESTRICTIONS    = ABAP_FALSE
*      I_VALUE_HELP_TYPE            = IF_WD_VALUE_HELP_HANDLER=>CO_PREFIX_NONE
*      I_VALUE_HELP_ID              =
*      I_VALUE_HELP_MODE            =
*      I_VALUE_HELP_STRUCTURE       =
*      I_VALUE_HELP_STRUCTURE_FIELD =
*      I_HELP_REQUEST_HANDLER       =
*      I_LOWER_CASE                 =
*      I_MEMORY_ID                  =
*      I_NO_EXTENSION               = ABAP_FALSE
*      I_NO_INTERVALS               = ABAP_FALSE
*      I_AS_CHECKBOX                = ABAP_FALSE
*      I_AS_DROPDOWN                = ABAP_FALSE
*      IT_VALUE_SET                 =
*      I_READ_ONLY                  = ABAP_FALSE
*      I_DONT_CARE_VALUE            =
*      I_EXPLANATION                =
      I_TOOLTIP                    = 'Select Date'.
8: To Fetch Data entered in the selection field, write following code on action of button click:
data:
        lt_date type REF TO DATA.
FIELD-SYMBOLS:
                 <fs_date> TYPE table.
* retrieve Date from Select Options
CALL METHOD WD_THIS->M_HANDLER->GET_RANGE_TABLE_OF_SEL_FIELD
    EXPORTING
      I_ID           = '<attrib_name>'
    RECEIVING
      RT_RANGE_TABLE = lt_date.
* assign Date Field Symbol
ASSIGN lt_date->* to <fs_date>.
9: Windows Window Tab: In the View Conatiner, embed the WND_SELECTION_SCREEN view from SELECT_OPTIONS component Usage of WDR_SELECT_OPTIONS component.
Regards,
Reema.

I need format for data in excel file load into info cube to planning area.

Hi gurus,
I need format for data in excel file load into info cube to planning area.
can you send me what should i maintain header
i have knowledge on like
plant,location,customer,product,history qty,calander
100,delhi,suresh,nokia,250,2011211
if it is right or wrong can u explain and send me about excel file format.
babu

Hi Babu,
The file format should be same as you want to upload. The sequence of File format should be same communication structure.
Like,
Initial columns with Characteristics (ex: plant,location,customer,product)
date column (check for data format) (ex: calander)
Last columsn with Key figures (history qty)
Hope this helps.
Regards,
Nawanit

I need sample basic data file containing Product,Market,Measures etc

I need sample basic data file containing Product,Market,Measures etc to load data in to Sample Basic applications. Where can I get this?

As I am the World Domain Lead for Sample.Basic (this is a joke, btw, it's sort of like being King of my front stoop, and besides, I just made it up) I will note two things about CALCDAT.TXT.
1) It is not in columnar format, but instead in Essbase free-form data load format as user2571802 notes. This means if you take a look at it with a text editor, it's a bit confusing to read till you realize that it contains all dimensional information in the data file itself. See the DBAG's section on [Data Sources That Do Not Need A Rules File|http://download.oracle.com/docs/cd/E10530_01/doc/epm.931/html_esb_dbag/ddlintro.htm#ddlintro1029529].
2) CALCDAT.TXT contains level 0 and calculated results. Just load it -- there's no need to calculate it.
Regards,
Cameron Lackpour

Need to build communication redundancy using serial RS-232 for Data Transfer b/w Host and RT irrespective of TCP/IP Data Transfer

Hi - I would like to build the logic in which it should accomodate the communication redundancy using serial RS-232 for Data Transfer b/w Host and RT irrespective of TCP/IP Data Transfer.
I want to do data transfer b/w host and RT through RS232 VISA portal whenever TCP/IP ethernet cable has been unplugged from the controller continuosly , it should keep on checking for TCP/IP link re-establishing also , when ever the tcp/ip link established again that time the communication should be using in that link only. This is accomplished by deploying the RT vi as execuatbale file. I made some logic regards to the above said logic , bur it was not working as much I expected.
I request you to go through the attached two VI's and let me know , what I did wrong in that,
Please do the needful.
Attachments:
TCP_Serial_Host.vi ‏33 KB
TCP_Serial_RT.vi ‏41 KB

even i am new to this topic and i am trying to get familiar with these protocols
refer to tcp server/client examples in labview examples

I have CS4 web Premium - I am trying to look at the Adobe Cloud option for the 2015 compable product. However...under my registered produst only Acrobate is listed...I also have the subject Adobe product. When I type in the serial # from the oriinal ad

I have CS4 Web Premium - I am trying to look at the Adobe Cloud options for the 2015 compatible products. However...under my registered products...only Acrobat is listed...I also have the CS$ Web Premium Adobe product. When I type in the serial # from the original Adobe CS 4 dvd's package I get a "product already registered"...but I can not find it's registration on any Adobe page and it doesn't show up under registered products on the Adobe Cloud page(s)
Since it's registered...how/where do I find this verification...
Thanks TRinAz
Message was edited by: Tim Rogers - spelling

You will have to contact support by web chat to figure out any such issues.
Mylenium

Select option for date

i want give default values in select option for date (for a period)
I used
SELECT-OPTIONS y_s_mnth FOR y_v_dt_month default first to last OPTION BT.
first and last are dates.
I am getting error dialog box....specify ranges...
Please give sample code..

Hi Suhas,
I hope this code will help you. Reward me if it is helpful.
select-options : y_s_mnth FOR sy-datum.
initialization.
y_s_mnth-sign   = 'I'.
y_s_mnth-option = 'BT'.
y_s_mnth-low    = sy-datum - 30.    "first_day
y_s_mnth-high   = sy-datum.         "last_day
append y_s_mnth.
clear y_s_mnth.
Regards,
Sagar

I need forum for beginner learner in inventory purchase and SCM modules

I need forum for beginner learner in inventory purchase and SCM modules

Saging,
Hmmm. It seems a bit odd to be creating a 'forecasting-of-material-procurement' tool, when SAP has so many already built in, either within ERP or within APO. Oh well, I am sure there must be a good reason.
I have seen from our systems that most loads come from APO going to BI. Is it always that way?
BI type data can come from any source. The most common BI solutions I have seen is where BI data are extracted from the main ERP. However, the beauty of BI is that it doesn't care, SAP builds in functionality to get data from anywhere.
Are data from ECC considered as well?
They can be if you design it so.
You should be aware that most data existing in ERP that are relevant for material planning also usually exist in APO. The Core Interface between ERP and APO is normally set up to natively replicate substantial quantities of Master data and also transactional data. It may be that in your business environment, you really don't need to connect to anything other than APO. However, this is not a limitation of BI, it is just smart programming to try to minimize the number of sources of your data.
Best Regards,
DB49

I want to buy a laptop for my study in college. I need it for web browsing, youtube, words, powerpoint, and light-medium photoshop. Should I buy rMBP 13" or MBA 13" ? Thx

I want to buy a laptop for my study in college. I need it for web browsing, youtube, words, powerpoint, and light-medium photoshop. Should I buy rMBP 13" or MBA 13" ? Thx

Either - if you need the 'ultimate' in portability, buy the Air. But whichever you buy, make sure that you max out the RAM and the storage as neither the Air or the Retina MacBook Pro are user upgradeable.
Clinton

Need API for EAM Active Association - Asset number and Asset Group

Hi
I am working in R12 and need api for EAM Active Association - Asset number and Asset Group to insert the new records.
If any one is aware please let me know API with sample script.
Regards
Suresh P

All APIs are listed in Oracle Integration Repository
http://irep.oracle.com/index.html
API User Notes - HTML Format [ID 236937.1]
R12.0.[3-4] : Oracle Install Base Api / Open Interface Setup Test [ID 427566.1]
Oracle Trading Community Architecture API User Notes, June 2003 [ID 241320.1]
Technical Uses of Customer Interface and TCA-API [ID 269121.1]
Pelase also check below:
Api's in EBS
Re: Api's in EBS
http://sairamgoudmalla.blogspot.com/2009/05/script-to-find-oracle-apis-for-any.html
API
Fixed Asset API
List of API
Re: List of APIs
Oracle Common Application Components API Reference Guide
download.oracle.com/docs/cd/B25284_01/current/acrobat/jta115api.pdf
List of APIs and open interface R12
Re: List of APIs and open interface R12
Regard
Helios

A question on different options for data archival and compression

Hi Experts,
I have production database of about 5 terabyte size in production and about 50 GB in development/QA. I am on Oracle 11.2.0.3 on Linux. We have RMAN backups configured. I have a question about data archival stretegy. To keep the OLTP database size optimum, what options can be suggested for data archival?
1) Should each table have a archival stretegy?
2) What is the best way to archive data - should it be sent to a seperate archival database?
In our environment, only for about 15 tables we have the archival stretegy defined. For these tables, we copy their data every night to a seperate schema meant to store this archived data and then transfer it eventualy to a diffent archival database. For all other tables, there is no data archival stretegy.
What are the different options and best practices about it that can be reviewed to put a practical data archival strategy in place? I will be most thankful for your inputs.
Also what are the different data compression stregegies? For example we have about 25 tables that are read-only. Should they be compressed using the default oracle 9i basic compression? (alter table compress).
Thanks,
OrauserN

You are using 11g and you can compress read only as well as read-write tables in 11g. Both read only and read write tables are the candidate for compression always. This will save space and could increase the performance but always test it before. This was not an option in 10g. Read the following docs.
http://www.oracle.com/technetwork/database/storage/advanced-compression-whitepaper-130502.pdf
http://www.oracle.com/technetwork/database/options/compression/faq-092157.html

Install oracle goldengate at ASM for data replication in RAC system?

Hi Experts,
We have 2 RAC server and each server have a 4 nodes RAC with 10R2 database in linux.
We will install oracle goldengate as data replication between two RAC servers.
Our database install on ASM in SAN box in linux
Based on Goldengate install requirement, 16. Set a shared driver that is accessed by each RAC nodes
and install goldebgate on shared driver.
As I understand, can we install goldengate on ASM that is shared by each node?
Or we MUST set up other shared driver ( NO ASM) for installation of goldengate.
Please advise me?
Thanks
Jim

http://www.oracle.com/technology/products/goldengate/10/whitepapers/ha-goldengate-whitepaper.pdf
This will answer your questions.

Remove option for Data Tracking and Drill Mode

Hi all
We have integrated a bunch of Webi reports into the SAP Portal. My question is now how to remove the options about Data Tracking and Drill Mode in the top right hand corner? I guess it is some special right we need to deny in the Access Level, we have defined. But if I deny data tracking and drilling in the Web Intelligence section of the Access Level, it has no effect.
Please assist.
Best regards,
Martin Søgaard

I, too, am perplexed by this change. Then again, I've been perplexed by most of the changes Apple has made to products/os in the last few years. I'm thinking that I may not only change browsers, but hardware/software also. It's issues like this that make me wonder if anyone on the Apple design team actually uses any of their products, or maybe they think we are all just too ignorant to be able to use a computer.
Making things simple to use shouldn't equate to removing advanced functionality, but it seems that's what Apple believes it to be.
Really disgusted now.
Thanks Apple.

Need Suiggestion forOracle data replication/integration/transfer strategies

Client OLTP database(Oracle 10g on Solaris) connected to a web based 'Point of Sale' system where some of their insurance related transactions(around 2000 per day) are stored. Most of their insurance related transactions are stored in a remote central system (accessible over the intranet).
Based on the net worth of a transaction, there is a requirement to either transfer the transaction real-time or batch it and send it across to a remote Oracle 10g(on Solaris) staging area(a part of the remote central system) and fire some stored procedures on the remote Oracle staging area to process the records transferred. Some amount of configurable data massaging would also be needed before firing the stored procedures on the remote Oracle 10g(on Solaris) staging area to process the records transferred. The outcome of the whole process also needs to be tracked.
Client is interested in automating this process to the extent possible using the various possible replication/data transfer strategies (dblink, datapump, etl, replication kit, MQ, xml/http etc.- pro's & con's) to do so taking into consideration the standard security and bandwidth related constraints.

Hi,
There are lots of solutions available
You can think and use the possible solutions for your scenarios.
1.) Data Pump Network Exports/Imports
http://www.oracle-base.com/articles/10g/oracle-data-pump-10g.php#NetworkExportsImports
2.) Data replication using DBMS_COMPARISON
http://nadvi.blogspot.in/2011/11/data-replication-using-dbmscomparison.html
http://www.bash-dba.com/2012/02/data-synchronization-replication-using.html
3.) Complete Schema Refresh using Data Pump
http://www.in-oracle.com/Oracle-DBA/DBA-I/schema-refresh-Data-Pump.php
4.) Oracle Golden Gate
5.) Oracle Streaming
Let you know if any query the same :)
Thanks
Hitgon

I need options for data replication within production db and dimensional db

Similar Messages

Maybe you are looking for