Regarding REFRESHING of Data in Data warehouse using DAC Incremental approa

My client is planning to move from Discoverer to OBIA but before that we need some answers.
1) My client needs the data to be refreshed every hour (incremental load using DAC) because they are using lot of real time data.
We don't have much updated data( e.g 10 invoices in an hour + some other). How much time it usually takes to refresh those tables in Data wareshouse using DAC?
2) While the table is getting refreshed can we use that table to generate a report? If yes, what is the state of data? Stale or incorrect(undefined)?
3) How does refresh of Fin analytics work? Is it one module at a time or it treats all 3 modules (GL, AR and AP) as a single unit of refresh?
I would really appreciate if I can get an answer for all the questions.
Thank You,

Here you go for answers:
1) Shouldn't be much problem for a such small amt of data. All depends on ur execution plan in DAC which can always be created as new and can be customized to load data for only those tables...(Star Schema) ---- Approx 15-20 mins as it does so many things apart from loading table.
2) Report in OBIEE will give previous data as I believe Cache will be (Shud be) turned on. You will get the new data in reports after the refresh is complete and cache is cleared using various methods ( Event Polling preferred)
3) Again for Fin Analytics or any other module, you will have OOTB plans. But you can create ur new plans and execute. GL, AR, AP are also provided seperate..
Hope this answers your question...You will get to know more which going through Oracle docs...particular for DAC

Similar Messages

  • Data Warehouse using MSSQL - SSIS : Installation best practices

    Hi All,
              I am working on a MSSQL - 2008 R2 , based data warehouse building.  The requirement is to read source data from files, put it in stage database and perform data cleansing etc .. and then move the
    data to data warehouse db .. Now the question is about the required number of physical servers and in which server which component (MSSQL , SSIS ) of MSSQL should be installed based on any best practices:
    Store Source files --> Stage database --> data warehouse db
    The data volumne will be high ( per day 20 - 30 k transactions) ... Please suggest
    Thank you
    MSSQL.Arc

    Microsoft documentation: "Use a Reference Architecture to Build An Optimal Warehouse
    Microsoft SQL Server 2012 Fast Track is a reference architecture data warehouse solution giving you a step-by-step guide to build a balanced hardware...Microsoft SQL Server 2012 Fast Track is a reference architecture
    data warehouse solution giving you a step-by-step guide to build a balanced hardware configuration and the exact software setup. 
    Step-by-step instructions on what hardware to buy and how to put the server together.
    Setup instructions  on installing the software and all the specific settings to configure.
    Pre-certified by Microsoft and industry hardware partners for the most optimal hardware and software configuration."
    LINK:
    https://www.microsoft.com/en-us/sqlserver/solutions-technologies/data-warehousing/reference-architecture.aspx
    Kalman Toth Database & OLAP Architect
    IPAD SELECT Query Video Tutorial 3.5 Hours
    New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

  • Can UCP(Utility Control Point) and MDW(Management Data Warehouse) use together?

    Hi,
    Can a server join a MDW and UCP at the same time? It seems that after i enrolled a instance which has joined a MDW, the collection data uploaded to UCP data warehouse only.
    So can UCP use exist MDW data directly?
    thanks.

    Hi mark.gao,
    UCP system uses the Data Collector feature from SQL Server version 2008.
     If you’ve implemented the Management Data Warehouse feature in SQL Server 2008, you’ll either have to break that relationship and start pointing that data to your UCP instance, or you won’t be able to monitor it with this utility.
    When enrolling an instances in UCP that is already using MDW, the UCP enrollment routine will change all the collections to go to the sysutility_mdw. 
    We could change the collection set to send data, including UCP data to our MDW database , the UCP utility on the manager would not see the MDW database. So in personally, UCP not use the MDW data directly.
    Thanks,
    Sofiya Li
    Sofiya Li
    TechNet Community Support

  • Can one build a data warehouse using SQL rather than Warehouse Builder?

    I would like to build a data warehouse purely using SQL statements. Where can I find the data warehouse extension of SQL statements?

    I am exploring the internal workings of Warehouse Builder.
    I have written a SQL script to generate sample data to be inserted into tables, then write SQL script to do Extraction, Transformation and Loading using MERGE,, GROUP BY CUBE, DECODE, etc.
    If anyone has any experience of just using SQL to perform ETL, would you share your expeience here? Thanks.

  • Query regarding refreshing grid data when returned from  a different Task Flow

    Hi Experts,
    JDEV version used is :11.1.1.5
    Our application uses dynamic UI shell tabs.
    Whenever the user logs in he is taken to the TAB A.
    From TAB A, user navigates to TAB B.
    The TAB B has a GRID B(table with some records ).
    Column A on TAB B has a hyperlink which when clicked will open up a different task flow in a different tab.
    The click on column A's hyperlink for different rows will open different TF's (based on some conditions).
    On clicking the hyperlink the _launchActivity(String title, String taskflowId, boolean newTab) method is used which open the TF in a new tab.
    User works on the TF( on a new tab) which was opened on click of the Column A's hyperlink and clicks on SAVE.
    On click of save  some operation is performed and removeCurrentTab method is called which will close the current tab and the control goes to first  tab(TAB A) .
    The problem:
    Once the user tries to click or come back to to TAB B the GRID B is never refreshed as we are unable to get the handle to refresh the grid data.
    Any suggestions would be highly appreciated.
    Thanks,
    Vikranth

    Hi Experts,
    JDEV version used is :11.1.1.5
    Our application uses dynamic UI shell tabs.
    Whenever the user logs in he is taken to the TAB A.
    From TAB A, user navigates to TAB B.
    The TAB B has a GRID B(table with some records ).
    Column A on TAB B has a hyperlink which when clicked will open up a different task flow in a different tab.
    The click on column A's hyperlink for different rows will open different TF's (based on some conditions).
    On clicking the hyperlink the _launchActivity(String title, String taskflowId, boolean newTab) method is used which open the TF in a new tab.
    User works on the TF( on a new tab) which was opened on click of the Column A's hyperlink and clicks on SAVE.
    On click of save  some operation is performed and removeCurrentTab method is called which will close the current tab and the control goes to first  tab(TAB A) .
    The problem:
    Once the user tries to click or come back to to TAB B the GRID B is never refreshed as we are unable to get the handle to refresh the grid data.
    Any suggestions would be highly appreciated.
    Thanks,
    Vikranth

  • ETL for Data warehouse - use view instead of transformations?

    When populating staging tables, is anyone else using this approach of using a view - as opposed to transformations within your ssis dataflow ?  I had not thought of this approach, but I suppose it results in the same goal - to get the wanted schema
    for data flowing into the destination.  I suppose it would be just a matter of using the view as your source - as opposed to the underlying table(s), followed by transformations before the destination?

    Hi sb,
    I would say that it depends.  You want your load to be efficient and your want your load to be simple and easy to enhance later.  Sometimes these goals can be conflicting, so you need to decide what's important for your implementation.
    Regarding efficiency, you will typically be better off with a view as the filtering, lookups etc will be done at source, so less data transferred to your staging area.  For example, the view might only ask for 12 of 25 columns in a source table, so
    you will be bringing over, perhaps, half the amount of data.  Another example, your view might join two tables at source, while another design option would bring over all of the larger table and perform a lookup (on the smaller table) for each record
    of the larger table.  This could be extremely inefficient if each lookup went back to source.
    Regarding easy enhancements, in the first example, if you bring over all 25 columns, you might find it easier to add one of the, as yet, unused 13 columns.  Regarding the second example above, with views, there is a risk that a new view will be created
    for new requirements, resulting in multiple views importing overlapping data.  You really only want to import each datum once, with no duplication.  Note; duplication is unlikely if the views are essentially one view per logical table in the source
    system.
    I've sat on the fence a bit answering this question, but it really does depend, and it is a big question.  What you need to do is understand the ramifications of the design you implement.  Having qualified my response, I very often use views to
    perform simple 1:1 mainipulation of the source data.
    Hope that helps a little,
    Richard

  • Alert data is not present in SCOM 2012 Data Warehouse database since two weeks

    Alert data is not present in SCOM 2012 Data Warehouse database since a week though I could see Performance data for the latest dates. Old Alert data is present but I think the latest Alert data is not being inserted to Data warehouse. No activity was done
    on the day from where we are missing data.
    I could see 31554 events on all my Management servers and this proves that Data Insertion is happening. I am not sure why only Alert data is missing (or not getting inserted) in DW database. I am trying to use SQL queries to fetch the data as I dont have reporting
    currently. The same query is working for other dates, so there is no issue with this query.
    I have noticed that I could see the Alert Data present in SCOM OperationsmNager Db but NOT present in OperationsManagerDW database.
    In SCOM 2007, data will be inserted in both Ops DB and DW simultaneously. I believe the same methodology in 2012 too.
    Please help me to fetch Alert data from DW. Any suggestion pls?
    Regards, Suresh

    Hi,
    Generally, data warehouse store a long-term data, and by default, it would keep 400 days data, I suggest check your configuration:
    How to Configure Grooming Settings for the Reporting Data Warehouse Database
    http://technet.microsoft.com/en-us/library/hh212806.aspx
    Alex Zhao
    TechNet Community Support

  • Data Warehouse performance since changing retention settings?

    Hi,
    I dont know if its a coincidence but I have managed to get into a bit of a state with regard to our data warehouse.
    Firstly when the server was specced I dont think anybody actually worked out what size the databases would work out to be. I have started troubleshooting initially because of a lack of disk space. The DW was set to the defaults of 400 days etc and had grown
    to around 700GB. Our operations DB is around 50GB in size. The disk at this point had around 50GB of space left.
    Anyway I did some work on the retention in the DW to knock a lot of stuff down to say 9 months as needed. A week later and the data is now 500GB although the physical size is still 700GB.
    Now I dont know if its coincidence but in the last couple of days I am getting performance alerts such as not being able to  store data in the DW in a timely manner, failing to perform maintenace and visual indications that things have slowed down on
    the DW. For example an SLA report for the month for all servers now times out when before it ran in a few minutes.
    So I am wondering if the "blank" space in the DW is now causing issues as there is data at both ends of the database perhaps. I would like to get this blank space back but no expert on SQL and wondering if any other considerations needs to be taken
    for SCOM "to get this back".
    I also understand that perhaps more disk space is required for the actual grooming so maybe I need to get down to 6 montghs of data before this can happen.
    The performance part may not be tied to the issue but I guess either way I would like to get the space back if possible
    thanks

    There are sereval causes
    1) check any events or performance collection which generate a hugh DB and DW size by using the following SQL query in
    http://blogs.technet.com/b/kevinholman/archive/2007/10/18/useful-operations-manager-2007-sql-queries.aspx
    2) You can also refer to the following post
    http://deploymentportal.blogspot.ru/2012/08/operations-manager-data-warehouse.html
    3) check SQL logs on the datawarehouse, especially for blocking problems
     Also, check Disk IO on the data warehouse (the windows mp collects these metrics). If it affects all Management Servers and the message does say "timeout" then the problem is likely to be at the SQL end. It may not be maxed out by CPU or Memory but
    there are likely to be other bottlenecks on the SQL box. What is the Disk Queue for disks that the operations manager data warehouse data and log files reside? These are on seperate physical disks aren't they??
     My guess is that it is a SQL issue .... temporary timeouts suggest that SQL is busy  doing something else. And I'd tend to concentrate my thoughts on Disk IO rather than memory or cpu.
    Roger

  • Connect to MS SQL Server 2000 data warehouse

    Hi,
    I use a MS SQL Server 2000 database for my web application where I use JSP. I suppose to create data warehouse using MS SQL Server's Data Transformation Service. But I don't know it's possible to connect to a MS SQL Server's data warehouse using JSP. So I want to know is it possible to connect to data warehouse using JSP and if it is how to do it? Thank you.

    You can certainly connect to M$ SQL Server using the JDBC driver:
    http://www.microsoft.com/downloads/details.aspx?FamilyID=4f8f2f01-1ed7-4c4d-8f7b-3d47969e66ae&displaylang=en
    Connecting to a data warehouse is no different from any relational database. (My understanding is that a data warehouse usually means a star schema implemented in a relational database.) This will connect you.
    If you're not familiar with JDBC, you might need the tutorial:
    http://java.sun.com/docs/books/tutorial/jdbc/

  • Only Alert Data is not being inserted in SCOM 2012 Data Warehouse database

    Hi All,
    Alert data is not getting inserted into SCOM Data Warehouse database since 10 days though I could see latest Performance data in DW DB.  No changes were made as far I know on SCOM servers or DB's. I had this issue few months back
    and got resolved by executing a qiery to create an entry for Data Warehouse Synchronisation server entry.
    Now I have checked the discovered inventory and could see an entry present and it is healthy. Still, latest Alert data is not getting inserted into DW DB. Please help me out.
    http://social.technet.microsoft.com/Forums/en-US/2dac4f45-4911-40dc-a220-702993188832/alert-data-is-not-present-in-scom-2012-data-warehouse-database-since-two-weeks?forum=operationsmanagergeneral
    Regards, Suresh

    Hi,
    Generally, data warehouse store a long-term data, and by default, it would keep 400 days data, I suggest check your configuration:
    How to Configure Grooming Settings for the Reporting Data Warehouse Database
    http://technet.microsoft.com/en-us/library/hh212806.aspx
    Alex Zhao
    TechNet Community Support

  • Unable to register my data warehouse in Service Manager

    I have been trying to register my data warehouse but keep getting the same error message each time - "Invalid URI:  the hostname could
    not be parsed."  I know the issue is on the ServiceManager database side of things, but there is not a lot of information related to this error message and the info I do find is unrelated to ServiceManager.  I have gone as far as building a
    brand new data warehouse server and reinstalling all of the data warehouse databases from scratch.  It doesn't matter if I tried to register with the original data warehouse environment or the new environment, I get the same error message.  I also
    received a powershell command from Microsoft Support to help clean up any residual entries in the ServiceManager database that might be left over.  At this point I'm at a loss on how to proceed.  Anyone ever run into this issue?
    Here's the event log message:
    Unable to register Service Manager installation with Data Warehouse installation.
     Data Warehouse Server: DW_SCSM
     Service Manager Management Server: FlowSMRC
     Exception: Microsoft.EnterpriseManagement.UI.Core.Shared.PowerShell.PSServiceException: Invalid URI: The hostname could not be parsed.
       at Microsoft.EnterpriseManagement.UI.Core.Shared.PowerShell.PSHostService.executeHelper(String cmd, Object[] input)
       at Microsoft.EnterpriseManagement.UI.Core.Shared.PowerShell.PSHostService.Invoke(String cmd, Object[] input)
       at Microsoft.EnterpriseManagement.ServiceManager.UI.Administration.DWRegistration.Registration.DWRegistrationHelper.AcceptChanges(WizardMode wizardMode)
    Also, I tried registering the data warehouse using powershell Add-SCDWMgmtGroup and get an error saying that Cannot associate Service Manager installation on scsm_server with Service Manager Data Warehouse installation on dw_server.

    Just got additional information about this error. If you run the following query in SQL pointing to the ServiceManager database you should see the name of the Management Server.  The query is:
    select * from MT_Microsoft$SystemCenter$ResourceAccessLayer$SdkResourceStore
    There is a column named Server_<some GUID> that should contain the Management Sever NetBIOS name.  If it has some other name, run an update query to ensure the column has the NetBIOS name of the Management Server.  Restart the SCSM Console
    and retry the Database Registration again and it should succeed.
    Microsoft has said that this is normally caused by either moving the database or database server to another server and the value is never updated.
    Try registering the DW Server again and see if you have better luck.

  • Default dates for Data Warehouse

    We are currently building a data warehouse using Oracle 9i. We need to have values for default low dates and high dates eg to store in a closed date field for rows not closed. Any recommendations? The defaults must work correctly in tools such as Access and Business Objects.

    From my point of view such limits depend totaly of the business case.
    What I have seen several times is that the 1.1.3000 is used as upper limit. I never saw, for dates, anything like a lower limit.
    Which is your need of having a lower date?

  • Missing Zip - OBE 9i2, Data Warehouse

    All the downloads work except 8.7 - Where is the file?
    8 Build a Data Warehouse for Business Intelligence
    8.1 Setting Up the Data Warehousing Environment
    8.2 High Speed Data Loading and Rolling Window Operations
    8.3 Using the ETL Infrastructure of Oracle9i
    8.4 Using Basic Database Functionality for Data Warehousing
    8.5 Using Oracle9i Materialized Views
    8.6 Using Oracle Data Mining to Predict Behavior
    8.7 Using the OLAP Analytic Workspace
    8.8 Creating a Data Warehouse using Oracle Warehouse Builder
    8.9 Implementing Relational Business Analysis with SQL
    8.10 Analyzing Business Information

    Please try the following link:
    http://otn.oracle.com/products/oracle9i/htdocs/9iober2/obe9ir2/download/obe-dwh_olap.zip

  • ISSUE:regarding production version tab of MRP4 of  data transfer using BD10

    Hi all,
    This is regarding production version tab of MRP4 of  data transfer using ALE idoc (BD10).
    When i transfer the data using BD10 the production version is received at receiving end through segment
    but not created in MRP4 view tab.An error is coming as-
    "You wanted to maintain the master record of the material AB_06.04.09(2). However, it is already being processed by the user EBGABAP and is therefore locked."
    I logged in as-EBGABAP
    Please help me resolve the issue.
    Thanks
    Edited by: sanu debu on May 6, 2009 11:08 AM
    Edited by: sanu debu on May 6, 2009 11:09 AM
    Edited by: sanu debu on May 6, 2009 11:11 AM

    >
    sanu debu wrote:
    > Hi,
    > I have to upload production version tab data of  MRP4 view(MM01).Please suggest a function  moduleor bapi  for the same.
    >
    > Thanks.
    >
    > Edited by: sanu debu on May 6, 2009 3:24 PM
    BAPI_MATERIAL_SAVEDATA can be used, populate the respective fields in input parameter PLANTDATA

  • How to convert number datatype to raw datatype for use in data warehouse?

    I am picking up the work of another grad student who assembled the initial data for a data warehouse, mapped out a dimensional dw and then created then initial fact and dimension tables. I am using oracle enterprise 11gR2. The student was new to oracle and used datatypes of NUMBER (without a length - defaulting to number(38) for dimension keys. The dw has 1 fact table and about 20 dimension tables at this point.
    Before refining the dw further, I have to translate all these dimension tables and convert all columns of Number and Number(n) (where n=1-38) to raw datatype with a length. The goal is to compact the size of the dw database significantly. With only a few exceptions every number column is a dimension key or attribute.
    The entire dw db is now sitting in a datapump dmp file. this has to be imported to the db instance and then somehow converted so all occurrences of a number datatype into raw datatypes. BTW, there are other datatypes present such as varchar2 and date.
    I discovered that datapump cannot convert number to raw in an import or export, so the instance tables once loaded using impdp will be the starting point.
    I found there is a utl_raw package delivered with oracle to facilitate using the raw datatype. This has a numbertoraw function. Never used it and am unsure how to incorporate this in the table conversions. I also hope to use OWB capabilities at some point but I have never used it and only know that it has a lot of analytical capabilities. As a preliminary step I have done partial imports and determined the max length of every number column so I can alter the present schema number columns tp be an apporpriate max length for each column in each table.
    Right now I am not sure what the next step is. Any suggestions for the data conversion steps would be appreciated.

    Hi there,
    The post about "Convert Numbers" might help in your case. You might also interested in "Anydata cast" or transformations.
    Thanks,

Maybe you are looking for