Persistent Staging Area
We have a concept of a Persistent Staging Area (PSA) which functions very similar to a Type II SCD.
There is a couple of minor exceptions.
1. No Surrogate Key (the key for the table is the Natural Key and a SCD Starting Time Stamp)
2. We keep a Previous Begin Date to allow a developer to travers history
The lack of a SK does not seem to be a problem, using the existing SCD KM, but the Previous Begin Date is. There is no type to select when defining the column. Is there a way to create my own SCD column types? If so where is this done?
Thank you,
Troy
I'm quoting the ODI doc there.
When accessing an object properties through Oracle Data Integrator' substitution methods, if you specify the Flexfield Code, Oracle Data Integrator will substitute the Code by the flexfield value for the object instance.
For instance:
<%=odiRef.getTable("L", "MY_DATASTORE_FIELD", "W")%> will return the value of the flexfield MY_DATASTORE_FIELD for the current table.
<%=odiRef.getSrcTableList("", "[MY_DATASTORE_FIELD] ", ", ", "")%> will return the flexfield value for each of the source tables of the interface.
It is also possible to get the value of a flexfield through the getFlexFieldValue() method.
You find sometimes good things in the doc :-).
-FX
Similar Messages
-
Oracle 8.1.5 Invalid Staging Area Error
I get an error message: Invalid staging area. There is no top level components for Windows NT available for installing
from this staging area. I installed this version successfully running win98, but i get this error with XP. I tried renaming the symcjit.dll
as suggested in some of the earlier posting with no success. Any help is appreciated.
Thanks,
Willcopy disk to hardrive in a temporary directory. go to properties for setup.exe (right click on file used to install oracle). Select the compatiblity tab. make sure the check box "run this program in compatibility mode" is checked. In combo box select windows 98.
-
We have a column on the source table which contain a person's country information. A single country name could be represented in different formats (for e.g. United States of America, USA, U.S.A). The target database has a table which stores the equivalence mapping for all these different possibilities (i.e. United States of America, USA, U.S.A are mapped to "USA")
We plan to have a design like this
Step 1. Load the country column to the staging area
Step 2. In the staging area, lookup the equivalences table, identify the country name and populate it on the staging area
Step 3. Transfer the data into target table.
The point where we have discussion is the Step-2. What would be an efficient way of resolving the equivalences and how we proceed in this step.
Any thoughts/suggestions on what would be a good or bad design here ?Hi,
Let me try to help...
If I understood right you can achieve that in just one interface by check the join between the column "country" and the table where the all possible match are at staging area, it means:
1) create an interface
2) drag and drop all souce tables plus the table where are the countries are, from target.
3) drag and drop the "final" target table at target position
4) create a join between the "target countries tables" and "person table" by "country" column and check it to be executed at Staging Area.
Does it make any sense to you?
Cezar -
How to print staging areas and doors on the pick doc. ?
Dear experts!
Thank you for your attention!
In our system, we use Lean WM.
We know staging areas and doors can aslo be printed on the pick doc. How to do that?
Best regard!
TangdarkI'm not a WM expert, but am pretty sure nothing special is required for that. If the fields, where this information is stored, are used by the output processing program and the data is passed to the form and then printed by the form, there should be no problem. If data is there, but it's not printed, then you might need to adjust the output program and/or form.
You might want at least to try it first and use Search whenever possible, then come back with more specific questions, if necessary. -
Hi,
We have got media DVDs for R12.1.1 for Linux X86 from Oracle. We copied in the server one by one using cp command.
Ans now when we are starting staging creation using these copied DVD's from server, it's giving
Invalid Disk is inserted.
Please insert DVD labeled Oracle Applications Rapid Install - of Rdbms Disk 1
We removed STARTCD part initially which was staged properly using OS rm command.but when it was asking for second DVD it failed due to unavailability of 2nd DVD path
We copied all DVD's into /do1/R1211dump folder
Please advice on how to create staging area
Regards,Hi,
Yes.
Also this is being executed by root user .
And when using oracle user, even though DVD dump folder is owned by oracle user
we are getting following error:
cannot unlink file for /tmp/staging/adautostg.pl: Permission denied at adautostg.pl line 365
cannot restore permissions to 0100777 for /tmp/staging/adautostg.pl: Permission denied at adautostg.pl line 365
cannot unlink file for /tmp/staging/RapidWiz.ini: Permission denied at adautostg.pl line 365
cannot restore permissions to 0100744 for /tmp/staging/RapidWiz.ini: Permission denied at adautostg.pl line 365
cannot unlink file for /tmp/staging/File/NCopy.pm: Permission denied at adautostg.pl line 365
cannot restore permissions to 0100744 for /tmp/staging/File/NCopy.pm: Permission denied at adautostg.pl line 365
cannot remove directory for /tmp/staging/File: Permission denied at adautostg.pl line 365
cannot remove directory for /tmp/staging: Operation not permitted at adautostg.pl line 365
Failed to copy RapidWiz.ini to /tmp/staging
The log file is located at /tmp/10311250/adautostaging.log
and
$ cd /tmp/staging/
$ ls -l
total 100
-rwxrwxrwx 1 root root 71841 Oct 31 12:50 adautostg.pl
drwxr-xr-x 2 root root 4096 Oct 31 12:26 File
-rwxr--r-- 1 root root 24329 Oct 31 12:26 RapidWiz.ini
$
Not sure how to proceed now.. -
Staging Area - Sans Transformations?
I am struggling to come up with a proper term for a database that will contain untransformed application data. This would be an EL process what will pull application data from the source, and insert it into the "staging" area. A
subsequent job will perform the ETL process into the data warehouse. The goal for this area is to have unaltered application data to use as the source for our ETL processes, where we will not have to deal with the retention policies associated with the
actual application data.Often Staging in a data warehouse is permanent and long-term. If you purge the Staging area you have to make sure that all needed information is making it into the Data Warehouse. If you leave the data in Staging it's available for validation
and to support design changes in the Data Warehouse.
Also I'm seeing more direct access to this raw area of the DW, as "Big Data" workflows are gaining popularity and complementing more traditional approaches to analytics. Broadly, in "Big Data" the analyst/end-users get access
to raw source data quickly, and then do the transforms and reporting together as part of an ad-hoc analysis.
David
David http://blogs.msdn.com/b/dbrowne/ -
Staging area for Management Agent files...?
Sorry for another question so quickly - I am reading the documentation first!
Management agents upload files to the OMS server, and these are parsed and loaded as data into the MR database, right?
Where is the staging area for these files (upload from all the management agents)? Is it possible to change it? From what I can gather it's
https://oms_server:1159/em/upload - but where is this in the real world? I've searched the OMS $ORACLE_HOME, but can't find any uploaded files
The reason for these questions is because we have a requirement to load these files to a shared area so that both our OMSes can access them - has anyone come across a configuration like this before? Does it work?
Many thanks (again!)
DThe upload area on the OMS would normally be <OMS_HOME>/sysman/recv.
You still might find no data files over here, as they may be uploaded to the OMS on that moment.
Yes, making this directory a shared location ,will work when running multiple OMS.
Regards
Rob -
Hi,
I am trying to install OEM agents thru run installer. but it says "staging area needs Oracle universal Installer version 10.2.0.0.0 or later", we are on we are on 10.1.0.5.0. How to download 10.2.0.0.0 or later.
Regards# From Metalink click on "Patches & Updates” tab
# Select "Advanced Search”
# Enter "Universal Installer” under Product or Product Family
# Select "Oracle 10.2.0.0.0” release (Or higher)
# Select your Platform
# Change "Patch Type” to Any
# Change Classification to Any
# Click on Go -
Staging area for inserts only?
If our DW will only over contain inserts, do we require a staging area?
Hi DarrenOD,
I personally like to put data in staging area before loading it to the Data Warehouse.It will give flexibility of debugging and very much needed when you have restricted time slot for data extraction from OLTP.
Following URL explains "Why do we need Staging Database"
http://www.dwbiconcepts.com/etl/27-basic-etl-concepts/137-why-do-we-need-staging-area-during-etl-load.html
Prathy
Prathy K -
Staging area error and universal installer does not run
Everything was ok. I installed Oracle 9i r 2, AS 9.0.2, iFS 9.0.2.
Then I uninstall AS and iFS. But AS folder remains there (with inventory,contentsXML.. folder inside), even if I deleted it, when I tried to install AS again I get the error staging area error, and the folder appears again.
Another thing is that in oracle universal installer the installed and deinstall products options do not do anything. I only can select the install option
Did I do something wrong during the AS uninstall?
What Can I do now?
Thanks for your help,Try looking here:
http://www.thomasfly.com/Oranux/#Step-by-step
follow these steps/configs and the install will go quite nice! -
Staging area different from target
I am using oracle 10g as target database. I want to upload a flat data file into oracle table.
I uploaded sucessfully using LKM Oracle (SQL Loader) in Interface. In this case i am using oracle database as a staging area. So all load transferred to my database at the timing of processing.
I want to create staging area at my file server. So please help me out to resolve this problem.A staging area must accept SQL syntax.
A File server won't accept SQL syntax.
So if you speak about Physical Server where you got your file and if there is a RDBMS installed in maybe but else I don't really know how you can...
You can specify another data server for your staging area or use the SUNOPSIS_MEMORY_ENGINE which use the cache I think but it's not optimized I think...
For this in the Definition Tab of your Interface choose Staging Area different from the Target and then select in the list box SUNOPSIS_MEMORY_ENGINE. -
Hello friends,
Can anyone give the exact physical Staging Area structure for 11.5.9 on both Windows and LINUX.
Thanks in advance.Below is the stagging area on how to start oracle application installation 11.5.9 window platform.
On Linux u need to create the stage area as well but need startcd and path to the link below to start in Linux .
BEST OF LUCK
Stage11i\StartCD\Disk1\rapidwiz -
Staging Area with OWB 10.2 - necessary or not?
Hi to all,
I have read so much about Staging Area and OWB 10.2 that I am totally confused: Some documents and powerpoints in the web say you do not need one, others say you need one. The thing is I am planning a DWH and now I am not sure if a staging area is necessary or not, because the mappings do the ETL jobs internal so I am not sure about the staging area. Most of my data sources are Tables/Views/MViews in a database.
Thank you very much for any help concerning this question!
Regards
ThomasWould you prefer the answer that you MAY need one? Then again, you may just WANT one!
For example, if you are building against a high transaction volume, busy 24/7 OLTP system then you may find that you need a local snapshot in order to do a complete build with a consistent set of source data for all your numbers to be consistent.
Then again, you also may just find that bringing over just delta data into a local snapshot makes for much more efficient load rather than running against huge full remote tables if they are not well partitioned and/or indexed.
Then again, complex joins run against a remote system may run more efficiently if you bring the data across with simple table dumps into a staging area that you can index to optimize your queries rather than have to deal with poor performance of complex joins over a dblink. Especially if you need to perform complex joins accross more than one db link to multiple source source systems. How big a cartesion product do you want bouncing around the network to perform that sort of scenario? Sure, maybe you can do it - but how much are you going to impact performance across the boards doing things like that?
Is the source system already stresed to the max and sitting on a vintage piece of equipment, but your shiny new DW environment is blessed with tons of resources that will make the ETL run faster by several factors if you first copy the data over locally?
So, do you need a staging area?
Fact is that there is no generic correct answer to this question.
You have to look at the specifics of your data requirements and your environment to answer that question. There are costs and benefits to having a staging area, and you have to determine which way the cost/benefit analysis comes out for your specific project.
Mike -
hi..friends.
should staging area and target area be same or different???
if same what are the advantages and dis-advantages???
and if not same what are the advantages and dis-advantages????
I want your help..
Thanks.Staging area is the place where transformation takes place.
Basically c$,I$ tables gets created at this place and once processing is done , the same gets dropped .
By defalut staging area and traget area are the same . But most of the DBA does not like to have the temp tables created at the target as this cause dbms performance, maintance issue in long term.
Instead you can have a dedicated schema created just for staging and use the same in your interface.
Plus when your target is non dbms then you need to go for a dedicated staging area which can be a separate schema in your database or it could be in memory schema. You will find performance issue if you are using in memory schema as your staging area in case the data volume increase.
Thanks,
Sutirtha -
Staging area different from target - which KM???
Hi,
I need to transfer data from CSV to DB (only new inserts operation)
I am working the following KM's
LKM File to SQL
IKM SQL Control Append
It's working fine. However now i need to keep the staging area (where C$, I$ etc table are created) in a separate schema.
I have created a diff schema for staging area and selected in the interface "Staging area different from target"
However not sure of which KM's to use.
Please let me know how to achieve this.
Thanks,
RoshHi
1st thing you have to give the workschema for temp tables when creating physical schema in dataserver for target.
Then you have to select the workschema in overview of interface as "staging different from target".
After doing this when you will use predefined KM for the interface it will create temp tables in workschema.
Now suppose you are not giving the workschma at the time of creating physical schema and you have selected "staging different than target" in interface.Here your C$ table will be created in your workschema but I$ table that is used by IKM is going to be created on target schema.So for this again you have change the IKM KM i.e. where to create I$ table (wokrschema) by selecting the corresponding logical schema.
So its better you give the workschema at the time of creating physical schema.
Here is the query to give privilege by the sys_dba
Grant create any table to ODI_TEMP.
Hope you got it
(Please mark the answer as correct or helpful and close the thread)
Thanks
Maybe you are looking for
-
To remove the block created by TOP_OF_PAGE event in ALV
hello All, i have added some code to modify the subtotal in ALV and that code has been added in the TOP_OF_PAGE event of the ALv . and in that case , a blank block is added on the top of the ALV that is consuming almost one third space of the scree
-
Support for Malayalam language
I wish to buy a Mac. Whether there any support for Malayalam language there? If so which unicode version is using?
-
How does workflow retrieve users under an org. unit when sending email
Dear All: Workflow supports sending email activity where you can specify the receipt type and receipt ID. For example, the email is supposed to send to the users within an organizational unit. I am just wondering how SAP workflow determines the users
-
Disco -- Any analytical functions for comparisons
Hi: I'm wondering if there are any analytical function to help me out with comparisons? Users often need to displays totals based on date ranges, and show the difference between the two totals, as well as percent change. For example, a workbook would
-
I want to change screenshot location from my Solid State hard drive with OSX on it, to my 2nd storage hard drive, how do I do this? I am aware of "defaults write com.apple.screencapture *location*" but I want to change the location to my 2nd drive wh