E$ table to be created in STAGING Area

Hello All,
I have an interface that has Staging Area different from TARGET. I have created an ODI Constraint in the target table in my model. Currently, when I run the scenario, the E$ table is created in the target database.
Because we are planning to use E$ for the tracking purpose for which the INtegration team would have access.
1) How can I force the E$ table be created in the ODI STAGING AREA (Database) rather than creating at the target database ?
2) What is the use of RECYCLING ERROR in IKM ?
Kindly clarify.
Thanks

Hi Nag,
Unfortunately a huge KM modification is necessary to accomplish this or divide in more than one interface (process). Let me try to explain:
An IKM Incremental Update create the I$ at target even when the stage area is another Logical Schema because it needs the target table to "decide" what records are to update and what are to insert.
Because of that, the internal the ODI algorithmic set the connections to the target once the I$ will be created there anyway.
To accomplish what you need it will be necessary to change the way that this kind of ETL is done and force the connections to the new staging area.
That is possible but will take some time.
An alternative solution, by process, could be;
1) make a copy of the target at staging area (if possible, I mean, if the amount of records allows it)
2) add 2 columns to this copy to flag the kind of dml (flg_ins, flg_upd for instance)
3) copy all desired constraints to the temporary table
4) use the same original interface but change the target to the temporary table.
5) at mapping check just "insert" to column flg_ins (value "Y" for instance)
6) at mapping check just "update" to column flg_upd (value "Y" for instance)
7) execute the interface
8) create a procedure with 2 steps:
9) step 1 - tab source: select all records from temporary table where flag_ins = 'Y'
- tab target; insert into original target
10)step 2 - tab source: select all records from temporary table where flag_upd = 'Y'
- tab target; update into original target
for the itens 9 and 10 will be necessary to choose the technology and respective Logical Schema.
If the amount of records at target doesn't allow this technique than:
Or will be necessary change the IKM
Or work with DBLINK from target to staging if both technologies are Oracle and to create a dblink will be possible. Any way IKM customization will be necessary, but a small one.
Does it make any sense to you?

Similar Messages

  • How do I create staging area after having copied Apps R12.1.1 DVD to disk

    Hi!
    I have copied all DVDs for Apps R12 to our filer. Now I would want to create the staging area using autostage.pl, but it only stages the startCD, then it asks me to insert the DVd named "Rdbms Disk1", but the DVD is already on the filer. Giving it the path to the copied DVd on disk does not work...
    I don't have access to the physical machines to mount the DVDs since the servers are in a hosted data center...
    Any ideas?
    Regards,
    Helmut

    Hi,
    I never tried this before, but you may try to pass the root directory name where all the media files were copied and see if it works. If this does not help, then I believe you need to create the stage area directory from the DVD-ROM drive.
    Oracle Applications Installation Guide: Using Rapid Install
    http://download.oracle.com/docs/cd/B53825_01/current/acrobat/121oaig.pdf
    Regards,
    Hussein

  • Staging Area Indexing

    We currently planing to build our staging area from source database (Oracle 11g database)
    So we decided to do 1 to 1 mapping for each table but there are some tables that contains huge data (millions of records) and for these tables we decide to do indexing to fasting the extraction using data services to our staging database but at the same time I think will affect the loading to staging area
    So my question is the indexes is recommended to be created in staging area?

    Hi Mohamed Anas,
    Usually Creating  indexes on the columns   will give better performace the index does not take much space in the memory, there by resulting in faster SELECTs. I am not much expert to say that whether it is suggestable in staging area or not but while loading the data into any target table which is having indexed columns will effect the performace of the job ,
    In general while loading the data into target we will drop the index in Preload SQL and will recreate it with post load SQL in target properties, because it will give better performace.
    so as per the above even though if you created the indexes on columns, its better to drop it and re create it before loading into target that will give you better performance.
    Hope you have got some idea,
    Thanks,
    subbu CH.

  • Staging Area Schema

    My source and target table is same and I am trying to update certain column in table XXX, I have set staging area different then target and specify the staging schema where I do have the create table prevelige but when I run this interface its trying to create temp table in target schema where I do not have preveilege to create table.Any clue ...?
    In the interface I have checked all my mapping process is in staging area not source or target.
    Any clue ...?
    Thanks

    HI,
    It depends on the KM that you are using... If you are using a IKM Incremental Update then the process will create a temp table at target because it needs it to make the PK comparation.
    My suggestions to work around it:
    1) if your ETL allows, work with the IKM Control Append
    2) If you need of a Incremental Update ELT just point the "Work Area" at the target Physical Schema to the "Staging Area" Schema, change the Database connection user to the user of Staging Area and give him the necessary grants at the tables of the target schema (insert and update i imagine),
    Just to be sure, are you using Oracle DB as source, staging and target?

  • Lookup issue when staging area diff from target

    Hi,
    I am using staging area different from target (csv file to database)
    Everything is working fine the source data is moved to target. The interface runs suiceessfuly.
    Now i want to add a lookup during transformation using a lookup table.
    When i do that using lookups in quick edit section, i am getting an error.
    When i run the interface, the C$ gets created in staging area - that is correct.
    However when inserting from staging to target, now the ODI searches for the C$ table in target area instead of the staging..
    Please help.
    Thanks,
    Rosh

    Hi
    1st thing you have to give the workschema for temp tables when creating physical schema in dataserver for target.
    Then you have to select the workschema in overview of interface as "staging different from target".
    After doing this when you will use predefined KM for the interface it will create temp tables in workschema.
    Now suppose you are not giving the workschma at the time of creating physical schema and you have selected "staging different than target" in interface.Here your C$ table will be created in your workschema but I$ table that is used by IKM is going to be created on target schema.So for this again you have change the IKM KM i.e. where to create I$ table (wokrschema) by selecting the corresponding logical schema.
    So its better you give the workschema at the time of creating physical schema.
    Here is the query to give privilege by the sys_dba
    Grant create any table to ODI_TEMP.
    Hope you got it
    (Please mark the answer as correct or helpful and close the thread)
    Thanks

  • Creating staging area for setup downloaded from Oracle Edelivery

    Hi,
    I am going to install EBS 12.1.1 on RHEL 5.3
    I have downloaded the setup from edelivery.oracle.com
    Now I was wondering how I should create stage area.
    I came to know from couple of posts from Hussein that as I have downloded the setup(no CDs/DVDs),I just have to copy the downloaded file under the stage area directory
    and then unzip those files.
    But I came to know from EBS R12.1.1 installatioin guide that there has to be five sub-directories,before you actually start installation,namely
    startCD, oraApps, oraDB, oraAS, and oraAppDB
    So,my question is
    Will these directories get created automatically when I unzip the downloaded files?
    Do I have to unzip the downloded files in any particular sequence(so that these five sub-directories get created properly)?

    I came to know from couple of posts from Hussein that as I have downloded the setup(no CDs/DVDs),I just have to copy the downloaded file under the stage area directory
    and then unzip those files.Correct.
    But I came to know from EBS R12.1.1 installatioin guide that there has to be five sub-directories,before you actually start installation,namely
    startCD, oraApps, oraDB, oraAS, and oraAppDBThis is valid only if you stage the files from the Media Pack. If you have downloaded the file from e-Delivery website, then just place the files in one directory, extract it there and this will create the stage area directory for you.
    So,my question is
    Will these directories get created automatically when I unzip the downloaded files?Yes.
    Do I have to unzip the downloded files in any particular sequence(so that these five sub-directories get created properly)?The sequence does not matter, just make sure you have all the directories created.
    You may also run md5sum as per (MD5 Checksums for R12.1.1 Rapid Install Media [ID 802195.1]) to verify the integrity of the stage area directory once you are done with the staging.
    Thanks,
    Hussein

  • Creating Staging Area

    Hi all,
    I am trying to create staging area in R12, when i ran the perl script(adautostg.pl) it was going fine, but when it has asked me to insert Database Disk 2 it says, invalid DVD, i tried from the second set of media pack but same problem arised.
    So now im copying all the zip files to local HDD so that i can unzip....this is the second method im following...
    please give any suggestion on this...thread.....

    First off your question relates to e-Business Suite not Database so you are in the wrong forum. In the future please post the appropriate location where your question will be on-topic.
    Second ... there are two possibilities. First that you have a corrupt DVD and the second that you are inserting the wrong Disk2.
    I have posted the 11.5.10 version of the process here:
    http://www.psoug.org/ebs/ebs_tree.html
    and the v12 one is essentially identical.
    If you still can not get it to work open an SR at metalink.

  • Capture DB Table and column comments when creating new Business Area/Folder

    Does anyone know if it is possible to pull the DB table and column comments into Discoverer when creating new Business Area/Folders? Our developers take the time to put the information in the Db data dictionary and we would like to leverage it (reduce need for manually adding descriptions) ... has anyone done this?
    If there isn't a way to automatically do it, would there be any harm in using a sql script to populate the description fields from the DB data dictionary directly into the EUL tables appropriate?
    I have been searching through documentation and forums for information - with no luck at this point.
    Thanks!

    Hi Seymour
    You can add column comments to views as well, as this example will show:
    CREATE OR REPLACE FORCE VIEW MY_SEQUENCE
    (SEQ_ID, SEQ_NAME, SEQ_NEXTVAL)
    AS
    SELECT "SEQ_ID","SEQ_NAME","SEQ_NEXTVAL" FROM EUL5_SEQUENCES;
    COMMENT ON COLUMN MY_SEQUENCE.SEQ_NAME IS 'The sequence';
    So you could add the comments at the view level and then refresh Discoverer.
    Best wishes
    Michael

  • Unable to load staging area table in teradata from ODI

    Hi
    i'm unable to load data in Staging area in teradata. while loading i'm geeting following Error
    org.apache.bsf.BSFException: exception from Jython:
    Traceback (innermost last):
    File "<string>", line 9, in ?
    Load Error: See D:\CRM_MOD\/CRM_PRODUCT_SS_0.log for details
         at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
         at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
         at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
         at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
         at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
         at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
         at com.sunopsis.dwg.dbobj.SnpSessTaskSqlC.treatTaskTrt(SnpSessTaskSqlC.java)
         at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
         at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
         at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
         at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
         at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
         at com.sunopsis.dwg.cmd.e.i(e.java)
         at com.sunopsis.dwg.cmd.g.y(g.java)
         at com.sunopsis.dwg.cmd.e.run(e.java)
         at java.lang.Thread.run(Unknown Source)
    please any one help me
    Thanks
    Edited by: user12079238 on Oct 19, 2009 1:17 AM

    Hi,
    I believe you made some mistake in the Phisycal Schema, quit the last "\" from there....
    Cezar Santos
    [www.odiexperts.com]

  • Lookup in staging area

    We have a column on the source table which contain a person's country information. A single country name could be represented in different formats (for e.g. United States of America, USA, U.S.A). The target database has a table which stores the equivalence mapping for all these different possibilities (i.e. United States of America, USA, U.S.A are mapped to "USA")
    We plan to have a design like this
    Step 1. Load the country column to the staging area
    Step 2. In the staging area, lookup the equivalences table, identify the country name and populate it on the staging area
    Step 3. Transfer the data into target table.
    The point where we have discussion is the Step-2. What would be an efficient way of resolving the equivalences and how we proceed in this step.
    Any thoughts/suggestions on what would be a good or bad design here ?

    Hi,
    Let me try to help...
    If I understood right you can achieve that in just one interface by check the join between the column "country" and the table where the all possible match are at staging area, it means:
    1) create an interface
    2) drag and drop all souce tables plus the table where are the countries are, from target.
    3) drag and drop the "final" target table at target position
    4) create a join between the "target countries tables" and "person table" by "country" column and check it to be executed at Staging Area.
    Does it make any sense to you?
    Cezar

  • Staging area different from target

    I am using oracle 10g as target database. I want to upload a flat data file into oracle table.
    I uploaded sucessfully using LKM Oracle (SQL Loader) in Interface. In this case i am using oracle database as a staging area. So all load transferred to my database at the timing of processing.
    I want to create staging area at my file server. So please help me out to resolve this problem.

    A staging area must accept SQL syntax.
    A File server won't accept SQL syntax.
    So if you speak about Physical Server where you got your file and if there is a RDBMS installed in maybe but else I don't really know how you can...
    You can specify another data server for your staging area or use the SUNOPSIS_MEMORY_ENGINE which use the cache I think but it's not optimized I think...
    For this in the Definition Tab of your Interface choose Staging Area different from the Target and then select in the list box SUNOPSIS_MEMORY_ENGINE.

  • Staging area and target area

    hi..friends.
    should staging area and target area be same or different???
    if same what are the advantages and dis-advantages???
    and if not same what are the advantages and dis-advantages????
    I want your help..
    Thanks.

    Staging area is the place where transformation takes place.
    Basically c$,I$ tables gets created at this place and once processing is done , the same gets dropped .
    By defalut staging area and traget area are the same . But most of the DBA does not like to have the temp tables created at the target as this cause dbms performance, maintance issue in long term.
    Instead you can have a dedicated schema created just for staging and use the same in your interface.
    Plus when your target is non dbms then you need to go for a dedicated staging area which can be a separate schema in your database or it could be in memory schema. You will find performance issue if you are using in memory schema as your staging area in case the data volume increase.
    Thanks,
    Sutirtha

  • Staging area different from target - which KM???

    Hi,
    I need to transfer data from CSV to DB (only new inserts operation)
    I am working the following KM's
    LKM File to SQL
    IKM SQL Control Append
    It's working fine. However now i need to keep the staging area (where C$, I$ etc table are created) in a separate schema.
    I have created a diff schema for staging area and selected in the interface "Staging area different from target"
    However not sure of which KM's to use.
    Please let me know how to achieve this.
    Thanks,
    Rosh

    Hi
    1st thing you have to give the workschema for temp tables when creating physical schema in dataserver for target.
    Then you have to select the workschema in overview of interface as "staging different from target".
    After doing this when you will use predefined KM for the interface it will create temp tables in workschema.
    Now suppose you are not giving the workschma at the time of creating physical schema and you have selected "staging different than target" in interface.Here your C$ table will be created in your workschema but I$ table that is used by IKM is going to be created on target schema.So for this again you have change the IKM KM i.e. where to create I$ table (wokrschema) by selecting the corresponding logical schema.
    So its better you give the workschema at the time of creating physical schema.
    Here is the query to give privilege by the sys_dba
    Grant create any table to ODI_TEMP.
    Hope you got it
    (Please mark the answer as correct or helpful and close the thread)
    Thanks

  • Staging area on source in Oracle

    Hi,
    My source and target, both are Oracle DBs.
    a) I created one interface with STAGING AREA ON TARGET. For this I used LKM SQL to SQL and IKM SQL Incremental Update.
    Its working fine and all the work tables, flow table etc are gettting created in the
    Work Schema (ie. ODI_TRG) I have given while defining physical schema of my target.
    I want to try with staging area on source....
    b) I checked the "Staging area different from Target" option and selected the logical schema of the source in the Definitions tab of my interface.
    In the corresponding physical schema, Work Schema I gave is ODI_SRC.
    Now I expected all the work tables, flow tables etc to be created ODI_SRC. But still they are getting created in ODI_TRG!!! Why???
    But finally to insert/update the target table, its trying to read the flow table from ODI_SRC, even though it created the flow table in ODI_TRG!!!!
    And as a result its failing with this error code...
    942 : 42000 : java.sql.SQLException: ORA-00942: table or view does not exist
    Please clarify.

    I think you didn't change your KM.
    Step1: import the "IKM SQL to SQL Append" into your project
    Step2: In your interface, on the definition table, select the "Staging Area Different From Target" checkbox, and select the schema of your source data in the drop-down list box.
    Step3: go to the flow tab, and select the target, and select the IKM SQL to SQL Append.
    Step4: Execute.
    Refer this thread what KM to change.
    Optimizing the KM

  • XML as staging area

    Hi All,
    I am using SQL server as my source and XML as my target. I am using target area same as staging area
    Now I want to look up fior all my work table i.e. E$.C$ and I$...where can I see these tables...i mean where are these tables stored when my staging area is XML?
    Please help
    Thanks

    Hi,
    ODI creates these temporary tables (E$, I$, C$) in the work schema of your staging area. So check your Staging area (on the definition tab), this will be the name of one of your logical schemas for SQL Server, then go to Topology Manager, find the logical schema and the physical schema which is associated through the Context in which you are running your process. Review the Physical Schema. There are two sections with two drop-down lists each: one section is for the for the data catalog/schema, the other one for the work catalog/schema. The temporary tables are created in the work schema (this might be "dbo" or what ever user you defined) of the work catalog.
    Hope this helps,
    Matt

Maybe you are looking for

  • OIM 11g High Availability Deployment

    Hi Experts, I'm deploying OIM 11g in High Available schema, following Oracle docs: http://download.oracle.com/docs/cd/E14571_01/core.1111/e10106/imha.htm#CDEFECJF, I have succesfully installed and configured OIM & SOA in weblogic domain on 'OIMHOST1'

  • Can acrobat 9 pro be updated onto mac 10.8.2/mtn lion? how?

    i had acrobat pro 9 on a mac 10.6.8 that updated regularly up as far as 9.5.0. then i upgraded to a new machine running 10.8.2 - acrobat migrated with everything else and sent  update reminders for 9.5.2, but when i tried to update - i couldn't.  i g

  • Dynamic routing for a Business Service with multiple operations

    I have two business services with multiple operations. Business service A (bsA) has operations OpA1 and OpA2. Business service B (bsB) has operations OpB1 and OpB2. Depending on incoming Proxy message and operation, I have to do one of the following

  • Petition: Chinese Song and Artist Search Function in the Next ZM Firmw

    Hi Everyone, Right now I can search for english song or artist in my ZM, but I have no way of doing the same thing for my chinese songs. It would be great if Creative can implement this feature in future firmware (Non-unicode search ability), maybe u

  • SSI on Solaris

    I am trying to add a poll to a web site, the script is called using ssi, on submit the page should refresh and the updated page displayed in response to the user. But instead the content isn't updated, I know the code is fine because I have tried it