Setting END_DATE in OWB 11g R1/R2 SCD type 2

Hi
I have this issue which needs an immediate solution. The SCD2 design in OWB 11g R1/R2 works well except that it does not allow a programmer to populate the value of END_DATE with a field from source.
I observed that one can set the value of end_date in the dimension properties (via inspector) for initial records/open records.
a. default effective time of initial record and
b. default effective time of open record
My question is for the above two properties being set on the SCD History logging properties on target level in mappings, can we set them to a particular date field coming in from the source?
The only work around I found was to have a function which returns me a particular value from the source which can be called within the properties of these two fields, but other than that, we cannot directly populate the END_DATE field as it is a derived field within the SCD2 logic generated in the background.
Please if you could answer this it would be great
Birdy

Hi Oleg
I want the STA_FROM to drive my DIM_TO as well
So I may have sets of records say
Business/Natural key : Account number
Triggering column: Name
Suppose I load all of this today
Account_number STA_FROM Name
1001 01-aug-2010 Dummy1
1001 03-aug-2010 Dummy2
1001 05-aug-2010 Dummy3
1001 07-aug-2010 Dummy4
1002 01-sept-2010 Dummy_1
Hence Dimension data will be
Account_key Account_number EFFECTIVE_DATE END_DATE Name
1 1001 01-aug-2010 03-aug-2010 Dummy1
2 1001 03-aug-2010 05-aug-2010 Dummy2
3 1001 05-aug-2010 07-aug-2010 Dummy3
4 1001 07-aug-2010 31-dec-9999 Dummy4
5 1002 01-aug-2010 31-dec-9999 Dummy_1
If you notice, I am driving both Effective and end date by the STA_FROM
I have already achieved this in the hard coded SCD logic by using Lead function to derive my end dates for "force-closing" records.
But the SCD wizard does not allow us to drive the value of end date based on a field coming from the source. Now in my case, the STA_FROM can also be value of an input load date parameter in some cases.
It would have been nice to allow population of END_DATE on target dimension operator instead of giving only the option of setting it in the operator properties.
Hope its much clearer now
Birdy

Similar Messages

  • SCD Type 2 Conversion

    Hello, I am converting to OWB. The existing ETL has some support for SCD Type 2. It does not support Triggering attributes, however if the ETL determines that the Business identifier no longer exists in the source table it will set a Status attribute to I (for inactive) in the target table.
    I assume that I can program this logic in OWB using an SCD Type 1. However, if possible I would like to take advantage of OWB's native support for SCD Type 2. Is it possible to define a SCD as Type 2 but not identify any Triggering attributes? If so, can OWB detect when the Business identifier no longer exists in the source table and update the Expiration Date in the target table? If so, can I modify the logic that updates the Expiration Date so that it also set's the Status attribute to I (for backwards compatibility)?
    I may have to resort to a SCD Type 1 and program the update to the Status attribute. However, if I could use OWB's native support for SCD Type 2, I would be in a position to introduce Triggering attributes as the business need arose.
    Thank you for your help.

    Hi,
    several years ago Oracle published whitepaper which described steps for designing OWB mappings for loading SCD (types 1,2,3) tables.
    But recently (after website reorganization) this whitepaper was removed, although you can stil find it by googling with "scdwhitepaper",
    or you can directly download it from http://sourceforge.net/projects/owbland/files/Stuffs_from_Oracle_site/SCDWhitePaper.zip/download
    Also it is available for download OWB experts which implement generation of SCD2 mappings according this whitepaper:
    http://odi-ee.blogspot.com/2009/02/scd-type2-expert-table-operator.html
    http://owbexpert.blogspot.com/2008/12/hallo-hallo.html
    Also look at this thread {message:id=4336731} with discussion of bug which force to update all rows in target table, even they not changed between mapping executions.
    Regards,
    Oleg

  • SCD type 2 and 3 for Relational Dimension?

    SCD type 2 and 3 for Relational Dimension?
    ==========================
    Thanks for your replies.
    I searched this forum and web on SCD 2 and 3 implementation using Relational Dimension (Table) using OWB.
    I find some thread talks about implementing Oracle Dimensional structures, which has levels/hierarchy etc.
    If we design our dimension in pure relational fashion, how do we go about using OWB for SCD 2 and 3?
    Are there any new SQL features of 11g to help us here?
    Thanks in helping.
    RI

    Hi,
    several years ago Oracle published whitepaper which described steps for designing OWB mappings for loading SCD (types 1,2,3) tables.
    But recently (after website reorganization) this whitepaper was removed, although you can stil find it by googling with "scdwhitepaper",
    or you can directly download it from http://sourceforge.net/projects/owbland/files/Stuffs_from_Oracle_site/SCDWhitePaper.zip/download
    Also it is available for download OWB experts which implement generation of SCD2 mappings according this whitepaper:
    http://odi-ee.blogspot.com/2009/02/scd-type2-expert-table-operator.html
    http://owbexpert.blogspot.com/2008/12/hallo-hallo.html
    Also look at this thread {message:id=4336731} with discussion of bug which force to update all rows in target table, even they not changed between mapping executions.
    Regards,
    Oleg

  • How to implement SCD type 2 in OWB 11g

    Hi all,
    I would like to know that how to implement SCD type 2 in OWB 11g.
    Actually I have tried to implement it but the target table which contains the effective_date and expiration_date are null after running the mapping.
    I have set the effective date and expiration date settings in the SCD tab of dimension object.
    Kindly help me the same if anyone knows.
    Kind regards,
    shikha

    You were able to get OWB11g to move data?
    Are you running on a 64-bit windows server? I could not get it to do a basic data move on this type of server install.

  • Error java.sql.exception when setting up repository for OWB 11g

    Hey all,
    I am encountering the following error on the last step of Repository Assistant, that is, while trying to set up the design repository in OWB 11g:
    "The Warehouse Builder workspace installation failed
    java.sql.SQLException : ORA-00942 table or view does not exist"
    Below is an excerpt from the the log file:
    main.TaskScheduler timer[5]20080620@14:51:54.054: 00> oracle.wh.service.impl.assistant.ProcessEngine.processSQLUserToken(ProcessEngine.java:1106)+>     at java.lang.Thread.run(Thread.java:595)
    main.TaskScheduler timer[5]20080620@14:51:54.054: 00> oracle.wh.service.impl.assistant.ProcessEngine.display(ProcessEngine.java:1572): Exception = java.sql.SQLException: ORA-00942: table or view does not exist
    main.TaskScheduler timer[5]20080620@14:51:54.054: 00> oracle.wh.ui.install.assistant.wizards.AssistantWizardDefinition.display(AssistantWizardDefinition.java:788): [executeOwbReposOrRuntime]: Error occurred during Workspace Installation. Exception =java.lang.Exception: java.sql.SQLException: ORA-00942: table or view does not exist
    main.AWT-EventQueue-0[6]20080620@14:51:54.054: 00> oracle.wh.ui.jcommon.WhButton@a22671: WhButton setLabel rtsString = OK
    main.AWT-EventQueue-0[6]20080620@14:58:17.017: 00> oracle.wh.ui.install.assistant.wizards.AssistantWizardDefinition.display(AssistantWizardDefinition.java:788): before open 'UnSuccessDialog'
    main.AWT-EventQueue-0[6]20080620@14:58:17.017: 00> oracle.wh.ui.install.assistant.wizards.AssistantWizardDefinition.display(AssistantWizardDefinition.java:788): Open UnSuccessDialog ...
    main.AWT-EventQueue-0[6]20080620@14:58:17.017: 00> oracle.wh.ui.jcommon.WhButton@a22671: WhButton setLabel rtsString = OK
    I am new to OWB so please let me know if I've left out any information that would help in figuring out why the installation is not completing.
    Thanks.

    The only thing I can think of in OWB 11g is that the main schema that is used, which is OWBSYS, wasn't fully installed or it doesn't have all the tables or views it needs or they weren't created properly with the cat_owb.sal script.
    Something must not have been created right. I would try to stop all OWB services with the appropriate scripts in:
    <your_owb_home>owb\rtp\sql
    try the stop_service.sql script.
    Then try to drop the users owbsys and whatever you might have created (if it exists) for a workspace owner user. Then clean up with:
    <your_owb_home>\owb\UnifiedRepos\clean_owbsys.sql
    After that it is back to the drawing board from the beginning. DO these steps again that you likely did in the first place:
    1. create owbsys with:
    <your_owb_home>\owb\UnifiedRepos\cat_owb.sql <tablespace_name>
    2. Set the control center home with:
    <your_owb_home>\owb\UnifiedRepos\reset_owbcc_home.sql <your_owb_home>
    *pay attention to the case of the the OWB HOME you give as a variable to the above script.  It needs to match the case of your real path.
    3. Finally unlock owbsys.
    4. look at <your_owb_home>\owb\bin\admin\ if the rtrepos.properties file size is at '0'. If it is for some reason, rename it to something else right now.
    5. Then try to run the repository assistant again.
    -Greg

  • Dynamic flat file loading in OWB 11g

    Hi,
    I'm working on owb 11g, i need to load multiple files into tables having the same file name where only the date and file sequence number changes. The files are of format:
    FileA_2009_1
    FileA_2009_2
    FileA_2009_3,etc....
    How can i dynamically change the files and load to one table. Can this be achieved through external tables or sql* loader? Is there any such new feature in OWB 11g?
    Rgds
    Rex

    Hi
    SQLLoader mappings have the data filename as an optional input parameter (a fully qualified name can be passed). So you could have a loop to get the names and call the mapping. If it was External table you'd have to do an alter table to set the data file. If the filenames are static you can configure the ext table and mapping with the names.
    Cheers
    David

  • SCD type 2 in OWB 10g R2

    Hello,
    I am trying out the SCD type 2 in OWB 10g R2. I have no hierarchies and hence created a dimension with one level. Apart from three business attributes I have 2 mandatory attributes as "EFFECTIVE_DATE" and "EXPIRY_DATE". I have set one of the business attributes to "Trigger History".
    I have 3000 rows in the source table. There is no transformation. the data is loaded from source to this dimension directly. One business attribute is loaded using a constant.
    When I executed the mapping, all 3000 rows are populated in the target with the expiry date column having null values and current date in the effective date, which is absolutely fine. When I execute the mapping again without changing anything in the source, rows are inserted in to the target with the effective date set to the second run and the expiry date set to previous effective date. As I understand new rows should be inserted only if there is change in the data.
    Please correct me if I am wrong. Please clarify and if my understanding is right where am I doing wrong with OWB?
    Your help is greatly appreciated
    Thanks a lot on advance!
    Regards,
    Maruthi

    Hi Roelant,
    I think it is important to be aware that although Paris - 10gR2 - is not actually buggy (in this respect!), it is really quite idiosyncratic in exactly how it processes SCDs.
    I followed up on your and Mark's comments, and did an in depth analysis of this topic. It is at http://www.donnapkelly.pwp.blueyonder.co.uk/documents/OWB_10gR2_SCD.pdf
    My conclusions are perhaps of interest to anyone considering doing SCD processing with Paris.
    I'll be doing a follow-up this weekend, and publishing a sort of 'how-to-do-it' guide.
    Cheers,
    Donna
    Message was edited to add the words: "in this respect"

  • Chunking + dimension operator+ owb 11g very slow

    Anbody using chunking for loading SCD type 2 dimesnions in Oracle 11g.
    Can it be used with dimension operator.
    Also what is Max Chunk iterator count - can't see in the documentation?
    Thinking about dicthing domension operator for one of our SCD type 2 as so slow.
    Also doing simple thing like deploying mapping very slow - anybody seen this - other previous version used also slow but not as slow.
    Other programming development tools thing on PC leads me to think problem with OWB.
    Do we need to purge repository auidting tables?
    If so is there a script to do this in Oracle 11g.
    Any ideas/thought on above much appreciated.
    Many Thanks

    Hi,
    Thanks for the excellent suggestion.
    Have run other mapings which maintain SCD type 2 using dimesnion operator behave similary to 10g. - have raised issue with this particular mapping with Oracle - awaiting response.
    One question - when look at the mappings which maintain SCD Type 2s looks to join on dimension key and the surrogate ids.
    What is best practice regarding indexing of such a dimension, e.g is it recommended to index dimension key and the surrogate ids along with the natural/nbusiness keys?
    Thanks

  • Error VLD-1108 while validating the mapping in owb 11g

    Hi All,
    I am using owb 11.1.0.7.0. I am new to owb 11g. I am getting the following error while validating the mapping
    error: VLD-1108 . Operator requires more input or output connections in order to generate mapping code.
    I am using a function as operator and mapping it with the table.
    Please tell me the solution for this. Its urgent
    Thanks in advance,
    Siva

    Hi,
    u must be using a procedure or table function that is called in the mapping for execution. When writing the function u would have specified 3 inputs but in the mapping u would have given only 2. check the number of inputs and make sure they match.
    Regards
    Bharadwaj Hari

  • Error while importing .MDL file to OWB 11g

    Hi
    I have a mdl file which is generated by OWB 10g, when i am importing it to OWB 11g it is giving message that please check if the disk is not full of write protected. i have given the access privilage to oralce folder.
    i am using windows vista
    Please help

    Do yo
    u have the software installed from a different user executing the software? If a different user, does the user have access to the sub-directories under owb\bin for write?
    Also the directory where the MDL file is being imported from is where by default the log file will be, you can change this directory to somewhere you can write.
    Cheers
    David

  • HOW TO INSTALL ODI 11g / OWB 11g  IN WINDOWS SERVER 2008 R2 (64 BITS)

    Hi everybody,
    I have a serious problem.
    Last week we buy a new server with Windows Server 2008 Std. R2 x64, for a new project. I tried to install the RDBMS Oracle 11g R2 (x64) without problems, but when i try execute the "Design Center" contents in OWB, show me the error: 0xc0000018
    Then, I´m thinking in install Oracle Data Integrator to solution it, but i`ve read that neither can install on 64 bits system... This is true?
    Somebdoy knows how can I install OWB 11g / ODI 11g in a Windows 2008 Server 64 bits?
    Thanks & Regards!

    OWB 11G Will have been installed with the database, it now ships with 11G.
    Check you are on a supported platform for design centre using the certification matrix.
    Quick google search for you regards 0xc0000018 :
    Problem in Lunching OWB Design Center

  • Missing objects when created a OWB 11g owner/user

    h4. i created a new owb owner and user using repository, but apparently no objects (tables,views,synonyms,function and etc) has been "imported" or copy from OWBSYS to the owner.
    h4. - Creation of OWNER is successful using repository
    h4. - Adding a USERS is successful
    h4. how can i copy or create a new OWB owner that has a objects that is same with OWBSYS? help please im new with 11g
    h4. version: 11.2.0.1.0

    Hi,
    Starting from OWB 11g all the metadata and audit information will be owned by OWBSYS user unlike OWB10g where in the metadata and audit information
    used to be created under respective repository owner.
    There will be only one OWB repository schema (i.e OWBSYS)per database
    Initially there won't be any objects under OWBSYS. Once you create a new workspace then all the objects will be created under OWBSYS.
    And the new owner will not have any objects, all the objects will be owned by OWBSYS.
    The workspace owner user is used to adminster the workspace and users.
    This is correct behaviour. No need bother about this. So no need to import any objects under this database user.
    The objects i referred previously are OWB design objects like mappings,transformations,modules,projects.
    If you want to import/create the OWB design objects you have to connect to the OWB design center and import the objects using MDL utility or create new objects.
    The metadata about these design objects will be stored in the tables owned by OWBSYS.
    Regards,
    Pnreddy

  • OWB 11g Problem in running Process flow

    I’ve build a process flow as described in “Getting Started with Oracle Warehouse Builder 11g”. But if I run the process flow I get a warning message “You have to deploy this object before running” followed by the error RTC-5170: The selected objects do not require deployment as they are all up to date in the Control Center.
    Therefore I’m not able to run the process flow. What’s wrong? It looks so easy in Getting Started but it doesn’t work.
    I’ve found two threads regarding this error from last year in this forum. But there is no solution for OWB 11g.
    Has anyone an advice for me?

    I've successfully installed OWF as described in Installation guide (all components are on the sam server).
    But when I deploy a workflow in OWB I get some errors. In the job details
    I find ORA-00942 and RPE-02053. It seems that the workflow repository is missing.
    Are there additional steps for creating a workflow repository?
    Or what is wrong? All installation logs (wf.log and workflow.log) are without errors and with success messages.
    Any idea?

  • Help with Understanding Workspaces in OWB 11G

    Hi
    We are planning to upgrade a 10.1.0.3 repository to 10.1.0.4 via the upgrade scripts and then migrate the entire environment to a new server with an 11g database. Also we need to migrate a separate 10gr2 repository and target schemas to the same 11g database.
    I have been reading the documentation and can see that the repository (OWBSYS) can be split into separate workspace owners that you can assign users to.
    I have looked at the Oracle tutorial for OWB 11g and can see it asks for a Workspace Owner User Name and also a Workspace Name. What is the difference between these? If you have multiple Workspaces do these appear as separate schemas on the database and, if so, do these have the Workspace Owner User Name or the Workspace Name?
    In our 10.1.0.3 database we have a design repository A, and a separate runtime repository with a runtime owner and runtime user schema.
    In the 10GR2 database we have a design repository B (containing design and runtime metadata).
    I am thinking of creating one 11G Workspace for the 10.1.0.3 repository data and another workspace for the 10GR2 data. However, would the workspace owner user names need to be the same i.e.'A' and 'B'?
    Any advice would be appreciated.
    Thanks
    GB

    This is what I've learned so far:
    You're repository will always be on the OWBSYS schema. So if you have 2 repositories and plan do put them both on the same database then you'll end up with 1 repository with 2 workspaces.
    All the metadata is stored on the OWBSYS schema.
    The workspace owner will be the user with most privileges on that workspace and can have a different name of the workspace.
    You can add more users (besides the workspace owner) to any of the workspaces.
    hope it helps... and please someone correct me if I'm wrong.

  • OWB 11g Repository Assistant -  Error occured in 'processSPAWN'

    Hello,
    I tried to create OWB 11g workspace on Oracle 11.1.0.6, but repository Assistant fails every time on the same step.
    If I run the last command manually ('wholeLine') it works fine.
    ... I am in processSPAWN ...
    wholeLine =../unix/jvm.sh -classpath ../../lib/ext/transx.zip:../../../lib/xschema.jar:../../../lib/xsu12.jar:../../../rdbms/jlib/xdb.jar:../../lib/int/rtpplatform.jar:../../lib/int/rtpcommon.jar:../../../jdbc/lib/ojdbc5.jar:../../../lib/xmlparserv2.jar:../../../sqlj/lib/runtime12.jar:../../../jdk/jre/lib/rt.jar oracle.xml.transx.loader (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=%host)(PORT=%port))(CONNECT_DATA=(SERVICE_NAME=%serviceName))) %user %password ../../browserasst/views/owb_uprop_nls.xml
    after executing the output
    (Spawn Token) Error loading Java into DB:
    Error occured in 'processSPAWN': java.io.BufferedInputStream@1b94ea2
    [processSPAWN]: A spawned program error. Exception = java.lang.Exception: Error occured in 'processSPAWN': java.io.BufferedInputStream@1b94ea2
    Get the error, stop processing other tokens...
    Exception = Exception occured in 'processSPAWN'. java.lang.Exception: Error occured in 'processSPAWN': java.io.BufferedInputStream@1b94ea2
    java.lang.Exception: Exception occured in 'processSPAWN'. java.lang.Exception: Error occured in 'processSPAWN': java.io.BufferedInputStream@1b94ea2
    at oracle.wh.service.impl.assistant.ProcessEngine.processSPAWN(ProcessEngine.java:1019)
    at oracle.wh.service.impl.assistant.ProcessEngine.processFileTokens(ProcessEngine.java:736)
    at oracle.wh.service.impl.assistant.ProcessEngine.createOWBRepository(ProcessEngine.java:294)
    at oracle.wh.ui.install.assistant.wizards.AssistantWizardDefinition$1.runTask(AssistantWizardDefinition.java:564)
    at oracle.ewt.thread.TaskScheduler.runTask(Unknown Source)
    at oracle.ewt.thread.TaskScheduler.processTask(Unknown Source)
    at oracle.ewt.thread.TaskScheduler$TaskQueue.run(Unknown Source)
    at oracle.ewt.timer.Timer.doRun(Unknown Source)
    at oracle.ewt.timer.Timer.run(Unknown Source)
    at java.lang.Thread.run(Thread.java:595)
    [executeOwbReposOrRuntime]: Error occurred during Seed OWBSYS. Exception =java.lang.Exception: Exception occured in 'processSPAWN'. java.lang.Exception: Error occured in 'processSPAWN': java.io.BufferedInputStream@1b94ea2
    java.lang.Exception: Exception occured in 'processSPAWN'. java.lang.Exception: Error occured in 'processSPAWN': java.io.BufferedInputStream@1b94ea2
    Please help.

    Fixed by changing parallel_max_servers init parameter.
    old value was 135
    new value is 50

Maybe you are looking for