How to implement mapping for a slowly changing dimension

Hello,
I don't have any experience with OWB and I need some help.
I just don't know how to create the ETL process for a slowly changing dimension.
My scenario is that I have 2 operative systems providing customer information, a staging area and a dwh with a customer dimension with SCD type 2 (created within OWB).
The oltp data is already transferred to the staging area. But how should the mapping for the dwh table look like? Which operators have to be used?
I have to check whether the customer record is new or just updated. How can I check every attribute? A new record shall be loaded, an updated record shall be historized (as I configured it in the SCD type 2). I just don't know how the trigger of the SCD is activated. Do I have to try an update on the trigger attribute and then automaticalle a new record is created? But with which operator can I do this? How should the mapping look like? Or is this impossible and do I have to implement this functionality with SQL code only?
I know how to implement this with SQL code, but my task is to implement this in OWB.
As you see I did not understand the logic of OWB so far and I hope somebody can help me.
Greetings,
Joerg

Joerg,
Check the blog below which provides good detail and also check the OWB documentation
http://www.rittmanmead.com/2006/09/21/working-through-some-scd-2-and-3-examples-using-owb10gr2/
Thanks,
Sam.

Similar Messages

SQL Server Agent Jobs error for Slowly changing dimension

Hi,
I have implemented Slowly changing dimension in 5 of my packages for lookup insert/update.
All the packages are running good in SSDT. And when i deployed the project to SSISDB and run the packages all are running successfully. But when i created a job out of that and run the packages, then 3 packages ran successfully and 2 packages failed.
When i opened All Execution Report. I found the following error:
Message
Message Source Name
Subcomponent Name
Process Provider:Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description:
"Login timeout expired". An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "A network-related or instance-specific error has occurred while establishing
a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For more information see SQL Server Books Online.". An OLE DB record is available.
Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "Named Pipes Provider: Could not open a connection to SQL Server [53]. ".
Process Provider
Slowly Changing Dimension [212]
Then i opened Provider package in SSDT and changed the source reading record limit from 4,00,000 to 15,000 in source query and deployed again and run, then the job succeeded. more than 15,000 failed.
And in the 2nd experiment, I removed slowly changing dimension task and implemented normal lookup for insert/update, and set the source reading limit again to 4,00,000 and deployed again and run, then the job succeeded.
Now i am not able to figure out, what exactly is the problem with Slowly changing dimension task for more than 15,00 records in SQL Server Agent Job run?
Can anybody pls help me out.
Thanks
Bikram

Hi Vikash,
As i have mentioned in the above post, below 2 scenarios:
"Then i opened Provider package in SSDT and changed the source reading record limit from 4,00,000 to 15,000 in source
query and deployed again and run, then the job succeeded. more than 15,000 failed.
And in the 2nd experiment, I removed slowly changing dimension task and implemented normal lookup for insert/update, and set the source reading limit again to 4,00,000 and deployed again and run, then the job succeeded."
That means i am able to connect to sql server.
But if i change the 1st scenario and read 4,00,000 records, the job fails and shows the above mentioned error.
Similarly in the 2nd scenario, if i implement SCD look up, the job fails and shows the above mentioned error.
And i am consistently reproducing this.
Thanks
Bikram

How to Model Slowly changing dimension ?

Hello Gurus,
I would like to know what a slowly changing dimension is, which scenarios is it used and also that how it is modelled.
Also please send screen shots.([email protected])
Thanks and best wishes,
raj

Hi,
Slowly changing dimensions - Data that changes over a period of time or dimenions that have data that changes slowly. e.g. Person responsible for a cost center. You cannot change that person daily, it is changed over a period of time.
Slowly changing dimensions are of different types: TYPE 0, 1,2,3 and 4.
PB

How to implement tooltip for the list items for the particular column in sharepoint 2013

Hi,
I had created a list, How to implement tooltip for the list items for the particular column in SharePoint 2013.
Any help will be appreciated

We can use JavaScript or JQuery to show the tooltips. Refer to the following similar thread.
http://social.technet.microsoft.com/forums/en/sharepointdevelopmentprevious/thread/1dac3ae0-c9ce-419d-b6dd-08dd48284324
http://stackoverflow.com/questions/3366515/small-description-window-on-mouse-hover-on-hyperlink
http://spjsblog.com/2012/02/12/list-view-preview-item-on-hover-sharepoint-2010/

Aggregating Slowly Changing Dimension

Hi All:
I have a problem with whole lot of changes in the dimension values (SCD), need to create a view or stored procedure:
Two Tables within the Oracle db are joined
Tbl1: Store Summary consisting of Store ID, SUM(Sales Qty)
Tbl2(View): Store View created which consists of Store ID, Name, Store_Latest_ID
Join Relationship: Store_summary.Store_ID = Store_View.Store_ID
If I’m pulling up the report its giving me this info
Ex:
Store ID: Name, Sales_Qty , Store_Latest_ID
121, Kansas, $1200, 1101
1101, Dallas, $1400, 1200
1200, Irvine, $ 1800, Null
141, Gering, $500, 1462
1462, Scott, $1500, Null
1346,Calif,$1500,0
There is no effective date within the store view, but can be added if requested.
Constraints in the Output:
1)     If the Store Latest ID = 0 that means the store id is hasn’t been shifted (Ex: Store ID = 1346)
2)     If the Store Latest ID = ‘XXXX’ then that replaces the old Store ID and the next records will be added to the db to the new Store ID ( Ex: 121 to 1101, 1101 to 1200, 141 to 1462)
3)     Output Needed: Everything rolled up to the New Store ID irrespective of the # of records or within the view or store procedure whenever there is a Store Latest ID that should be assigned to the Store ID (Ex: the Max Latest Store ID Record for all the changing Store ID Values) and if the value of Latest Store ID is 0 then no change of the record.
I need the output to look like
Store ID: Name, Sales_Qty , Store_Latest_ID
1200,Irvine,$4400,Null
1462,Scott,$2000,Null
1346,Calif,$1500,Null or 0
The Query I wrote for the view creation:
Select ss.Store_ID, ss.Sales_Qty, 0 as Store_Latest_ID
From Store_Summary ss, Store_Details sd
Where ss.Store_ID=sd.Store_ID and sd.Store_Latest_ID is null
union
Select sd.Store_Latest_ID, ss.Sales_Qty, null
From Store_Summary ss, Store_Details sd
Where ss.Store_ID=sd.Store_Latest_ID and sd.Store_Latest_ID is not null
And placing a join to the created view to Store Summary ended up getting the aggreagation values without rolling up and also the Store ID's which are not having latest ids are ending up with a value 0 and the ss quantity aggregated, and if there are changes within store id for more than two times then its not aggreagating the ss quatity to the latest and also its not giving the store name of the latest store id.
I need help to create a view or stored procedure
Please let me know if you have any questions, Thanks.
Any suggestions would be really Grateful.
Thanks
Vamsi

Hi
Please see the following example
ID- Name -Dependants
100 - Tom - 5
101 - Rick -2
102 - Sunil -2
See the above contents...assume the ID represents employee ID and the dependants include parents, spouse and kids....
After sometime, dependants may increase over a period of time but noone is sure when exactly it will increase.....assume in case of a single get married and increase in dependants
So the attributes of the Employee had a slow chance of changing over the time
This kind of dimensions are called slowly changing dimensions
Regards
N Ganesh

Not able to see ikm oracle incremental update and ikm oracle slowly changing dimensions under PHYSCIAL tab in odi 12c

not able to see ikm oracle incremental update and ikm oracle slowly changing dimensions under PHYSCIAL tab in odi 12c
But i'm able to see other IKM's please help me, how can i see them

Nope, It has not been altered.
COMPONENT NAME: LKM Oracle to Oracle (datapump)
COMPONENT VERSION: 11.1.2.3
AUTHOR: Oracle
COMPATIBILITY: ODI 11.1.2 and above
Description:
- Loading Knowledge Module
- Loads data from an Oracle Server to an Oracle Server using external tables in the datapump format.
- This module is recommended when developing interfaces between two Oracle servers when DBLINK is not an option.
- An External table definition is created on the source and target servers.
- When using this module on a journalized source table, the Journaling table is first updated to flag the records consumed and then cleaned from these records at the end of the interface.

Facing problem in loading table using IKM Oracle Slowly Changing Dimension

Hi,
I am facing problem in loading dimension table using IKM Oracle Slowly Changing Dimension
Following is the setup :-
SRC :- source_table (MSSQL)
Staging :- staging_table (MSSQL)
TRGT :- target_table (Oracle)
-------- source_table
group_id     int
group_version_id     int
name     varchar (255)
description     varchar (255)
comments     varchar (2000)
ref_number     varchar (255)
is_latest_version     decimal (5)
is_deleted     decimal (5)
--------- target_table
id     number (38,0) - Mapped to <%=odiRef.getObjectName( "L" , "SEQ_NAME" , "D" )%>.nextval
          - Executed on target
          - defined the column as SK in model
group_id     number (38,0) - defined the column as NK in model
group_version_id     number (38,0) - defined the column as NK in model
name     varchar (255) - undefined on the model description
description     varchar (255) - Add row on change
comments     varchar (2000) - Add row on change
ref_number     varchar (255) - Add row on change
is_latest_version     number (1,0) - Add row on change
is_deleted     number (1,0) - Add row on change
start_datetime     date     - SYSDATE
               - Executed on target
               - Starting Timestamp
end_datetime     date     - NULL
               - Executed on target
               - End Timestamp
I am using following KM's:-
     LKM SQL to SQL
     IKM Oracle Slowly Changing Dimension
     CKM SQL
it gives me the following error -
920:Invalid relational operator

Hi,
Yes, this is a run-time error. Currently I am debugging it by checking SNP_SESS_TXT_LOG based on sess_no ID.
Now, I get the following error.
I just see the following in the operator:-
911 : 42000 : java.sql.BatchUpdateException: ORA-00911: invalid character
911 : 42000 : java.sql.SQLException: ORA-00911: invalid character
java.sql.BatchUpdateException: ORA-00911: invalid character
     at oracle.jdbc.driver.DatabaseError.throwBatchUpdateException(DatabaseError.java:342)
     at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:10720)
     at com.sunopsis.sql.SnpsQuery.executeBatch(SnpsQuery.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execCollOrders(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSqlC.treatTaskTrt(SnpSessTaskSqlC.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
     at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
     at com.sunopsis.dwg.cmd.e.i(e.java)
     at com.sunopsis.dwg.cmd.g.y(g.java)
     at com.sunopsis.dwg.cmd.e.run(e.java)
     at java.lang.Thread.run(Unknown Source)
So, I do not get any idea of the exact step that is causing failure.
Is there any setting in the operator that I am missing on?

Types of dimensions like Line item & Slowly changing dimension?

Hi All,
Please explain about the Line item dimension & Slowly changing dimension.
Can anyone give the scenarios for these dimensions?
Other than these, we have like datapacket, time & unit dimensions.
Is there any other dimensions we have?
Thanks in Advance.

Hi,
Line Item Dimension-
A Line Item dimension is the dimension which has only one info object assigned. In this case, the DIM table for this dimension is not created. This way the lookup of data from this dimension is a little faster. An info object (eg: Sales Orders, customers) which can have huge number of data can be made line item dimensions as it will take less time looking up the data while running the reports.
In general,If the size of dimension table exceeds more than 20% of the size of the fact table,We mark it as Line item dimension.It depends upon the scenario.It helps in improving the overall data loading performance.
From Help.Sap
1. Line item: This means the dimension contains precisely one characteristic. This means that the system does not create a dimension table. Instead, the SID table of the characteristic takes on the role of dimension table. Removing the dimension table has the following advantages:
¡ When loading transaction data, no IDs are generated for the entries in the dimension table. This number range operation can compromise performance precisely in the case where a degenerated dimension is involved.
¡ A table- having a very large cardinality- is removed from the star schema. As a result, the SQL-based queries are simpler. In many cases, the database optimizer can choose better execution plans.
Nevertheless, it also has a disadvantage: A dimension marked as a line item cannot subsequently include additional characteristics. This is only possible with normal dimensions.
Line Item: This means that the dimension contains exactly one characteristic. If you set this indicator, no dimension table is created,but rather the SID table of the characteristic takes over the role of dimension table. Omitting the dimension table has the following advantages:
When loading transaction data, no IDs for the entries in the dimension table have to be generated. This number range operation can lead to a decrease in performance in the case of a degenerated dimension.
In the star schema of the InfoCube a possibly very large table, depending on the cardinality, is omitted. The SQL-based queries are therefore more simple. In many cases, the database optimizer can choose better execution plans.
However, there is also one disadvantage: A dimension indicated as a line item cannot accept additional characteristics at a later time. This is only possible for normal dimensions.
Example:
A line item is an InfoObject such as an order number, for whose attributes one or a few facts are listed in the fact table of the InfoCube.
Refer this.
/people/juergen.noe/blog/2007/12/07/spot-on-line-item-dimensions
should help you out.
Slowly Changing Dimension
This comes into picture when you have something which chenages over a period of time.For example,the Designation of an employee.Say,When an employee joins as an Associate and gradually gets promoted to Project Manager,this can be put into Slowly changing Dimension.
I hope thiis helpful for you.Do assign points if you find it helpful.
Regards,
Amar

How to implement maps in obiee11g and configure map viewer

Dear All,
Greeting for the day,
I am trying to explore obiee11g, ,how to implement the maps that is one of the finest features incorporated in obiee11g, and what all configurations(if required) are to be done. or any helpful documentation regarding same.
Please help!!!!
Thanks in advance
Regards

Hi,
Check the RittmanMead-blog
http://www.rittmanmead.com/2010/08/oracle-bi-ee-11g-map-views-integration-with-mapviewer/
Good Luck,
Daan Bakboord
http://obibb.wordpress.com

How to get maps for Japan?

I have a 1520 in Japan and it works like a charm, with the exception maps. They are horrible, completely useless; and you cannot even download maps for Japan (they do not show up in the settings). But Bing maps works perfectly on a Windows 8.1 laptop ... so what can I do to get Japan maps in my Lumia 1520 WP 8.1 device?

Availability of apps and services is up to Microsoft and the agreements it is possible to sign with local database providers and network operators. Apps and services are subject to changes over time, and there is not much you or I can do about it, except choose a brand and device that works out of the box with the features we want.
http://www.windowsphone.com/en-us/how-to/wp8/basics/feature-and-service-availability
does not explain why but has an updated overview of feature availability by country.
Moderator's note: Posts were merged into 1 thread and a more suited title is provided.

How to implement bapi for transaction code f-02 for multiple line items

Hi All,
I am having one requirement to of implementing bapi for tcode f-02.
I have identified the name of the badi e.i. BAPI_ACC_GL_POSTING_POST.
but i dont have any idea how implement it.
i have multiple line items for one header.
Please help me in this.
Regards,
Shoaib.

HI
In recording once u save, the recording comings out the transaction.
If u want the pop-up to display before save. Then in recording also
after entering all data and before Save press enter or do check.Try
this way after that save the transaction.
Regards,
Raghu.

How to do Mapping for the following Scenario

Hi All,
I am doing File 2 File Multimapping Scenario with out using BPM Concept but, My result was Struck at Message Mapping.
Source                          Target
Message                       Message1     Details                                Details
         Name                            Name
         ID                                  ID
Message2
                                                Details
                                                    Name
                                                    ID
I am getting Runtime Exception at Message Transfermation error if i do the one 2 one direct mapping....
so, How to do the Mapping for thei Scenario?
WIth Regards,
Mahesh

Hi Farooq,
I am using Split and Merge.
Source XML
<?xml version="1.0" encoding="ISO-8859-1"?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns="http://sap.com/xi/XI/SplitAndMerge" targetNamespace="http://sap.com/xi/XI/SplitAndMerge">
<xsd:import namespace="http://tcs.com/Demo" />
<xsd:element xmlns:p0="http://tcs.com/Demo" name="Messages">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="Message1" form="qualified">
<xsd:complexType>
<xsd:sequence>
<xsd:element ref="p0:BPM_In_MT" />
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:schema>
Target XML
<?xml version="1.0" encoding="ISO-8859-1"?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns="http://sap.com/xi/XI/SplitAndMerge" targetNamespace="http://sap.com/xi/XI/SplitAndMerge">
<xsd:import namespace="http://tcs.com/Demo" />
<xsd:element xmlns:p0="http://tcs.com/Demo" name="Messages">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="Message1" form="qualified">
<xsd:complexType>
<xsd:sequence>
<xsd:element ref="p0:BPM_Out_MT" minOccurs="0" maxOccurs="unbounded" />
</xsd:sequence>
</xsd:complexType>
</xsd:element>
<xsd:element name="Message2" form="qualified">
<xsd:complexType>
<xsd:sequence>
<xsd:element ref="p0:BPM_Out1_MT" minOccurs="0" maxOccurs="unbounded" />
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:schema>
Thanks
Mahesh

How to give authorization for create and change particular Condition Type

Hi...
In my requirement is , Only one user can be authorized to create and change a particular condition type 'ZABC' in vk11 and vk12 .
For remaining condition type can be used as in normal .
How to do this ? How to give authorization for a particular user for particular condition type ?
Plz guide me ..
Thanks in advance .
Deepa .

Hi Deepa ,
u can check A.Object V_KOND_VEA, in user profile u can assign condition type or tables.
have a word with ur basis guy , so he can help u in better way.
aand also ref FM SD_COND_AUTH_CHECK
Regards
Prabhu

How to implement aggregation for different date periods

We have a report which shows various metrics for a given date period, selected by date prompts.
The problem is that one of the metrics should show data only for the first day in the range, selected by the prompt.
So, for example, if user selects in the prompt the range Oct 1 - Oct 10, then that particular column should only show data for Oct 1, while all others - for Oct 1 - Oct 10.
Any suggestions how to implement this would be appreciated.

Please try to play around with case statements in the fact column.

How to implement mapping logic?

Hi Experts,
i have 5 idocs coming with structure as this.
IDOC-1* SEGMENT-EKPKF*
    SEGMENT-EKSEG
    field-KOART=D
    field-SKHZG=H
    field-WRBTR=200.00
   SEGMENT-EKSEG
    field-KOART=D
    field-SKHZG=S
    field-WRBTR=230.00
IDOC-2 SEGMENT-EKPKF
    SEGMENT-EKSEG
    field-KOART=D
    field-SKHZG=H
    field-WRBTR=50.00
   SEGMENT-EKSEG
    field-KOART=D
    field-SKHZG=S
    field-WRBTR=290.00
now two fields of reciever structure should have value as
FIELD-1
add WRBTR for each idoc when KOART=D and SKHZG=H
i.e result should be 250.00
FIELD-2
add WRBTR for each idoc when KOART=D and SKHZG=S
i.e result should be 520.00
can someone tell me how to implement this.....
regards
Akhil
Edited by: Akhil Rastogi on Mar 13, 2008 11:03 AM

EKPKF>RemoveContext>EKPKF
EKSEG>RemoveContext>EKSEG
SKHZG----
Constant(H)>IFWITHOUTELSE ()> WRBTR-->FIELD1
                         SKHZG==H
SKHZG----
>
Constant(S)>IFWITHOUTELSE ()> WRBTR-->FIELD2
                         SKHZG==S

How to implement mapping for a slowly changing dimension

Similar Messages

Maybe you are looking for