Dimension Hieracrhy in Star Schema
Hi devs,
I'm in the process of creating OLAP dimensions using AWM 10.2.0.30A on 10gR2 database, and have successfully created some flat (no levels) dimensions. Now I have to create another dimension, which based on existing model, has parent and child in same dimension table at database end.
When I first attempt to do this using the default "Star Schema" setting for type of dimension table in the mapping section, I get the below error:
oracle.AWXML.AWException: Action BUILDDATABASE failed on object TA_DMT_OWNER.GLA_MP
at oracle.AWAction.BuildDatabase.Execute(BuildDatabase.java:737)
at oracle.olap.awm.wizard.awbuild.BuildWizardHelper$1.construct(BuildWizardHelper.java:184)
at oracle.olap.awm.ui.SwingWorker$2.run(SwingWorker.java:109)
at java.lang.Thread.run(Thread.java:534)
Caused by: oracle.AWXML.AWException: ***Error Occured in BUILD_DRIVER: In __XML_SEQUENTIAL_LOADER: In __XML_LOAD_HIERS: In __XML_SET_GID_FREL: One or more loops have been detected in relationship GLA_MP!PROD_PARENTREL over GLA_MP!PROD. The 1 items involved are TD.
at oracle.AWAction.BuildDatabase.Execute(BuildDatabase.java:604)
... 3 more
I've tried changing the type to "Snowflake" but get the same error. Do you have suggestions as to how to best handle these scenarios?
**Little more background to the data. We DO have surrogate keys in table as well, which is used in fact table. If I do not use the "use natural keys from data source" and use "generate surrogate keys in AW" option, dimension is built successfully. So my follow-up question is, when I build cube will AW know to link the dimension correctly from fact based on surrogates generated by AWM even though those surrogate keys do not physically exist in fact?
Edited by: user8659932 on Oct 30, 2009 7:58 AM
When I first attempt to do this using the default "Star Schema" setting for type of dimension table in the mapping section, I get the below error:
oracle.AWXML.AWException: Action BUILDDATABASE failed on object TA_DMT_OWNER.GLA_MP
at oracle.AWAction.BuildDatabase.Execute(BuildDatabase.java:737)
at oracle.olap.awm.wizard.awbuild.BuildWizardHelper$1.construct(BuildWizardHelper.java:184)
at oracle.olap.awm.ui.SwingWorker$2.run(SwingWorker.java:109)
at java.lang.Thread.run(Thread.java:534)
Caused by: oracle.AWXML.AWException: ***Error Occured in BUILD_DRIVER: In __XML_SEQUENTIAL_LOADER: In __XML_LOAD_HIERS: In __XML_SET_GID_FREL: One or more loops have been detected in relationship GLA_MP!PROD_PARENTREL over GLA_MP!PROD. The 1 items involved are TD.
at oracle.AWAction.BuildDatabase.Execute(BuildDatabase.java:604)This error comes when you have a member rolloing to a different via two different path. If you use surrogate key then as you said the error is gone.
**Little more background to the data. We DO have surrogate keys in table as well, which is used in fact table. If I do not use the "use natural keys from data >source" and use "generate surrogate keys in AW" option, dimension is built successfully. It appended the some text to the value.
So my follow-up question is, when I build cube will AW know to link >the dimension correctly from fact based on surrogates generated by AWM even though >those surrogate keys do not physically exist in fact?Yes it do. You needn't to fabricate that kind of fact data.
You can check this link -> http://www.oracle.com/technology/products/bi/olap/index.html
Thanks,
Brijesh
Edited by: Brijesh Gaur on Oct 30, 2009 9:08 PM
Similar Messages
-
No query rewriting in a star schema
Gentlemen,
I am facing a problem with query rewriting in a simple data warehouse star schema. I want to take advantage of the built-in roll up along dimensions of a star schema. Therefore, I created several DIMENSIONs and made sure that all foreign key/primary key relationships between fact and dimension tables are set up correctly. In addition, as many table attributes as possible are assigned the NOT NULL constraint, especially the ones that are used by the CHILD Of and ATTRIBUTE relationships.
I defined materialized views on the fact table and a couple of dimension tables to report on aggregated data. All the MVIEWs are enabled for query rewriting and I have the initialization parameter set correctly (QUERY_REWRITE_INTEGRITY is set to TRUSTED).
From my tests I learned that a query is rewritten correctly only of the corresponding MVIEW contains the fact table and one dimension table. This is true for every dimension I created. However, as soon as the MVIEW joins more than one dimension table to the fact table the rewriting mechanism fails. It appears that the roll-up (aggregation along the hierarchy) is only possible for one of the dimensions. If the original query suggests rolling-up more than one dimension (e.g., "summarize the key figures by year and product category" but the underlying dimension is based on month and product), the MVIEW is no longer rewritten at all.
Do you know this effect from your work experience? Is this a bug or have I made a mistake or forgotten to switch on a special feature?
Here are some technical data of our data warehouse: we are running an Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 on a Windows Server 2003, the size of the database is about 10 GB (excluding indexes), the star schema contains ten dimension tables each one with a simple or parallel hierarchies (e.g. a product dimension). The fact table and the MVIEWS are partitioned by month.
Any help is very welcome.
Regards,
JohnHi,
you may ask with DBMS_MVIEW why your query does not get rewritten:
Maybe you have to create a util table first with
SQL> @?/rdbms/admin/utlxrw.sql
Then you ask:
SQL> begin
DBMS_MVIEW.EXPLAIN_REWRITE('<your query without ; at the end>');
end;
The reason why it is not rewritten:
SQL> select message from rewrite_table order by sequence;
Kind regards
Uwe -
Map cloned star schema in same BMM Layer.
I have an ID of a group of companies and STAR SCHEMA related to billing with 8 dimensions. This STAR SCHEMA is loaded exclusively with data coming in EBS.
But, due to the acquisition of another company, today I have the need to load data coming from a legacy system.
To create no impact on existing and ETLs conflict of some code, we decided to clone all the star schema tables and load data from legacy.
To not generate any inconvenience to users, we want these facts and dimensions (which have identical structures) arranged so that they appear unique.
Example:
fact_billing_holding
- dimension_day
- dimension_organization
- dimension_vendor
- dimension_consumer
- dimension_transaction_type
fact_billing_legacy
- dimension_day_legacy
- dimension_organization_legacy
- dimension_vendor_legacy
- dimension_consumer_legacy
- dimension_transaction_type_legacy
But you should see structure like this:
fact_billing_holding
- dimension_day
- dimension_organization
- dimension_vendor
- dimension_consumer
- dimension_transaction_type
How can I implement this solution / problem?Hi Vjbez1!
All facts and dimensions are identical! But all tables in this schema are duplicated and with different data.
The data is organized like:
dimension_organization
- dky_organization - name_organization
1 Company X
2 Company Y
dimension_organization_legacy
- dky_organization - name_organization
1 Company Z
fact_billing_holding
- dky_day - dky_organization - dky_vendor - dky_consumer - dky_transaction_type - qtd_items
20130101 1 1 1 1 50
20130101 2 1 1 1 70
20130102 1 1 1 1 14
20130102 2 1 1 1 88
20130103 1 1 1 1 22
20130103 2 1 1 1 10
fact_billing_legacy
- dky_day - dky_organization - dky_vendor - dky_consumer - dky_transaction_type - qtd_items
20130101 1 71 31 12 88
20130102 1 71 31 12 70
20130103 1 71 31 12 92
In my analysis I want to see like this:
Organization | Total
Company X | 86
Company Y | 168
Company Z | 250
Fernando. -
Using two facts of two different star schemas and conformed dimensions
Hi,
I've been working as developer and database designer for years and I'm new to Business Objects. Some people says you can not use two facts of two different star schemas in the same query because of conformed dimensions and loop problems in BO.
For example I have a CUSTOMER_SALE_fACT table containing customer_id and date_id as FK, and some other business metrics about sales. And there is another fact table CUSTOMER_CAMPAIGN_FACT which also contains customer_id and date_id as FK, and some other business metrics about customer campaigns. SO I have two stars like below:
DIM_TIME -- SALE_FACT -- DIM_CUSTOMER
DIM_TIME -- CAMPAIGN_FACT -- DIM_CUSTOMER
Business metrics are loaded into fact tables and facts can be used together along conformed dimensions . This is one of the fundamentals of the dimensional modeling. Is it really impossible to use SALE_FACT and CAMPAIGN_FACT together? If the answer is No, what is the solution?
Saying "you cannot do that because of loops" is very interesting.
Thank you..When you join two facts together with a common dimension you have created what is called a "chasm trap" which leads to invalid results because of the way SQL is processed. The query rows are first retrieved and then aggregated. Since sales fact and campaign fact have no direct relationship, the rows coming from either side can end up as a product join.
Suppose a customer has 3 sales fact rows and 2 campaign fact rows. The result set will have six rows before any aggregation is performed. That would mean that sales measures are doubled and campaign measures are tripled.
You can report on them together, using multiple SQL passes, but you can't query them together. Does that distinction make sense? -
Resolving loops in a star schema with 5 fact tables and 6 dimension tables
Hello
I have a star schema, ie 5 FACT tables and 7 dimension tables, All fact tables share the same dimension tables, some FACT tables share 3 dimesnsions, while other share 5 dimensions.
I did adopt the best practices, and as recommended in the book, I tried to resolve them using Context, as it is the recommended option to Alias in a star schema setting. The contexts are resolved, but I still have loops. I also cleared the Multiple SQL Statement for each context option, but no luck. I need to get this resoved ASAPHi Patil,
It is not clear what exactly is the problem. As a starting point you could set the context up so that it only covers the joins from fact to dimension.
Fact A, joins Dim 1, Dim 2, Dim 3, and Dim 4
Fact B, joins Dim 1, Dim 2, Dim 3, Dim 4 and Dim 5
Fact C, joins Dim 1, Dim 2, Dim 3, Dim 4 and Dim 6
Fact D, joins Dim 1, Dim 2, Dim 3, Dim 4 and Dim 7
Fact E, joins Dim 1, Dim 2, Dim 4 and Dim 6
If each of these are contexts are done and just cover the joins from fact to dim then you should be not get loops.
If you could lay out your joins like above then it may be possible to specify the contexts/aliases that should work.
Regards
Alan -
Star schema design, metrics dimension or not.
Hello Guys,
I just heard from one of my colleagues that its wise to
have an "KPI" or "metrics" dimension in my DWH star schema (later used in OBIEE).
Now, we have quite a lot of data 100 000 rows per day (botton leve, non-aggregated, the aggregations are obviously far less then that, lets say 200 rows per day) and
we have build pre-aggregated data marts for each of the 5 very static reports (OBIEE Publisher).
The table structure is very simple
e.g.
Date,County,NumberofCars,RevenuePerCar, ExpensesPerCar, BreakEvenPerCar, CarType
One could exclude the metrics "NumberofCars","RevenuePerCar", "ExpensesPerCar", "BreakEvenPerCar"
and put them into a metrics dimension.
MetricID Metric
1 NumberofCars
2 RevenuePerCar
3 ExpensesPerCar
4 BreakEvenPerCar
and hence the fact table design would be simpler.
Date,County,MetricID,Metric, CarType
Disadvanatages: A join is required
We would have to redesign our tables
tables are not aggregated anymore for specific metric types
if we notice performance is bad, we would need to go back to the old design
Advantages : Should new metrics appear, we dont have to change the design of the tables
its probably best practice
Note: date, country and cartype are already dimensions. we are just missing one to differentiate the metrics/KPI's
So I struggle a bit, what should I do? Redesign, or stick to the way I have done it, having
performance optimization in mind.
Thanks"Usually the date is stored in sales table or product table.
ut here why they created separate Dimension table for date(Dim_date)? "
You should provide the link.
A good place to start with the basic concepts is :
http://www.ralphkimball.com/
Pick up some of his books and start going through them.
My recommendation would be
The Data Warehouse Toolkit, 2nd Edition: The Complete Guide to Dimensional Modeling
John Wiley & Sons, 2002 (436 pages
Good Luck., -
Dimensions and facts related to all BI Apps Financials Star Schemas
I am kind of new to BI Apps and was wondering whether there is a list of tables/dimension names/ facts that constitute each star schema in Financial Analytics?
I know there are star schemas like AP Aging, AR Aging, AP Transactions, AR Transactions and so on.
How do I get the OBAW dimension and fact table names that are in each of these star schemas?
Oracle BI Apps presentations take me only to the business name of the dimensions and does not give me the original dimension name used in OBAW.
Thanks in advance!Hi Sid
I am in Data Model Reference that you have mentioned. All the star schemas over here are pictures and are not searchable. Also, the ppt that Oracle gave us just says AP Aging as the fact name and I dont know how I can find the fact table corresponding to that.
If someone can point me for that piece of work, I will go though the star schema pictures in the documentation and find relevant dimensions and facts.
Is there any naming convention that we can use like W_APAging_F table or something like that??
Thanks in advance !
Edited by: user566193 on Jan 21, 2010 2:43 PM -
Help to design Star Schema facts and dimensions
Hi
I have the following summarized table that I need to convert to the star schema.
I am totally confused how to create the dimensions. Any help to start with this will be highly appreciated.
I am in an urgent need of it.
Month
AccountId
Cust_id
City
State
Zip
Zip4
AccountMonthsOnBooks
APR
APY
AccountType
OriginationChannel
RewardType
BankProductType
BranchId
CycleEndDate
CycleStartDate
DaysInCycle
DaysInStatement
DirectDepositLastUseDate
FlagElectronicBilling
FlagOverdrawnThisMonth
FlagOverdrawnThisCycle
FlagPaidOverdraft
NumberofTimesOverdraft
OnlineBankingEnrolledIndicator
OnlineBankingLastUseDate
WebLoginCount
OpenDate
OverdraftAmount
OverdraftCount
OverdraftLastDate
OverdraftProtectionIndicator
OverDraftProtectionSourceType
PaidOverdraftAmount
PaidOverdraftCount
PopulationClassIndicator
ProductId
RewardAccruedAmount
RewardBalance
RewardCurrency
RewardRedeemedAmount
RewardsDateEnrolled
RewardsExpirationAmount
RewardTypeBank
RiskScore
RiskScorePlugged
StatementEndDate
StatementStartDate
SubProductId
BalanceADBAmount
BalanceADBNonSweepNonZBAAmount
CycleBeginningBalance
CycleEndingBalance
MonthBeginningBalance
MonthEndingBalance
StatementBeginningBalance
StatementEndingBalance
NonSystemCreditTotalAmount
NonSystemCreditTotalCount
NonSystemDebitTotalAmount
NonSystemDebitTotalCount
ACHCreditTotalAmount
ACHCreditTotalCount
ACHDebitTotalAmount
ACHDebitTotalCount
ACHPPDBillPayCreditAmount
ACHPPDBillPayCreditCount
ACHPPDBillPayDebitAmount
ACHPPDBillPayDebitCount
ACHPPDPayrollDirectDepositCreditAmount
ACHPPDPayrollDirectDepositCreditCount
ACHPPDPayrollDirectDepositDebitAmount
ACHPPDPayrollDirectDepositDebitCount
ATMCreditAmount
ATMCreditCount
ATMDebitAmount
ATMDebitCount
ATMOffUsCashDepositAmount
ATMOffUsCashDepositCount
ATMOffUsCashWithdrawalAmount
ATMOffUsCashWithdrawalCount
ATMOffUsCheckDepositAmount
ATMOffUsCheckDepositCount
ATMOffUsTransferCreditAmount
ATMOffUsTransferCreditCount
ATMOffUsTransferDebitAmount
ATMOffUsTransferDebitCount
ATMOnUsCashDepositAmount
ATMOnUsCashDepositCount
ATMOnUsCashWithdrawalAmount
ATMOnUsCashWithdrawalCount
ATMOnUsCheckDepositAmount
ATMOnUsCheckDepositCount
ATMOnUsTransferCreditAmount
ATMOnUsTransferCreditCount
ATMOnUsTransferDebitAmount
ATMOnUsTransferDebitCount
BranchCheckDepositAmount
BranchCheckDepositCount
BranchCheckWithdrawalAmount
BranchCheckWithdrawalCount
BranchCreditTotalAmount
BranchCreditTotalCount
BranchDepositAmount
BranchDepositCount
BranchDebitTotalAmount
BranchDebitTotalCount
BranchMiscellaneousCreditAmount
BranchMiscellaneousCreditCount
BranchMiscellaneousDebitAmount
BranchMiscellaneousDebitCount
BranchWithdrawalAmount
BranchWithdrawalCount
BranchTransferCreditAmount
BranchTransferCreditCount
BranchTransferDebitAmount
BranchTransferDebitCount
ChargeOffDebitAmount
ChargeOffDebitCount
CheckCausingOverdraftCreditAmount
CheckCausingOverdraftCreditCount
CheckCausingOverdraftDebitAmount
CheckCausingOverdraftDebitCount
CheckCreditTotalAmount
CheckCreditTotalCount
CheckDebitTotalAmount
CheckDebitTotalCount
CheckReturnedCreditAmount
CheckReturnedCreditCount
CheckReturnedDebitAmount
CheckReturnedDebitCount
CheckStopPaymentCreditAmount
CheckStopPaymentCreditCount
CheckStopPaymentDebitAmount
CheckStopPaymentDebitCount
CreditTotalAmount
CreditTotalCount
DebitTotalAmount
DebitTotalCount
FeeACHBillPayAmount
FeeACHBillPayCount
FeeAnnualAmortizedAmount
FeeAnnualAmount
FeeAnnualCount
FeeATMOffUsAmount
FeeATMOffUsBalanceInquiryAmount
FeeATMOffUsBalanceInquiryCount
FeeATMOffUsCount
FeeATMOffUsTransferAmount
FeeATMOffUsTransferCount
FeeATMOnUsCheckInquiryAmount
FeeATMOnUsCheckInquiryCount
FeeDormantAmount
FeeDormantCount
FeeEarlyWithdrawalAmount
FeeEarlyWithdrawalCount
FeeForeignTransactionAmount
FeeForeignTransactionCount
FeeMonthlyAmount
FeeMonthlyCount
FeeNSFAmount
FeeNSFCount
FeeODPTransferAmount
FeeODPTransferCount
FeeOtherAmount
FeeOtherCount
FeeOverdraftAmount
FeeExtendedOverdraftAmount
FeeOverdraftCount
FeeExtendedOverdraftCount
FeePOSPINPurchaseAmount
FeePOSPINPurchaseCount
FeeReturnedCheckAmount
FeeReturnedCheckCount
FeeStopPaymentAmount
FeeStopPaymentCount
FeeTotalAmount
FeeTotalATMCreditAmount
FeeTotalATMCreditCount
FeeTotalATMDebitAmount
FeeTotalATMDebitCount
FeeTotalNonPenaltyAmount
FeeTotalNonPenaltyCount
FeeTotalPenaltyAmount
FeeTotalPenaltyCount
FeeWaiverACHBillPayAmount
FeeWaiverAnnualAmount
FeeWaiverATMOffUsAmount
FeeWaiverATMOffUsBalanceInquiryAmount
FeeWaiverDormantAmount
FeeWaiverForeignTransactionAmount
FeeWaiverMonthlyAmount
FeeWaiverNSFAmount
FeeWaiverODPTransferAmount
FeeWaiverOtherAmount
FeeWaiverOverdraftAmount
FeeWaiverExtendedOverdraftAmount
FeeWaiverStopPaymentAmount
FeeWaiverTotalAmount
FeeWaiverTotalNonPenaltyAmount
FeeWaiverTotalPenaltyAmount
FeeWaiverWireTransferAmount
FeeWireTransferAmount
FeeWireTransferCount
FraudTransactionAmount
FraudTransactionCount
InterestPaymentCreditAmount
InterestPaymentDebitAmount
InternetTransferCreditAmount
InternetTransferCreditCount
InternetTransferDebitAmount
InternetTransferDebitCount
ODPTransferCreditAmount
ODPTransferCreditCount
ODPTransferDebitAmount
ODPTransferDebitCount
OtherCreditAmount
OtherCreditCount
OtherCreditReversalAmount
OtherDebitAmount
OtherDebitCount
OtherDebitReversalAmount
OtherTransferCreditAmount
OtherTransferCreditCount
OtherTransferDebitAmount
OtherTransferDebitCount
PhoneTransferCreditAmount
PhoneTransferCreditCount
PhoneTransferDebitAmount
PhoneTransferDebitCount
POSSIGForeignCreditAmount
POSSIGForeignCreditCount
POSSIGForeignDebitAmount
POSSIGForeignDebitCount
POSPINCreditTotalAmount
POSPINCreditTotalCount
POSPINDebitTotalAmount
POSPINDebitTotalCount
POSSIGCreditTotalAmount
POSSIGCreditTotalCount
POSSIGDebitTotalAmount
POSSIGDebitTotalCount
ReversalFeeACHBillPayAmount
ReversalFeeEarlyWithdrawalAmount
ReversalFeeForeignTransactionAmount
ReversalFeeMonthlyAmount
ReversalFeeNSFAmount
ReversalFeeODPTransferAmount
ReversalFeeOtherAmount
ReversalFeeOverdraftAmount
ReversalFeeExtendedOverdraftAmount
ReversalFeePOSPINPurchaseAmount
ReversalFeeReturnedCheckAmount
ReversalFeeStopPaymentAmount
ReversalFeeTotalAmount
ReversalFeeTotalNonPenaltyAmount
ReversalFeeTotalPenaltyAmount
ReversalFeeWireTransferAmount
SubstituteCheckDepositAmount
SubstituteCheckDepositCount
SubstituteCheckWithdrawalAmount
SubstituteCheckWithdrawalCount
SystemCreditTotalAmount
SystemCreditTotalCount
SystemDebitTotalAmount
SystemDebitTotalCount
TargetSweepCreditAmount
TargetSweepCreditCount
TargetSweepDebitAmount
TargetSweepDebitCount
WaiverFeeReturnedCheckCount
WireTransferFedCreditAmount
WireTransferFedCreditCount
WireTransferFedDebitAmount
WireTransferFedDebitCount
WireTransferInternalCreditAmount
WireTransferInternalCreditCount
WireTransferInternalDebitAmount
WireTransferInternalDebitCount
WireTransferInternationalCreditAmount
WireTransferInternationalCreditCount
WireTransferInternationalDebitAmount
WireTransferInternationalDebitCount
ZBACreditAmount
ZBACreditCount
ZBADebitAmount
ZBADebitCount
AllocatedEquityAmount
CapitalCharge
ContraExpenseCreditLossRecoveryAmount
ContraExpenseFraudRecoveryAmount
EquityCreditAmount
ExpenseCorporateTaxAmount
ExpenseCreditLossWriteOffAmount
ExpenseDepositInsuranceAmount
ExpenseFraudWriteOffAmount
ExpenseMarketingAmount
ExpenseNetworkFeesAmount
ExpenseOperatingAmount
ExpenseOriginationAmortizedAmount
ExpenseOtherAmount
ExpenseTotalAmount
RevenueInterchangeTotalAmount
RevenuePINInterchangeAmount
RevenueSIGInterchangeAmount
RevenueInterestAmount
RevenueOtherAmount
RevenueNetIncomeAmount
RevenuePreTaxIncomeAmount
RevenueTotalAmount
StatusCode
ClosedCode
ClosedDateuser13407709 wrote:
I have the following summarized table that I need to convert to the star schema.
I am totally confused how to create the dimensions. Any help to start with this will be highly appreciated. The first step should be to tell whoever gave you this task that you have no idea what you are doing and set their expectations accordingly.
I am in an urgent need of it.Then it would no longer be urgent and you would have the time to read and learn this.
http://download.oracle.com/docs/cd/E11882_01/server.112/e16579/toc.htm -
What happens when i remove Dimension table in extended star schema
*how to integrate the flex builder web dynpro and xcelsius?
i found some scenarios like when the content of the table change the chart will changes for the changed data in the table using flash islands and web dynpro.
my scenario is like this.
when i changed the chart with sliders automatically the content in the table will update to the chart level ? but both table and chart will be in the same dashboard. how can i work out this scenario using flash islands, flex and web dynpro>
thanks in Advance*Hi Sateesh,
Please go through this URL you will get overall Idea about Extended Star schema with DIM ID's,SID's and Data flow.
http://help.sap.com/saphelp_nw70/helpdata/EN/8d/2b4e3cb7f4d83ee10000000a114084/frameset.htm
http://help.sap.com/saphelp_nw70/helpdata/EN/8d/2b4e3cb7f4d83ee10000000a114084/frameset.htm
http://help.sap.com/saphelp_nw70/helpdata/EN/8d/2b4e3cb7f4d83ee10000000a114084/frameset.htm
I hope it will help you.
Regards
Suresh B.G. -
Why do we need SSIS and star schema of Data Warehouse?
If SSAS in MOLAP mode stores data, what is the application of SSIS and why do we need a Data Warehouse and the ETL process of SSIS?
I have a SQL Server OLTP database. I am using SSIS to transfer my SQL Server data from OLTP database to a Data Warehouse database that contains fact and dimension tables.
After that I want to create cubes using SSAS form Data Warehouse data.
I know that MOLAP stores data. Do I need any Data warehouse with Fact and Dimension tables?
Is not it better to avoid creating Data warehouse and create cubes directly from OLTP database?Another thing to note is data stored in transactional system may not always be in end user consumable format for ex. we may use bit fields/flags to represent some details in OLTP as storage required ius minimum but presenting them as is would not make any
sense to user as they would not know what each bit value represents. In such cases we apply some transformations and convert data into useful information for users to understand. This is also in the warehouse so that information in warehouse can directly be
used for reporting. Also in many cases the report will merge data from multiple source systems so merging it on the fly in report would be tedious and would have hit on report server. In comparison bringing them onto common layer (warehouse) and prebuilding
aggregates would be benefitial for the report performance.
I think (not sure) we join tables in SSAS queries and calculate aggregations in it.
I think SSAS stores these values and joined tables and we do not need to evaluates those values again and this behavior is like a Data Warehouse.
Is not it?
So if I do not need historical data, Can I avoid creating Data Warehouse?
On the backend SSAS uses queries only to extract the data
B/w I was not explaining on SSAS. I was explaining on what happens inside datawarehouse which is a relational database by itself. SSAS is used to built cube (OLAP structures) on top of datawarehouse. star schema is easier for defining relationships
and buidling aggregations inside SSAS as its simple and requires minimal lookups to be performed. Also data would be held at lowest granularity level which can easily be aggregated to required levels inside OLAP cubes. Cube processing is very resource
intensive and using OLTP system would really have a huge impact on processing performance as its nnot denormalized and also doing tranformation etc on the fly adds up to complexity. Precreating a layer (data warehouse) having data in required format would
make cube processing easier and simpler as it has to just cross join tables and aggregate data based on relationships defined and level needed inside the cube.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs -
Star schema without a fact table?
Hi,
I'm preparing my warehouse for using with Discoverer and my question is about the star schema.
- Is a star schema directly associated with data warehouse?
- Can I talk about a star schema if a) I do not have a fact table (no summarized values) and b) if I do not have a dimension of time?
The problem is, I'm thinking of usine Discoverer but should I use it if it's not connected to a data warehouse?
As I told, I'd like to modelized my data "like" a star schema but my "center table" will contain only the foreign key of my dimensions; no time dimensions, no aggregate data in the center table (fact table).
Is there another word for the model I'd like to do?
Thank in advance.Hi,
Is a star schema directly associated with data warehouse?Not really, a star schema is just one where there is one large fact table joined to many smaller dimension tables using key fields. You usually see this in data warehouses.
Can I talk about a star schema if a) I do not have a fact table (no summarized values) and b) if I do not have a dimension of time?A star schema must have a fact table but it doesn't need contain summarised values or a time dimension.
You can use Discoverer with any Oracle database, it doesn't have to be a data warehouse.
Rod West -
Regarding Extended star schema
Hi Friends,
In Extended star schema,master data will load separately ,which will connect through sid's to dimension table .
My question is.. This master data tables can be used other than this cube ?
Please tell me i am in confusion.
Thanks in advace,
Regards,
ramnaresh.Hi
InfoCubes are made up of a number of InfoObjects. All InfoObjects (characteristics and key figures) are available independent of the InfoCube. Characteristics refer to master data with their attributes and text descriptions.
An InfoCube consists of several InfoObjects and is structured according to the star schema. This means there is a (large) fact table that contains the key figures for the InfoCube, as well as several (smaller) dimension tables which surround it. The characteristics of the InfoCube are stored in these dimensions.
An InfoCube fact table only contains key figures, in contrast to a DataStore object, whose data part can also contain characteristics. The characteristics of an InfoCube are stored in its dimensions.
The dimensions and the fact table are linked to one another using abstract identification numbers (dimension IDs) which are contained in the key part of the particular database table. As a result, the key figures of the InfoCube relate to the characteristics of the dimension. The characteristics determine the granularity (the degree of detail) at which the key figures are stored in the InfoCube.
Characteristics that logically belong together (for example, district and area belong to the regional dimension) are grouped together in a dimension. By adhering to this design criterion, dimensions are to a large extent independent of each other, and dimension tables remain small with regards to data volume. This is beneficial in terms of performance. This InfoCube structure is optimized for data analysis.
The fact table and dimension tables are both relational database tables.
Characteristics refer to the master data with their attributes and text descriptions. All InfoObjects (characteristics with their master data as well as key figures) are available for all InfoCubes, unlike dimensions, which represent the specific organizational form of characteristics in one InfoCube.
Integration
You can create aggregates to access data quickly. Here, the InfoCube data is stored redundantly and in an aggregated form.
You can either use an InfoCube directly as an InfoProvider for analysis and reporting, or use it with other InfoProviders as the basis of a MultiProvider or InfoSet.
See also:
Checking the Data Loaded in the InfoCube
If the above info is useful, please grant me points -
Hi All,
I have a star schema in place with 8 dimension and 1 fact table.
But due to some specific requirement, I need to denormalize the schema. I want to copy all fields from all dimension tables to the fact table.
I know this sounds bad but I have to do it. pls dont ask why..
Now, the same can be done using a materialized view but the problem in MV is there are fields which are present in 2 or more table with the same column name, due to which I cant create a MV.
Is there some other way to achieve this goal.
BRK.I have too many records which is affecting the performance of the database.
But now its raising performance problems.Your application had a performance problem. Somebody guessed that a star schema would solve the problem. But it hasn't. So now you intend to implement some spavined variant on star schema because somebody has suggested that complete de-normalisation might solve the problem.
Is this a demonstrable fact (you have benchmarks and explain plans to justify it) or just a guess?
I know how difficult this sort of thing can be, because I've been working through some similar scenario for a while now. The important thing is get some decent metrics on your application. Use statspack. Use the wait interface. Find out where your application is spending its time and figure out what you need to do to reduce the waits. Benchmark some alternatives. This may result in you having to re-write your code but at least you'll be doing so in the knowledge
Cheers, APC
Blog : http://radiofreetooting.blogspot.com/ -
Design Fixed Assets Star Schema from OLTP DB
Hi,
Scope : Design Fixed Assets logical Star Schema for Demonstrate with OLTP tables
Our platform is Oracle 10g Forms and Reports deployed on Oracle 10g App Server._ At the moment we don’t have data warehouse constructed. We are pumping OLTP Data into Staging DB thru jobs and then by using materialized views getting the data in DWH DB which is in progress.
OBIEE 10g installed and working fine for testing.
We are planning to implement OBIEE for Reporting. As a starting point I would like to design Fixed Assets star schema to demonstrate FA reports in OBIEE from OLTP Tables.
FA- OLTP Tables:_
AC_UNIT_MASTR – Business Units
AC_ACNT_MASTR - Nominal Codes
AC_COST_CENTR_MASTR - Departments
AC_MANTN_ASTS - Assets transaction table
AC_AST_BAL_DETLS – Period wise Asset summary
AC_AST_BAL_DETLS_V - View
To achieve this
1).Import tables in physical layer and set physical joins
2).identify and create dimensions and set complex joins and then move to presentation layer.
Please suggest best approach to design Repository
Thanks
Regards,
Kulkarni
Edited by: hai_shailesh on Jan 25, 2012 11:36 PM
Edited by: hai_shailesh on Jan 25, 2012 11:38 PM
Edited by: hai_shailesh on Jan 25, 2012 11:39 PMHi Saichand,
Thanks for the response.
Already i referred that doc and completed practically. now i have to work on Finance data . as a starting point working with Fixed Assets module. already i designed centralised fact with dimensions as below
in physical&BMM layer defined relationship as below()
AC_UNIT_MASTR_D --> AC_AST_BAL_DETLS_F
AC_ACNT_YEAR_MASTR_D --> AC_AST_BAL_DETLS_F
AC_ACNT_PERD_MASTR_D --> AC_AST_BAL_DETLS_F
AC_COST_CENTR_MASTR_D --> AC_AST_BAL_DETLS_F
AC_AST_GRP_MASTR_D --> AC_AST_BAL_DETLS_F
AC_AST_SUBGRP_MASTR_D --> AC_AST_BAL_DETLS_F
and
AC_ACNT_YEAR_MASTR_D --> AC_ACNT_PERD_MASTR_D
When iam trying to create a dimension for Periods(AC_ACNT_PERD_MASTR) , Periods dimesnion created with two tables
AC_ACNT_YEAR_MASTR_D,AC_ACNT_PERD_MASTR_D
Please advice..
Regards,
Kulkarni -
How to convert database in 3NF to Star schema
Hi
Can anyone help me out to convert the database in 3NF to Star schema so that it can be used for Business Intelligence.
Our Application will be populating the database in normal 3NF form which may be difficult for the intelligence to generate queries from it. From the documents given, i saw that only star schema containing dimensions table and fact table is simpler to generate reports. Is there any tool that would convert the schema from 3NF to star schema?
Regards
S. KokilaHi,
I do not know any tools that would do this for you. You can apply a certain logic to create your dimensions and facts, but decisions will have to be taken along the way.
You need to know the basis of database design for datawarehousing. A few good books and articles are available on the subject.
Bonne lecture!
Maybe you are looking for
-
I want to publish my fathers books using iBooks Author. I'm going to set him up with an Apple ID, but he does not have a computer and I will be publishing it from my personal computer. I have my own Apple ID and wish to publish my own books using t
-
How to change legend name in Web-I line graph
Hi, Please help me on this. My Web-I line graph displays the legend same with the universe measure name that I have used. Is there a way to rename the legend. Thank you in advance. Rose
-
Why Flash CC crashes while working
Unable to save file progress.
-
Monitoring, resource managing & logging application for desktop apps.
Hi, I am newbie as far as health checking, monitoring applicartions are concerned. Actually we have several services written in java, & those services/apps. normally runs on differnet machines as a windows service. I have to write a monitoring & cont
-
Comparision btw Struts and JSTL tags
Hi, Is there any article or helpful information that any body have come across that have good comparision between struts and JSTL tags? I am trying to find similar JSTL tags to my struts application. Any help in this regard is appreciated. Thanks, -j