Oracle Development Survey: Data Warehouses Customers

At the start of most data warehouse projects, or even during a project, I am sure you as customers try to find answers to the following questions to help you plan and manage your environments:
* Where can I find trend and comparison information to help me plan for future growth of my data warehouse?
* How many cpu's do other customers use per terabyte?
* How many partitions are typically used in large tables? How many indexes?
* How much should I allocate for memory for buffer cache?
* How does my warehouse compare to others of similar and larger scale?
The data warehouse development team, here at Oracle would like to help provide answers to these questions. However, to do this we need your help. If you have an existing data warehouse environment, we would like to obtain more technical information about your environment(s) by running a simple measurement script and returning the output files to us, here at Oracle. This will allow our developers to provide comprehensive documents that explain best practices and get a better understanding of which features our customers use the most. This will also allow you as Customers, to benchmark your environments compared to other customers environments.
From a Company perspective we are also interested to get feedback on features we have added to the database, are these features used, how are they used etc. For example we are keen to understand:
* Which initialization parameters are most frequently used at what values?
* How many Oracle data warehouses run on RAC? on single nodes?
* Is there a trend one-way or the other, especially as data volumes increase?
* Does this change with newer releases of the database?
All results from these scripts will be held confidential. No customers will be mentioned by name; only summaries and trends will be reported (e.g., X percent of tables are partitioned and Y percent are indexed in data warehouses that are Z terabytes and larger in size. or X percent of Oracle9i and Y percent of Oracle10g data warehouses surveyed run RAC). Results will be written up as a summarized report. Every participating customer will receive a copy of the report.
Terabyte and larger DW are the primary interest, but information on any data warehouse environment is useful. We would like to have as many customers as possible submit results, ideally by the end of this week. However, this will be an on going process so regular feedback after this week is extremely useful.
To help our developers and product management team please download and run the DW measurement script kit from OTN which is available from the following link:
http://www.oracle.com/technology/products/bi/db/10g/dw_survey_0206.html
Please return the script outputs using the link shown on the above web page, see the FAQ section, or alternatively mail them directly to me: [email protected].
Thank you and we look forward to your responses.
Message was edited by:
klaker

Similar Messages

Business Process Oriented Development of Data Warehouse Structures

I've recenltly read an interesting paper by Michael Böhnlein and Achim Ulbrich-vom Ende:
Business Process Oriented Development of Data Warehouse Structures .
It discusses the derivation of data warehouse structures from business process models, as opposed to deriving relevant datasets from the underlying operational data sources.
The Semantic Object Model (SOM) methodology is also introduced. The SOM approach can be useful for the modeling of business systems as well as analysis and design.
Cheers, Davide

I've recenltly read an interesting paper by Michael Böhnlein and Achim Ulbrich-vom Ende:
Business Process Oriented Development of Data Warehouse Structures .
It discusses the derivation of data warehouse structures from business process models, as opposed to deriving relevant datasets from the underlying operational data sources.
The Semantic Object Model (SOM) methodology is also introduced. The SOM approach can be useful for the modeling of business systems as well as analysis and design.
Cheers, Davide

Oracle Development Survey on Data Warehouses: How Does Yours Compare?

At the start of most data warehouse projects, or even during a project, I am sure you as customers try to find answers to the following questions to help you plan and manage your environments:
* Where can I find trend and comparison information to help me plan for future growth of my data warehouse?
* How many cpu's do other customers use per terabyte?
* How many partitions are typically used in large tables? How many indexes?
* How much should I allocate for memory for buffer cache?
* How does my warehouse compare to others of similar and larger scale?
The data warehouse development team, here at Oracle, would like to help provide answers to these questions. However, to do this we need your help. If you have an existing data warehouse environment, we would like to obtain more technical information about your environment(s) by running a simple measurement script and returning the output files to us, here at Oracle. This will allow our developers to provide comprehensive documents that explain best practices and get a better understanding of which features our customers use the most. This will also allow you as Customers, to benchmark your environments compared to other customers environments.
From a Company perspective we are also interested to get feedback on features we have added to the database, are these features used, how are they used etc. For example we are keen to understand:
* Which initialization parameters are most frequently used at what values?
* How many Oracle data warehouses run on RAC? on single nodes?
* Is there a trend one-way or the other, especially as data volumes increase?
* Does this change with newer releases of the database?
All results from these scripts will be held confidential. No customers will be mentioned by name; only summaries and trends will be reported (e.g., X percent of tables are partitioned and Y percent are indexed in data warehouses that are Z terabytes and larger in size. or X percent of Oracle9i and Y percent of Oracle10g data warehouses surveyed run RAC). Results will be written up as a summarized report. Every participating customer will receive a copy of the report.
Terabyte and larger DW are the primary interest, but information on any data warehouse environment is useful. We would like to have as many customers as possible submit results, ideally by the end of this week. However, this will be an on going process so regular feedback after this week is extremely useful.
To help our developers and product management team please download and run the DW measurement script kit from OTN which is available from the following link:
http://www.oracle.com/technology/products/bi/db/10g/dw_survey_0206.html
Please return the script outputs using the link shown on the above web page, see the FAQ section, or alternatively mail them directly to me: [email protected].

969224 wrote:
Hi Guys, just a quick question. when we have a primary key on 4 coloumns and we have, say 20 million rows and we want to add one extra row. How does oracle check whether the data on the primary key is unique to the record being added compared to the 20 million rows. Does it actually compare the record being added to all the rows present in the table?
Edited by: 969224 on May 10, 2013 8:14 AMNot the whole row, it compares the 4 columns in the INDEX against the 4 columns in the new row.

Oracle for a Data Warehouse & Data Mining Project

Hello,
I am working for a marketing company and we have a pretty big OLTP database and my supervisor wants to make use of these data for decision making. The plan is to create a
data mart(if not a warehouse) and use data mining tools on top of it.
He does not want to buy one of those expensive tools so I was wondering if we could handle such a project just by downloading OWB and Darwin from Oracle site? None of us are data warehouse specialists so it will be very though for us. But I would like to learn. Actually, I was looking for some example warehouse + mining environment implementations to get the main ideas. I will appreciate any suggestions and comments.
Thank you

Go to
http://www.oracle.com/ip/analyze/warehouse/datamining/
for white papers, demos, etc. as a beginning.
Also, Oracle University offers a course on Oracle data Mining.

[ANN] New Oracle Developer Days Dates and Locations

New dates for the Oracle Developer Days.
These include J2EE training as well.
Look for a location near you:
http://www.oracle.com/go/?&Src=1587968&Act=43

Here is a list of the location currently planed:
Bellevue, Web Services Jan 20-21
Redwood Shores, Best Practices for J2EE Development Jan 27
Redwood Shores, Web Services Jan 28-29
Oklahoma City, Introduction to J2EE Feb 2
Oklahoma City, Best Practices for J2EE Development Feb 3
Oklahoma City, Web Services Feb 4
Oklahoma City, Web Services Feb 5
Cincinnati, Introduction to J2EE Feb 9
Cincinnati, Best Practices for J2EE Development Feb 10
Cincinnati, Web Services Feb 11
Cincinnati, Web Services Feb 12
Orlando, Introduction to J2EE Feb 23
Orlando, Best Practices for J2EE Development Feb 24
Orlando, Web Services Feb 25
Orlando, Web Services Feb 26
There are other topics covered as well.

What Master Data to hold within a Data Warehouse

Hi,
We are developing a data warehouse which will incorporate Master Data entities. We have a pre-existing Master Data Management solution which will be the system of source for MD within the DW & associated Data Marts. We have decided to have a copy
of the MD within the DW. However we are of two schools of thought on what data should be held.
One school says that only those attributes that shapes a query result should be held in the DW-MD the second says that All MD that may be used by a reporting system should be held within the DW so that it is the single source of data for the reporting
application. let me give an example. Let’s say we have a Customer MD entity with the following attributes
Customer
ID
NAME
COUNTRY *
EMAIL ADDR
CITY *
PHONE NUM
GENDER *
LAST LOGGED IN
FAX ADDR
DATE OF JOINING *
LOGO (binary)
Now, we will never do a query based on phone number, fax or email address etc. But the attributes flagged by a
* will shape queries when coupled with our facts. Such as "find all male customers with 4 or more transactions over $1000" or "find all customers registered from 2007 based in New York who have purchased an X". However when
showing the results we will always show the full customer profile including Name, email address etc. (I realise the queries are very specific and not report queries as such but they suffice for the question at hand)
The first schools says only the query shaping MD elements should form the MD within the DW and that the reporting application should obtain the remainder directly from the group MD system as required. The second school says that the DW (or the DM) should
furnish all the MD required by the application. My question is which of the two approaches is considered best practice and as importantly, why?
Cheers,
Daryl

Do you have ODS? NDS?...? or you just have Data warehouse as the only resource for covering reports and dashboards?
if you do have only the Data Warehouse then you have to cover
all report's requirements within the data warehouse, no matter it used in the filter/slicing dicing/or as display only field. So I would add those fields such as names, email address, phone number, as attributes in the data warehouse. But I will only
consider indexing and data warehouse best practices for performance tuning for attributes that participate in slicing and dicing and filtering (such as country, year....).
on the other hand; if you use SSAS multi-dimensional cube on top of your data warehouse, then you can set some attributes to be only visible (attributes for display only), and some of them to be visible and hierarchy enabled (attributes that participate
in slicing and dicing and filtering).
Regards,
Reza
SQL Server MVP
Blog:
http://rad.pasfu.com Twitter:
LinkedIn:
SQL Server Integration Services 2012 Tutorial Videos:
http://www.radacad.com/CoursePlan.aspx?course=1

Should we be using RAC for a data warehouse?

We have an Oracle 11.1 data warehouse system. We were having some performance issues with the system so we shutdown one of the RAC nodes, to see if that was causing the problem. The problem was slow updates on a table (all 30+ million rows on one table had to be fixed). One other perforamnce problem is queries of large partitoned tables (even if the partitioin key is used). Both bulk collect and bulk inserts are very fast.
Question: for a 11.1 data warehouse system should we use RAC? Why?
Thank you...

a school of thought that suggests RAC potentially decreases system availability, rather than increasing it.RAC also has the potential of increasing availability. The potential "cuts both ways", so to speak.
I've worked with non-RAC and RAC databases on a variety of platforms. My experience doesn't show evidence that RAC decreases availability. Given that most servers, even in non-HA clusters, are very reliable (generally), downtime is low in both non-RAC and RAC environments. However, RAC does provide an availability advantage -- protection against node outage. And there are environments which do require the avaialability of RAC. Not all applications require it. RAC is too oversold, not in terms of advantages but in terms of installations.
the increased complexity and the increased risk of both software and human related errors in a RAC environmentI would say that a similar argument arises in DASD v SAN. A SAN is more complex. Human error on a SAN causes a much higher cost. Human error does occur on a SAN. However, no one rejects a SAN on these grounds alone.
RAC is complex to implement. It requires more skills to adminster and diagnose. However, if it is setup well, it doesn't suffer outages. An outage from human error is the same as in a non-RAC environment.
The issue isn't RAC. The issue is that too many customers buy RAC without evaluating seriously whether
a. they need the additional minute increase in availability
b. whether there applications are "RAC-aware" {TAF is still misunderstood}
c. whether they have the skills
RAC provides scalability. It also provides HA. Let me say that again : It also provides HA.
I've seen a high end Failover Cluster environment where one of the "best" vendors in the world talked of a 10-30minute outage for the Failover.
Hemant K Chitale
http://hemantoracledba.blogspot.com
Edited by: Hemant K Chitale on May 31, 2009 11:41 PM

Data warehouse Admin Console - MySQL Physical Data Source

We have some tables on a MySQL database that we'd like to include in our ETL process. The data is to be loaded into our Oracle 11g R1 data warehouse after the transformations are completed.
Everything works with the exception of adding a physical data source in the DAC (Data warehouse administration console) for the MySQL database. There is no connection type for this database. I don't see how it's setup in the documentation.
Can someone explain what needs to be done or direct me to the docs? Or, can this be done?
Does it have to be done? The connection details are stored in the odbc.ini file on the server. So that's managed by Informatica. Will the workflow call from the DAC be sufficient?
Thanks,
LWatkins
DAC 10.1.3.4.0.20080729.2025
Informatica PowerCenter 8.1.1
AIX 5.3/64Bit
OBIA 7.9.5
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit
MySQL 5.5
Edited by: LWatkins on Mar 25, 2013 12:32 PM

I would suggest this work only if you are able to connect MySQL thru Informatica;
1) Create Connection in Worflow Manager and try to use the same connecton in sessions and try to avoid parameters from dac
2) Create same connection in DAC pointing to Oracle or MSSQL or DB2
3) Add tasks in DAC and do not add source and target tables
Another workaround to handling full loads using dac system variables or any other
If helps mark
Edited by: Srini VEERAVALLI on Mar 25, 2013 4:49 PM

Is RAC suited for Data Warehouse

Hi,
I have to provide a best architecture for our data warehouse project, as i googled , i found documents about Oracle RAC for Data Warehouse and features that Oracle RAC provide for a warehouse environment, like performane, availability ...
But i see some document that says , Oracle RAC is not best choice for data warehousing.
I want to provide flexible design that don't need to change after years. but our resources are limited, we have two IBM Power7 servers with 32cores and 62GB ram, we estimate about 1 to 2TB data yearly that should upload into warehouse, because each server just have 62GB ram, what should we do?
Implementing Oracle RAC or just running warehouse on sigle-instance database on one server and just increase the resources of that server?

VahidS wrote:
Hi,
I have to provide a best architecture for our data warehouse project, as i googled , i found documents about Oracle RAC for Data Warehouse and features that Oracle RAC provide for a warehouse environment, like performane, availability ...
But i see some document that says , Oracle RAC is not best choice for data warehousing.
I want to provide flexible design that don't need to change after years. but our resources are limited, we have two IBM Power7 servers with 32cores and 62GB ram, we estimate about 1 to 2TB data yearly that should upload into warehouse, because each server just have 62GB ram, what should we do?
Implementing Oracle RAC or just running warehouse on sigle-instance database on one server and just increase the resources of that server?
I am not sure that which documents you have read based on which you have got the impression that RAC is for DWH. RAC is a part of the Oracle's High Availability solution architecture. It's not designed to cater any specific kind of workload but to provide HA in the case of a node or instance crash. And also, RAC itself doesn't give any performance benefit. If you have a database which is poorly performing, it would remain the same or may be , will become even worse after implementing RAC due to too many things being involved in the architecture now e.g storage, network etc. So if you do want to implement RAC, give it a careful thought, do some testing and then only project it. If you are determined to go for RAC and you are a pure DWH shop, I would suggest to go fro Exadata running RAC . Smart Scan, Compression are just few of those benefits which would come with Exadata along with the RAC's HA solution that would be serving better for your requirements.
HTH
Aman....

Permanent Job Opportunity - Oracle BI Data Warehouse Developer Chicago, IL

Submit Resumes to [email protected]
The Business Intelligence Specialist will play a critical role in designing, developing, deploying, and supporting data warehouse/data mart applications. In this role, the person will be responsible for all BI aspects of a data warehouse/data mart application. Primary duties will be to create reporting standards, as well as coach and support power users with selected Oracle tool. The ideal candidate will have 3+ years demonstrated experience in data warehousing and Business Intelligence tools. Must also possess excellent communication skills and an outstanding track record with the user.
Principal Duties:
Participates with internal clients to define software requirements for development, maintenance and/or improvements
Maintains accuracy, integrity, and availability of the data warehouse
Tests, monitors, manages, and validates data warehouse activity, including data extraction, transformation, movement, loading, cleansing, and updating processes
Designs and optimizes data mart models for Oracle Business Intelligence Suite.
Translates the reporting requirements into data analysis and reporting solutions.
Reviews and sign off on project plan(s).
Reviews and sign off on technical design(s).
Defines and develops BI reports for accessing/analyzing data in warehouse.
Customizes BI tools and data sets for different types of users.
Designs and develop UAT (User Acceptance Testing).
Drives improvement of BI system architecture and development process.
Develops and maintains internal relationships. Actively champions teamwork. Uses internal resources to enhance knowledge and expertise of industry, research, products and services. Provides information and support to others in the company.
Required Skills:
Education and Experience:
BS/MS in Computer Science or equivalent.
3+ years of experience with Oracle, PL/SQL Development and Data Warehousing.
Experience Oracle Business Intelligence Suite and Crystal Reports is a plus.
2-3 years dimensional modeling experience.
Demonstrated hands on experience with Unix/Linux, SQL required.
Demonstrated hands on experience with Oracle reporting tools.
Demonstrated experience with translating business requirements into data analysis and reporting solutions.
Experience in training programs/teach users to use tools.
Expertise with software development process.
Effective mediator - able to facilitate constructive and productive discussions with internal customers, external clients, and development personnel pertaining to feature definition, project scope, and status
Problem solving*identifies and resolves problems in a timely manner, gathers and analyzes information skillfully and maintains confidentiality.
Planning/organizing*prioritizes and plans work activities and uses time efficiently. Work requires continual attention to detail in composing and proofing materials, establishing priorities and meeting deadlines. Must be able to work in a fast-paced environment with demonstrated ability to juggle multiple competing tasks and demands.
Quality control*demonstrates accuracy and thoroughness and monitors own work to ensure quality.
Adaptability*adapts to changes in the work environment, manages competing demands and is able to deal with frequent change, delays or unexpected events.
Benefits/Compensation:
Employees enjoy competitive compensation. We have a full benefits package including medical and dental insurance, long-term disability and life insurance and a 401(k) plan.
The client operates within the healthcare industry.
This is a permanent full-time position. After ensuring your availability and qualifications we will put you in direct contact with the client to move forward in the process.

FORWARD THE UPDATED RESUME AS SOON AS POSSIBLE.

Designer Vs. Oracle Data warehouse builder

Dear all,
Currently I'm responsible of building a Data warehousing project using Oracle database. I'm trying to decide on a tool for modelling my datawarehouse. I have two options:
1) Designer: we have some experience with this tool and we are using it for our main OLTP application.
2) Oracle Data Warehouse builder: we are using this to design our ETL processes.
I want to get some advice on whether the OWB is capable of modelling my datawarehouse and of doing a retrofit action. also, I try to standardize on the tools that are using in the Data Warehouse department (currently we are using only OWB).
I will appreciate for any other advice to help in my selection process.
Best Regards,
Bilal

Hi,
In my experience this choice depends on the implementation of the datawarehouse. If you are building a "pure" Kimball style dimensional data warehouse you should be able to do this using OWB. I have architected such a DW in the past using only OWB, so I am speaking from experience.
If on the other hand you are planning to implement an Inmon style CIF, if your requirements includes an operational data store (ODS), or if you for any other reason anticipate that you are going to be doing a lot of ER modeling, then I would not recommend using the current release of OWB for modelling. (Note however that there are significant improvements to the modelling capabilities in the Paris release of OWB, so this may change in the future)
The advantage of improved maintainability when using a single tools needs to be weighted against the improved functionality if you choose a combination of the two. In the "two tool" scenario strict development and deployment routines need to be enforced to avoid that the model in Designer comes out of sync with the metadata in OWB. (Consider the effect of a developer making a change to a table definition in OWB and deploying it directly to the database without updating the model in Designer.)
Hope this helps.
Regards,
Roald

Creation data warehouse par l'outil oracle warehouse builder (OWB)

Bonjour,
Dans le cadre de mon PFE je veux construire un data warehouse par l'outil Oracle warehouse builder.
je cherche des exemples et un tutorial en français pour faire l'ETL d'une base de données de l'ERP JD Edwards.
SVP, aidez moi et merci.

Bonjour,
For examples try:
http://www.oracle.com/technetwork/developer-tools/warehouse/otn-collateral-086331.html
If you need them in French try changing the country / language on Oracle site, not sure what's available though as my French is not good enough to let me read documentation in that language.
Bonne chance

Tools required to install to work with Oracle Data warehouse

Could anyone please guide me...as I am quite new to Oracle...
till now I was working on Data warehousing using Microsoft tools i.e. (SSIS, SSRS, SSAS, SQL Server)
So Please tell me which are the tools required to install to work with Oracle Data warehouse
I came to know about OWB and OBIEE, but not sure what exactly these are ?

In order to create and develop a webcenter portal application, you only need to install JDeveloper and download the WeBCenter extensions. That's true.
But this install does not include the WebCenter services like dicussions, document services, analytics,... If you want to use these and integrate them in your portal, then you would need to install the suite as described on my blog.

Database and Data Warehouse, SAP BW Vs Oracle

Hello Gurus,
I would like to know the differences between Database and Data Warehouse.
Oracle acts as a Database for SAP BW. I understand it this way, that all the data is stored in Oracle and BW tell the Database how to store, with all the links etc.
Please tell me whether I am correct.
Its my pleasure to award points,
Thanks and best wishes,
i-bi

hi,
A data warehouse is, primarily, a record of an enterprise's past transactional and operational information, stored in a database designed to favour efficient data analysis and reporting (especially OLAP). Data warehousing is not meant for current, "live" data.
A database is a collection of information stored in a computer in a systematic way, such that a computer program can consult it to answer questions. The software used to manage and query a database is known as a database management system (DBMS). The properties of database systems are studied in information science.
http://www.webopedia.com/TERM/D/data_warehouse.html
Hope this helps.
Regards,
yunus

Tables between OBAW and Oracle Data Warehouse in OBIA rpd are different

Hi,
The tables in the Data Warehouse DB is different as compared to the tables in the physical layer of the Oracle data Warehouse in OracleBIAnalytiscApps.rpd.
When I click update Row Count, it gives me below error message:
There was an error while updating row count for "Oracle Data Warehouse"."Catalog"."DBO"."W_CTRY_REGN_D":
[nQSError :17001] Oracle Error Code: 942, message: ORA-00942:Table or view does not exist at OCICallSTmTEXECUTE
Whereas when I click on some other tables for Row count there is not error.
Also, When I am trying to look for some specific table which exist in Data Warehouse (that has the data), it does not exist in the rpd.
Kindly assit me.

hi,
Have a look
Not able toView Data in Answers
Let me know
thanks,
saichand.v

Oracle Development Survey: Data Warehouses Customers

Similar Messages

Maybe you are looking for