Reporting database advice needed
I need some advice from you folks that have been doing this a long time.
I've implemented a reporting database using materialized views. It runs on HPUX 11.23, using Oracle 10.2.0.2.Bottom line is that the performance on it is HORRIBLE. I'm talking on a scale of 1 to 10, it's a 1.
Are there any other options to doing a reporting database that updates nightly from the production database?
I'm getting hit hard to get this thing up and functional. But it's so poor, that people won't use it. I've run the sql through the tuner, and it comes back good. Is there some other way of looking into this thing to see where the brick wall is?
I had thought about using a standby database, running in read only mode. But I learned that once brought online in read only mode, it doesn't update the logs anymore. I guess I could run some nightly scripts to bring it back off line and into recovery mode to update all the logs, then return to read only?
Is there better options out there? I'm at a loss at this point.
Thanks.
Being that the bad performance is coming off a different server, if I understand the environment, have your compared the hardware capability including cpu, memory, and disk?
What kind of disk do you have, is it stripped, etc ...?
Are both databases using the same version of Oracle?
Are both databases running on the same OS and version?
What do the OS level IO, memory, and cpu statistics look like?
What kind of network connection do you have between the two machines? Has anyone verified that the network card is set to full duplex? Has anyone even looked at the network for this situation?
HTH -- Mark D Powell --
PS - Is the second server physical or virtual? There are a lot of things that can impact performance. You have not provided much in the way of what the environment looks like. Reviewing the answers to the above questions may allow you to spot the problem.
Edited by: MarkDPowell on May 8, 2009 5:02 PM Add PS
Similar Messages
-
Since I have no knowledge of databases, I'm turning to my fellow Arch users for advice. I would like to have a collection of quotes. I don't believe something as simple as fortune text files would be sufficient, because I would like to have the ability to add meta information which classifies the subject or nature of a quote: tagging the moral of one of Aesop's fables as 'moral' or tagging a quote from Jefferson as 'personal liberty' to signify the subject of the quote. A database, as far as I know, will help simplify the maintenance and access to this collection. As for future plans, I may use this database to put a quote on my website. So my problem is that I don't know where to go from here. A simple interface is preferred but not necessary. As for integrating the database with my website, my hosting environment is the math department at Kansas State University. Thus my host will change when I change schools. Any suggestions or criticisms of my plans are welcome.
ok poet... here's a quick breakdown:
sqlite (mentioned twice) is rather interesting. It's self contained, meaning you don't need a seperate daemon running to retrieve the data (check out trac, it uses sqlite exclusively for all it's wiki data). There are also numerous sqlite language extensions (pysqlite is in my repo + AUR)
mysql most likely outperforms sqlite, however it requires a decent chunk of db knowledge, and runs a seperate daemon...
alot of people love mysql, but me, not being a web developer, would spring for sqlite instead. -
Front End to Oracle Database - Advice Needed
Hi
My company has recently purchased an Oracle Database. Are there any advantages in creating the front end in Oracle as opposed to writing the front end in Java.
I am interested to know if one method is preferred over the other. I was planning on writing it entirely in Java.
Any help or advice would be appreciated.
Thanks
Kellyhttp://www.tuxedo.org/~esr/faqs/smart-questions.html#ASKING
pls don't crosspost
http://forums.java.sun.com/thread.jsp?thread=243868&forum=31&message=892346
http://forums.java.sun.com/thread.jsp?thread=243869&forum=48&message=892352 -
P6 user name is not valid for connecting to the reporting database
No data is available because your P6 user name is not valid for connecting to the reporting database
I am getting above error in the following environment:
P6 running on wls instance 1.
BI Publisger running on wls instance 2
MS SQL server 2005
Note that the error appears when I clink on the 'Reports' tab in P6. My admin user on P6 has access to report/analyser modules.
To connect P6 to BI Publisher I am using 'PxRptUser' in the P6 configuration for Bi Publisher. I know as well that the WSDL URL is correct and I can test this in SoapUI tool.
In BI publisher I have created the PMDB data source using PxRprUser, and the test of this connection works.
(Because the report samples come with Oracle flavoured SQL that SQL server does not like, I have configured BI Publisher so I have just a single report left that sources it data from an xml file. This works in BI Publisher. It also helps me in that I do not need to add 'WHERE' clauses and parameters required for SQL server?)
Furthermore, using a DB tool, I can connect to my SQL server using PxRPTUser.
So why do I get the error above?
I picked up somewhere that I should not be adding users to BI Publisher. Funny enough, testing the 'login' method the BI Publisher exposes through its WSDL (as above) I noticed I HAD to create the user PxRptUser in BI publisher application itself (on top of PxRptUser in database) for the login web service to work with PxRptUser
That did not solve the connection between P6 and BI Publisher though. What am I missing ...
Edited by: user3674522 on 10/11/2011 20:16Thought I found something but can't repliacte, som issue is still there:
Had a look at the wls instance logs where BI publisher is running, and the error I get is:
111111_023646955][][ERROR] javax.naming.NamingException: Unresolved naming: cn=admin, dc=user, dc=users, dc=principals at [cn=admin]
That user, admin, is the one I have used to access P6. Why is this passed on to BI Publisher? I thought the idea was that the PxRptUser set in BI Publisher configurations in P6 would be used?
Edited by: user3674522 on 10/11/2011 20:17 -
How to report database performance to upper management?
Hello all.
I am looking for a way to report database performance to upper management. I'll start by giving you an overview of our team structure. I manage a team of various roles: Level 2 support specialists, configuration managers, and DBAs - we are dubbed the
"Production Support Team". I report directly to the VP of Software Development who oversees the Design, DEV, and QA, team managers. This means that our team, Production Support, can be considered a peer team of Design, DEV, and QA.
The manager of each team compiles metrics from their team members and reviews them on a weekly basis to ensure we are headed in the right direction. We then take our metrics, and distill them down into a few key metrics that we then report to the VP
of Software Development. Those metrics are easy tom compile for the L2 support roles (number of tickets escalated, number closed, etc.). However, I've been struggling with how to report DBA performance for a long time. Every time I start
to compile numbers, I end up with tons of things that are great for a DBA, but don't mean much to upper management. Does anyone have any suggestions. Surely I'm not the only person that has had this issue?
I'd be happy to provide more info if needed. Thanks!
Clintare you using an RTF template ?
in the RTF template you need to use this syntax for the HTML enabled field
<?html2fo:MOSC_COMMENTS?>
instead of <?MOSC_COMMENTS?> -
Hi Experts,
I am looking for best concept for reporting database. Requirement is to send to data warehouse system aggregated data from my database. The idea is to have something like DWH area and prepare data before export. This (let’s say) DWH area can be a separate instance or can be in the main database.
I am taking into consideration data guard mechanism but I do not want to have whole database – I need only a piece of data from several tables.
The next idea I have in mind is to simply get data from main database and insert it into the DWH area – but this operation can be very resource (and time) consuming.
Is there any out of the box Oracle mechanism to develop such as architecture?
Maybe you have any other suggestion how I can prepare this mechanism to prevent database kill?
Thank you in advance for your help,
Michal.DWH design is not something that can be answered on a forum. There is just too much detail to explain. Get a good book on the subject.
It all depends on the data structures, size, transaction volume, and reports you want to run.
If you want to move a subset of aggregate data to a reporting database (or reporting schema), then you should read up on database links, "merge into" statements, mviews, and streams. Also read up on the OWB product, fact and dimension table design, and bitmap indexes. -
Reporting database - copy of production. How to create?
Hi!
To offload our production environment from heavy queries caused by reporting needs, we need to set up a reporting database. This database must be a copy of our production database. However, the reporting database can be lagging behind the production environment by some time (let's say an hour or so).
The reporting database may be read-only if that makes it more easy to set up and administer.
We would like the reporting database to have minimum impact on our current production environment. Preferably the coupling should be non-existent, meaning that the production environment should not know about the reporting database.
The reporting database can initially be created by a copy of production.
We can also accept downtime on the reporting database in case creation of new datafiles, or any other reason, in the production database requires a recreation of the reporting database.
We are currently running Oracle 9iR2, but are planning to upgrade to Oracle 10gR2 later this year. We are running in an enterprise environment.
Could you please suggest to me how to set up a reporting database as described here? A solution for either Oracle 9iR2 or 10gR2 is welcome.
Thanks in advance for you help!In addition to what previous poster said, you may use Archiver Transmission with maximum performance mode for your standby DB.
If you choose logical standby, then it can be queried while it is actualizing (constantly), but may not support all data types and DDL operations from your primary DB.
If you choose physical standby, then these limitations are gone, but you can use it for reports only after interrupting the actualization (versions before 11g, that is) for the time of your query, opening the DB read only. -
OEM 12c Report Database Growth Trends
DB Size
Shows DB size for all databases
Total size and total free
• Able to do this month by month in OEM 12c by whatever group we define via Information Publisher "canned reports"
However, I need some help because OEM 12c does not provide this requested information:
• Other than manually going to each database one by one (we have hundreds) Do any of you have any ideas or scripts that would provide the following:
(Dumping the data out of OEM month by month via csv and trying to compare using excel is not working because we are adding and removing databases monthly and we have hundreds)
- In one report show Jan, Feb, March, etc database size, used, free, %used by each database
- Compare growth between months
- Show Top 25 databases that have grown
- Show Top 25 Trending growthHi,
You can query the OMS Repository directly, I used to run a report quite a long time back, using the SQL below to do similar thing:
SELECT target_name Database, key_value TB, round(max(maximum),0) maximum
FROM mgmt$metric_daily
WHERE target_type = 'rac_database'
and metric_name = 'tbspAllocation' and metric_column = 'spaceUsed'
and trunc(rollup_timestamp, 'MONTH') = '01-JUL-08'
and target_name in ('<DB_NAME>')
GROUP BY target_name, key_value, trunc(rollup_timestamp, 'MONTH')
ORDER BY Database, TB;
This was query a 11g OMS, so the tables and columns may of changed.
Hope this helps
ZedDBA -
BBSM - how do we manage the report Database
From the documentation, it seem that we can not purge BBSM records in the report Database. Does somebody care about the management of those records, if yes how ?Can it happen that the database get full and that BBSM crash ?
thanksAs a regular maintenance item I would clear out the transaction history and debugging tables. These should not cause the BBSM to crash but can cause a performance hit.
Purge both the transaction history and debugging tables. This can be done via SQL commands. MSDE has a 2GB limit per database. The past history in the transaction history will be purged. If you want to save this data in a text file, use the following:
Bcp "use atdial select * from transaction_history" queryout -T -c
The above will export the table to a tab delimited text file. It will be very large and notepad will not be able to open this file. You will need
to use excel, access or some other text editor that can handle large files.
The next step is to purge the two tables. These will be the largest tables especially if they have been using debug. Transaction_history is
written to constantly and needs to be purged on occasions.
From the command prompt
OSQL -d atdial -E
> delete transaction_history
> delete debugging
> go
Hope this helps. -
Can anyone confirm if I need to modify the InsertVersionInfo.sql and Permisioins.sql scripts for both the APP-V Management and Reporting databases? KB3031340 only references the Management Database, but I suspect it is required for both.
Thank You!It should only apply to Management Database. There weren't any changes to the Reporting DB AFAIK.
Steve Thomas, Senior Consultant, Microsoft
App-V/MED-V/SCVMM/Server App-V/MDOP/AppCompat
http://blogs.technet.com/gladiatormsft/
The App-V Team blog: http://blogs.technet.com/appv/
The MED-V Team Blog: http://blogs.technet.com/medv
The SCVMM Team blog: http://blogs.technet.com/scvmm/
“This posting is provided "AS IS" with no warranties, and confers no rights. User assumes all risks.” -
Report on Training need management
Hello,
we have to report on training needs by employee with delivery method : we need a report to show booked and not booked for all training needs for all employees with the delivery method of the training.
Is there a standard report? can we create a query?
please advise
BR,
K.There is no standard report for this.
You can create a query BUT your requirements won't be met in a single query. Report on employees booked for trainings is easy. Remember though, that ad hoc query only displays EXISTING records not records that are not there e.g. employee who ARE NOT booked to trainings with certain delivery method.
Heres what you do: activate the Rel. BE Type/Att in V_T77KV_2 for Person (or other otypes you want to report on). You do this so that you'll have direct relationship between D and P. Remember that Delivery method is stored in the D object type not in E.
You might have ideas on using E as start object in your infoset. Sure you can display the 'attended by' relationship between E and P but you won't be able to filter by Delivery Method because, like i said, it is stored in the D object type not E. You hear.
Heres what you do next.
1. Create a query for the employee population you want to report on e.g. all Permanent employees.
2. Create infoset with starting object P. Include 034 relationship to D. And all infoytpes of D object.
3. Create a query for all employee with that population (Permanent Employees) who have relationship P 034 D and then select the Delivery Method as parameter. The search result would show all employees who have attended that training with the delivery method you specified.
4. You cross-check this list with the result in step 1 to get the list of employees who HAVE NOT attended the training and then wham bam thank you maam. now give me points. lol -
The command TfsAdmin ProjectServer /RegisterPWA causes next error:
TF244069: An error occurred while checking the provisioning status of the reporting database schema for a PWA instance.
Project Server returned the following error: "Server was unable to process request. ---> The request failed with HTTP status 401: Unauthorized.".
(type ProvisionException)
Exception Stack Trace: at Microsoft.TeamFoundation.Sync.Provisioning.ProvisionPwaDBSchema.HandleSoapException(SoapException soapException, String errorResourceString)
at Microsoft.TeamFoundation.Sync.Provisioning.ProvisionPwaDBSchema.IsDBSchemaProvisioned()
at Microsoft.TeamFoundation.Sync.Provisioning.ProvisionManager.Provision()
I installed SharePoint 2013 and Project Server 2013 as farm and TFS 2012 and my account has permissions everywhere. I read article
http://msdn.microsoft.com/en-us/library/gg412653.aspx and gave full permissions for TFS account to SQL and Project, Project app pool account to SQL, but still have an error.
How can I find out what exactly permissions are not enough???The problem was in claims authentication. Changed to Windows and all worked out.
-
Standard Report RFKABLOO i need to add email functionality
In Standard Report RFKABLOO i need to add email functionality. I am a bit
Confused with the field groups used and insert statements as:
INSERT
icdpos-tabname
icdpos-tabkey
icdpos-fname
icdpos-chngind
icdpos-f_old
icdpos-f_new
fldtype
fldleng
INTO daten
Its having some includes too flags set. Can anyone suggest how to proceed.Hi,
did you try STR+F7?
do you mean report RFKABL00 (00 -> zero zero) or oo?
We only have RFKABL00 (zero zero)!
regards, dieter -
I have SSRS parametarized report in that one data set have repeated values with query parameter . but while am mapping that query
parameter to report parameter i need to pass distinct values. How can i resolve thisHi nancharaiah,
If I understand correctly, you want to pass distinct values to report parameter. In Reporting Service, there are only three methods for parameter's Available Values:
None
Specify values
Get values from a query
If we utilize the third option that get values from a dataset query, then the all available values are from the returns of the dataset. So if we want to pass distinct values from a dataset, we need to make the dataset returns distinct values. The following
sample is for your reference:
Select distinct field_name from table_name
If you have any other questions, please feel free to ask.
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support -
Error installing P6 Reporting Database 3.0
I am a relative noob when it comes to Oracle applications. And my customer has allowed their Oracle support contract to expire, which makes things so very easy....
I currently have EPPM 8.2 w/Weblogic and OBIEE installed and functional...11.1.1.5....on 2008 R2, with a Solaris backend. I am attempting to install and configure the P6 Reporting Database 3.0. I'm running into errors when running the staretl.bat process for the first time- I believe what is happening is it is trying to pull data into the Star database. It generates the following error:
*+<12.19.2012 16:50:04> staretl [INFO] (Progress) - Finished Script W_PROJECT_SECURITY_SS.sql+*
*+<12.19.2012 16:50:10> staretl [INFO] (Message) - Extract2Stage Insert Time for 825327 rows on table W_UDFVALUE_DS is .231 mins (13.85s) at rate 59590.397/s+*
*+<12.19.2012 16:50:10> staretl [INFO] (Message) - Complete extract on UDFVALUE for table W_UDFVALUE_DS rows=825327+*
*+<12.19.2012 16:50:10> staretl [INFO] (Message) - Processed 825327 rows in 13.857/s at rate of 59560.294/s+*
*+<12.19.2012 16:50:10> staretl [INFO] (Progress) - Finished Script W_UDFVALUE_DS.sql+*
*+<12.19.2012 16:50:10> staretl [ERROR] (Message) - The SQL script W_PROJECT_DS.sql failed+*
*+<12.19.2012 16:50:10> staretl [ERROR] (Message) - The SQL script W_ACTIVITY_DS.sql failed+*
*+<12.19.2012 16:50:10> staretl [ERROR] (Message) - The SQL script W_USER_SS.sql failed+*
*+<12.19.2012 16:50:10> staretl [ERROR] (Message) - The SQL script W_RESOURCE_DS.sql failed+*
*+<12.19.2012 16:50:10> staretl [ERROR] (Message) - The SQL script W_WBS_DS.sql failed+*
*+<12.19.2012 16:50:10> staretl [INFO] (Progress) - Step 12/28 Part 2/3 - FAILED (1) (0 hours, 0 minutes, 40 seconds, 16 milliseconds)+*
I can view those scripts that are referenced, but they don't mean much to me. The info I've posted is from the log files, so you can see how useless it is....when I spool and run one of them individually, to see what the exact errors are, here is what I get:
SQL> @ W_PROJECT_DS.sql*
ORA-06512: at "STARUSER.EXTRACT2STAGING", line 74*
Exception: Error during extract for table W_PROJECT_DS: ORA-00904: "LOCATION_ID": invalid i*
+(100,PROJECT,W_PROJECT_DS,n/a,n/a)+
BEGIN*
+*
ERROR at line 1:*
ORA-00904: "LOCATION_ID": invalid identifier*
ORA-06512: at "STARUSER.EXTRACT2STAGING", line 109*
ORA-06512: at line 2*
I don't pretend to know what the error means, or how I might correct it. Anyone have an idea of where I should start looking?I have the same issue, but instead of "Location_ID" it claims that the problem is with "LASTUPDATEDATEX" (ORA-00904: invalid identifier). Oracle DB version is 11g, all of the instances (EPPM, ODS, STAR) are hosted on the same server, but are separate instances.
How does the Multimedia component influence this bug?
BTW: Reporting DB version is 3.1 - staretl process has 48 instead of 28 in 3.0 steps.
Edited by: Victor Razumov on 19.03.2013 8:14
Maybe you are looking for
-
I have a .js file that is part of a web-application. The web application is deployed on tomcat. This .js file in turn calls a .html file deployed on jetty. This .html file is responsible for starting the cometd service, but when i run my web-app, fir
-
Weblogic Server does not show managed server started when I used the Windows service to start it.
I created a windows service to start a managed server and the services was created successfully and stated. WHen I go to the Weblogic Server Admn console, the server is still showing shutdown. Whenm I try to start it, it returns with error that the
-
Where have all the Stars gone?
Hello all, I have just realised that all the Stars by Posters' names have disappeared. Would love to know why that may have happened. Thanks.
-
What is a delta migration and is there any tool that support delta migration?
Hi, We are migrating from MOSS 2007 to SharePoint 2013. What is a delta migration and is there any tool that supports delta migration...Please help me understand.
-
Customized scrollbar for af:table,af:panelgroup & af:panelbox
Hi All, Im using Jdev 11.1.15 version. My requirement is to customize the scroll bars in Table,PanelGroup & Panelbox. like replacing the background of the scroll with custom image and the scroll bar with custom scroll bar image. Any inputs on this mu