Problems with Full loads/Decreased query performance in Prod

We have a table which serves as a base for a complex view. The table has roughly around 10 Million records and its a daily full load(I know, that delta loads are much better for handling large sets of data, but this information is very dynamic and with the business time constraints and project deliverables, the best decision was to do a Full load).
This is the process we follow:
> Drop Indexes (All columns individual indexes which are used inside the complex view as joins)
> Truncate table
> Load data
> Recreate indexes.
All the above steps are performed from SAP Dataservices Thru scripts and sql() function to execute the command, no manual intervention what so ever.
After the job is successfully completed, the view doesn't refresh at all(It sits there forever). The same job when run across same volume of production data in Test environment performs much faster.
Then, how do I refresh the view is manually log into SQL Developer, drop all the indexes on the parent table, and re-create all the indexes in the same order as Dataservices script. It performs very well after till the next load (the next morning).
Any suggestions would be very helpful.
My main question is why does it run faster, when I drop and recreate the indexes? and doesnt complete when the indexes are created by the SQL() from data services tool.
Tried:
Explain Plan(in dev, Test, Prod): Query cost vaired accross environments but returned results with same return times (In Production after manual Index creation)
Tuning advisor (Only in Test) DBA evaluated it to be good.
Thanks
Nash
DB Version Oracle 11.0.7
Dataservices 3.2

BluShadow and Harman
Thank You!
Im using a regular view, not a materialized view. and yes the query plan is completely different from Test and Production. In test the query was completely running on Hash based joins whereas in Production its using Nested Joins in the execution plan.
Will try to gather statistics after the load and as per BluShadow, will look on the way of writing a function that makes a call to Database.
Thank you all for taking sometime. I will try to test this out starting today and will extend tests over a couple of days.
Regards
Nash

Similar Messages

Problem with delta load urgent!!

Hi,
I have a problem with delta load
We have an IP, which loads data from R/3 system daily, its a delta load to the ODS and it updates to the cube with the selection on Company Codes and 0FISCPER
we are in 3.5 system
For a couple of company codes A & B, the init was done for the period 07.2010 to 12.2099 and after tht the deltas are loaded from 07.2010 till 12.2099 and there's no pblm with tht
Now, there was some updation in R/3 system and the data was maintained for the company codes in A& B for the FISCPER 001.2010 to 006.2010, for which init wasnt maintained...
now how shall we need to load the init in this case? dnt ask me how the postings was done in R/3, but my pblm is purely related to the loading data in BW from R/3, as its very imp for the customer to see the data from 01.2010 to 12.2010 in reports, but the data was only available in reports from 07.2010 onwards
do i need to create another IP and maintain the init for 01.2010 to 06.2010? so tht this selection will automatically appear in the ODS delta loading infopackage
pls throw ur inputs ASAP
thank you

Hi Prince,
No need to maintain any Init for this data, It will be enough if you can load the data from jan 2010 to jun 2010 into your Info Cube.
Follow the below steps:
1)create full load IP for this data source.
2) give the selection as A and B company codes and 0FISCPER as 001.2010 to 006.2010
3) in menu bar, click on scheduler --> select full repair request
4) In the next screen check the check box and save
5) Now execute the IP, it will the data with out disturbing your daily delta.
follow the same procedure to load data till to your Info Cube.
Please revert if you have any questions
Regards,
Venkatesh

Hi! Everyone, I have some problems with JOIN and Sub-query; Could you help me, Please?

Dear Sir/Madam
I'm a student who is interested in Oracle Database and
I have some problems with JOIN and Sub-query.
I hope so many of you could help me.
if i use JOIN without sub-query, may it be faster or not?
SELECT field1, field2 FROM tableA INNER JOIN tableB
if i use JOIN with sub-query, may it be faster or not?
SELECT field1,field2,field3 FROM tableA INNER JOIN (SELECT field1,field2 FROM tableB)
Thanks in advance!

Hi,
fac30d8e-74d3-42aa-b643-e30a3780e00f wrote:
Dear Sir/Madam
I'm a student who is interested in Oracle Database and
I have some problems with JOIN and Sub-query.
I hope so many of you could help me.
if i use JOIN without sub-query, may it be faster or not?
SELECT field1, field2 FROM tableA INNER JOIN tableB
if i use JOIN with sub-query, may it be faster or not?
SELECT field1,field2,field3 FROM tableA INNER JOIN (SELECT field1,field2 FROM tableB)
Thanks in advance!
As the others have said, the execution plan will give you a better idea about which is faster.
If you're trying to see how using (or not using) a sub-query affects performance, make the rest of the queries as similar as possible. For example, include field3 in both queries, or ignore field3 in both queries.
In this particular case, I guess the optimizer would do the same thing either way, but that's just a guess. I can't see your execution plans.
In general, simpler code is faster, and better in other ways, too. In this case
tableB
is simpler than
(SELECT field1, field2 FROM tableB)
Why do you want a sub-query in this example?

Problems with Safari Loading Sites and Photos

For the past week (Feb. 2015) I've experience problems with Safari loading websites on my 2009 20" iMac desktop. Running version OSX Lion 10.7.3 4 GB. Intel Duo Core 2.66 GHz
Mac also will frequently not upload photos at websites like Yahoo News or Facebook. It does this throughout the day.
So, I downloaded Chrome, thinking it would be a better browser if Safari is not functioning. Chrome is just slightly better, and when it won't load a website I get the following error message from Chrome: DNS_PROBE_FINISHED_NO_INTERNET.
I'm debating taking the Mac to the Apple store for diagnosis or repair today, but if anyone else is experiencing similar problems, could you please offer some solutions as to what is going on.
Thank you.
AngieRK

Non-responsive DNS server or invalid DNS configuration can cause long delay before webpages load - Apple Support
Unless you have a good reason not to, you should update the OS to version 10.7.5.

X220:Graphics problem with full screen videos

I have got my X220 laptop last month. I am facing problem while playing youtube videos full sceen.
videos can be seen best with smaller window but there is major graphics problem with full screen.
Can someone help on this?
I am using Windows 7 Enterprise edition.
Thanks

what do you mean by major graphics problem, please elaborate.
Regards,
Jin Li
May this year, be the year of 'DO'!
I am a volunteer, and not a paid staff of Lenovo or Microsoft

Problem with Full Screen

Ok I am getting problems with full screen graphics on some computers.
I am writing an internet based RPG and this is really eating into my time...
Can any one explain why my graphics will not show some times (works others) with the exact same code running....
I am using a BufferStratagy with a frame.
Any help would be gladly apreashiated thank you in advance,
Phibred

Not a thread issue, no thread on this side of the program and yes there is a media tracker. However I have learned that my problem was that my screen does not like to flip to 800x600 for java applications for some reason thx any way.

Problems with the load of Deliveries

Hi experts,
I am having some problems with the load of Deliveries from R/3 into BW.
In LIPS table of R/3, there are 41412 records. I delete the setup tables and realize the extraction with the transaction OLI8BW. After that I launch a simulation with RSA3 but only 6765 records are taken into account.
Apart of that, there is a range of deliveries documents (between 180000000 and 1084000000) that is not be taken into account.
Has someone have similar problems with the load of deliveries?
Thanks.

Matute,
you can try comparing those missing records with those already extracted. I found in my side that some records with document category of "H"(Returns) don't be extracted by 2lis_12_vcitm.
Jin Ming

Problems with pages loading

We are having a lot of problems with pages loading slowly or not at all. We get this message all the time...server not found...even on pages that have just recently been visited. We have this problem with Safari, Firefox, and Camino. I don't have Internet Explorer installed, but why should I just keep adding new browsers. My ISP assures me that the connection is fine. I have emptied caches, cookies, whatever I can find to empty. Did I empty too much? We use a Netgear router and a company called Digitron. Any suggestions?
Message was edited by: cynder13

Hi
Perhaps the easiest way to sort this out is to set up a separate Network Location for your connection:
-Location - set up a personal location by clicking on the drop down menu and selecting "add a location". Use a name familiar to you. Once established, select "apply".
-Next, click on the "Show" drop down menu and select Network Port Configurations. Only Airport ought to be checked. Move it to the top of the list (you can drag it). Select "apply".
-Back to the "Show" menu, select "Airport". Click on the TCP panel. There, enter 4.2.2.2 and 4.2.2.1 (separate lines) in the DNS servers box and select "apply". Also, you can always call your Internet Provider to find out if they have specific codes.
Creating a personal location, plus adding the DNS codes seems to speed things up. Otherwise, the "automatic" function has a tendency to "search" for available locations, hence creating the lag you are seeing.
Lastly, in the Finder, go to your Applications>Utilities folder and select "Terminal". Once the screen is open copy/paste lookupd -flushcache and press return. This clears out the DNS cache. Once done, quit Terminal.
If the above doesn't help, I suspect the Router is the problem. Perhaps you need to upgrade its firmware. Check at the Netgear site>Support.
Post back

DAC - Can I run more then one Exection Plans with full load option enabled?

Hello All,
I have configured for subject Area sales – Orders, Backlog and Invoices (OBIEE)
Now I want to run DAC to load the underline tables for subject Areas Financials – Revenue Analysis and Financials – GL Budget and Expenses, I have identified the relevant fact tables and built a Execution Plan in DAC.
DAC - In which mode should I run the execution plan?
With full load option enabled or disabled because already full load run is done for sales – Orders, Backlog and Invoices and this run should not disturb the existing data
If I run with full load option enabled do it overrides the existing data for other subject area
Please help me I am bit confused!
Regards,
SMA
Edited by: SMA on Aug 18, 2009 3:36 PM

No need of combining all the subject areas into one execution plan. Simply run the second ETL without checking the full load option. It will do the full load for the tables related to the newly added subject areas and incremental for the common tables between old and new subject areas.

Problems with OLE Container in QUERY

Hi all,
I have problem with OLE Container when I am trying to retrieve data from the database. Inserting is no problem and commit is done. I am doing it with
initialize_container('block.ole_object','C:\test.doc');
I have only one column of BLOB type and it is last in the block as it was suggested somewhere on the forum.
When I am trying to retrieve the already inserted data I get error with the following
Description:
FRM-40505: Oracle ERROR: unable to perform query and CTRL+F1 says the following:
ORA-00932: inconsistent data types: expected got
The forms and the database are as follow:
Forms [32 Bit] Version 6.0.8.24.1 (Production)
Oracle Database 10g Enterprise Edition Release 10.1.0.4.2 - Production
I need immediate help!!!

This may be related to the 10g database, I'm not sure as there is no way for me to test it. I know that it works with a 9i database.
One thing to check is to make sure that you don't have the FORMS60_DISABLE_DESCRIBE set to 1 within the Oracle registry.
If this doesn't work, your only option might be to use a LONG RAW instead of a BLOB column type in the database.

Problem with dynamically loading the dropdown list from database

Please help me,
i am having a jsp page which contains a form
with a textfield ,two dropdown list
and a submit button
when i select a list from first drop down, second drop down has to
be loaded from the database dynamically according to the
selected one in the first drop down.
i gave onselect event for the first drop down and
gave this one
temp=first dropdown selected value
self.location='currentfile+query='+temp;
after this current page is reloading, but the already existing
values in textfield and first selected value in drop down list is
missing.
how to solve this problem? and the rest of the problem. i mean
loading the data into second drop down list.
plz help me......

in first <selcet> tag write Onchange and submit to the jsp then the values will return in second select box.

Problem with SQL loader - "maximum length"

using SQL*Loader: Release 8.1.7.0.0
===================================
(full CTL enclosed below)
I have a problem with several rows, in which I'm getting the "Field in data file exceeds maximum length" error.
the DB field (referer) is a VARCHAR2(4000), and the field in the error rows never exceeds few hundred characters. According to Oracle docs I should be able to load fields which are no bigger than the DB field, what gives?
I tried the variation
referer CHAR "SUBSTR(:referer,1,100)"
for this field, which causes all the "referer" columns in the "good" rows to load no more than 100 characters, but the same error repeats for the same rows!
the input file is an IIS log, and the field is the REFERER field. its pure ASCII encoded, is there some character that cause Oracle to behave this way? is this a bug?
here is one "bad" row: the "bad" field starts with "ht
tp://web , is enclosed with quotes. I have replaced the client IP and other fields with xxx for privacy reasons.
after that, I have enclosed my CTL as well.
any help ?
Yoram Ayalon
BTW - I verified in the LOG file that the loader is reading my options for the columns as I described in the CTL. no problem there.
"2003-06-30 11:11:12" xxx.xxx.xxx.xxx WEBSRVXX 80 GET /xxx.xxx 200 0 778 1359 "ht
tp://web.ask.com/redir?bpg=http%3a%2f%2fweb.ask.com%2fweb%3fq%3dWhat%2bis%2bsign
al%2bcommunication%253f%26o%3d0%26page%3d1&q=What+is+signal+communication%3f&u=h
ttp%3a%2f%2ftm.wc.ask.com%2fr%3ft%3dan%26s%3da%26uid%3d032EBF1A318A100F3%26sid%3
d3d2bbe4f8d2bbe4f8%26qid%3d4B2346DA8A56C6418CB4DCB9091EEBA7%26io%3d0%26sv%3dza5c
b0db2%"
LOAD DATA
INFILE '/tmp/mod_websrvxx.txt'
APPEND INTO TABLE tmpLogs
FIELDS TERMINATED BY WHITESPACE optionally enclosed by '"'
(LogDate DATE "YYYY-MM-DD HH24:MI:SS", ClientIP, ServerName, ServerPort, ClientM
ethod,UriStem,Status,BytesSent,BytesReceived,TimeTaken,Referer CHAR "SUBSTR(:Re
ferer, 1, 100)" )

Use:
readsize=3000000
or some large number to raise this limit.
Check the below link for detailed explanation
http://asktom.oracle.com/pls/ask/f?p=4950:8:380010202423963671::NO::F4950_P8_DISPLAYID,F4950_P8_CRITERIA:2167288643374,

Problem with cascading dependent LOV query running when it should not

I have a page fragment with a regular ADF form on it that I use to add new entries to a table. This form has many fields on it with LOV’s associated with them. I have dependent LOV’s on some of them. The one case I have is I have three fields A, B, and C. Field C is dependent on A and B. The problem I seem to be having is when I enter a value for field A using it’s LOV, I get an hourglass for a long time after I select it and before it is displayed on the form. If I delete field C from the form the problem goes away. If I change the query behind the view for the LOV for field C to include a rownum < 20 in the where clause the problem goes away. My question is, why would the selection of a value for field A cause the query to fire for field C’s LOV view and how can I stop it. I don’t really want to use the rownum in the where clause.

i had lot of question?
The problem I seem to be having is when I enter a value for field A using it’s LOV, I get an hourglass for a long time
ok. are using? any complex query to pick the lov 'a' .
Answer: The LOV for A is based on a read only non-EO view with a SQL that is not really very complex. The LOV definition does set multiple values when the selection is made to blank out dependent fields in the data model used by the main form.
after I select it and before it is displayed on the form.
here i cant undestud?
Answer. The order of things is I open the main form, I click the mag glass to open the LOV popup, I select the row I want and click the OK button. Navigation returns to the main form where I get the hourglass waiting for the selected value to be displayed in the field on the main form.
If I delete field C from the form the problem goes away. If I change the query behind the view for the LOV for field C to include a rownum < 20 in the where clause the problem goes away.
ok.
why are you going to delete the value of c?. At intial stage you can make empty after selecting a and/or b you can load into c.
Answer: I physically deleted field C from the main form to see if that was what was causing the long delay. When I run the main form without field C I do not get the hourglass. That is how I know they are related.
My question is, why would the selection of a value for field A cause the query to fire for field C’s LOV view and how can I stop it.
you may set partial trigger to c depends for 'a'.
or else lov 'c' query depends on 'a'
Answer. The query for C's LOV does depend on the value returned when I select a value for A. They are cascading LOV's. Will setting the partial trigger stop the SQL for field C from running? Is the SQL running because I'm blanking out field C when I change the value for field A?
am not sure i understud correctly. can you pictuarize you problem with an example.

Problem with parameter and sql query

I've a problem with te query of my report. The query is:
SELECT [DESCRIPTN]
      ,[LOGTIME]
      ,[STATUS]
      ,[CARDNO]
      ,[LOGDATE]
FROM [Granta5P0].[dbo].[TIMELOG32]
where cardno in ({?cardNo})
the parameter as multiple values checked so I can query for more than one card.
If i put just one parameter everything works fine but when I put 2 or more I have his error
[http://www.megagaleria.com/pictures/Pic_10074_25.jpg]
I realized that the field as no ' delimiting the parameters, I have a function that already does it but I don't know how to put it in my sql command.
If anyone can help I appreciate

Yes, because your parameter is only looking for one card.
where cardno in ({?cardNo})
Will you only be creating querys on two cards or less ?
Are you trying to create an Array?
If two or less you could
where cardno = ({?cardNo}) or cardno = ({?cardNo2})

Problem with Application Loader

Hi,
I'm trying to submit an iPhone application to iTunes using the Application Loader on a Mac Mini (OSX 10.5.8). After I enter my iTunes Connect login details I receive the following error response
*There is a problem with you login information*
Please click back and try again
An error occurred talking to the iTunes Store
The login details are correct, the device connects to the itunesconnect web site from Safari without issue.
Is anybody else experiencing a similar issue? Anybody have any ideas on how I might resolve this issue. It's really frustrating as this is now the only way to get an App into iTunes and the error message is not exactly giving me a lot to go on.

I got a message in an email saying I had the wrong binary code and therefore had to change it by downloading the application manager.
This was the email they sent me?
Some potential reasons that your binary is invalid: the binary icon doesn't meet our requirements, the payload directory is set at the wrong level in the .app wrapper, the bundle version has not been increased, and so on.
You will receive an email detailing the reason for your invalid binary. To clear the error, log in to iTunes Connect, locate your app, and click Ready to Upload Binary to reset your app's status to Waiting For Upload. This will allow you to redeliver your corrected binary through Application Loader.
Makes no sense to me either!

Problems with Full loads/Decreased query performance in Prod

Similar Messages

Maybe you are looking for