Downsizing a fat ODS to optimaze the processing time!

Hello all,
Working with SAP NetWeaver BI 7.0, a customizing FI_CO OPC ODS with 300.000.000 records extracted from Sap R/3, was enhanced with 2 new fields and since then it has generated big processing time about 20 hrs and same times basis team needs to kill it! This ODS has been loading a Cube and the new enhanced fields will be loaded to another Cube.
As a newbie and Sap BI also newbie at this project, Ive been requested to analyze the model and give a better option to optimize the loading process, options such as should this ODS be deleted and data be extracted straight to the Cubes, or downsizing this ODS by removing the olds records of it and saving it in other new ODS?
Anyone could come up with a bright idea?
Thanks in advanced

Hi all,
Thanks for all replies (Alex & Jorge)
But I've just learned today, the problem above is not exactly what is going on! In reality the problem is not about processing overtime while loading the COPS ODS, but after the 2 new attributes were added to the structure COPS ODS the "Transport" of it is taking big overtime, caused by the needy of BW to re-index the ODS since the 300.0000.000 records are already there! As I said before, I need to redesign the model and suggest some good options to solve the problem. Some options could be deleting data from ODS and keeping the InfoCubes; or deleting data prior to current fiscal year from COPS ODS and keeping historical InfoCubes; or updating everything then perform logical partitioning then keep details in the ODS and aggregate data in Infocubes, also could be moving all COPS ODS data to a temp, apply OPC changes to it and then move data back!
I need to show the advantage or disadvantage of my options and must choose the better solution!
Please, any good suggestion?
Many thanks in advance
Bia

Similar Messages

How to show the processing time taken for a BPEL process in BAM report.

Hi All,
I have the data as below in the Data object. I would like to show the time taken for each order to complete in the report.
instance Id     order Id     product Name     product Code     price     status     instance Time      updaterName
1360010     ord004     Guitar     prod003     2000     requested     9/22/2008 12:12:11 PM     Invoke_InsertSalesOrder
1360010     ord004     Guitar     prod003     2000     Approved     9/22/2008 12:15:11 PM     Invoke_OrderStatusUpdate
This data comes from simple BPEL process where sensors are configured at the start and end of BPEL process. Also have a human task activity in between to create the time difference.
In Enterprise link design studio, I tried to calculate the time difference using expression calculator and store it as calculated field. But that doesn't seems to work because when I execute the plan, second sensor data reaches only after human approval whereas first sensor data would be waiting for calculation and ultimately nothing comes into data object.
How and where the calculation be done to show the processing time in the report. Please someone throw some light on this.
Regards
Jude.
Edited by: user600726 on Sep 30, 2008 1:30 AM

I would suggest modifying your data object so that the data can all be in a single row and use the sensor at the end of the process to upsert (update) the row created by the sensor at the start of the process. The time difference between two fields in the same row is then an easy calculation on a BAM report -- No EL plan should be needed.

How to calculate the Processing time for material based on its route ?

Hello experts,
I would like to calculate the Scheduled in-house production time based on route.
Actually this is done in the prod. route in tcode CA02. (via menu Extras => scheduling => schedule).
After getting the schedule table press the 'scheduling results' button I received the Processing time, Setup and teardown time,... Scheduled in-house production time.
So I'm looking for a function or any tool to use it in report.
thanks,
Eli

hi,
from routing screen,extras>scheduling>schedule(give a variant name)>scheduling results>update material master.this writes the info in the temp file.use tcode CA96 to update material master.this updates lot size dependent in house production time in work scheduling view of material master and deletes the lot size independent inhouse prod, time in MRP2 view.this tool gives more accurate results for your inhouse prod. time.
> Hello experts,
> I would like to calculate the Scheduled in-house
> production time based on route.
> Actually this is done in the prod. route in tcode
> CA02. (via menu Extras => scheduling => schedule).
> After getting the schedule table press the
> 'scheduling results' button I received the Processing
> time, Setup and teardown time,... Scheduled in-house
> production time.
> So I'm looking for a function or any tool to use it
> in report.
>
> thanks,
> Eli

Planned orders are not taking into account the processing time

Hi,
Could you please tell me why planned orders quantities are not based on processing time from the material master.
Materials was set before with 1 day in house production , no matter of lot size.
Based on routings I updated material master with processing time depending on lot size.
What is bottering me now is that planned orders are not taking into account processing time. (e.g. based on my processing time 1000 pce are produced in 3 days, but planned orders show me that 1000 pce are still need in 1 day , but it can not be produced in 1 day ).
what did I miss?
Thanks a lot for any information!

Hello Simona
The in house production time from tab MRP 2 is lot size independent.
However, on tab work scheduling you can define a lot size dependent times.
Please observe that, if you have entered an in house production time, the processing time will not be considered. The F1 help of the field provides the following explanation:
You can define work scheduling times in the material master record in one of two ways:
Either you enter the in-house production time. If required, you can get the system to update this value from the routing.
Or you enter the setup, teardown, processing, and interoperation times. If you maintain these values, the system determines the in-house production time on the basis of lot size.
Therefore, if you want to consider the processing time, you should remove the in house processing time.
BR
Caetano

What is Microsoft's official policy regarding the processing time for HCK2.1 Driver Submissions?

What is Microsoft's official policy regarding the processing time for HCK2.1 Driver Submissions?
Can someone point me to a document that states the official policy stating their maximum review time? This info used to be in the WLK1.6 FAQ but I don't see it for the HCK2.1 suite.
Thanks!
Al

Ian,
Thanks for your reply. Yes, I'm sure LabVIEW uses the (default) Windows timer. And yes, 1 mS is not guaranteed due to the preemptive nature of Windows (and even "RTOSs" to varying degrees), which is why I see about plus or minus 2 mS.
Apparently the Windows timer can be set by API calls. See: http://www.lucashale.com/timer-resolution/. Here's a screen shot of his TimerResolution.exe on a Windows 7 PC:
Here it is on my Windows XP PC after I set it to "Maximum" (initially it was 15.625 mS):
Notice that it sets the Maximum to less than 1 mS, which is supposed to be the max, so there are some bugs. Plus the Default button does not reset it in XP, but does work on Windows 7 or 8. (I know this is not the place to "debug" non-LabVIEW applications!)
I'll bet LabVIEW sets it, too. The only caveat, as I said, is it looks like another application can change it, since the hardware timer is a "global" timer. I have not seen this issue in my LabVIEW applications, have you?
I guess I need to do some more digging to see the code to set the timer, but it looks like the developers of LabVIEW have it figured it out.
(FYI, I did notice that running my LabVIEW app (which gives about 2 mS resolution) or a C# app, which gives 15.625 mS resolution, does not affect what TimerResolution.exe reports, so I'm not sure if it's really working correctly. If I figure it out I'll post the results.)
Ed

Why the processing time for loading is taking longtime

Hi All,
why the processing time for loading is taking longtime i want to know the soltion.
Thanks,
chandu

To analyze the process chain and fix it, go through the below document:
[SAP BW Data Load Performance Analysis and Tuning|https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/3a699d90-0201-0010-bc99-d5c0e3a2c87b]
Hope it helps,
Naveen

Consumption during the processing time of the production order

Which adjustments must be made in the material master for the calculation of the lot size in the MRP run, that the consumption of the material during the processing time of the production order is considered for the calculation of the lot size.

Hi ,
You have to judiciously indicate the re order point in the material master( the re-order point is the sum of saftey stock and consumption during replenishment lead time).
How ever , this does not in any way influence the lot size , but only influence the no of lots i.e the procurement proposals. The lot size is determined by the lot sizing procedure selected by you , depending on various factors like agrrements with your vendor , optimum lot sizes to reduce the cost of procurment and storages etc.
You can refer to the following url for details on lot size :http://help.sap.com/saphelp_47x200/helpdata/en/fe/819b9f643b11d3b4e40004ac160649/frameset.htm
and for details about re order point :
http://help.sap.com/saphelp_47x200/helpdata/en/db/6f143ea7ec11d3a8330000e82a3c24/frameset.htm
Hope this information will be useful.
Regards
Raghuramam.

How to find the processing time of any query?

im using oracle express edition, can anyone help me, how to find the processing time of any query?

Trace the query and tkprof the generated trace file.
http://download.oracle.com/docs/cd/E11882_01/server.112/e16638/sqltrace.htm#PFGRF01010

How to accelerate the processing time of pattern match

How to accelerate the processing time of pattern match
If my camera acquire an image in 50ms, but when we analyze this image with pattern match, we need about 300ms. Except using queue to seprate acquisition
and analysis to different loops, there is another way to directly accelerate the processing time of pattern match ? Maybe compact rio with FPGA ?
But I saw a paper in NI web, there is no this function in c-rio ?
Any suggersion will be very apperciated ~
Ricky
Attachments:
aa.png ‏65 KB

Hello,
what matching algorithm are you using? You can reduce time using the Gaussian pyramids algorithm.You can fine tune the parameters using the advanced options.
What is your template size/image resolution?
I suppose using a computer with better performance would also work...
Best regards,
K
https://decibel.ni.com/content/blogs/kl3m3n
"Kudos: Users may give one another Kudos on the forums for posts that they found particularly helpful or insightful."

Reduce the process time..??!! complex algorithm

HI,
I have a complex algorithm which takes almost 900 milliseconds per line to process this . I have to calculate the probability for hundreds of thousand lines. Just imagine if have to calculate this for some 500000 lines which is not feasilble at al.. Can anyone help me in simplifing this algorithm & improve the performance..
This is very urgent & your help will desperately needed. Pls...pls ..help.
thanks in advacnce...
probabilty(int a, int b, int c, int d)     {
     int a1 = 0;
     int b1 = 0;
     int c1 = 0;
     int d1 = 0;
     double p = 0.0;
     double q = 0.0;
     double sum = 0.0;
     if(a*b*c*d == 0) {
          if (d == 0) {
               a1 = a;
               a = b;
               b = a1;
               a1 = c;
               c = d;
               d = a1;
     } else if (((a + 0.0)/(b + 0.0)) < ((c + 0.0)/(d + 0.0))) {
          a1 = a;
          a = b;
          b = a1;
          a1 = c;
          c = d;
          d = a1;
     p = logFact(a+b) +
          logFact(a+c) +
          logFact(b+d) +
          logFact(c+d) -
          logFact(a+b+c+d);
     for (int i=b; i>=0; i--) {
          b1 = i;
          a1 = a + b - b1;
          c1 = a + c - a1;
          d1 = b + d - b1;
          q = logFact(a1) +
               logFact(b1) +
               logFact(c1) +
               logFact(d1);
          sum = Math.exp(p-q) + sum;
          if(a*b*c*d == 0) {
               break;
     }

Replace
if (a*b*c*d == 0) ==> if (a | b | c | d == 0)
Try to avoid arithmetic operation, if it cannot be avoided, try to use integer than double. For example :
the line:
if (((a + 0.0)/(b + 0.0)) < ((c + 0.0)/(d + 0.0))) can be rewritten as
if (a * d < b * c)
If the above has not reduce much processing time...I guess you need to take a closer look at logFact() function. Go thru' its mathematic algo, see if there is anyway to rewrite it, or u can try to post the body of logFact() in this forum.
CT

The process time between INNER JOIN and join in WHERE clause

as u know, there are 2 kind of join
SELECT *
FROM tableA
INNER JOIN tableB
ON tableA.ID= tableB.ID
WHERE ....
and
SELECT *
FROM tableA, tableA
WHERE tableA.ID = tableB.ID
AND ....
I find the first one is faster in MS SQL Server.
But i test them in oracle and i find that it is the same. Is it correct?

Who knows why SQL Server shows different timings. Perhaps it's just cos it's not good at knowing that the two things are the same.
The only difference in timing as far as Oracle is concerned is the time it takes to parse the syntax of the query, which will be nanoseconds. The execution time of two equivalent queries will not differ based on the factor of the syntax used.

Error while executing the Process chain

Hi Friends,
The process chain that I scheduled is getting failed at the Infopackage loading stage.
On checking the diplay message, I found the following log:
Cannot stage requested data for datasource
Error in source system
I activated the datasource in source system, then replicated the same and tried to load data.
But the issue remains the same.
I checked in RSA7. The status corresponding to this datasource is in yellow status.
Can I delete this entry and try again?
Please suggest.
Thanks in advance.
Surjit P

Hi,
/people/mona.kapur/blog/2008/01/14/process-chain-errors
Deadlock
http://help.sap.com/saphelp_nw04s/helpdata/en/2e/44934257a5c86ae10000000a155106/frameset.htm
Dead Locks
2. Error in unit conversion
Units of measure
3.Error 1 in update
When Src file is already open or not accessible.
4.Processing no data
theres no data selected after extraction
5.Caller 70 missing
" This error normally occurs whenever BW encounters error and is not able to classify them. There could be multiple reasons for the same
1) Whenever we are loading the Master Data for the first time, it creates SIDs. If system is unable to create SIDs for the records in the Data packet, we can get this error message.
2) If the Indexes of the cube are not deleted, then it may happen that the system may give the caller 70 error.
3)Whenever we are trying to load the Transactional data which has master data as one of the Characteristics and the value does not exist in Master Data table we get this error. System can have difficultly in creating SIDs for the Master Data and also load the transactional data.
4) If ODS activation is taking place and at the same time there is another ODS activation running parallel then in that case it may happen that the system may classify the error as caller 70. As there were no processes free for that ODS Activation.
5) It also occurs whenever there is a Read/Write occurring in the Active Data Table of ODS. For example if activation is happening for an ODS and at the same time the data loading is also taking place to the same ODS, then system may classify the error as caller 70.
6) It is a system error which can be seen under
the Status tab in the Job Over View.
solution:
" If the Master Data is getting loaded for the first time then in that case we can reduce the Data Package size and load the Info Package. Processing sometimes is based on the size of Data Package. Hence we can reduce the data package size and then reload the data again. We can also try to split the data load into different data loads
If the error occurs in the cube load then we can try to delete the indexes of the cube and then reload the data again.
If we are trying to load the Transactional and Master Data together and this error occurs then we can reduce the size of the Data Package and try reloading, as system may be finding it difficult to create SIDs and load data at the same time. Or we can load the Master Data first and then load Tranactional Data
If the error is happening while ODS activation cause of no processes free, or available for processing the ODS activation, then we can define processes in the T Code RSCUSTA2.
If error is occurring due to Read/Write in ODS then we need to make changes in the schedule time of the data loading.
Once we are sure that the data has not been extracted completely, we can then go ahead and delete the red request from the manage tab in the InfoProvider. Re-trigger the InfoPackage again.
Monitor the load for successful completion, and complete the further loads if any in the Process Chain.
6.Idoc not processed completely.
Here the request remains yellow (in process) and with the same details (as seen in the details tab of the monitor) for an abnormally long time. Many-a-times, the port for communication is not open and re-starting the load helps. For long running jobs, it may not be advisable to restart the extraction
Contact the BASIS administrator to push the IDOC.
look into these links:
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
For common data load errors check this link:
/people/siegfried.szameitat/blog/2005/07/28/data-load-errors--basic-checks
Majority of the issues will be based on these things only..
Hope the following links will give u a clear idea about process chains and clear ur doubts.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/events/sap-teched-03/using%20process%20chains%20in%20sap%20business%20information%20warehouse
Business Intelligence Old Forum (Read Only Archive)
http://help.sap.com/saphelp_nw2004s/helpdata/en/8f/c08b3baaa59649e10000000a11402f/frameset.htm
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/8da0cd90-0201-0010-2d9a-abab69f10045
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/19683495-0501-0010-4381-b31db6ece1e9
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/36693695-0501-0010-698a-a015c6aac9e1
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/9936e790-0201-0010-f185-89d0377639db
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3507aa90-0201-0010-6891-d7df8c4722f7
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/263de690-0201-0010-bc9f-b65b3e7ba11c
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
Siggi's weblogs for data load error and how to restart process chain
/people/siegfried.szameitat/blog/2005/07/28/data-load-errors--basic-checks
/people/siegfried.szameitat/blog/2006/02/26/restarting-processchains
Hope this helps.
pls award me some points
thanks.
Thanks

How to include processing time in the LogFormat in httpd.conf of OAS

Hi,
I want to add processing time parameter in the LogFormat of the HTTP requests in Application server logs file.
i tried to edit the httpd.conf file which orginally is as below
LogFormat "%h %l %u %t \"%r\" \"%{Cache-Control}i\" CC \"%{Cache-Control}o\" %>s %b" common
to
LogFormat "%h %l %u %t *%T* \"%r\" \"%{Cache-Control}i\" CC \"%{Cache-Control}o\" %>s %b" common
But doing so, did not add the Processing time in the GET and POST requests.Although same works for Apache HTTP server.
I want to know how do i add the Processing time attribute in the LOGFormat.
By Default the LogFormat is Common, what are the other possibilities fpr LogFormat.
Please revert.
Regards
Ak

Hi,
1. To reduce the processing time for JMS -> IDOC scenario, try to get the Average processing time taken by JMS adapter, IE, IDOC adapter for the messages that are processed so far by going thro the Adapter Audit logs, SXMB_MONI race and Time in WE02 in R/3 system. Calculate this for 5 - 10 messages at different time to get the clear idea of which step is consuming more time. Then it will be helpful to focus on tuning that specific step. If you are using BPM, check the processing time taken by PE.
2. Check the Inbound and Outbound queues used by this interface, if required try to configure Prioritized Queue with more time allocated for this interface in Integration Engine.
3. Check the load on the Integration Server when this Interface messages are getting processed, to understand/ isolate the interfaces which are consuming more processing time and system resources.
4. If this is not in Production try to perform the Mapping/ transformation in graphical mapping itself, it will be helpful to minimise use of XSLT mapping to get better performance.
5. Check if the Archive and Delete jobs are running successfully in the Integration Server, since this will free up the occupied resources in the system.
6. If possible post seperate Forum questions for issues in different Interface scenarios, it will be easy to understand the problem for all of us.
Hope this will be helpful,
Regards,
S.Santhosh Kumar

How to run save for web and contact sheets at the same time

Hi
my question is simple and a means to save time-
Lets suppose I have 3 camera images and I want to run either save for web applications on 2 cameras at the same time, how/can i do that to save time or lets say contact sheet action on 1 and save for web on the other to save time or photoshop files and this runs in the background?
would really help save me time.

Even if you could run the three process in the background at the same time I do not think the duration of the total execution time would be any shorter. You would still be executing the same number of processor instruction reading and writing the same number of files. If the whole processor was constrained by the processing power running them cuncurrenly may increase the processing time because of contention for the processor. If the processes are IO bound that will not change a overlaping the processes may cause more hard disk seaking because of contention of the hard disk arm.

Processing time

Hi guys,
my question is this: I should to use the Processing time(WRPL-BZTEK) defined in customizing (SPRO>Materials Management>Purchasing>Purchase Requisition>Processing Time) in according to material type and not to side/division as such is now.
My purpose is to enlarge the processing time purchasing (or the planned delivery time) to modify the delivery date scheduled by MRP.
Is there a user-exit\Badi to implement this?Is necessary to modify the standard and if this is the one way how and where can I act?
Thanks in advance to all,bye
Maximilian

Hello, Riva
Processing Time: (configuration setup)
Here, you define the plant-specific purchasing department processing time.
And the processing time is the time required by the buyer to convert a requisition into a purchase order. And the processing time is taken into account during the scheduling process for externally procured materials within the framework of materials planning and control.
Actions
Suggestion:
Maintain the purchasing department processing time for each plant.
Processing time required by purchasing department.
-> Time that the purchasing department requires to convert a purchase requisition into a purchase order.
The usage of this configuration setup is
-> The purchasing department processing time is included in the computation of the delivery date.
Table Name: WRPL (i.e, for Replenishment: quantities per customer/material)
Field Name: SRP_BZTEK (i.e, for Processing time required by purchasing department)
Data element: BZTEK (i.e, data element for processing time for purchase department)
If you want to change the length of the field BZTEK (allowable characters is 2), you can do it, by modifying the TWO TABLES (i.e, T399D (Control parameters for MRP &
WRPL (Replenishment: quantities per customer/material)) using the Acess key (from SAP)
Importent Note: Before you modify it, you need to check with the PP &MM (since this requirement belongs to both modules)
Suggestion: As per my knowledge this (processing time for PR) configuration setup is for the plant (or plants).
Hope this will clarifies you,
Reward, if it helps,
Regards,
Srin.K

Downsizing a fat ODS to optimaze the processing time!

Similar Messages

Maybe you are looking for