How to improve the load performance while using Datasources for the Invoice
HI All,
How to improve the load performance while using Datasources for the Invoice . Actually my invoice load (Appx. 0.4 M records) is taking very long time nearly ~16 to 18 hrs to update data from R/3 to 0ASA_DS01.
If I load through flat file it will load with in ~20 Min for the same amount of data.
Please suggest how to improve load performance.
PS: I have done the Inpo package settings as per the OSS note.
Regads
Srininivasarao.Namburi.
Hi Srinivas,
Please refer to my blog posting [/people/divyesh.jain/blog/2010/07/20/package-size-in-spend-performance-management-extraction|/people/divyesh.jain/blog/2010/07/20/package-size-in-spend-performance-management-extraction] which gives the details about the package size setting for extractors. I am sure that will be helpful in your case.
Thanks,
Divyesh
Edited by: Divyesh Jain on Jul 20, 2010 8:47 PM
Similar Messages
-
How to improve query & loading performance.
Hi All,
How to improve query & loading performance.
Thanks in advance.
Rgrds
shobaHi Shoba
There are lot of things to improve the query and loading performance.
please refer oss note :557870 : Frequently asked questions on query performance
also refer to
weblogs:
/people/prakash.darji/blog/2006/01/27/query-creation-checklist
/people/prakash.darji/blog/2006/01/26/query-optimization
performance docs on query
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3f66ba90-0201-0010-ac8d-b61d8fd9abe9
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/cccad390-0201-0010-5093-fd9ec8157802
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/ce7fb368-0601-0010-64ba-fadc985a1f94
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/c8c4d794-0501-0010-a693-918a17e663cc
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/064fed90-0201-0010-13ae-b16fa4dab695
This is the oss notes of FAQ on query performance
1. What kind of tools are available to monitor the overall Query Performance?
1. BW Statistics
2. BW Workload Analysis in ST03N (Use Export Mode!)
3. Content of Table RSDDSTAT
2. Do I have to do something to enable such tools?
Yes, you need to turn on the BW Statistics:
RSA1, choose Tools -> BW statistics for InfoCubes
(Choose OLAP and WHM for your relevant Cubes)
3. What kind of tools is available to analyze a specific query in detail?
1. Transaction RSRT
2. Transaction RSRTRACE
4. Do I have an overall query performance problem?
i. Use ST03N -> BW System load values to recognize the problem. Use the number given in table 'Reporting - InfoCubes:Share of total time (s)' to check if one of the columns %OLAP, %DB, %Frontend shows a high number in all Info Cubes.
ii. You need to run ST03N in expert mode to get these values
5. What can I do if the database proportion is high for all queries?
Check:
1. If the database statistic strategy is set up properly for your DB platform (above all for the BW specific tables)
2. If database parameter set up accords with SAP Notes and SAP Services (EarlyWatch)
3. If Buffers, I/O, CPU, memory on the database server are exhausted?
4. If Cube compression is used regularly
5. If Database partitioning is used (not available on all DB platforms)
6. What can I do if the OLAP proportion is high for all queries?
Check:
1. If the CPUs on the application server are exhausted
2. If the SAP R/3 memory set up is done properly (use TX ST02 to find bottlenecks)
3. If the read mode of the queries is unfavourable (RSRREPDIR, RSDDSTAT, Customizing default)
7. What can I do if the client proportion is high for all queries?
Check whether most of your clients are connected via a WAN connection and the amount of data which is transferred is rather high.
8. Where can I get specific runtime information for one query?
1. Again you can use ST03N -> BW System Load
2. Depending on the time frame you select, you get historical data or current data.
3. To get to a specific query you need to drill down using the InfoCube name
4. Use Aggregation Query to get more runtime information about a single query. Use tab All data to get to the details. (DB, OLAP, and Frontend time, plus Select/ Transferred records, plus number of cells and formats)
9. What kind of query performance problems can I recognize using ST03N
values for a specific query?
(Use Details to get the runtime segments)
1. High Database Runtime
2. High OLAP Runtime
3. High Frontend Runtime
10. What can I do if a query has a high database runtime?
1. Check if an aggregate is suitable (use All data to get values "selected records to transferred records", a high number here would be an indicator for query performance improvement using an aggregate)
2. o Check if database statistics are update to data for the Cube/Aggregate, use TX RSRV output (use database check for statistics and indexes)
3. Check if the read mode of the query is unfavourable - Recommended (H)
11. What can I do if a query has a high OLAP runtime?
1. Check if a high number of Cells transferred to the OLAP (use "All data" to get value "No. of Cells")
2. Use RSRT technical Information to check if any extra OLAP-processing is necessary (Stock Query, Exception Aggregation, Calc. before Aggregation, Virtual Char. Key Figures, Attributes in Calculated Key Figs, Time-dependent Currency Translation) together with a high number of records transferred.
3. Check if a user exit Usage is involved in the OLAP runtime?
4. Check if large hierarchies are used and the entry hierarchy level is as deep as possible. This limits the levels of the hierarchy that must be processed. Use SE16 on the inclusion tables and use the List of Value feature on the column successor and predecessor to see which entry level of the hierarchy is used.
5. Check if a proper index on the inclusion table exist
12. What can I do if a query has a high frontend runtime?
1. Check if a very high number of cells and formatting are transferred to the Frontend (use "All data" to get value "No. of Cells") which cause high network and frontend (processing) runtime.
2. Check if frontend PC are within the recommendation (RAM, CPU MHz)
3. Check if the bandwidth for WAN connection is sufficient
and the some threads:
how can i increse query performance other than creating aggregates
How to improve query performance ?
Query performance - bench marking
may be helpful
Regards
C.S.Ramesh
[email protected] -
my iPod has not been working for a month now and i was hoping that you could help me.The part where you charge and sync the iPod is not connecting.There is defiantly not the lead as we use it for the iPhone and that works please could you help!
yours sincerly
jackfromsurreyWhat I am saying is ..........
The iPhone HAS to be active making calls on the UK carrier network for the carrier to identify as "theirs" and therefore eligible for the Carrier to unlock
The way to achieve this is to use a PAYG sim making and receiving calls to establish a customer relationship with the Carrier and then follow the Carrier's process to unlock
With a PAYG it usually means adding a specified (by the carrier ) amount usually £15 /£20 depending on the carrier
This is how O2 function and according to Gemma this is how Vodafone work -
How to Improve DSO loading performance
Hello,
I have a DSO having 3 infosources. This DSO is Generic means based on generic Data Sources. Daily we have a full upload (last 2 months data). Initially it was taking around 55 mins to load the data but now a days all are taking 2.5 Hrs daily.
Can u please tell me how can i improve the performance in other word how can i reduce the time.
Please give some solution or document to resolve this.
amitHi,
Genearl tips you can try to improve the data load performance
1. If they are full loads then try to see if you make them delta loads.
2. Check if there are complex routines/transformations being performed in any layer. In that case see if you can optimize those codes with the help of an abaper.
3. Ensure that you are following the standard procedures in the chain like deleting Indices/secondary Indices before loading etc.
4. Check whether the system processes are free when this load is running
5. Try making the load as parallel as possible if the load is happening serially. Remove PSA if not needed.
6. Goto manage ODS -> activate -> activate in parallel -> increase the number of processes from there.for direct access try TCode RSODSO_SETTINGS
7. Remove Bex Reporting check box in ODS if not required.
Ensure the data packet sizing and also the number range buffering, PSA Partition size, upload sequence i.e, always load master data first, perform change run and then transaction data loads.
Use InfoPackages with disjoint selection criteria to parallelize the data export.
Complex database selections can be split to several less complex requests.
Check this doc on BW data load perfomance optimization
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/1955ba90-0201-0010-d3aa-8b2a4ef6bbb2
BI Performance Tuning
Business Intelligence Journal Improving Query Performance in Data Warehouses
http://www.tdwi.org/Publications/BIJournal/display.aspx?ID=7891
Achieving BI Query Performance Building Business Intelligence
http://www.dmreview.com/issues/20051001/1038109-1.html
SAP Business Intelligence Accelerator : A High - Performance Analytic Engine for SAP Ne tWeaver Business Intelligence
http://www.sap.com/platform/netweaver/pdf/BWP_AR_IDC_BI_Accelerator.pdf
BI Performance Audit
http://www.xtivia.com/downloads/Xtivia_BIT_Performance%20Audit.pdf
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/10564d5c-cf00-2a10-7b87-c94e38267742
ODS Query Performance
Thanks,
JituK -
How to improve class-loading performance for missing classes
Hi,
do you have any ideas how we can improve the class-loading performance on a weblogic 12c running on jrockit? We spend about 20-30 ms per request in class-loading due to the way hibernate criteria API works (it tries to load quite a lot of missing classes). The only thing I came up with was to invert the class-loading using the weblogic descriptor for those missing classes (which are actually no real classes but some parts of a generated JPQL) which does improve performance a bit.
Thanks
DimoHi,
do you have any ideas how we can improve the class-loading performance on a weblogic 12c running on jrockit? We spend about 20-30 ms per request in class-loading due to the way hibernate criteria API works (it tries to load quite a lot of missing classes). The only thing I came up with was to invert the class-loading using the weblogic descriptor for those missing classes (which are actually no real classes but some parts of a generated JPQL) which does improve performance a bit.
Thanks
Dimo -
How to improve this load performance
Hi Experts,
There is load to infoobject which is full and having selections on sales document (4 ranges )
AUART Sales Document Type (10) and PSTYV Sales document item category (12)
The zdatasource is based on view which is built on three tables VBAK, VBAP and VBKD
what are the possibilities of improving the performance , Please help
Thanks in Advance,
NityaWhy you had created a Generic data source for tables VBAP<VBAK<VBKD
You have standard data source
2LIS_11_VAITM -
> VBAP, VBUP, VBAK, VBKD, VBAJP, T001, VBUK, PRPS.
Make use of standard data source if at all there are any fields needed other than provided by SAP enhance the data source.
VIEW is nothing but combination of tables with keys in the tables. it will degrade the performance.... try to check the view design once again....
Are you running the info object full load for the first time? then it will take time...
Try running the delta from next load for info object....
Regards
KP -
Increase the Insert performance while using th e DBlink
Dear Friends ,
I am trying to insert 4 lacs records into a table by using the DB-Link.It is taking very long time ( 1hour) to insert the records,is there any other way where to increase the performance.
This is my insert statement.
insert /*+ APPEND PARALLEL NOLOGGING */ into target_table
select * from source_table@dblink_nameThere is little chance alter table your_table noparallel would help (if parallel keyword was specified at table creation)
It seems you'll have to be more specific (I consider using parallelism as the last resort so consequently I don't have much experience)
- is this a one time job ?
there are several other methods (export/import, datapump, external tables ...) to get the job done
- is this a regular procedure ?
is it feasible to use methods mentioned above
- how frequently has to be performed ?
is it still feasible to use methods mentioned above (taking dblink performance as not acceptable)
- is it mandatory to transfer 400 000 rows from the other database ?
wouldn't be better to pull from the other database just the rows you need ?
wouldn't be better to make the other database the driving site ?
Regards
Etbin
Edited by: Etbin on 25.12.2011 13:30
Try to remove (not sure if it can be done) the status answered as others would think no other contributions are needed
you are supposed to mark the thread answered when you think a satisfactory solution from your point of view has been provided. Take a look at FAQ link (on upper right) -
Improve your System Performance while using SIEBEL
Take a look at Intel & IBM Machines --> here
To improve ur system performance
Siebel CRM Bookshelf
RegardsHi Srinivas,
Please refer to my blog posting [/people/divyesh.jain/blog/2010/07/20/package-size-in-spend-performance-management-extraction|/people/divyesh.jain/blog/2010/07/20/package-size-in-spend-performance-management-extraction] which gives the details about the package size setting for extractors. I am sure that will be helpful in your case.
Thanks,
Divyesh
Edited by: Divyesh Jain on Jul 20, 2010 8:47 PM -
Hey I have created a login page in Dashcode for a mobile safari app (aka iphone web app) and I am having trouble since I can not find any useful info about multiple pages. I don't want to use a stack layout view because it is only a login page and I need to check with a database to make sure the user's login info is correct. Right now I have it set up so that it loads another iphone web app project once it validates the info.
The only problem with this is I am having a good bit of trouble trying to pass values from my php code to javascript or html. For some reason calling the javascript inside the php code makes the actual code inside the app not be called and same with the echo statment for the html.
So I would like to be able to create the app in this way:
Login page > PHP > MS SQL > PHP > UNKNOWN (if I can't get the javascript or html to output both) > Secure info on the next page
I believe It would be a lot easier if I had the option for a multiple page but instead I am having to load up an entirely new dashcode project. If anyone knows a better way please let me know. Or if anyone knows a link to good information on passing values from php to javascript, because I couldn't get any of the code I tried to work, I would really appreciate it.Addendum to previous reply:
OK. This is weird--but I should be used to that, and just grateful that it seems to work (for now).
What I had done is FTPd some image files to my site using Filezilla, but when I had tried to access them, I was unsuccessful. I am almost sure that I used the same url (and variations of it) as you suggested, namely, http://mysite.verizon.net/username/filename , and it either did not work, or gave me the "Page under construction", or, in some cases asked me for my username and password.
But, when I did it this time, it worked. So I probably had something off, but I can now do what I want.
By the way, if you'll permit another question, while on the site-builder site, it said that there was a "Web Photo Manager", and said that "To download the Web Photo Manager: Open the Site Builder application and go to the All My Sites page. Click on the Web Photo Manager link (listed under Advanced Building Tools )." I can't find it--would you happen to know where it is?
In any case, thanks a lot for all your help--it solved my problem. -
No record found in the table while using condition for the new added field
Hi,
I have added a new field in Z table. There is lots of record in the table. The field which I added have null records. When I am checking the record using the condition new field equal(EQ) to space or blank. This shows no record in the table, but when I execute whole of the table, it shows entries for all field.
Please suggest. Thanks in Advance.
Rgds,
Hemant MauryaHi Suhas,
Thanks for your quick response.
Yes I have run SE14 and activate & adjust the database, But problem is same.
My select query is:
SELECT VBELN
PI
GJAHR
KUNNR
GPD
GPI
INTO TABLE I_GP_DATA
FROM ZFI_GP_DISCOUNTS
WHERE AUGDT BETWEEN ZFI_GP_DISCOUNTS-AUGDT AND ZFI_GP_DISCOUNTS-P_DATE
AND DOC_NO EQ SPACE.
Thanks & Regards,
Hemant Maurya -
I got and iphone 5 recently and when i turned it on to use it, the battery was half full so i charged it until it was about 90 percent full. I had this question whether the batterie's lifetime is reduced or not.
I'd be thankful to your answers."People" are wrong, and failing to keep up with current battery technology. There are no rules to charging lithium batteries.
-
Getting Error In the Routine - While writing Code for the Cross Reference.
Hi,
Getting Error In the Start Routine - While writing Code for the Cross Reference from the Text table ( /BIC/TZMDES with Fields /BIC/ZMDES(Key),TXTSH ) Getting Error as [ E:Field "ZMDES" unknown ].
Transformation : IOBJ ZPRJ3(Source) -> IOBJ ZPRJC ( Target ).
The Source Fields are: 0logsys(Key),zprj3(Key),ZDOM3.
The Target Fields are : 0logsys(Key),zprjc(Key),ZDOM3, UID.
Here i am trying to Update the target Field UID by Comparing the Source Field [ zprj3(Key)] with the Text table ( /BIC/TZMDES ) and update the UID.
The Code is as below:
Global Declarations in the Start Routine:
Types: begin of itabtype,
ZMDES type /BIC/TZMDES-/BIC/ZMDES,
TXT type /BIC/TZMDES-TXTSH,
end of itabtype.
data : itab type standard table of itabtype
with key ZMDES,
wa_itab like line of itab.
Routine Code :
select * from /BIC/TZMDES into corresponding fields of table itab for
all entries in SOURCE_PACKAGE
where ZMDES = SOURCE_PACKAGE-/BIC/ZPRJ3.
READ TABLE itab INTO wa_itab
WITH KEY ZMDES = SOURCE_PACKAGE-/BIC/ZPRJ3
BINARY SEARCH.
IF SY-SUBRC = 0.
RESULT = wa_itab.
CLEAR wa_itab.
The tys_SC_1 structure is :
BEGIN OF tys_SC_1,
InfoObject: 0LOGSYS.
LOGSYS TYPE RSDLOGSYS,
InfoObject: ZPRJ3.
/BIC/ZPRJ3 TYPE /BIC/OIZPRJ3,
InfoObject: ZDOM3.
/BIC/ZDOM3 TYPE /BIC/OIZDOM3,
Field: RECORD.
RECORD TYPE RSARECORD,
END OF tys_SC_1.
TYPES:
tyt_SC_1 TYPE STANDARD TABLE OF tys_SC_1
WITH NON-UNIQUE DEFAULT KEY.
Please suggest with your valuable inputs.
Thanks in AdvanceI have split the code in two.. one for start routine.. other for field routine.. hope this helps
Types: begin of itabtype,
ZMDES type /BIC/TZMDES-/BIC/ZMDES,
TXT type /BIC/TZMDES-TXTSH,
end of itabtype.
data : itab type standard table of itabtype
with key ZMDES,
wa_itab like line of itab.
Start routine
select * from /BIC/TZMDES into corresponding fields of table itab for
all entries in SOURCE_PACKAGE
where ZMDES = SOURCE_PACKAGE-/BIC/ZPRJ3.
Sort itab.
field routine
CLEAR wa_itab.
READ TABLE itab INTO wa_itab
WITH KEY ZMDES = SOURCE_FIELD-/BIC/ZPRJ3
BINARY SEARCH.
IF SY-SUBRC = 0.
RESULT = wa_itab-<field name> -
Improve data load performance using ABAP code
Hi all,
I want to improve my load performance using ABAP code, how to do this?. If i writing ABAP code in SE38 how i can call
in BW side? if give sample code to improve load performance it will be usefull. please guide me.There are several points that can improve performance of your ABAP code:
1. Avoid using SELECT...ENDSELECT... construct and use SELECT ... INTO TABLE.
2. Use WHERE clause in your SELECT statement to restrict the volume of data retrieved.
3. Use FOR ALL ENTRIES in your SELECT statement to retrieve the matching records at one shot.
4.Avoid using nested SELECT and SELECT statements within LOOPs.
5. Avoid using INTO CORRESPONDING FIELDS OF. Instead use INTO TABLE.
6. Avoid using SELECT * and select only the required fields from the table.
7. Avoid Executing a SELECT multiple times in the program.
8. Avoid nested loops when working with large internal tables.
9.Whenever using READ TABLE use BINARY SEARCH addition to speed up the search.
10. Use FIELD-SYMBOLS instead of a work area when there are more than 200 entries in an internal table where some fields are being manipulated.
11. Use MOVE with individual variable/field moves instead of MOVE-CORRESPONDING.
12. Use CASE instead of IF/ENDIF whenever possible.
13. Runtime transaction code se30 can be used to measure the application performance.
14. Transaction code st05 can be used to analyse the SQL trace and measure the performance of the select statements of the program.
15. Start routines can be used when transformation is needed in the data package level. Field/individual routines can be used for a simple formula or calculation. End routines are used when you wish to populate data not present in the source but present in the target.
16. Always use a WHERE clause for DELETE statement. To delete records for multiple values, use SELECT-OPTIONS.
17. Always use 'IS INITIAL' instead of equal to '' because null for a character is '' but '0' for an integer.
Hope it helps. -
HOW DOES COMPRESSION OF AN INFOCUBE INCREASE THE LOAD PERFORMANCE?
Hi all
I see that Compression of infocube is one of the parameters to improve/increase load performance. If I am not wrong, Can some one please explain how compressing a cube improves the load performance?
Thanks in advance
RishiHi,
I see that Compression of infocube is one of the parameters to improve/increase load performance. If I am not wrong, Can some one please explain how compressing a cube improves the load performance?
As per my information Compression improves the Quaer performance not loading perforamnce
when u do compression the same characterstics which are having the same values those records will be moved to E Fact table
ex Custno Mat NO Qty Value
C101 M101 10 100
c101 m101 20 200
when u do comperession the recors will be compressed as below
c101 m101 30 300
when the query execution instead of reading two reocrds and compressing at the time of producing output at report level
but when already compressed it fetchs one record directly form E table like that the query perforamnce will be improved.
Not loading perforamnce.
Thansk & regards,
sathish -
How does one use Sound sticks while using HDMI at the same time ??
How does one use Soundsticks while using HDMI at the same time ??
Hi Caleb,
This isn't a precise answer but a possible workable solution. SoundSource puts a menu extra which allows you to switch input/output and has an option for Auto-Switch to Headphones. The auto-switch feature doesn't work with USB headphones but I believe it will with 'regular' headphone plugs such as you use.
http://www.rogueamoeba.com/freebies/
(Oh, did I mention it's free Universal and works with Leopard?)
Maybe you are looking for
-
Employees are not getting displayed in PA20
Hello Experts. I have an Issue.When I am trying to give the employees in PA20,its not querying the employee details.But its employees details are available in the Infotypes. Please Advice. Thanks, Lakshmy.
-
It is asking for a router name and password???
The sales person told me how easy this would be to set up..."just plug it in" he said...right. Anyhoo - I disconnected my ancient wireless router and put the cd in - started doing its thing and then it asks for a router name and password...the only
-
Problem logging onto WRT160N router.
I installed the WRT160N router successfully, setting the type of connection (B/G/N/) to mixed. My laptop and wireless printer see the network just fine, but when I try to logon with the laptop, I get the following error message: "The network password
-
Handling Invalid character.
Hello All My message mapping is failing because of an invalid character and gives the following Exception com.sap.aii.utilxi.misc.api.BaseRuntimeException: Fatal Error: com.sap.engine.lib.xml.parser.ParserException: Invalid char #0x1a(:main:, row:1,
-
Where should i fire the plug within the webdynpro component
when the search don't match for the url parameters passed in my scenario, i need to display the error view page, so wanted to know where should i fire the plug within the webdynpro component. could some one guide plz. thanks n regards Anoop