IDOC size

Hi All,
I have collected number idoc for status 03,12,53 on specific month in BD87 Transaction
Number of idoc =6185902
How to get size of idoc?
According that i can allocate disk space .
Yiour response and suggestion would be highly appreciated
Tks,
Raju

Hi,
I can't select SDATA filed and i got message like
ABAP Dictionary type LCHR is not allowe
screen element
Tks,
Raju

Similar Messages

IDOC Size Handling

Hi,
it seems that my IDOC is broken into several files when it reaches a size threshold. Where can I find information on the IDOC size limit?
Thanks.
/Elvez

Hi Rob,
Your IDoc consists of segments which will actually hold the records.
Each segment can hold a max of 1000 bytes of data.
For instance the segment E1MAKTM of the IDoc type MATMAS01 cannot hold more than 1000 bytes of data.
If you exceed this size then your IDoc will end up with an error.
Have a look at the IDoc type MATMAS01 in WE30.
Cheers,
Abdul Hakim

What is the maximum IDOC size?

Hi,
I would like to know the maximum number of segments that an IDOC can manage.
Thank you a lot.
Kind Regards,
Victoria

Hi Victoria,
Check out the below helpful threads
Limit on Number of Segments in an Idoc?
Maximum size of XML files and number of IDocs for IDoc receiver adapter
Regards,
Krupa

Reducing IDOC size

Hi,
I would like to reduce the size of the IDOC. Can we restrict the maximum segments per IDOC. How can we modify IDOC basic type ( Eg: HRMD_A06)?

Check the documents below:
http://www.dataxstream.com/doclib/ALEOptimization.pdf
http://www.supinfo-projects.com/cn/2005/idocs_en/3/
http://help.sap.com/saphelp_45b/helpdata/en/1a/0e350a539911d1898b0000e8322d00/content.htm
Please give me reward points...

Maximum package size for data packages was exceeded and Process terminated

Hello Guru,
When i am execute the process chain i got this message Maximum package size for data packages was exceeded and Process terminated,any body help to me in this case how can i proceed.
Thanks & Regards,
Suresh.

Hi,
When the load is not getiing processed due to huge volume of data, or more number of records per data packet, Please try the below option.
1) Reduce the IDOC size to 8000 and number of data packets per IDOC as 10. This can be done in info package settings.
2) Run the load only to PSA.
3) Once the load is succesfull , then push the data to targets.
In this way you can overcome this issue.
You can also try RSCUSTV* where * is an integer to change data load settings.
Change Datapackage size for extraction, use Transaction RSCUSTV6.
Change Datapackage size when upload from an R/3 system, set this value in R/3 Customizing (SBIW -> General settings -> Control parameters for data transfer).
IN R/3, T-Code SBIW --> Genaral settings --> Maintain Control Parameters for Data Transfer (source system specific)
Hope this helps.
Thanks,
JituK

IDoc to IDoc Scenario with High Volumes

We have requirement to load around 2.4 million idocs using XI from source SAP to target SAP system in ~8 hours. It's a IDoc to IDoc scenario with simple mapping involved.
I Have looked at various weblogs with the design optons such as BPM collect pattern, collect pattern using IDoc XML file and IDoc Packaging.
I am looking for inputs from real time experiences on such scenarios...i.e performanace statstics, best practices to handle such scenarios, hardware, XI basis tuning etc...
Please share any experiences on the same...
Regrads
Anand

Thanks Michal and Chandra...
Chandra,
I have looked into the weblog mentioned( option 2 - collecting idocs using IDoc XML port).
I undersatnd that performance would also depened on hardware,tuning, idoc size, mapping complexity etc, but just get a rough idea and to decide on the design I was looking for stats, approaches followed in other projects and past experiences in such scenarios.
Michal,
I cannot avoid collection of idocs as sending idoc's individually from source to target will have performance problems.
I can avoid BPM by using IDoc XML port collection ( option 2).
2.4 million idocs in 8 hours would mean that XI needs to process 300K idocs per hour. I guess I need to try option 2 and check the performance.
Regards
Anand

Split the IDOC into multiple IDOC if the IDOC has more than 500 records

Hi All,
I developed an outbound IDOC in which we are facing an issue.
There is some limitation on the maximum idoc size it can handle.
If number of records is more than 500, split the idoc into multiple iDoc's, e.g. if it would have 1300 records , the result would be 2 iDoc's with 500 records, and the last one would have 300 records
How can i acheive this.
Regards
Jai

Hi,
1) first you need to know which message type/Idoc type you are triggering.
2) Get the Corresponding processcode from Partner profiles(WE20/ WE41).
3) Then the look for prper user-exit in the related processing FM.
4) write logic to split the IDoc accordingly.
if no proper user exit available then copy the standard processing FM and need to all ALE related configurations.
Catch hold any ABAP expert in your team to do all these.
Suresh

Failed to process DELVRY03 IDoc with 36,000 Segment

Hi All,
We have interface IDoc to JMS. ECC is sending DELVRY03 IDoc to XI to JMS.
One of the IDoc couldnt reach to XI & produced memory error dump with exception "Heap limit exceeded on work process" We have already set maximum heap size for abap/dialog heap.
This problem occurs only when IDoc has more than 25,000 Segments.
Is there any other way to compress the data on IDoc side ....?
Any solution for this kind of situation
Thanks

Hi Rakesh,
While importing the idoc into IR, make sure you reduce the idoc size.
This could be done in the following manner
Go to Imported Objects --> IDOC -->Ur Idoc --> Tools -> Export Reduced XSD.
Use this reduced xsd in message mappings, other wise the mapping tool will fail with a memory dump failure error.
Also check out ztta/max_memreq_MB parameter
U may also do the background processing
IDoc Sending Problem
U could find some suggestions here
iDoc performance question
Regards,
Prateek

ODS to CUBE loading - taking too much time

Hi Experts,
I am loading data from R/3(4.7) to BW (3.5).
I am loading with option --> PSA and then Data Target (ODS ).
I have a selection criteria in Infopackage while loading from standard Datasource to ODS.
It takes me 20 mins to load 300K records.
But, from ODS to Infocube ( update method: Data Target Only), it is taking 8 hours.
The data packet size in Infopackage is 20,000 ( same for ODS and Infocube).
I also tried changing the data packet size, tried with full load , load with initialization,..
I tried scheduling it as a background job too.
I do not have any selection criteria in the infopackage from ODS to Cube.
Please let me know how can I decrease this loading time from ODS to Infocube.

Hi,
To improve the data load performance
1. If they are full loads then try to see if you make them delta loads.
2. Check if there are complex routines/transformations being performed in any layer. In that case see if you can optimize those codes with the help of an abaper.
3. Ensure that you are following the standard procedures in the chain like deleting Indices/secondary Indices before loading etc.
4. Check whether the system processes are free when this load is running
5. try making the load as parallel as possible if the load is happening serially. Remove PSA if not needed.
6. When the load is not getiing processed due to huge volume of data, or more number of records per data packet, Please try the below option.
1) Reduce the IDOC size to 8000 and number of data packets per IDOC as 10. This can be done in info package settings.
2) Run the load only to PSA.
3) Once the load is succesfull , then push the data to targets.
In this way you can overcome this issue.
Ensure the data packet sizing and also the number range buffering, PSA Partition size, upload sequence i.e, always load master data first, perform change run and then transaction data loads.
Check this doc on BW data load perfomance optimization
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/1955ba90-0201-0010-d3aa-8b2a4ef6bbb2
BI Performance Tuning
FAQ - The Future of SAP NetWeaver Business Intelligence in the Light of the NetWeaver BI&Business Objects Roadmap
Thanks,
JituK

0fi_ar_4 netduedate(netdt) value coming in RSA3 but not coming in BI PSA

Hi all,
i am using 0fi_ar_4,
netduedate(netdt) value coming in RSA3 but not coming in BI PSA, in BI PSA there is 10-12 do cument there where netduedate is null while for same document we are getting the netduedate running from transaction RSA3, how?
Thanks.

Hi,
I found the problem, i have write a user exit in data sourc e in ecc, i am getting value in rsa3 but not getting in BI PSA becaue ise there is 20000 KB limits for per info package load request i.e. idoc size, as its fixed, i did change little in my user exit at ECC.
thaks

Time limit Exceeded problem

Hi ,
I have a file to idoc scenario .
I have a file which generates many idocs (size atmost 5 mb)
I am aware sap recommends to limit the message the file size to atmost 5mb.
Do they mean file size of the payload ...because size increases in xi also .
I just want to process such a file quickly .
For that I am employing queue priortization at both sender and reciever .
and would idoc packaging help at the receiver .
Besides I am getting 'time limit exceeded in sm58' although I am seeing my idocs in idx5.
Here are some of the things I have checked ..
1) Parameters in SXMB_ADM - Integration Eningine configuration ---Specific configuration ...tried various tuning parameters ...but it didn't work..
2) In partner profile in recieving CRM system made chagend the setting from trigger immediately ..to background Task ...
(I am not certain how far that is relevant .
If it is a problem with CRM system's ability to accept mass idocs (because a small number is acceptible ...under 1mb file size ) then seetings should in crm so that large number idocs get succesfully posted .
I have posted this issue several times ...Kindlyhelp
KIndly what parameters i should tweak in xi or that matter recieving crm system to take care of this problem.
Kindly help

HI,
Large size of file processing
In general, an extra sizing for XI memory consumption is not required. The total memory of the SAP Web Application Server
should be sufficient except in the case of large messages (>1MB).
To determine the memory consumption for processing large messages, you can use the following rules of thumb:
Allocate 3 MB per process (for example, the number of parallel messages per second may be an indicator)
Allocate 4 kB per 1kB of message size in the asynchronous case or 9 kB per 1kB message size in the synchronous case
Example: asynchronous concurrent processing of 10 messages with a size of 1MB requires 70 MB of memory
(3MB + 4 * 1MB) * 10 = 70 MB With mapping or content-based routing where an internal representation of the message payload
may be necessary, the memory requirements can be much higher (possibly exceeding 20 kBytes per 1kByte
message, depending on the type of mapping).
The size of the largest message thus depends mainly on the size of the available main memory. On a normal 32Bit operating system, there is an upper boundary of approximately 1.5 to 2 GByte per process, limiting the respective largest message size.
please check these links..
/community [original link is broken]:///people/michal.krawczyk2/blog/2006/06/08/xi-timeouts-timeouts-timeouts
Input Flat File Size Determination
/people/shabarish.vijayakumar/blog/2006/04/03/xi-in-the-role-of-a-ftp
data packet size - load from flat file
How to upload a file of very huge size on to server.
Regards
Chilla

Data source using Fn.Mod. in R/3 shows 53 records but in BW side show error

Hello gurus,
I have created a data source in R/3 , when tested showed 53 records, but in BW side when i did extraction it failed, & put me an error message saying
" error occured in source system"
Points will be awarded for any kind of response.
Thanks and regards,
Anurupa.

Hi,
Try what is given above.
Also check SM37 job log (In source system if load is from R/3) (give request name) and it should give you the details about the request. If its active make sure that the job log is getting updated at frequent intervals.
Also see if there is any 'sysfail' or cpicerror for any datapacket in SM37.
SM21 - System log can also be helpful.
If you are 3.5 try this also
1) Reduce the IDOC size to 8000 and number of data packets per IDOC as 10. This can be done in info package settings.
2) Run the load only to PSA.
3) Once the load is succesfull , then push the data to targets.
In this way you should be able to overcome this issue.
Hope this helps.
Thanks,
JituK

Performance Issues in IS-Retail system

Hi Idoc Gurus,
We are working in IS-Retail environment.
As a part of process we are posting sales from POS system in R/3 system.
Which than create a billing document in SD.While doing this process,there are performance issues.
Issue is that this sales posting takes considerable time which hampers system performance.
Our Idoc sizes are considerably big.We are planning to break this Idoc to 1000 segments.
Kindly suggest what is a solution apart from breaking Idocs.
Warm Regards,
Anil

Hello,
As you are creating billing document, then the billing document object RV_BELEG table should be buffered. This is the number range object for SD documents. You can activate buffering in SNRO transaction, this will reduce the time for creating the billing documents. Also Please have a look into the SAP Note 213546 is a collective note for POS inbound.
Hope this helps
Regards
Dileep

Reg:Efficient solution for a data upload scenario

Hi All,
I have the following task.
Required data from a legacy system(generate data only in the form of flat files)to SAP R3 as FB01 journals and the output file should be generated periodically(daily,weekly,fortnightly etc)
Solution Approaches:
1)Write a BDC program to extract the data.
2) Write a ABAP Progam to populate IDoc (if standard IDOc is available) or generate a Outbound proxy (If standard IDoc is not available) to push the data into SAP XI.
Could anyone tell me which would be the the best and efficient approach for this task and need your recommendations.
Thanks in Advance.
B.Lavanya
Edited by: Lavanya Balanandham on Mar 31, 2008 2:23 PM

Hi Lavanya,
Required data from a legacy system(generate data only in the form of flat files)to SAP R3 as FB01 journals - use BDC for this thing because it will be better for large source files.
the output file should be generated periodically(daily,weekly,fortnightly etc) - if this output file contains acknowledgment for the data uploaded by the above process, create a ABAP report for it and schedule it..........but if this output contains some other IDOC data which you need to send as a file to a third-party system, then go for SAP XI provided the IDOC data is not too large... but if the IDOC size is huge, then just create a ABAP report for outputting data to a file on application server and FTP the file to third-party system.
Regards,
Rajeev Gupta

SAP to Data Services System (Business Objects)

Hi,
Currently there is an RFC connection between Data Services and R/3 which exchange three idocs. Each idoc has an volume of 30k per day.
As we are trying to introduce PI as central broker, will it be recommended to bring PI into the scope thinking on the performance head.
As this would be simple idoc to idoc conversion, let me know the things that will help to reduce the performance overhead.
Also should i be using RFC adapter between PI and Data Services.
Also since the licensing model is based on CPU, what effect will it bring with these three interfaces?
Is there any other connectivity that we can try apart from simple RFC

Hi,
>>>Do you mean to say with dual stack, Idoc adapter is available both in ABAP as well JAVA.
yes you can use any of the two
but if you want to use ICO you can only use IDOC_AAE (java stack idoc adapter)
>>>I thought idoc adapter would present in Java stack when you go for java stand alone installation only.
no, with dual you also get it
>>>>That would solve my volume issues. What is the best way to find the size of an idoc?
send it via PI or easier and without PI - send it to an XML port (but this will give you the XML idoc size)
Regards,
Michal Krawczyk

IDOC size

Similar Messages

Maybe you are looking for