APD master data join - ABAP dump TSV_TNEW_PAGE_ALLOC_FAILED

Question

Hi,
I have created an APD to join 3 ISU master data infoobjects
1. left join 0UCPREMISE with 0UC_CONNOBJ
2. left join 0UCINSTALLA with result of 1.
3. Store the data in ODS
When I did this in DEV (D4S) everything worked - but there is also much
less data in the master data infoobjects.
When running the APD in Test (Q4S) I get ABAP dump after a while (not
time out): TSV_TNEW_PAGE_ALLOC_FAILED
1. I have tried with the APD setting to store in internal memory to OFF
but the same problems occur.
2. I tried to create index (on /BI0/P* ) for fields part of the join
which was not table key but same problem occurs.
3. I have no filters for the joins as I want to get all master data in
the output ODS.
4. The size of the p-tables are:
/BI0/PUCPREMISE = 1 385 792
/BI0/PUC_CONNOBJ = 1 031 272
/BI0/PUCINSTALLA = 2 445 742
5. Components + SP level:
SAP_ABA     700     0013     SAPKA70013
SAP_BASIS     700     0013     SAPKB70013
PI_BASIS     2005_1_700     0013     SAPKIPYJ7D
ST-PI     2005_1_700     0005     SAPKITLQI5
SAP_BW     700     0015     SAPKW70015
BI_CONT     703     0005     SAPKIBIIP5
Linux / Oracle 10.2.0.2.0
6. Info from ABAP Dump:
Error analysis
The internal table "\CLASS=CL_RSMD_RS_UTILITIES\METHOD=DATA_TO_RETURN\DATA=L_SX
RETURN-TVALUE" could not be further extended. To enable
error handling, the table had to be delete before this log was written.
As a result, the table is displayed further down or, if you branch to
the ABAP Debugger, with 0 rows.
At the time of the termination, the following data was determined for
the relevant internal table:
Memory location: "Session memory"
Row width: 200
Number of rows: 15
Allocated rows: 15
Newly requested rows: 64 (in 1 blocks)
Last error logged in SAP kernel
Component............ "EM"
Place................ "SAP-Server q4s_Q4S_72 on host q4s (wp 12)"
Version.............. 37
Error code........... 7
Error text........... "Warning: EM-Memory exhausted: Workprocess gets PRIV "
Description.......... " "
System call.......... " "
Module............... "emxx.c"
Line................. 1881
The error reported by the operating system is:
Error number..... " "
|    Error text....... " "
How to correct the error
The amount of storage space (in bytes) filled at termination time was:
Roll area...................... 2755600
Extended memory (EM)........... 1977608256
Assigned memory (HEAP)......... 2000733904
Short area..................... " "
Paging area.................... 24576
Maximum address space.......... 4294967295
If the error occures in a non-modified SAP program, you may be able to
find an interim solution in an SAP Note.
If you have access to SAP Notes, carry out a search with the following
keywords:
"TSV_TNEW_PAGE_ALLOC_FAILED" " "
"CL_RSMD_RS_UTILITIES==========CP" or "CL_RSMD_RS_UTILITIES==========CM006"
|    "DATA_TO_RETURN"                    
Anybody have any idea what i can do to be able to run this APD (in production I want to run it on a monthly basis). To me it seems the APD fills 2 gig of mem, I thought the APD option to not store the complete dataset in internal memory (using temp tables instead) would kick in before the 2 gigs was used. Basis team didn't want to raise mem paramenters if it could be sorted out any other way.
Thanks,
Johan

Answer 1

I have searched on my problem before posting here ofcourse - but somehow I missed this one, mentioned in 794257:
"InfoObject" data source
A dump occurs because of a memory overflow in the SAPLRSDM_F4 function group in the SD_CHA_GET_VALUES function module.
The InfoObject data source for reading master data is currently based on a function module that loads all data into the main memory in an inefficient data structure. As a result, the data source is only suitable for reading master data with a few data records. A memory overflow can occur for master data tables with lots of records such as business partners or products. This occurs regardless of how the "Process data in the memory" indicator was set.
If this situation occurs, set the InfoObject in such a way that it is available as an InfoProvider. Then use the "InfoProvider" data source instead of the "InfoObject" data source in the analysis process.
I'll try this...
//Johan