Excessive memory consumption when loading Customers through Component Inter

Hi All,
I'm facing a big problem with the high memory consumption when loading Customers, Companies and Sites using the Component Interfaces delivered by the product (RD_CONSUMER_CI_API, RD_COMPANY_CI_API, RD_SITE_CI_API) within Application Engine programs. I'm loading about 7 million customers, an amount that is not so big in my opinion, but the memory consume is too high.
We have 3 Batch Servers, each one running under Red Hat OS with 32 GB RAM memory plus 32 GB Swap memory in each server. We are running 2 Process by Server and with a day and half the servers crash with 100% of memory consumed (RAM and SWAP).
There's a good pratice to use Component Interface in a heavy load process?
There are parameters in the process scheduler configuration file that could help to reduce the memory consumption?
There's a way to free the memory through PeopleCode or by running another process?
Thanking you in advance.

You may want to try and cut down on the input data to ascertain that the load might be a problem.
You may try and use the GarbageCollector, but might not help in your case.
To get an idea of the size allocated in buffer for the Rowset being used, you may want to check out the memory overhead ...
Also, could check, which is the process that is consuming a lot of memory

Similar Messages

Error when loading the callback component

Hi friends
Am getting this error. Error when loading the callback component. Am working in Travel expense workflow which is 2 level based on condition. If its EG > 8 its one level and EG < 8 its 2 level. When the approver does the approval am changing the status from 3 to 4 at that time the pernr is getting locked. Next step itself mail step. But the workflow is throwing the error and mail its hanging in the mail step. I have try to restart the workflow but its not restarting. Error when loading the callback component this error is showing in the lock pernr. Am not locking the pernr system locks the pernr by itslef and not unlocking the pernr. How to solve this issue.
Regards
vijay

Hello,
Check if OSS Note 854495 is applicable.
regards
Rick Bakker
Hanabi Technology

Memory consumption when computer locked?

I noticed something strange with my app. If I leave it open and switch to login screen, it's memory consumption raises up to gigabyte. I discover this in Activity Monitor when logging in back. But just after I logged back in, process's working set size begins slowly going back to normal, and then there're no leaks reported, and app works just normal.
Other apps dont issue this. Besides ordinary Cocoa GUI, my app makes use of multithreading, sockets and webcam capture (sequence grabber).
Looks like there's something specific to fast user switching feature that I don't know, maybe some buffer is infinitely filled until there's chance to display, or something.
Does anyone have idea what it could be?
Message was edited by: kasym

Another point that I wanted to mention...
As a mentioned, we are looping with our application through a resultset and "processing" each record. If we simply disconnect the sqlca object (the transaction object the PowerBuilder application uses to connect to the database) and then simply re-connect, say, every 100 records or so... the problem goes away. We simply disconnect, re-connect, and pick up at the point where we left off. This shows me the memory gets flushed every time the session is disconnected.
This is the effect that I want... for the memory to be flushed every so many records, so it can continue looping through each record in the resultset as if it were doing the first one each time. I understand there may be a performance impact as it flushes the memory for each record (or every hundred or so), but I'm willing to sacrifice that to keep it from running out of memory altogether.
I'd appreciate feedback on this point.

Memory error when executing package through SQL Server Agent.

Hi!!
I have a problem with a package (SSIS) when run on SQL Server Agent.
The job is configured
with the proxy and the account has the
required privileges. Runs perfectly
if the job runs manually, but if I let it
run on schedule I get a memory error.
Also if I run the
package through DTExec.exe or VS2008,
everything runs smoothly.
I am using SQL2008R2.
If someone has something similar happened
and have found how to fix it please i need
to know how.
Thank you.

This is most likely your issue:
http://support.microsoft.com/kb/824422

Memory leak when loading .swf in AS3?

Hi all,
I've got a pretty big issue here that I can't understand.
I've got a pretty simple app that just repeatedly loads and then
unloads an .swf called test.swf (this loaded .swf contains nothing
but a document class and a graphic - a circle. The document class
is blank, it just extends Sprite).
When I set this class as the document class of a blank .swf,
I trace the 'totalMemory' of the flash player, and load and unload
the (very simple) clip over and over. You'd think that with garbage
collection and all that, the memory would stay pretty
constant...but no! It increases (and continues to for as long as
I've run it!).
I'm writing an application that loads and unloads many many
.swf files, but it needs to have the smallest footprint
possible...any ideas as to why the memory is never released?

One idea - there is a separate stack of memory in the flash
player where loaded classes in separate application domains exist,
and these classes are not being garbage collected....however, there
is a line in adobe's documentation here:
http://livedocs.adobe.com/flash/9.0/main/wwhelp/wwhimpl/common/html/wwhelp.htm?context=Liv eDocs_Parts&file=00000327.html
under "Usage C" :
quote:
Having a new application domain also allows you to unload all
the class definitions for garbage collection, if you can ensure
that you do not continue to have references to the child SWF.
Given that, as far as I can see from this code, there is no
reference to the loaded .swf maintained....it seems to me like the
loaded data (graphical assets AND classes) should be garbage
collected - but, while you WILL see a slight drop in memory after
the removal of the SWF, the overall memory continues to increase
the more you do it. Could Adobe be mistaken?

Reduce memory consumption when consolidating systems

We are in the process of consolidating all our DEV and QAS systems to one physical system (HP Super dome).
We are consolidate more then 20 SAP instances (Java and ABAP) to on physical system.
The question now is, how to setup the memory requirements (all instance are 64bit and Unicode), during the installation of those instances we defined 4GB for a ABAP instances and 2 GB for a Java instance (Abap+Java 6GB).
In our situation we need around 90GB of main memory.
Does any one have a suggestion how to reduce this amount of memory.
Because this are all DEV and QAS systems and not all the systems are used at the same time. Is it possible to swapout allocated memory for instances which are not used.
Kind Regards,
Evert Schuiteman

Hi Evert
Because this are all DEV and QAS systems and not all the systems are used at the same time. Is it possible to swapout allocated memory for instances which are not used.
This is possible theoretically, but even if no user is connected and no application job is running, there is still activity on a system, so the only way to free ressources is to stop a system when it is not needed. As memory is cheap, you should rather buy more, than running low on it. If the server starts paging, the sap systems will practically freeze.
You should not forget about the database memory, you will need at least another 2gb for every database.
In my opinion, you should not consider running 20 instances on one server (hard partition on superdomes). We still have several hard partitions on our superdomes running up to 4 sap instances / databases per partition. I strongly suggest to have a "rolling" consolidation, speaking you add systems one after another. This gives you the possibilty to react if any component becomes a bottleneck.
Regards
Michael

Getting HeapDump on out of memory error when executing method through JNI

I have a C++ code that executes a method inside the jvm through the JNI.
I have a memory leak in my java code that results an out of memory error, this exception is caught in my C++ code and as a result the heap dump is not created on the disk.
I am running the jvm with
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=C:\x.hprof
Any suggestions?
Thanks

I'll rephrase it then.
I have a java class named PbsExecuter and one static method in it ExecuteCommand.
I am calling this method through JNI (using CallStaticObjectMethod). sometimes this method causes the jvm to throw OutOfMemoryError and I would like to get a heap dump on the disk when this happens in order to locate my memory leak.
I've started the jvm with JNI_CreateJavaVM and I've put two options inside the JavaVMInitArgs that is used to create the Jvm. -XX:+HeapDumpOnOutOfMemoryError and -XX:HeapDumpPath=C:\x.hprof
which supposed to create a heap dump on the disk when OutOfMemoryError occurs.
Normally if I would execute normal java code, when this exception would occur and I wouldn't catch it the Jvm would crash and the heap dump would be created on the disk.
Since I need to handle errors in my C++ code I am use ExceptionOccured() and extracts the exception message from the exception it self and write it.
For some reason when I execute this method through JNI it doesn't create the dump.

Error when loading hierarchy through flat file

Dear All,
We are facing an issue during hierarchy upload through flat file.
Below is the message :-
Error 8 when compiling the upload program: row 658, message: A newer version of data type /BIC/B0000559000 was.
Message no. RSAR233.
Nothing else is being displayed.
Request you to guide on this.
Thanks & Regards,
Anup

Hi,
I faced the same issue earlier.
This is what i did. SE38-RS_TRANSTRU_ACTIVATE_ALL run the program and give your sourcesystem name this activates all the structure including new version /BIC structure what you have stated.
After which you need to refresh the RSA1 Tcode and do the same process again to load the hierarchy.
It should work fine now.
Hope this helps.
Regards,
Harish
Edited by: Harish3152 on May 18, 2010 2:23 PM
Edited by: Harish3152 on May 18, 2010 2:32 PM

How to reduce memory usage when loading bitmaps from the library?

When I use BitmapData.loadBitmap() to load an image from the library and then attachBitmap() to add it to a MovieClip it takes a lot more memory as opposed to just having the same image inside a MovieClip statically in a frame on it's timeline.
The function dispose() not only clears the BitmapData object but also destroys the previously attached bitmap inside the MovieClip, so it can not be used to free any memory.
Is it how it is supposed to be or is there any other way to dynamically attach bitmaps with memory usage comparable to just having them on stage?

no, you use attachMovie() to create instance from library movieclips that have a linkage id.
you can then create a bitmapdata instance and use the draw() method to overlay as many as needed.

Insufficient memory error when loading a large Excel 2007 file

My Tx shows approximately 110 M free memory. I have the Documents To Go version 11 applications, as well as the 1.9 M spreadsheet on a 2Gb SD card. when I try to load the file, I get an insufficient memory error, and the device does a soft reset when I touch OK. I haven't tried moving the file to the device memory. Would that help? Is there anything else I can do to get the file to load?
Any suggestions would be appreciated
Post relates to: Palm TX

It means not enough dynamic memory, or the "RAM" portion of the memory. You have 110 MB of free program memory, which is where everything is stored, and is largely unrelated.
You could try buying UDMH, (palmpowerups.com) an app that expands the dynamic memory area.
A soft reset before opening the file may help too.
webosnation.com is another option for help.

"Memory effect" when loading .xls file information using PropertyLoader

I have a TestStand 3.1 application, in which the sequence start off loading a number of configuration settings embedded in different .xls files using the PropertyLoader.
Unfortunately, Teststand sometimes loads the previously used .xls files (same name, located elsewhere), rather than those it were supposed to. In particular, if a .xls file is missing, Teststand will often (always?) load a previously used file with the same name, but located elsewhere. VERY inconvinient when testing ...!
Is there any way to remove this unfortunate "memory effect"?

Where are your sequence files located? If the .xls files are relative to them you might want to use a more fully specified relative path to the files (for example: bin\config\filename.xls) rather than just filename.xls. Then becareful to remove search directories (especially recursive ones) that you might have added to find these files. It's very easy to get into problems with recursive search directories or by adding too many search directories if you have lots of files with the same names, by instead using paths relative to the sequence file you can avoid the need to add search directories in many cases.
Hope this helps,
-Doug

Data Load Error: When loading Hierarchy through a flat file

Hi Bw experts,
I am getting the error message: Info object is not available: Message RSAR210, when trying to load the Hierarchy through flat file upload with IDOC processing.The info object is active. I am getting this error message only for one hierarchy, other hierarchies for the same inof object are loaded successfully.Can some one help me in this?
Thanks in Advance.
Regards,
Bala

Hi Bala,
Can you please share the solution asap..
As we are also facing the same issue.
Your quick response will be appreciated a lot
Regards,
Sai

Possible bug when loading dll through JNI

Hi guys,
I have come accross a strange occurance, if anyone can help me out i'd appreciate it lot.
I have written an unmanged (MFC) dll which connects to a managed(.NET) dll.
If I load the MFC dll without using any of the references to the managed dll everything is ok.
But as soon as I include a call to initialize a managed member my java program just exits. Then if i try and run it again it gives me a stack overflow exception.
The dll works absolutely 100% perfectly from other c++ applications (I've called all of its methods via a simple dos program), so it seems that there may be some protective layer that java is wrapping the dll in that isn't letting it make any managed calls.
Has anyone had this problem before or know how to get around it?
Below is the code from the unmanged (MFC) dll
     CNewDLLTestApp();
     void WriteToDevice(int Value);
     char ReadFromDevice();
        // this is the managed call, gcroot lets you call managed code from an unmanged area
     gcroot<JavaIntegrateManagedClass::Class1*>c;In the exposed java functions I initialize the class member c, and then call the regular dll functions.

Sadly that is the complete error message.
I've tried putting the load("DLL") in a try catch block but it never catches it. The debugger output screen just prints StackOverflowException.
The JNI calling code doens't even get invoked at this point.
* Class:     MainInterface
* Method:    WriteToDevice
* Signature: (I)V
JNIEXPORT void JNICALL Java_MainInterface_WriteToDevice
(JNIEnv *, jobject, jint Value)
     MessageBox( (HWND)NULL,"In java function","Unmanged DLL",MB_OK);
     //theApp.c->WriteToDevice(Value);
}If I put the commented line back in the StackOverflowException occurs. If I leave it out everything is fine.
c is a class within a managed DLL, which in turn links to a managed class.
The layers may seem excessive but I understood it was needed to fool java into thinking it was calling unmanaged code.
What I don't understand is how a standard C++ console application can make the calls no problem, but Java can't. Surely the execution of the dll process should be exactly the same.
Thanks
DRB2k5

Low memory crash when loading an external swf

I have a swf file that is basically a image gallery created in slideshow pro. I import the swf file into catalyst load it onto the stage and the swf file starts playing in the preview window. However within about two to three minutes the program always crashes with a low memory warning, even if I do nothing else and just leave the progam running? I am tearing my hair out (thats if I had any) just dont know what to do.

after completion of the loading set the width and height.
so that it wont occupy all the stage
If this post answers your question or helps, Please mark it as such .

Why Does Safari Use Excessive Memory with Gmail?

I am running Safari 7.0.1 along with Maverics (10.9.1) on a 2011 MacBook Air with 4 GB of memory. Just recently I have begun to notice excessive memory usage when using Gmail. I have iStat Menus as well as something called MemoryKeeper so I can monitor memory use in real time.
The table below shows numbers taken from Activity Monitor with each of the sites running in a single tab. The Safari Web Content is through the roof with Gmail compared to My Yahoo or indeed with any other single site. In Gmail it starts out above 500 MB and slowly comes down to the lower end indicated if I do nothing. If I open tabs with both My Yahoo and Gmail, I sink below 100 MB and if I have three tabs open I'm heading to zero. As far as I can tell, the excessive memory useage only occurs with Gmail.
Process
Yahoo
Gmail
Safari
156 MB
167 MB
Safari Web Content
96 MB
531-338 MB
Kernel Task
464 MB
464 MB
Free
662 MB
210 MB
Typically I will close Safari and start it again if I get much below 100 MB. I usually have to close Safari at the end of the day to refresh it for the next day. This has only become a problem within the last month or so, and I am at a loss to explain it. I thought it might be Mavericks related (though I have been running Mavericks since its release), but then the Safari I have on my 5 year old Mac Mini running Snow Leopard gives me similar results.
When I run Google Chrome I don't have any of these problems. Indeed, though it is not my preference, I am having to use it more and more for day to day activities or I have to stick with one tab if I am going back and forth between Gmail and other sites. I have not seen this problem reported elsewhere, so I have to believe there is something going on in my system. I have cleared the cache one time on both systems, but that doesn't seem to have made any difference. I would appreciate any comments or suggestions.
-Bill

I would not have even tried this app had I not heard about it on the Mac Rountable podcast (episode #222), where it received favorable comments from otherwise knowledgeable people. It also has a 4.5 star rating on the Mac App Store with 706 5-Star ratings out of 1,049. If you add up the 5-Star and 4-Star ratings you get close to 1,000 favorable rates right there. I have to wonder if people really know what's going on. Since the most obvious detrimental effects for me were centered around using Safari with Gmail on Mavericks, others must not be using that lethal combination. As I mentioned, using Google Chrome does not seem to have any obvious deliterious effects.
Well, there's going to be one more 1-Star rating reflecting my experience.
-Bill

Excessive memory consumption when loading Customers through Component Inter

Similar Messages

Maybe you are looking for