Application limit to 1G memory allocation

My application uses a lot of memory. I break the memory allocation to small arrays of 100M each.
I have Windows XP 32bit and I set the /3GB flag in the boot.ini file, the computer has 4G byte of ram memory. Never the less, Labview (ver 8.2) can't allocate more then 1G byte memory.
Why?
Attached small vi that represents the problem.
Regards
Gabi
Attachments:
Giga allocation 2.vi ‏37 KB

Well if you managed to get 1.5 Gig then you beat my best which was 1.2 G.
The issue is the hardware of the pentium chip and the OS.
The MSB of the address distinguishes between OS memory space and program space which limits you to 2G max.
64 bit machine may let you go farther but I have not tested this myself.
The other factor that has to be taken into concideration is that LV insists all of its buffer be contiguous so if the OS can not find a contiguous block, the allocation fails.
Quoting from JPD signature;
"All of the above may be wrong!"
If you know better, then by all means straighten me out.
Ben
Ben Rayner
I am currently active on.. MainStream Preppers
Rayner's Ridge is under construction

Similar Messages

Can't increase memory allocation

For a previous question it was recommended that I allocate more memory to an application. However, when I attempt to do that with Get Info, I only get the options of "General Information" or "Sharing". "Memory" is never listed. Any ideas on what I'm doing wrong?

Under General Information, check what the file's kind is listed as; if it is 'application program package', control-click it and choose Show Package Contents. Open the folder Contents and then MacOSClassic, or MacOS if there isn't a MacOSClassic folder. Inside this folder, locate the application and increase the memory allocation.
(9936)

How can I measure memory allocation of a Java Application?

We built a web application that enables images to be loaded into a database through a servlet running on Tomcat. We have inconsistent behaivor when more than x number of people are loading images simultaneously. No doubt a memory allocation problem, but how can I measure it?
For example, I'd like to be able to create a graph showing the resources used against the number of people making uploads. I am using Linux and Tomcat/Apache.
I am hoping for something like Memory counters that are available for measurine Windows applications on MS Windows - comes with the Resource Kit. Does this type of tool exist for the Java/Linux market?

It is difficult to gauge memory usage from a Java application as the JVM handles garbage collection and even if objects are not referenced they might still be sitting in memory until the next garbage collect.
Anyhow, a way to query available memory is:
Runtime.getRuntime().freeMemory()
You can run this at the begining of a process and at the end and examine the difference. You should call System.gc() before each freeMemory() call in order to try to force garbage collection.
Another method would be to turn to the underlying OS. On linux you could use 'top' or 'ps'. With ps you could do something like:
ps -o rss,vsz,%mem <pid>
Where <pid> is the parent Tomcat process' id. The resulting three columns are:
- Amount of real memory used.
- Amount of virtual memory used.
- Percentage of real memory used.
'man ps' wil give you more options on how to use ps.
There are also fancy graphical stuff like 'gtop' as well.
Hope this helps.

[iphone sdk] memory allocations and application sandboxing

folks,
does the os automatically de-allocate any memory allocated when my app exists? reason i ask is the phone seems to get slower and slower over time with more crashes. a hard restart seems to fix the problem.
i'm guessing that it is because i'm not cleaning things up on exit or something, but maybe there is something else wrong.
john

The academic answer is: It shouldn't matter how much memory you leak in your app after the app has been closed. I can't speak to how the device functions cause I can't test on one yet! But it's UNIX under the hood and that means each process is assigned it's own address space. Any memory allocated to a process is completely reclaimed when the process exits.
I'm not sure what changes Apple made to the VM kernel subsystem for the iPhone. Unix is already tried and tested in this arena -- so if it's the default Darwin VM I would be very surprised if this is a bug. But since this is embedded they may have added some "shortcuts" for performance and efficiency... hard to say. Since you have the device, are you able to do any system level diagnostics? does the device lose free memory the more your start/stop your app?
Also -- the device has 128MB of RAM. The 8 or 16GB is storage, which isn't used for RAM. The specs are hard to find, but I think I found the answer through Google on the amount of RAM in the iPhone and iPod Touch.
Cheers,
George

Cluster memory allocation

Hello,
I have a beginner's question: I have a large number of variables I need to pass to a function. Will there be a difference in memory use if I pass them directly compared to if I bundle them to a cluster and pass the cluster to the function and unbundle it inside?
I tried to read online posts, and some say that cluster is like a struct... does it mean that bundling variables to cluster creates new memory locations for each variable, with overhead? My application refuses to run already ("Not enough memory") so if cluster creates new memory allocations, it's critical that I know it...
Any information is appreciated
MichalM

Norbert B wrote:
Different tunnels are always different dataspaces, so an output tunnel is creates a copy in regard to the inputtunnel. A shiftregister can address this because the left and right node grant access to the same dataspace. Please note that most often, this does not take much effect, but when working with arrays, it is mandatory to work with shiftregisters.
Hi, Norbert, you're right (as usual).
The only small thing about Shift Registers (vs AutoIndex)... Let's say, we have pretty big array (nearby memory limit), which should be computed inside of loop.
Now we have two possibilities: a) using AutoIndex tunnel, or b) using "preallocated" array and Shift Register. Something like that:
The method b) with preallocated array is "more understandable" for me also from the "traditional programming" point of view. Continuous memory allocated (like with malloc), then Shift Register acts as pointer, and we performing elements replacement step by step.
The method a) theoretically should work slow, because new elementh added to the array at each iteration (which caused memory reallocation every time), but it seems to be that LabVIEW intelligent enough for memory allocation before looping, and not during looping. And AutoIndex is faster than Shift Register in this case.
But it looks completely other with while loops:
Now array cannot be preallocated with AutoIndex, because total amount of iterations is unknown, and this caused big performance penalties (at least at first run). So, here Shift Register is preferred. What is funny - at second run the Method a) will be faster than method b) (looks like internal LabVIEW cache), but when total amount of iterations will be changed, then it will be slow again.
And finally For Loop with Conditional Terminal vs While Loop:
The total amount of iterations is unknown in both cases, but For Loop still fast because memory preallocated before iterations (created Array will be "trimmed" if loop will be breaked with condition).
It means, that sometimes (but not always) AutoIndex is more preferred than ShiftRegister.
Andrey.

Problem : Application run out of memory while processing image I/O.

Hi,
I have coded an application (utility) for creating scaled (JPEG) images (thumb nails) and writing (saving) them to files. I tried this with both imageio package of jdk1.4 and com.sun.image.codec.jpeg.* classes of earlier version. Application works with both versions but when I execute it for more (say more than 10 images) images, system becomes very slow and application starts throwing a memory related (OutOfMemoryError) error. Is it that objects of java image related classes consume too much memory ? How to solve this problem ? (My system run P4 processor with 256 MB RAM).
Awaiting solution,
Thanx and regards,
IB

So I am not alone in this...
I wrote the jpeg thumbnail generating code over a year ago and now when I am ready to use it in the finished app. I noticed that each process (as monitored using Forte 3's execution window) that instantiates a new ImageIcon object is never killed by the JVM. As more and more processes are started for distinct tasks they build up endlessly. Here's the method which is almost identical to the test code provided in sun's tutorial for generating thumbnails from jpeg and gif image files (http://developer.java.sun.com/developer/TechTips/1999/tt1021.html) :
public boolean createThumbImage(int maxDim) throws EntegraEntityException {
     * Reads an image in a file and creates
     * a thumbnail in another file.
     * @param this.getImagePath() The name of image file.
     * @param thumb The name of thumbnail file.
     * Will be created if necessary.
     * @param maxDim The width and height of
     * the thumbnail must
     * be maxDim pixels or less.
       String thumbsource = this.path + this.filename;
       String thumbdest = this.path + "thumbs_" + maxDim + File.separator/*"\\"*/ + Utilities.replaceString(Utilities.replaceString(this.filename," ","_","ALL").trim(),"[.][a-zA-Z]*",".jpg","ALL");
   // System.out.println("thumbsource in createthumbimage(): " + thumbsource + "\n");
   // System.out.println("thumbdest in createthumbimage(): " + thumbdest + "\n");
        try {
            // Get the image from a file.
            java.awt.Image inImage = new ImageIcon (thumbsource).getImage();
            // Determine the scale.
         double scale = (double)maxDim/(double)inImage.getHeight(null);
            if (inImage.getWidth(null) > inImage.getHeight(null)) {
                scale = (double)maxDim/(double)inImage.getWidth(null);
            // Determine size of new image.
            //One of them
            // should equal maxDim.
            int scaledW = (int)(scale*inImage.getWidth(null));
            int scaledH = (int)(scale*inImage.getHeight(null));
            // Create an image buffer in
            //which to paint on.
            BufferedImage outImage =
              new BufferedImage(scaledW, scaledH,
                BufferedImage.TYPE_INT_RGB);
            // Set the scale.
            AffineTransform tx =
              new AffineTransform();
            // If the image is smaller than
            //the desired image size,
            // don't bother scaling.
            if (scale < 1.0d) {
                tx.scale(scale, scale);
            // Paint image.
            Graphics2D g2d =
             outImage.createGraphics();
            g2d.drawImage(inImage, tx, null);
            g2d.dispose();
            // JPEG-encode the image
            //and write to file.
            Utilities.fileMakeDirs(this.path + "thumbs_" + maxDim + File.separator/*"\\"*/);
            Utilities.fileMakeFile(thumbdest);
            OutputStream os =
             new FileOutputStream(thumbdest);
            JPEGImageEncoder encoder = JPEGCodec.createJPEGEncoder(os);
            encoder.encode(outImage);
            os.close();
            return true;
        } catch (IOException e) {
            throw new EntegraEntityException("IO exception creating thumbnail for Image object ID: " + this.getId() + " ::",e);
        } catch (EntegraFileIOException fi) {
            throw new EntegraEntityException("File IO exception creating thumbnail for Image object ID: " + this.getId() + " ::",fi);
    //    return false; //Never reached. Since it doesn't live in the "try" block but must be here to ensure method body gets a return value.
}:During my troubleshooting of the method execution yesterday I discovered that the stuck process only occurs as a consequence of the line shown in bold below :
java.awt.Image inImage = new ImageIcon (thumbsource).getImage();
:this indicates to me that there is something wrong with how either the Image object or the ImageIcon file resources are allocated. At first I tried using the "flush()" method of the java.awt.Image class to release the resources to no avail, later I was able to confirm that the error does not occur for the default constructor of ImageIcon only for the one that specifies the source path (as shown in the line above) this indicates that a fileIO stream is being created and probably not being released inside ImageIcon or Image, but since that stream is probably private to those core classes we can't access it to close() it properly. I sure hope I am wrong on this or there is an alternative to using these classes..
Please let me know if any of you have other ideas on how to quash this bug or can otherwise find flaws in my logic for it's occurance.
Regards,
Sent2null

Dynamic memory allocation failure

Dear reader,
We sometimes have a problem where our windows 2012 r2 RDS virtual servers, that reside on windows 2012r2 hyper-v hosts, loose their dynamic memory and only have their startup memory left to work with. Users start complaining that things are very slow etc.
If I check several screens (RDS Broker load balancing, hyper-v manager, cluster manager and the vm's task manager) it's clear that the vm only has its startup memory allocated. I'm not sure if this happens instantly or immidiatly after the nightly reboot.
To resolve the problem we have to call all users on the vm where it happens and ask them to logoff (if they are even able to), and then we reboot the machine.
I have checked the logs from the machine where the VM resides on and the logs from the vm itself. But I cannot find anything. We also have alot of windows 2008r2 vm's with dynamivc memory, but none of those have ever had this problem.
Searched the internet, but so far it seems we are only.
Can anyone give me a lead to troubleshoot this?
Best regards,
Ruud Boersma
MCITP Enterprise administrator

Hi all,
I'm going to be "one of those people" who revives dead posts for something that is relevant but obviously not fixed... sorry in advance!
We have the exact same situation, a bunch of RDSH guests with Dynamic memory turned on (60+ of them). every day between 1-8 of them will fail to allocate Dynamic memory and will be stuck on their startup RAM amount. This really hurts our users at peak
times.
I have engaged our TAM and have raised a case with PSS, Usual story "your the only one with this problem". Which obviously isn't true.
So, we have tons of free RAM on the hosts, 600GB+ on most of them, the issue affects RDSH hosts at random, across multiple hosts and clusters.
The screen shots attached are of one of our hosts from this morning. it has 8GB startup, 8GB minimum, 32GB Maximum RAM configured, with a 23% buffer. the host has 752GB RAM FREE. Notice how the perf counter "Hyper-V Dynamic Memory Integration Service"
is reporting "0", it should be reporting "32768". also under task manager on the VM we are missing "Maximum memory" which should be just below "Hardware reserved" in the bottom right hand corner.
Looks like the balloon driver is being delayed at boot time, we are going to XPerf all the servers in the hope that we can catch the critter. It's an unusual problem.
We only have Acrobat PDF viewer, word viewer, excel viewer and two custom dot.NET applications installed on the guests. Some of the servers are also just dumb RDSH hosts, with not connection broker configured, using an F5 loadbalancer for load distribution
and session management. All guests are 2012R2 patched up to March 2015, integration Services are installed and up to date (its an enlightened OS remember).

Dynamic memory allocation

Hi, guys, does anyone know whether I can use dyanmic memory allocation on the Real time system with "call library function" node. DLL is programmed using C language. Thanks.
Machman

You certainly can. LabVIEW Real-Time functionality is really not much different than what you can do on Windows. The only difference being that you can now assign priorty and timing to your execution loops; essentially, you have determinism with RT whereas with Windows, you never have a guarantee.
Thus, in regards to calling a dll, you can perform this the same way you would in LabVIEW for Windows. Here's a KnowledgeBase article on how to do this if you're not already familiar.
Cheers,
Emilie K. | Applications Engineer | National Instruments

Memory Allocation

I have Premiere Elements 2 and Windows XP SP3. We have 1GB of RAM and 500 GB Hard drive with only 50% used. I save my videos on an external hard drive.
I have always satifactorily burnt my DVDs with the system as it is, including a short DVD last week. In the last couple of days I've been trying to burn my DVd but Adobe fails part through the burning process as it is running short of memory allocation. We have followed previous instructions on the forum and turned off background applications. Can anyone help? I burnt something much longer without a problem about 3 weeks ago and am a loss as to what to do.
Thanks Erika

Thanks. I don't use any stills in my DVD, just music which I import in the way I have always done and it's been ok. For information my audio clips are either MP3 Audio or Windows Media and files are up to 4.3MB. These are ripped from CD via Real Player (Windows Media seems to encode them and I cannot download to Adobe via WM)
Source: 44100HZ 16 bit and Data rate approx 23.4375 KB.
SHould I be doing anything else?
Any further suggestions would be appreciated.
Kind Regards
Erika

Memory Allocation problem when using JNI

For a Project we need to interface Labwindows-CVI/ Teststand with an application written in Java. we are using JNI. The code uses JNI_CreateJavaVM to start a JVM to run the Java interface code. The code did run for some time , but now ( without any obvious change nor on the CVI side neither on the Java side) JNI_CreateJavaVM fails with -4 error code, that means that the start of the JVM failed due to memory allocation failure. First investigation showed, that even if Windows Task Manager shows about 600M free physical memory, you can allocate in CVI only about 250M as a single block at the time we are calling JNI_CreateJavaVM. That might be a little bit to less as we need to pass -Xmx192m to the JVM to run our code. Unfortunately just increasing the physical memory of that machine from 1.5G to 2G doesn't change anything. The free memory showed by Task Manager increases, but the allocatable memory block size does not. Are the any trick to optimize CVI/Teststand for that use case ? Or maybe known problems with JNI ?
Solved!
Go to Solution.

hi,
have you tried other functions to allocate memory?
the -Xmx command only sets the maximum heap size. You can try to use -Xms. This command sets the initial Java heap size.

Memory allocation model on Windows

We have an application server with 16 GB of RAM and 54 GB of SWAP.
The application server run on a Windows 2003 IA64 SP2.
We are using 6.40_ex2 kernel.
When we run intensive memory program (program that use a lot of memory in internal table) we see that all the EM is allocated in PM.
HM too is allocated in PM until the PM rech less than 200 MB.
When the PM is less than 200 MB the total VM used on the server is less than 25 GB (EM: 10 GB; HM < 10 GB).
There are SAP kernel rules that defined what allocate in RAM and what allocate in Paging file?
We think that should be a better distribution from RAM and SWAP but we don't know if it is a right consideration.

Essbase should use the amount of memory allocated in the Database settings, (plus some overhead for the Agent / App Server itself, which should be nowhere near 4G).Take a look at the database settings within the application. Look at the Index Cache, Data Cache and Data File Cache to ensure are not set absurdly high. As a test, leave them at their default values - worry about tuning them later.Also, how many Essbase applications are running on this server? Is it just the one?Regards,Jade-----------------------------------Jade ColeSenior Business Intelligence ConsultantClarity [email protected]

NI-VISA NI-PAL memory allocation

Hello,
I'm about to write a device driver for a custom PXI board using NI-VISA/NI-PAL and CVI.
I may need up to 32MB continuous memory for DMA transfer so I would like to if is it possible to configure a memory allocation at boot time using these tools ?
The way is it done in NI-VXI for hardware memory reservation would be perfect...
Thanks

JFM,
Je ne crois pas qu'il soit possible de forcer VISA à allouer de la mémoire au démarrage du driver VISA.
Par contre, il est possible au niveau user (Dans votre application ou votre driver) d'instancier la ressources VISA Memory Access (MEMACC)pour allouer des blocs de mémoires contigues qui pourront être utilisées exclusivement pour la gestion du DMA.
Sur le lien suivant, vous trouverez des informations concernant ce mecanisme au travers de NI VISA pour LabVIEW RT, mais ceci est équivalent pour VISA Windows. (Reportez vous aux rubriques DMA)
http://zone.ni.com/devzone/conceptd.nsf/webmain/97a3dcc557ffaf7086256d2c0057dece?OpenDocument
A titre d'exemple, nous fournisssons gratuitement un MHDDK (HArdware Developpement Kit), qui permet de travailler avec des cartes NI (DAQ, DIO) sur des environnements non supportés (Linux, Mac) par nos drivers. Le DDK est en ensemble de fonctions de haut niveau qui sont OS indépendant. L'utilisateur à seulement besoin de développer la couche dite OSi (OS interface) qui est spécifique à chaque OS.
Vous trouverez dans les liens ci dessous, une note descriptive du DKK ainsi que les fichier à utiliser. Ce qui est important, c'est que la couche OSi à été développé pour les plateforme supporte VISA pour le PCI/PXI. Ainsi vous trouverez dans les exemples de gestion des carte 6533 (DIO rapide), l'implémentation du DMA au travers de VISA.
Voici un présentation du DDK:
http://sine.ni.com/apps/we/nioc.vp?cid=11737〈=US
Sur le lien ci dessus, (après un enregistrement gratuit) vous pourrez le DDK pour different type de carte. Téléchargez et étudiez le DDK pour la carte PCI 6533, car il sera très instructif pour gérer le DMA avec VISA.
Cordialement,
Raphaël TILLET
NI FRANCE.
Cordialement,
Raphael T

Regarding memory allocation & deallocation of memory during portal access.

Dear Experts,
Please help me with the below simple query.
I am working on webydnpro abap for develpment. Lets suppose, If i have 2 links/applications in sap portal , both are individual sap webdynpro components. If i click 1st link/application in portal, then it will call the url of web dynpro abap component. If i click 2nd link immediately after 1st link, then it navigates and opens the 2nd application. But the memory is still open for 1st application as well as 2nd application. So the load is getting increased though the user may acess the application or not .
So could anyone suggest on what should be done, for terminating the memory allocation of 1st application while accessing 2nd application and vice versa.
Regards,
Murali.

I can't offer much in the way of details, but you might want to investigate USBTMC (USB Test and Measurement Class). With a driver written to this spec, you use VISA commands to the USB instrument in exactly the same manner as a GPIB device (i.e. VISA Write "*IDN?", VISA Read "response"). Drivers that implement this are much easier to use than exposing USB Raw. This will take more work on your end but will end up with greater customer satisfaction. This is the route we're taking with some instruments developed for internal use. They may never be commercially released but the current customer (me), is very happy. The developer started by googling USBTMC and went on from there.

Increase memory allocated to flash

Hi,
i have created a MX file with size 7.5MB.
when i try to oen the file again then its showing a popus
saying that there is not enough memory to open the current scene.
to increse the memory allocated to flash type get info
command in finder windw.
but i am unabel to understand which finder window.
i tried opening the file in flash 7 and 8 , it gives the same
error.
can some one help me out???
regards Prashant

"PrashantP" <[email protected]> wrote in
message news:e5jcvu$lvt$[email protected]..
>
> Hi,
>
> i have created a MX file with size 7.5MB.
> when i try to oen the file again then its showing a
popus saying that there is
> not enough memory to open the current scene.
> to increse the memory allocated to flash type get info
command in finder windw.
> but i am unabel to understand which finder window.
> i tried opening the file in flash 7 and 8 , it gives the
same error.
>
> can some one help me out???
>
> regards Prashant
It's a corrupted fla file most likely. Windows assigns memory
dynamically.. that stupid message about assigning more memory to
Flash is really annoying because it is not possible to do
your own memory assignments. If you run too many other applications
at
the same time you might use up the needed ram memory though.
If you aren't running too many other things then it's not the
problem,
it's the fla file. If you have Windows XP, you can open up
the Task Manager and see how much memory is in use, before and
after you
load your files in Flash. To bring up the Task Manager, press
CTRL-ALT-DEL Under the Performance tab you can look at CPU load and
ram usage. Under the Processes tab you can see how much ram
each program is using. Anyway, almost certainly something wrong
with
the fla file.
tralfaz

How to limit the maximum memory used by the JVM

Dears
we enabled sybase webservice and started it , and now find the process is running much memory,
how could I limit the maximum memory used by the JVM ?
aidcd02:/> prstat -p 8164 -p 17768
   PID USERNAME SIZE   RSS STATE PRI NICE      TIME CPU PROCESS/NLWP
8164 sybase   1079M 848M sleep   59    0   0:10:44 0.0% java/30
aidcd02:/> pargs 8164
8164:   /sybase/shared/JRE-6_0_24/bin/java -Dsybase.home=/sybase -Docs.home=OCS-15_0 -D
argv[0]: /sybase/shared/JRE-6_0_24/bin/java
argv[1]: -Dsybase.home=/sybase
argv[2]: -Docs.home=OCS-15_0
argv[3]: -Dcom.sybase.ase.ws.libtcl=
argv[4]: -classpath
argv[5]: /sybase/WS-15_0/lib/axis.jar:/sybase/WS-15_0/lib/jaxrpc.jar:/sybase/WS-15_0/lib/saaj.jar:/sybase/WS-15_0/lib/commons-logging-1.0.4.jar:/sybase/WS-15_0/lib/commons-discovery-0.2.jar:/sybase/WS-15_0/lib/log4j-1.2.4.jar:/sybase/WS-15_0/lib/wsdl4j-1.5.1.jar:/sybase/jConnect-6_0/classes/jconn3.jar:/sybase/jConnect-6_0/classes/jTDS3.jar:/sybase/WS-15_0/lib/xercesImpl.jar:/sybase/WS-15_0/lib/xmlParserAPIs.jar:/sybase/WS-15_0/lib/server.jar:/sybase/WS-15_0/lib/sqlx.jar:/sybase/WS-15_0/lib/flexlm.jar:/sybase/WS-15_0/lib/servlet-api-2.5-20081211.jar:/sybase/WS-15_0/lib/jetty-6.1.22.jar:/sybase/WS-15_0/lib/jetty-sslengine-6.1.22.jar:/sybase/WS-15_0/lib/jetty-util-6.1.22.jar:/sybase/WS-15_0/lib/tools.jar:/sybase/WS-15_0/lib/jcert.jar:/sybase/WS-15_0/lib/jnet.jar:/sybase/WS-15_0/lib/jsse.jar:/sybase/WS-15_0/lib/jce1_2_2.jar:/sybase/WS-15_0/lib/sunjce_provider.jar:/sybase/WS-15_0/lib/ws.jar:/sybase/shared/lib/dsparser.jar:/sybase/WS-15_0/props:/sybase/WS-15_0/producer/WEB-INF
thanks.

You can limit the maximum memory used via command line options to the VM.
Noting of course that typically if you are in fact actually using that memory that reducing it is going to have some negative impact on your application including catastrophic failure.
Conversely if the application is not in fact actively using that memory then limiting it just because some tool reports that the OS has reserved it then limiting it is pointless.

Application limit to 1G memory allocation

Similar Messages

Maybe you are looking for