[gnome 3] memory leak or at least something suspicious

Mem: 2055060 1919924 135136 0 17044 1536900
-/+ buffers/cache: 365980 1689080
Swap: 530140 0 530140
Doesn't look that nice.
755 root 20 0 6308 1556 1108 R 14.6 0.1 4:32.78 syslog-ng
4245 jochem 20 0 160m 34m 9732 S 10.3 1.7 3:28.96 transmission-gt
3159 root 20 0 73608 18m 6676 S 0.7 0.9 1:37.21 Xorg
6573 jochem 20 0 120m 12m 9352 S 0.3 0.6 0:01.42 gnome-terminal
6797 jochem 20 0 2544 936 724 R 0.3 0.0 0:00.80 top
1 root 20 0 1872 540 476 S 0.0 0.0 0:00.63 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
09:54:07 up 1:50, 2 users, load average: 0.14, 0.31, 0.36
I just closed firefox of which I heard it can eat memory??
I'm in the dark here. Does anyone know what to search for? Are there any known issues regarding gnome3 and mem-usage? Maybe known issues around Xorg?
Could it be that it's funny that there's 2 users active , namely me and uhmmmm...me?
[jochem@laptop ~]$ users
jochem jochem
Any ideas??
[edit]
Maybe this is the culprit:
I noticed the other day that my everything.log and iptables.log were eating diskspace >> they both grew into 2Gb (!). I even couldn't log into X after a while. I did solve that problem by manually removing those logs. I didn't uninstall ufw/iptables though as I thought that this was some temporary issue......
This was two days ago, but this morning I noticed the same behaviour regarding my firewall. Obviously a bug. I got rid of ufw now ( and iptables )
I'm not sure if this is related though.....
Last edited by jocheem67 (2011-06-09 08:33:31)

Holy toledo, that's at least a piece of a obligatory read. Excuse me for my ignorance.. I never realized this stuff....( after 7 years of linux I might add >> grmmmmmbbbll )
I'm not marking my thread as solved though, because I do experience slowdowns when and if top and free are 'full'...
I do blame firefox though for not being too effective on resources, but do realize that there's already a lot of material on the web 'bout that one.....
Let me get back to this later on....first I have to do some reading.

Similar Messages

Memory leaks in GC or something else on iOS

Hello.
I am making a game by Adobe AIR for iOS. My application has a memory leak bug with using only iOS.
So, I have some questions.
Why is it different using memory size of between Scout and Instruments VM Tracker (Dirty size) ?
Why is the difference increased between Scout and VM Tracker?I think, AIR makes memory leaks on GC when iOS alerts a low memory warning.
Can I catch GPU memory size ?
Rendering mode is 'gpu'.
I don't use Stage3D.
I think it is 'IOKit' dirty size of VM Tracker. Its right?
Scout gives no memory leaks. Instruments VM Tracker gives 50MB leaks for 20min.
1min ago. 162MB
20min ago. 162MB
Instruments 220MB -> 272MB
Scout overhead memory was about 1kB/min increasing.
I am sorry I have no small code to reproduce.
Environment:
iPad mini iOS7.0.4
AIR 3.9.0.1030

Hi!
I think the virus did modify or delete some system files so are not able to boot in safe mode, print documents and so far.
Furthermore I must agree Raver. The best way would be to reinstall Windows with the recovery disk. This takes only few minutes but safe your data before. The HDD will be completely formatted.
If have reinstalled Windows, you should first install all Service Packs and Hotfixes (visit the Windows update website).
And dont forget to install a antivirus program like AntiVir (freeware).
Bye

JSF: partial page rendering is causing memory leak leading to outofmemory

JDeveloper 10.1.3.2.0
JDK: 1.6.0_06
Operating System: Windows XP.
I test my application for memory leaks. For that purpose, I use jconsole to monitor java heap space. I have an edit page that has two dependent list components. One displays all countries and the other displays cities of the selected country.
I noticed java heap space keeps growing as I change country from country list.
I run garbage collection and memory usage does not go down. If I keep changing the province for 5 minutes, then I hit a java heap space outofmemory exception.
To narrow down the problem, I removed the second city component and the problem still exists.
To narrow it down further, I removed autosubmit attribute from the country component and then memory usage stopped increasing as I change country.
country/city partial page rendering is just an example. I am able to reproduce the same problem on every page where i use partial page rendering. My conclusion is PPR is causing memory leak or at least the autosubmit attribute.
This is really bad. Anyone out there experienced same issue. Any help/advice is highly appreciated !!
Thanks
<af:panelLabelAndMessage
inlineStyle="font-weight:bold;"
label="Country:"
tip=" "
showRequired="true"
for="CountryId">
<af:selectOneChoice id="CountryId"
               valuePassThru="true"
               value="#{bindings.CountryId.inputValue}"
               autoSubmit="true"
               inlineStyle="width:221px"
               simple="true">
     <af:forEach var="item"
          items="#{bindings.CountriesListIterator.allRowsInRange}">
     <af:selectItem value="#{item.countryId}"
               label="#{item.countryName}"/>
     </af:forEach>
</af:selectOneChoice>
</af:panelLabelAndMessage>
<af:panelLabelAndMessage
inlineStyle="font-weight:bold;"
label="City:"
tip=" "
showRequired="true"
for="CityId">
<af:selectOneChoice id="CityId"
               valuePassThru="true"
               value="#{bindings.CityId.inputValue}"
               partialTriggers="CountryId"
               autoSubmit="true"
               inlineStyle="width:221px"
               unselectedLabel="--Select City--"
               simple="true">
     <f:selectItems value="#{backing_CountryCityBean.citiesSelectItems}"/>
</af:selectOneChoice>
</af:panelLabelAndMessage>

Samsam,
I haven't seen this problem myself, no.
To clarify - are you seeing this behaviour when running your app in JDeveloper, or when running in an application server? If in JDeveloper, a copuple of suggestions:
* (may not matter, but...) It's not supported to run JDev 10g with JDK 6
* have you tried the [url http://www.oracle.com/technology/pub/articles/masterj2ee/j2ee_wk11.html]memory profiler
Best,
John

Secd Process Memory Leak

Finding the secd process using 13GB of RAM was a bit of a shock. Watching its RAM consumption continue to increase, indicates a memory leak. Is this something anyone else has noticed? And any possible solutions?

Thanks - I think this helped, but will give it a day or two to see what happens.
My secd was over 32 GB the other day and the iMac wasn't quite its usual self. After restarting, secd's memory usage dropped away, but has been steadily creeping up over the last couple of days and was over 5GB this morning. So I tried dragging the Keychains folder to the trash and restarting.
The thing about dragging your keychain to the trash and restarting is, on logging back in you may be asked for a pile of passwords to all your mail accounts and your keychain will be empty!
I filled out all the requests for icloud passwords, but for the keychain to update properly, this took a while. I think what saved me from panicking about losing all my passwords, was going into System Preferences and signing into iCloud there. I was also requested to verify my iCloud login from another device (e.g., iPAD). I think this is what restored my keychain from the cloud.
Once the keychain had updated itself, I restarted the iMac again, and Mail returned to normal (no more requests for mail account passwords).
The only thing that wasn't restored after restarting was automatic keychain access to my time machine. I had to enter the password and save it to the keychain.

Memory leak 2

i have a super simple java test applet. it does nothing but generate a memory leak. maybe im doning something wrong.
the interesting thing is that i only have to comment out the code that adds the JScrollPane object to the contentPane of the JApplet. and this class will then finalize.
here is the test applet
package com.hobart.scale.test;
import java.awt.*;
import javax.swing.*;
public class TestApplet extends JApplet
     /*                             PUBLIC MEMBERS                             */
     public TestApplet()
        System.out.println("TestApplet:constructor ...");
     /*                         APPLET PUBLIC MEMBERS                          */
     //Initialize the applet
     public void init()
        System.out.println("TestApplet:Initializing ...");
         Container cont = getContentPane();                                                            // get the container to hold it all
         cont.setLayout( new BorderLayout() );                                             // define the layout used for this applet
          cont.add(new JScrollPane(), "Center" );
     //Start the applet
     public void start()
        System.out.println("TestApplet:Initializing ...");
     //Stop the applet
     public void stop()
        System.out.println("TestApplet:Stopped ...");
     //Destroy the applet
     public void destroy()
          Container cont = getContentPane();
          cont.removeAll();
          removeAll();
        System.out.println("TestApplet:Destroying ...");
    public void finalize() throws Throwable {
        System.out.println("finalize ListFonts.java");
          super.finalize();
     /*                         PUBLIC STATIC MEMBERS                          */
     public static void main(String[] args)
        System.out.println("TestApplet:main ...");
     /*                      PUBLIC STATIC FINAL MEMBERS                       */
     /*                            PRIVATE MEMBERS                             */
}

why should it create a memory leak?

Z77 G45 Gaming - Memory leak (Non-paged pool)

Good day MSI forum.
I recently bought this motherboard of yours, and it's working great. As the title says, I am having a memory leak of some sort. I've been doing all kinds of googeling, using poolmon trying to locate the error and so on, but I am not educated enough in this area to know what I am really doing!
What me and my frined managed to find out so far:
1. When I download something, or when I upload youtube with max pixels (more upload then), the non-paged pool meter just rises as if he was to climb the mount everest!
2. When I disabeled the Killer 2200 driver, (killed the EXE file in my task manager) the memory started to leak A LOT slower.
3. Over the course of 24 hours with no downloading, just youtube music streaming and online games being ran, it can leak up to 1000mb. (While downloading it does 1000mb in 1 hour). It was basically the same speed of my download - 1MB downloaded > 1 MB leaked - so in conclusion it has to do with the network (and here's the problem, I don't know what might cause this).
Now I am not completely sure that the driver/download is what is causing the memory leak, it might be something that I don't know of. I am not a pro in this matter, so I ask of help!
Thank you in advance,
Orlaw.

Hi,
Please check the following article for troubleshooting:
http://support.microsoft.com/kb/q177415/en-us
Regards.
Vivian Wang

Memory Leak issue 1.5.4.59.40-no-jre jdk1.6.0_12 jre6

Me and 2 other develops have been using SQL developer since it was created but we are getting really frustrated with the memory leaks we are experencing.
We will start up sql developer and if we just leave it alone within a couple hours it will have taken up 650Megs of ram and be completely locked up. If we are working in sql developer the time can be even faster till it lockups up. We have been experencing the issue for very long time but seems to have gotten worse in the last to updates.
I have tried to search the web and form for information to the memory problem to no avail. We are running oracle 10g and windows XP with 2gigs of ram.
Can some one point me to some information or have any idea what is going on?
Edit--
I just realized that I was not using the latest version that I have downloaded. Trying sqldeveloper-1.5.4.59.40-no-jre will advise as to results.
Edited by: ObeTheDuck on Mar 17, 2009 8:47 AM
2nd Edit--
1.5.4.59.40-no-jre has the same issue. 2hrs and it has locked up and is no longer listed as a running app and can only be seen under the process thread in windows task manager with 50% CPU use on a dual-core cpu and 626megs ram being used. Have to kill and restart ... <sigh>
Edited by: ObeTheDuck on Mar 17, 2009 10:45 AM

Thanks for the info so far....
We really do like sql developer as a tool and has been execeding helpful and useful as our development tool.
I am proud to say we have been using it since the 2nd month is was available and have been encourged and happy with most of the improvements.
I am looking forward to trying the modeling tool soon.
If I can get back to having a stable work enviorment for a work day that will be fine for now. It's just been reduced down to 2hrs which is a bit much.
Anyway...
1. We don't have any in house extentions that we need. I am speaking of the one that come bundled with the tool. Or at least I thought that they came bundled.
Several are migration tools which we don't need. One is TenTime tool which I don't think we need.
Last is the versioning extention, this sounds like something we want to use, but stability is more important at the moment. So unchecked they have all been.
2. Sue you asked about a clean install. Is that simply an unpacking a new folder copy and then not migrate settings when running?
3. I will be glad to uninstall java a switch to different version of the jdk which one is consider to be the most stable atm?
Thanks,
Obe

ITunes 6.0.4(3) memory leak

I know this topic has popped up on the Windows forum, but I'd like to officially document the same problem in iTunes for OSX.
Using the iStat Nano widget, I've been monitoring my memory usage when running iTunes. When I first start the program, memory usage jumps to 600 MB. The longer iTunes is open, the more and more memory disappears, whether I'm actively using the program or not (i.e. listening to music). Eventually, this causes a hard crash. By hard crash I mean that I must use the on/off button to reboot the machine. I have had this problem since getting my computer (in mid-March), so there has been at least one iTunes update since then that has not fixed this issue. (I have a previous post on this topic called "iTunes freezing" that was made before I realized that it was caused by a memory leak.)
I am very, very pleased with my MacBook Pro and I realize that this is not a hardware issue. Has anyone else encountered this problem? Are there any plans to fix it in a future update?
Thanks in advance for any comments, suggestions, or solutions!
2.16GHz 15.4" MacBook Pro, 2GB RAM Mac OS X (10.4.6) 4G 40GB Photo iPod, 5G 2GB nano

I posted a question this evening on what sounds like the same issue: the link is here:
http://discussions.apple.com/thread.jspa?threadID=548752
I think your original post makes clear that this issue is about iTunes itself, it's not about any devices or iPods, not is it to do with the Intel or non-Intel processors... I will try looking at the Memory stats too.
What baffles me is that I had been using iTunes 6 for quite a long time (and only updating it manually, not automatically) before I ever experienced this.
My hunch (but what do I know?) is that my initial freeze might have happened for some other reason (too many applications working hard at once, as sometimes happens -- though I have had this happen reasonably often on the PowerBook it is extremely rare on the G5) -- and then in the course of that freeze / crash something in iTunes got corrupted (perhaps the database file that allows iTunes to navigate the iTunes library?)
By the way, what is the technical name for the total freeze thing (i.e. no beachballs, just complete loss of the mouse and keyboard response, clock stops, no shortcuts working, only PowerButton allows you to shut down).
Has anyone with this issue tried uninstalling iTunes (by Trashing the App) and reinstalling from a newly-downloaded copy? (I might try that ...)
PowerMac G5 Dual 1.8GHz, PowerBook G4 12" 1.33GHz Mac OS X (10.4.5)
PowerMac G5 Dual 1.8GHz, PowerBook G4 12" 1.33GHz Mac OS X (10.4.5)
PowerMac G5 Dual 1.8GHz, PowerBook G4 12" 1.33GHz Mac OS X (10.4.5)
PowerMac G5 Dual 1.8GHz, PowerBook G4 12" 1.33GHz Mac OS X (10.4.5)
PowerMac G5 Dual 1.8GHz, PowerBook G4 12" 1.33GHz Mac OS X (10.4.5)

Memory Leak with new Font()

Hello all,
Not sure if this is the right place to post this but here goes. I have a program that needs to change the font of at least 250,000 letters, however after doing this the program runs slow and laggy as if changing the fonts of each letter took up memory and never released it? Here is a compilable example, Click the button at the bottom of the window and watch the letter it is currently working on. You will notice that around 200,000 it will begin to not smoothly count up anymore but count in kind of a skipping pattern. This seems to get worse the more you do it and seems to indicate to me that something is using memory and not releasing it. I'm not sure why replacing a letter's font with a new font would cause more memory to be taken up I would think if I was doing it properly it would simply replace the old font with the new one not taking anymore memory then it did before. Here is the example: This program sometimes locks up so be prepared. If someone could maybe point out what is causing this to take up more memory after changing the fonts that would be great and hopefully find a solution :) Thanks in advance.
-neptune692
* To change this template, choose Tools | Templates
* and open the template in the editor.
package paintsurface;
import java.awt.*;
import java.awt.event.*;
import javax.swing.*;
import java.util.*;
import java.util.List;
public class PaintSurface implements Runnable, ActionListener {
public static void main(String[] args) {
        SwingUtilities.invokeLater(new PaintSurface());
List<StringState> states = new ArrayList<StringState>();
Tableaux tableaux;
Random random = new Random();
Font font = new Font("Arial",Font.PLAIN,15);
//        Point mouselocation = new Point(0,0);
static final int WIDTH = 1000;
static final int HEIGHT = 1000;
JFrame frame = new JFrame();
JButton add;
public void run() {
        tableaux = new Tableaux();
        for (int i=250000; --i>=0;)
                addRandom();
        frame.add(tableaux, BorderLayout.CENTER);
        add = new JButton("Change Font of letters - memory leak?");
        add.addActionListener(this);
        frame.add(add, BorderLayout.SOUTH);
        frame.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
        frame.setSize(WIDTH, HEIGHT);
        frame.setLocationRelativeTo(null);
        frame.setVisible(true);
public void actionPerformed(ActionEvent e) {
    new Thread(new ChangeFonts()).start();
void addRandom() {
        tableaux.add(
                        Character.toString((char)('a'+random.nextInt(26))),
                        UIManager.getFont("Button.font"),
                        random.nextInt(WIDTH), random.nextInt(HEIGHT));
//THIS CLASS SEEMS TO HAVE SOME KIND OF MEMORY LEAK I'M NOT SURE?
class ChangeFonts implements Runnable {
    public void run() {
    Random rand = new Random();
        for(int i = 0; i<states.size(); i++) {
            font = new Font("Arial",Font.PLAIN,rand.nextInt(50));
            states.get(i).font = font;
            add.setText("Working on letter - "+i);
class StringState extends Rectangle {
        StringState(String str, Font font, int x, int y, int w, int h) {
                super(x, y, w, h);
                string = str;
                this.font = font;
        String string;
        Font font;
class Tableaux extends JComponent {
        Tableaux() {
                this.enableEvents(MouseEvent.MOUSE_MOTION_EVENT_MASK);
                lagState = createState("Lag", new Font("Arial",Font.BOLD,20), 0, 0);
        protected void processMouseMotionEvent(MouseEvent e) {
                repaint(lagState);
                lagState.setLocation(e.getX(), e.getY());
                repaint(lagState);
                super.processMouseMotionEvent(e);
        StringState lagState;
        StringState createState(String str, Font font, int x, int y) {
            FontMetrics metrics = getFontMetrics(font);
            int w = metrics.stringWidth(str);
            int h = metrics.getHeight();
            return new StringState(str, font, x, y-metrics.getAscent(), w, h);
        public void add(String str, Font font, int x, int y) {
                StringState state = createState(str, font, x, y);
                states.add(state);
                repaint(state);
        protected void paintComponent(Graphics g) {
                Rectangle clip = g.getClipBounds();
                FontMetrics metrics = g.getFontMetrics();
                for (StringState state : states) {
                        if (state.intersects(clip)) {
                                if (!state.font.equals(g.getFont())) {
                                        g.setFont(state.font);
                                        metrics = g.getFontMetrics();
                                g.drawString(state.string, state.x, state.y+metrics.getAscent());
                if (lagState.intersects(clip)) {
                g.setColor(Color.red);
                if (!lagState.font.equals(g.getFont())) {
                    g.setFont(lagState.font);
                    metrics = g.getFontMetrics();
                g.drawString("Lag", lagState.x, lagState.y+metrics.getAscent());
}Here is the block of code that I think is causing the problem:
//THIS CLASS SEEMS TO HAVE SOME KIND OF MEMORY LEAK I'M NOT SURE?
class ChangeFonts implements Runnable {
    public void run() {
    Random rand = new Random();
        for(int i = 0; i<states.size(); i++) {
            font = new Font("Arial",Font.PLAIN,rand.nextInt(50));
            states.get(i).font = font; // this line seems to cause the problem?
            add.setText("Working on letter - "+i);
}

neptune692 wrote:
jverd wrote:
You're creating a quarter million distinct Font objects, and obviously you must be hanging on to all of them because each character is having its font set to the newly created object. So if you have 250k chars, you're forcing it to have 250k Font objects.
Since the only difference is that rand.nextInt(50) parameter, just pre-create 50 Font objects with 0..49, stick 'em in the corresponding elements in an array, and use rand.nextInt to select the Font object to use.That does make sense but it does that when the the program is first launched and doesn't lag. But the second and third time you change the letters font it seems to lag so if it wasn't taking up more memory the second time it should perform like it did when it first launched. I don't care to investigate any further. The real problem is almost certainly the quarter million Font objects. It could be that 250k is fine, but by the time you get to 500k, it has to do a lot of GC, and that's where the slow down is coming. You might even be able to make it work better with the code you have just by tweaking the GC parameters at startup, but I wouldn't bother. Fix the code first, and then see if you have issues.
Does creating a new font for each of those letters not replace the old font object? If it didn't use more memory the second and third time I don't think you would see the skipping in the counter and the slowing down of the iterations. So it must be remembering some of the old font objects or am I wrong?Using new always creates a new object. When you do it the second time around, and call letter.setFont(newFont), the old Font object is eligible for GC. That doesn't mean it will be GCed right away though. The JVM can leave them all laying around until it runs out of memory, and then GC some or all of them.

Memory leak in "Tenured Generation" heap (JVM 1.5)?!

For about over a year, I'm trying to hunt down the memory leak in our server application. But after all the improvements I've made (especially with 'forgotten' listeners that didn't exist anymore), I'm confident that the application doesn't have a memory leak anymore. At least the new "jconsole.exe" tool of JDK 1.5 shows me a very intersting behaviour:
Even if the server app is doing nothing than one thread polling a database table for possible new jobs to process, the memory slightly increases over time ... very slightly. It's just like the screenshot at
http://java.sun.com/j2se/1.5.0/docs/guide/management/jconsole.html#memory
where you might find a very slight tendency up. I run jconsole the whole day to track the application on a computer where no jobs got processed, so the application only sit there there whole day and just one thread has a loop that polls a database table via JDBC and doesn't get a result. The result is, that the memory chart is like the chart in the screenshot of the link above just with much more jaggies. About every 20 minutes, garbage collection seems to kick in, as the jaggie line drops about several megabytes just to increase again slowly.
Of course the thread loop creates objects but it doesn't hold any (debugged it several times and it is quite easy code). So this behaviour makes sense. But it doesn't make sense that the memory usage overall slowly increases over many hours (ultimativaly leading to an OutOfmemoryError).
So far, I still thought, it must be a memory leak in my application. But then, I played with jConsole and noticed this: if I just display the Memory Pool "Eden Space", the jagged line always drops down to the same level, i.e. no memroy leak. The "Survivor Space" is also constant in average (no memory leak). But the "Tenured Generation" line shows this memroy leak behaviour (slowly increases). This space is described as:
Tenured Generation (heap): pool containing objects that have existed for some time in the survivor space.
So, I'm not so sure anymore if this memory must be in my application. Unfortunately, jConsole doesn't show some kind of object tree that can be browsed and I would see what kind of object (collection) increase.
I tried profiling my application, but the profiled app runs so slowly that it would need many days or weeks until it's possible to identify some bad objects.
Is there another way to identify such memory waisters?

Write a main() that does the polling in a tight loop 1000 times. Then System.gc(); Thread.sleep(1000); System.exit(). Run the thing with -Xrunhprof. Observe the "live bytes" and "live objs" columns in the generated java.hprof.txt file. Anything that strikes as suspicious? If every polling round leaks one object, there's likely to be 1000 (or N*1000) of something live. Make sure the leak is in the polling routine by running it 1,000,000 rounds and getting an OutOfMemory.

Custom MediaStreamSource and Memory Leaks During SampleRequested

Greetings,
I have a nasty memory leak problem that is causing me to pull my hair out.
I'm implementing a custom MediaStreamSource along with MediaTranscoder to generate video to disk. The frame generation operation occurs in the SampleRequested handler (as in the MediaStreamSource example). No matter what I do - and I've tried a
ton of options - inevitably the app runs out of memory after a couple hundred frames of HD video. Investigating, I see that indeed GC.GetTotalMemory reports an increasing, and never decreasing, amount of allocated RAM.
The frame generator in my actual app is using RenderTargetBitmap to get screen captures, and is handing the buffer to MediaStreamSample.CreateFromBuffer(). However, as you can see in the example below, the issue occurs even with a dumb allocation
of RAM and no other actual logic. Here's the code:
void _mss_SampleRequested(Windows.Media.Core.MediaStreamSource sender, MediaStreamSourceSampleRequestedEventArgs args)
if ( args.Request.StreamDescriptor is VideoStreamDescriptor )
if (_FrameCount >= 3000) return;
var videoDeferral = args.Request.GetDeferral();
var descriptor = (VideoStreamDescriptor)args.Request.StreamDescriptor;
uint frameWidth = descriptor.EncodingProperties.Width;
uint frameHeight = descriptor.EncodingProperties.Height;
uint size = frameWidth * frameHeight * 4;
byte[] buffer = null;
try
buffer = new byte[size];
// do something to create the frame
catch
App.LogAction("Ran out of memory", this);
return;
args.Request.Sample = MediaStreamSample.CreateFromBuffer(buffer.AsBuffer(), TimeFromFrame(_FrameCount++, _frameSource.Framerate));
args.Request.Sample.Duration = TimeFromFrame(1, _frameSource.Framerate);
buffer = null; // attempt to release the memory
videoDeferral.Complete();
App.LogAction("Completed Video frame " + (_FrameCount-1).ToString() + "\n" +
"Allocated memory: " + GC.GetTotalMemory(true), this);
return;
It usually fails around frame 357, with GC.GetTotalMemory() reporting 750MB allocated.
I've tried tons of work-arounds, none of which made a difference. I tried putting the code that allocates the bytes in a separate thread - no dice. I tried Task.Delay to give the GC a chance to work, on the assumption that it just had no time
to do its job. No luck.
As another experiment, I wanted to see if the problem went away if I allocated memory each frame, but never assigned it to the MediaStreamSample, instead giving the sample (constant) dummy data. Indeed, in that scenario, memory consumption stayed
constant. However, while I never get an out-of-memory exception, RequestSample just stops getting called around frame 1600 and as a result the transcode operation never actually returns to completion.
I also tried taking a cue from the SDK sample which uses C++ entirely to generate the frame. So I passed the buffer as a Platform::Array<BYTE> to a static Runtime extension class function I wrote in C++.
I won't bore you with the C++ code, but even directly copying the bytes of the array to the media sample using memcpy still had the same result! It seems that there is no way to communicate the contents of the byte[] array to the media sample without
it never being released.
I know what some will say: the difference between my code and the SDK sample, of course, is that the SDK sample generates the frame _entirely_ in C++, thus taking care of its own memory allocation and deallocation. Because I want to get
the data from RenderTargetBitmap, this isn't an option for me. (As a side note, if anyone knows if there's a way to get the contents of an RT Window using DirectX, that might work too, but I know this is not a C++ forum, so...). But more importantly,
MediaStreamSource and MediaStreamSample are managed classes that appear to allow you to generate custom frames using C# or other managed code. The MediaStreamSample.CreateFromBuffer function appears to be tailored for exactly what I want. But there appears
to be no way to release the buffer when giving the bytes to the MediaStreamSample. At least none that I can find.
I know the RT version of these classes are new to Windows 8.1, but I did see other posts going back 3 years discussing a similar issue in Silverlight. That never appears to have been resolved.
I guess the question boils down to this: how do I safely get managed data, allocated during the SampleRequested handler, to the MediaStreamSample without causing a memory leak? Also, why would the SampleRequested handler just stop getting called
out of the blue, even when I artificially eliminate the memory leak problem?
Thanks so much for all input!

Hi Rob -
Thanks for your quick reply and for clarifying the terminology.
In the Memory Usage test under Analyze/Performance and Diagnostics (is that what you mean?) it's clear that each frame of video being created is not released from memory except when memory consumption gets very high. GC will occasionally kick in, but eventually
it succumbs.
Interestingly, if I reduce the frame size substantially, say 320x240, it never runs out of RAM no matter how many frames I throw at it. The Memory Usage test, however, shows the same pattern. But this time the GC can keep up and release the RAM.
After playing with this ad nauseum, I am fairly convinced I know what the problem is, but the solution still escapes me. It appears that the Transcoder is requesting frames from the MediaStreamSource (and the MediaStreamSource is providing them via
my SampleRequested handler) faster than the Transcoder can write them to disk and release them. Why would this be happening? The MediaStreamSource.BufferTime property is - I thought - used to prevent this very problem. However, changing the BufferTime seems
to have no effect at all - even changing it to ZERO doesn't change anything. If I'm right, this would explain why the GC can't do its job - it can't release the buffers I'm giving to the Transcoder via SampleRequested because the Transcoder won't give them
up until it's finished transcoding and writing them to disk. And yet the transcoder keeps requesting samples until there's no more memory to create them with.
The following code, which I made from scratch to illustrate my scenario, should be air-tight according to everything I've read. And yet, it still runs out of memory when the frame size is too large.
If you or anyone else can spot the problem in this code, I'd be thrilled to hear it. Maybe I'm omitting a key step with regard to getting the deferral? Or maybe it's a bug in the back-end? Can I "slow down" the transcoder and force it to release samples
it's already used?
Anyway here's the new code, which other than App.cs is everything. So if I'm doing something wrong it will be in this module:
using System;
using System.Collections.Generic;
using System.IO;
using System.Threading.Tasks;
using System.Linq;
using System.Runtime.InteropServices.WindowsRuntime;
using System.Diagnostics;
using Windows.Foundation;
using Windows.Foundation.Collections;
using Windows.UI.Xaml;
using Windows.UI.Xaml.Controls;
using Windows.UI.Xaml.Controls.Primitives;
using Windows.UI.Xaml.Data;
using Windows.UI.Xaml.Input;
using Windows.UI.Xaml.Media;
using Windows.UI.Xaml.Navigation;
using Windows.UI.Popups;
using Windows.Storage;
using Windows.Storage.Pickers;
using Windows.Storage.Streams;
using Windows.Media.MediaProperties;
using Windows.Media.Core;
using Windows.Media.Transcoding;
// The Blank Page item template is documented at http://go.microsoft.com/fwlink/?LinkId=234238
namespace MyTranscodeTest
/// <summary>
/// An empty page that can be used on its own or navigated to within a Frame.
/// </summary>
public sealed partial class MainPage : Page
MediaTranscoder _transcoder;
MediaStreamSource _mss;
VideoStreamDescriptor _videoSourceDescriptor;
const int c_width = 1920;
const int c_height = 1080;
const int c_frames = 10000;
const int c_frNumerator = 30000;
const int c_frDenominator = 1001;
uint _frameSizeBytes;
uint _frameDurationTicks;
uint _transcodePositionTicks = 0;
uint _frameCurrent = 0;
Random _random = new Random();
public MainPage()
this.InitializeComponent();
private async void GoButtonClicked(object sender, RoutedEventArgs e)
Windows.Storage.Pickers.FileSavePicker picker = new Windows.Storage.Pickers.FileSavePicker();
picker.FileTypeChoices.Add("MP4 File", new List<string>() { ".MP4" });
Windows.Storage.StorageFile file = await picker.PickSaveFileAsync();
if (file == null) return;
Stream outputStream = await file.OpenStreamForWriteAsync();
var transcodeTask = (await this.InitializeTranscoderAsync(outputStream)).TranscodeAsync();
transcodeTask.Progress = (asyncInfo, progressInfo) =>
Dispatcher.RunAsync(Windows.UI.Core.CoreDispatcherPriority.Normal, () =>
_ProgressReport.Text = "Sourcing frame " + _frameCurrent.ToString() + " of " + c_frames.ToString() +
" with " + GC.GetTotalMemory(false).ToString() + " bytes allocated.";
await transcodeTask;
MessageDialog dialog = new MessageDialog("Transcode completed.");
await dialog.ShowAsync();
async Task<PrepareTranscodeResult> InitializeTranscoderAsync (Stream output)
_transcoder = new MediaTranscoder();
_transcoder.HardwareAccelerationEnabled = false;
_videoSourceDescriptor = new VideoStreamDescriptor(VideoEncodingProperties.CreateUncompressed( MediaEncodingSubtypes.Bgra8, c_width, c_height ));
_videoSourceDescriptor.EncodingProperties.PixelAspectRatio.Numerator = 1;
_videoSourceDescriptor.EncodingProperties.PixelAspectRatio.Denominator = 1;
_videoSourceDescriptor.EncodingProperties.FrameRate.Numerator = c_frNumerator;
_videoSourceDescriptor.EncodingProperties.FrameRate.Denominator = c_frDenominator;
_videoSourceDescriptor.EncodingProperties.Bitrate = (uint)((c_width * c_height * 4 * 8 * (ulong)c_frDenominator) / (ulong)c_frNumerator);
_frameDurationTicks = (uint)(10000000 * (ulong)c_frDenominator / (ulong)c_frNumerator);
_frameSizeBytes = c_width * c_height * 4;
_mss = new MediaStreamSource(_videoSourceDescriptor);
_mss.BufferTime = TimeSpan.FromTicks(_frameDurationTicks);
_mss.Duration = TimeSpan.FromTicks( _frameDurationTicks * c_frames );
_mss.Starting += _mss_Starting;
_mss.Paused += _mss_Paused;
_mss.SampleRequested += _mss_SampleRequested;
MediaEncodingProfile outputProfile = MediaEncodingProfile.CreateMp4(VideoEncodingQuality.Ntsc);
outputProfile.Audio = null;
return await _transcoder.PrepareMediaStreamSourceTranscodeAsync(_mss, output.AsRandomAccessStream(), outputProfile);
void _mss_Paused(MediaStreamSource sender, object args)
throw new NotImplementedException();
void _mss_Starting(MediaStreamSource sender, MediaStreamSourceStartingEventArgs args)
args.Request.SetActualStartPosition(new TimeSpan(0));
/// <summary>
/// This is derived from the sample in "Windows 8.1 Apps with Xaml and C# Unleashed"
/// </summary>
/// <param name="sender"></param>
/// <param name="args"></param>
void _mss_SampleRequested(MediaStreamSource sender, MediaStreamSourceSampleRequestedEventArgs args)
if (_frameCurrent == c_frames) return;
var deferral = args.Request.GetDeferral();
byte[] frameBuffer;
try
frameBuffer = new byte[_frameSizeBytes];
this._random.NextBytes(frameBuffer);
catch
throw new Exception("Sample source ran out of RAM");
args.Request.Sample = MediaStreamSample.CreateFromBuffer(frameBuffer.AsBuffer(), TimeSpan.FromTicks(_transcodePositionTicks));
args.Request.Sample.Duration = TimeSpan.FromTicks(_frameDurationTicks);
args.Request.Sample.KeyFrame = true;
_transcodePositionTicks += _frameDurationTicks;
_frameCurrent++;
deferral.Complete();
Again, I can't see any reason why this shouldn't work. You'll note it mirrors pretty closely the sample in the Windows 8.1 Apps With Xaml Unleashed book (Chapter 14). The difference is I'm feeding the samples to a transcoder rather than a MediaElement (which,
again should be no issue).
Thanks again for any suggestions!
Peter

BUG: Apex4/Anychart5 - memory leak?

We are running into a pretty serious problem with resources. It seems that there is some kind of interaction between Apex and Anychart5 that is causing a pretty serious memory leak. For example, in one dashboard I am building, I have 9 charts on a page. When I click through a chart to a second page, I have three charts and an Interactive report.
None of the sql is really all that complex. But I will include one of the queries singled out by one of our DBAs as being involved in consuming over 20 GB of data (values slightly modified for security). The query:
SELECT CASE
WHEN quarter = 'Q1'
THEN
'/pls/apex/f?p=108:3:1111111111111111::::P3_YEAR1,P3_YEAR2,P3_CLICK_VAL,P3_QUARTER:2009,2008,2009,1:'
WHEN quarter = 'Q2'
THEN
'/pls/apex/f?p=108:3:1111111111111111::::P3_YEAR1,P3_YEAR2,P3_CLICK_VAL,P3_QUARTER:2009,2008,2009,2:'
WHEN quarter = 'Q3'
THEN
'/pls/apex/f?p=108:3:1111111111111111::::P3_YEAR1,P3_YEAR2,P3_CLICK_VAL,P3_QUARTER:2009,2008,2009,3:'
WHEN quarter = 'Q4'
THEN
'/pls/apex/f?p=108:3:1111111111111111::::P3_YEAR1,P3_YEAR2,P3_CLICK_VAL,P3_QUARTER:2009,2008,2009,4:'
END
link,
quarter label,
so_ext_price Sales_2009
FROM ( SELECT SUM (v.so_ext_price) so_ext_price,
('Q' || TO_CHAR (v.cal_qtr_num)) quarter
FROM owner.materialized_view_mv@db_link_name v
WHERE v.cal_year = TO_CHAR (2009)
AND v.account_number IN
(SELECT *
FROM TABLE(user_pkg.get_customer_numbers (
'APP_USER',
'USER_PROPERTY',
'CUSTOMER_NAME'
-- THE ABOVE SUBQUERY SELECTS FROM A PIPELINE FUNCTION TO RETURN A LIST OF STRINGS
GROUP BY v.cal_qtr_num
ORDER BY v.cal_qtr_num)
As you would expect, this query returns 4 records reflecting sales by quarter. The query takes about four seconds to run. Explain plan cost is just under 14K. The pipeline function literally returns a single column of about six values using a simple select distinct where the parameters passed are filters in the where clause. The pipeline function returns in approximately 1 second. The largest result set it ever returns is six rows. The pipeline function is innocuous on its own but I am suspicious that it may be where we're running into issues. We weren't seeing these problems (or at least they weren't as noticeable) until we needed to use pipline functions. 'Don't use pipeline functions' is not an acceptable work around in our case. While I can figure out a way around it in the charts by returning SQL from a function, I cannot do so in the interactive reports.
What our DBAs found is that the code pasted below is what was sucking down 22 GB of ram, then after clicking through to the second page the same code (for a different chart query) was consuming 17 GB of ram almost depleting our 48 GB of ram on our server in less than ten minutes. I disabled the chart running each 'offending' query and we had the same results with a different chart but the same underlying code below.
I don't know where in Apex this lives but it's the killer. Can I get some feedback? Anyone else having similar issues?
declare
rc__ number;
simple_list__ owa_util.vc_arr;
complex_list__ owa_util.vc_arr;
begin
owa.init_cgi_env(:n__,:nm__,:v__);
htp.HTBUF_LEN := 63;
null;
null;
simple_list__(1) := 'sys.%';
simple_list__(2) := 'dbms\_%';
simple_list__(3) := 'utl\_%';
simple_list__(4) := 'owa\_%';
simple_list__(5) := 'owa.%';
simple_list__(6) := 'htp.%';
simple_list__(7) := 'htf.%';
simple_list__(8) := 'wpg_docload.%';
if ((wwv_flow_epg_include_modules.authorize('apex_util.flash') = false) or (owa_match.match_pattern(p_string =>
'apex_util.flash'
/* */,p_simple_pattern =>
simple_list__
,p_complex_pattern =>
complex_list__
,p_use_special_chars =>
false)))
then
rc__ := 2;
else
null;
null;
apex_util.flash(p=>:p,XMLCallDate=>:XMLCallDate);
if (wpg_docload.is_file_download) then
rc__ := 1;
wpg_docload.get_download_file(:doc_info);
null;
null;
null;
commit;
else
rc__ := 0;
null;
null;
null;
commit;
owa.get_page(:data__,:ndata__);
end if;
end if;
If we are barking up the wrong tree, I'd be VERY happy. I'd rather it was something I could fix.
Edited by: WannaRock on Aug 24, 2010 9:53 AM

Thanks for looking at this post. We have resolved the issue for ourselves by working with our DBAs to narrow down where the problem actually started. We found that the particular SQL we were looking at was not the issue. In a chart on a subsequent page (via a click through), we were actually running into where apex was starting to consuming memory but we were catching it later.
What we found was that when we had a chart query that was SQL containing a pipeline function, the memory usage went up. And within 10 minutes, the server would crawl to a halt. To release the memory, the DBAs would have to bounce the Apex instance. When I changed the query to be a function returning SQL, the problem stopped. I don't know what the correlation was between SQL and moving to a PL/SQL function returning SQL.
I am not even 100% positive of the pipeline function being the cause. I only know that this started happening about the same time as when I implemented the pipeline function. I understand you are leery of a one-second function/query running up that kind of utilization. No one here believed me either (including me really). We figured it HAD to be a coincidence. But once I changed the query from SQL to a function returning PL/SQL, our problem went away.
Thanks to all who looked at and thought about this.
Walter

PGA memory Leak issue along with TNS: listener could not hand off client connection

Hi,
We have two Oracle Database instances in a 32 bit Standard Edition Windows OS machine with 3 GB RAM : 1) 1525 MB (SGA+PGA) 2) 515 MB (SGA+PGA)
Recently we upgraded the RAM from 3 GB to 4 GB. Subsequently we upgraded the SGA + PGA of the 2nd instance to 771 MB.
This has resulted into PGA memory leak issue reported in the alert log file and trace file.
Reverting back the SGA+PGA size to 515 MB solved the issue.
Is this issue related to Address Windowing Extension (AWE)?
Is the reason related to Total memory for all the cumulative Oracle instance should be < 2GB.
How to solve this?
Mon Jul 15 08:21:25 2013
ORACLE V10.2.0.4.0 - Production vsnsta=0
vsnsql=14 vsnxtr=3
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Windows Server 2003 Version V5.2 Service Pack 2
CPU                 : 4 - type 586, 4 Physical Cores
Process Affinity    : 0x00000000
Memory (Avail/Total): Ph:1068M/4023M, Ph+PgF:4985M/7933M, VA:18M/2047M
Instance name: dp3
Redo thread mounted by this instance: 0 <none>
Oracle process number: 0
Windows thread id: 4484, image: ORACLE.EXE (SHAD)
*** 2013-07-15 08:21:25.133
*** ACTION NAME:() 2013-07-15 08:21:25.133
*** MODULE NAME:() 2013-07-15 08:21:25.133
*** SERVICE NAME:() 2013-07-15 08:21:25.133
*** SESSION ID:(90.829) 2013-07-15 08:21:25.133
******** ERROR: PGA memory leak detected 6302928 > 30176 ********
HEAP DUMP heap name="pga heap" desc=6C98A800
extent sz=0x206c alt=92 het=32767 rec=0 flg=3 opc=3
parent=00000000 owner=00000000 nex=00000000 xsz=0x0
EXTENT 0 addr=7FC10008
Chunk 7fc10010 sz=    64996    free      "               "
Chunk 7fc1fdf4 sz= 2097676    freeable "krfrbAllocate: "
Dump of memory from 0x7FC1FDF4 to 0x7FE20000
7FC1FDF0          1020020D 7FC10010 03871E90      [.. .........]
7FC1FE00 00000000 00000000 00000000 00000000 [................]
Repeat 131103 times
EXTENT 1 addr=7FA00008
Chunk 7fa00010 sz=    64996    free      "               "
Chunk 7fa0fdf4 sz= 2097676    freeable "krfrbAllocate: "
Dump of memory from 0x7FA0FDF4 to 0x7FC10000
7FA0FDF0          1020020D 7FA00010 03871E90      [.. .........]
7FA0FE00 00000000 00000000 00000000 00000000 [................]
Repeat 131103 times
EXTENT 2 addr=7F7F0008
Chunk 7f7f0010 sz=    64996    free      "               "
Chunk 7f7ffdf4 sz= 2097676    freeable "krfrbAllocate: "
Dump of memory from 0x7F7FFDF4 to 0x7FA00000
7F7FFDF0          1020020D 7F7F0010 03871E90      [.. .........]
7F7FFE00 00000000 00000000 00000000 00000000 [................]
Repeat 131103 times
EXTENT 3 addr=70A50008

There may be something fixed in the patch that gives the error rather than mysterious hangs. I would prefer that, myself. There may be something in the patch that changes how Oracle allocates user, system and program areas.
At some point you spend more trying to limp things along in a growing environment than simply upgrading. 32 bit environments these days is an indicator that management is figuring some false economies. But that's their prerogative.
The PGA can be affected by many things, not least of which is how the application uses it. Much has been written about it, my own experience has been more is used than most people say. But that is probably just my app. Note there are different ways to set it, and a parameter with "target" in it might not be a hard limit. Different execution plans for the same code may use different amounts of memory - there can even be situations where forcing some code to use a sort area instead, or even forcing more operations to disk, can free up more pga for everyone else. It depends. But that's why I look at multi-pass operations in dbconsole.

Possible of memory leak in the loop

Recently my application do get OutOfMemory issue. I realized the memory is keep on stack up as i saw in the task manager, the jlaunch keep growing and it won't drop back. That day i'm running a search function and it will query the table to retrieve the data. The jlaunch shoot from 500MB -> 2.2GB and now remain in there. Wondering is it during it query it populate at least 10,000 records into the arraylist and then the memory already allocated and once i finish run the function, it will clear the allocated memory to re-use it.
public ArrayList ejbHomeInJDBCConnection(Map map){
     ArrayList beanList = new ArrayList();
     try{
          Context ctx = new InitialContext();
          DataSource ds = (DataSource) ctx.lookup("jdbc/POOL");
          Connection con = ds.getConnection();
          String query = "SELECT * FROM USER WHERE ";
          for (Iterator iterator = map.keySet().iterator(); iterator.hasNext();) {
               Object key = iterator.next();
               if(key.toString().startsWith("TIME") | key.toString().startsWith("TIMEIN")){
                    long longValue = Long.parseLong(map.get(key).toString());
                    query += key.toString()+ longValue + " AND ";
               }else{
                    String value = (String)map.get(key);
                    query += key.toString()+ value + " AND ";
          String newquery = query.substring(0, query.length()-5);
          newquery += " ORDER BY TIMEIN DESC";
          Statement stmt = con.createStatement();
          try {
               ResultSet rs = stmt.executeQuery(newquery);
              try {
                    while (rs.next()){
                         InBean bean = new InBean();
                         bean.setSmsId(rs.getString("EMP"));
                         beanList.add(bean);
               }finally{
                    rs.close();
          }finally{
               stmt.close();
     }catch(Exception e){
          System.err.println(e.fillInStackTrace());
return beanList;
Wondering is it the InBean will cause any memory leak as if there is 10,000 records, which mean it will create 10,000 objects and once it add into the arraylist the previous bean is not in use, will the GC clear it as i didn't set it as null. Do i need to do something like reallocate/defragment the memory?
Thanks.

Hi,
I'm sure a "count" would not generate the overhead you are concerned.
To understand some aspects, you need to read the source files of Java, and understand how the stack would work in your case.
Evertime you "add" an element to you list, the implementation will run the ensureCapacity, and grown the list one by one. Understand that the list is an Array with a lot more functions, but below, you are still working with an Array, and it needs to have a defined size. Everytime you add, it's doing a System.arraycopy(all the crap) - So you can save this, everytime you add something if you create your List with the right size.
Note, this is not an issue if we consider small lists, of small objects, but working with large lists, you can feel slow downs.
About the GC stuff, well.. I'm sure you can do some reading how it works. One good start point would be
Link: [http://java.sun.com/docs/hotspot/gc1.4.2/]
I'm sure you don't need that, but still, it's good reading. Maybe you should just increase your heap size, or you can manually clear the List using list.clear();
Rgds,
Daniel

Memory leak in OracleDataReader with UDT in 11g

Hi,
Can someone confirm that the following code is leaking (hugely!):
command = new OracleCommand("select c.polygon from spatial c", connection);
reader = command.ExecuteReader();
while (reader.Read())
reader.Dispose();
command.Dispose();
where polygon is SDO_GEOMETRY.
Memory consumption for this code in Task Manager is +100MB above "normal" and it does not drop after calling Dispose() methods. I've also noticed that this "leak" is proportional to FetchSize. GC.Collect also does not change anything.
Is it a bug of 11g beta or am I missing something?

I'm not sure what do you mean by ODAC 2007. I couldn't find anything useful on your website regarding "ODAC 2007". I'm using Oracle 11g ODAC 11.1.0.5.10 Beta and I'm particularly interested in SDO objects. Based on your code samples I created strongly-typed C# classes for SDO objects and everything works like a dream (apart from this memory leak). And the performance is just OUTSTANDING! Keep up the good work!
BTW: Congratulations regarding ODP.NET API for binding UDT with C# classes. It's very intuitive and easy to use even if you want to create C# classes from the scratch, i.e. without any wizards. Did I mention performance? :-)
Many thanks Kiminari for your reassurance: it means a lot to me since I can now keep working on my project without any worries (I need a stable version of ODP.NET with UDT before Q2 2008). I was thinking about using OLE DB but the performance was horrible due to marshalling, passing untyped objects, etc. But you've just saved the day, and for development purposes the leaking version is absolutely fine.
Just small questions: when can we expect "ODAC 2007" or at least another beta? More less? Any estimations?

[gnome 3] memory leak or at least something suspicious

Similar Messages

Maybe you are looking for