Memory used by unknown processes

Hey all,
I have a serious problem on my 2008 model macbook running snow leopard 10.6.8 with 4GB of memory
Used memory continuosly grows even though no work is being done (i.e. no application opened).
It gets to a point where free memory goes almost to zero and only then system apparently frees some of it.
Using free memory app I can free memory manually but still after freeing, free memory continue to decline.
What really bothers me is that the sum of all memory used by processes (from both activity monitor and ps command) does not sum up to total used memory.
Can some "invisible" process be using my memory? or ps/activity monitor outputs are not correct?

Not exactly sure what you mean.
Here's output from top (the header):
Processes: 74 total, 3 running, 1 stuck, 70 sleeping, 535 threads                                                        13:40:42
Load Avg: 0.36, 0.22, 0.35  CPU usage: 8.33% user, 41.66% sys, 50.0% idle    SharedLibs: 5888K resident, 8800K data, 0B linkedit.
MemRegions: 13884 total, 1746M resident, 28M private, 380M shared.
PhysMem: 590M wired, 2219M active, 1025M inactive, 3834M used, 261M free.
VM: 178G vsize, 1043M framework vsize, 738071(0) pageins, 235(0) pageouts. Networks: packets: 660846/677M in, 332007/37M out.
Disks: 327320/5791M read, 154559/5840M written.
And here's the sum of RSS from ps:
# ps -axm -o "rss,comm"|grep -v COMM|awk 'BEGIN{a=0}{a+=$1}END{print a}'
2537976
As you can see, top reports 3834MB as used, while sum of RSS from ps shows ~2.5GB

Similar Messages

  • Increasing memory used by java process when calling Runtime.exec()

    Hi everyone!
    I'm running a servlet Oracle iAS 9i, Jserv. It receives an image posted by a user and does a System.exec() which performs a call to convert (an image processing utility included in ImageMagick).
    After a few hours, java process start taking more and more RAM, until it crashes with an error like this:
    Memory: 5394008 free of 134217728 total. (I log this myself)
    Exception: java.io.IOException: Not enough space
    java.lang.UNIXProcess.forkAndExec(), line -2.
    java.lang.UNIXProcess.<init>(), line 54.
    java.lang.Runtime.execInternal(), line -2.
    java.lang.Runtime.exec(), line 553.
    ImageProcessor.convert(), line 235.
    ImageProcessor.createItemPics(), line 124.
    Uploader.doPost(), line 69.
    As you can see, this is not an OutOfMemoryError, but something else in connection with O/S.
    This is not related to hard disk space, since there is a lot of free space in every filesystems
    After restarting the webserver, everything goes back to normal and start increasing RAM again.
    Is there anything I can do? Any help will be gratly appreciated... Thanks!!!
    Dani.-

    Have you had any solutions to this pal?
    I am also suffering. I tried closing the processes by:
    Runtime runtime = Runtime.getRuntime();
    Process proc = runtime.exec("/opt/sta_rpms.sh " + sFileName);
    proc.waitFor();
    proc.getInputStream().close();
    proc.getOutputStream().close();
    proc.getErrorStream().close();
    proc.destroy();
    proc = null;
    but still after like a day...Though our codes are not alike, it sounds like the same reason.
    Cheers!

  • Memory used by oracle 11g processes on solaris 10

    I am running oracle 11.1.0.7 on solaris 10. The database uses some 280M virtual memory size for each oracle backup or user process. See the SZ column in output of ps -efl below.
    I just wonder how come oracle that much of memory for each process. Is that something we can control through some system/database parameters or is that the way oracle 11g on solaris works?
    oracle@taut $ ps -efl|grep cttrain6
    F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
    0 S oracle 2490 1 0 40 20 ? 284111 ? 12:23:37 ? 0:01 ora_q001_cttrain6
    0 S oracle 9698 1 0 40 20 ? 283837 ? 13:37:51 ? 0:00 ora_w000_cttrain6
    0 S oracle 2147 1 0 40 20 ? 285464 ? 12:18:11 ? 0:15 ora_lgwr_cttrain6
    0 S oracle 2135 1 0 40 20 ? 283878 ? 12:18:09 ? 0:17 ora_dia0_cttrain6
    0 S oracle 9979 11472 0 50 20 ? 211 ? 13:40:24 pts/2 0:00 grep cttrain6
    0 S oracle 2157 1 0 40 20 ? 283942 ? 12:18:13 ? 0:47 ora_mmnl_cttrain6
    0 S oracle 2129 1 0 40 20 ? 283830 ? 12:18:09 ? 0:06 ora_diag_cttrain6
    0 S root 2159 1 0 40 20 ? 263214 ? 12:18:13 ? 3:52 ora_dism_cttrain6
    0 S oracle 9565 1 0 40 20 ? 283861 ? 13:35:18 ? 0:00 oraclecttrain6 (LOCAL=NO)
    0 S oracle 2482 1 0 40 20 ? 283837 ? 12:22:55 ? 0:01 ora_q000_cttrain6
    0 S oracle 2884 1 0 40 20 ? 283830 ? 12:27:46 ? 0:01 ora_smco_cttrain6
    0 S oracle 2153 1 0 40 20 ? 283846 ? 12:18:12 ? 0:01 ora_reco_cttrain6
    0 S oracle 2464 1 0 40 20 ? 284150 ? 12:22:42 ? 0:01 ora_fbda_cttrain6
    0 S oracle 2123 1 0 40 20 ? 284270 ? 12:18:08 ? 0:14 ora_pmon_cttrain6
    0 S oracle 2454 1 0 40 20 ? 285190 ? 12:22:34 ? 0:01 ora_arc1_cttrain6
    0 S oracle 2145 1 0 40 20 ? 284792 ? 12:18:11 ? 0:06 ora_dbw3_cttrain6
    0 S oracle 2141 1 0 40 20 ? 284792 ? 12:18:10 ? 0:08 ora_dbw1_cttrain6
    0 S oracle 2149 1 0 40 20 ? 284112 ? 12:18:11 ? 0:25 ora_ckpt_cttrain6
    0 S oracle 9513 1 0 40 20 ? 283885 ? 13:34:18 ? 0:02 oraclecttrain6 (LOCAL=NO)
    0 S oracle 2125 1 0 0 RT ? 283830 ? 12:18:08 ? 0:07 ora_vktm_cttrain6
    0 S oracle 2143 1 0 40 20 ? 284792 ? 12:18:10 ? 0:04 ora_dbw2_cttrain6
    0 S oracle 2459 1 0 40 20 ? 285198 ? 12:22:35 ? 0:01 ora_arc3_cttrain6
    0 S oracle 2451 1 0 40 20 ? 285190 ? 12:22:33 ? 0:01 ora_arc0_cttrain6
    0 S oracle 2131 1 0 40 20 ? 283838 ? 12:18:09 ? 0:02 ora_dbrm_cttrain6
    0 S oracle 2139 1 0 40 20 ? 284872 ? 12:18:10 ? 0:03 ora_dbw0_cttrain6
    0 S oracle 2466 1 0 40 20 ? 283830 ? 12:22:44 ? 0:01 ora_qmnc_cttrain6
    0 S oracle 2151 1 0 40 20 ? 283974 ? 12:18:12 ? 0:05 ora_smon_cttrain6
    0 S oracle 2457 1 0 40 20 ? 285198 ? 12:22:34 ? 0:01 ora_arc2_cttrain6
    0 S oracle 2133 1 0 40 20 ? 283830 ? 12:18:09 ? 0:02 ora_psp0_cttrain6
    0 S oracle 2155 1 0 40 20 ? 284656 ? 12:18:12 ? 0:11 ora_mmon_cttrain6
    0 S oracle 2137 1 0 40 20 ? 283830 ? 12:18:09 ? 0:02 ora_mman_cttrain6

    user567271 wrote:
    I am running oracle 11.1.0.7 on solaris 10. The database uses some 280M virtual memory size for each oracle backup or user process. See the SZ column in output of ps -efl below.
    I just wonder how come oracle that much of memory for each process. Is that something we can control through some system/database parameters or is that the way oracle 11g on solaris works?As you have already said, it is "virtual" memory. This is not real, "physical" memory. Solaris has a virtual memory sub-system layer in it, as do almost all other modern operating systems. Google "operating system virtual memory" to find out more on what virtual memory is and how it works.
    In terms of your question, virtual memory means that not all of a process's memory space needs to be in physical memory for it to run and execute. The process virtual memory space is broken up into equal sized pages, and only those pages currently being referenced (used) are mapped and read into physical memory pages. Thus the virtual size of a process is irrelevant to how much physical memory is being used. Look at the RSS column (ps -ely) for the physical memory used by each process - Resident Set Size.
    Furthermore, an Oracle shadow server process (oracle) uses a large segment of shared memory for the SGA. This shared memory only exists once in physical memory, and is shared amongst all the shadow server processes. But it is mapped into the address space of each process, and so appears and is counted in the virtual and physical memory of each process.
    So each reported virtual size (SZ) of each oracle process is also counting the mapped shared memory pages in each process, and so counting the same pages multiple times across all the oracle processes. You need to subtract the size of the SGA shared memory from the virtual size of each oracle process to determine the private, local memory per shadow process.
    If you want a further breakdown of the memory map of each process, look at the manual pages for pmap (man pmap), which will break it down by text, private data, zero initialized, shared and other types. By subtracting the shared size from the resident size you can get a true view of the private, local memory per oracle shadow server process.
    John

  • How to find memory taken by a process using top command

    I wanted to know how to find the memory taken by a process using top command. The output of the top command is as follows as an example:
    Mem: 13333364k total, 13238904k used, 94460k free, 623640k buffers
    Swap: 25165816k total, 112k used, 25165704k free, 4572904k cached
    PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
    16514 applmgr 25 0 2197m 1.7g 10m S 0.3 13.0 15:20.67 java
    30692 crestelo 22 0 2901m 1.4g 9284 S 0.0 11.0 3:03.68 java
    30431 crestelo 25 0 2043m 1.4g 161m S 50.9 11.0 79:02.73 java
    30869 crestelo 25 0 2860m 1.2g 9292 S 0.0 9.6 7:11.18 java
    16655 applmgr 23 0 1934m 1.1g 10m S 0.3 8.9 2:17.49 java
    16319 crestelo 19 0 1541m 299m 44m S 0.0 2.3 2:52.11 java
    I hope, my question is clear as to how to find the memory taken by a process using top command.
    Please revert with the reply to my query.
    Regards

    Have you tried "man top" to see the documentation for the top command?
    How about the following: http://lmgtfy.com/?q=show+memory+with+top+command
    The 5th column (VIRT) shows the amount of RAM + swap
    The 6th column (RES) shows RAM
    The 7th column (SHR) shows memory shared between processes

  • How to find memory taken by Oracle processes using top command

    I wanted to know how to find the memory taken by Oracle processes using top command. The output of the top command is as follows as an example:
    Mem: 16436072k total, 16215708k used, 220364k free, 395128k buffers
    Swap: 25165816k total, 1168288k used, 23997528k free, 13366520k cached
    PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
    27281 oraprod 15 0 6705m 1.3g 1.3g S 0.0 8.6 61:44.71 oracle
    27383 oraprod 15 0 6702m 1.2g 1.2g S 0.0 7.7 2:22.75 oracle
    5199 oraprod 16 0 6745m 1.1g 1.0g S 0.0 6.8 2:51.23 oracle
    The different Oracle processes could be Oracle database, Oracle listener, Oracle enterprise manager etc.
    I hope, my question is clear as to how to find the memory taken by a process using top command.
    Please revert with the reply to my query.
    Regards

    a short and correct answer would be: you can't.
    As oracle uses a fair amount of shared memory, and that shared memory is attached to most of the oracle processes, the same memory appears a number of times.
    you should rephrase your question / what is it you want to achieve?
    you can ask oracle how much memory is assigned to it, v$sga, v$sgastat, v$process (for PGA). moreover, you as DBA are the one who configured that.
    you can look at major an minor faults per process to see what is causing the paging (if you have any).
    you can also look at the /proc/pid/statm pseudofilesystem for your oracle pids.

  • How many memory is used for the process of one connection?

    Hi,
    how many memory is used for the process of one connection in unix
    when the user connects to the database?
    Thanks,

    Write some queries using v$sesstat, v$statname, v$session to find the statistics for different stats. Query name from v$statname and find whatever you wants. I don't think there is a common rule that tells how much memory will be used for each connection, it depends on different factors like , resources available, type of databases, database memory settings etc.
    Example query.
    select s.osuser osuser,s.serial# serial,se.sid,n.name,
    max(se.value) maxmem
    from v$sesstat se,
    v$statname n
    ,v$session s
    where n.statistic# = se.statistic#
    and n.name in ('session pga memory','session pga memory max',
    'session uga memory','session uga memory max')
    and s.sid=se.sid
    group by n.name,se.sid,s.osuser,s.serial#
    order by 2
    ;

  • Wired memory counts up to 100%, how to find unknown process leaking memory

    Hi,
    On my Macbook Pro 2011, 8GB wired memory counts up to 100% over a period of 4-5 regular usage days. The more I use the macbook, the more wired memory grows until I have to restart again, otherwise the machine becomes slow because it uses the harddrive for memory. This is not normal behavior!
    Attached is a screenshot of the activity monitor. I'm not able to identify the process which leaks the wired memory.
    I had once an eyeopening experience: I was about to restart my macbook totally overloaded by wired memory but then I canceled the shutdown because of some reason. Some of the processes and programmes were already terminated and SURPRISE, the wired memory was down to 10%! The 8 Gb were all of a sudden shared by free, active and inactive memory, as it should be! So some process was terminated during shutdown which caused the leak and even freed all of the wired memory. I did work with the macbook for 2 more days without any memory problem. Once I restarted, the leaking problem started again.
    My gut-feeling says the hole problem started when I installed VM Ware Fusion a while ago. But I did a clean uninstall.
    The solution could be to identify the leaking process, but how should I do this? It is also not clear to me wether wired memory is real, virtual, private or shared memory displayed in the activity monitor. Is there any tool which identify memory leaks?
    According to g_wolfman, the only process with a hugh difference between real and virtual memory is the kernel_task and the many Chrome Renderer processes. I have always 30 tabs open in chrome plus Safari (Flash disabled). I'm not able to terminate the kernel_task of course.
    Is there any way to isolate the troublesome process? There is no save start mode like in Microsoft Windows possible? This would be the first think I would do, checking if the problem persists in save mode.
    Disabled every start login objects btw.
    See in the image the amount of wired memory compared to the processes which are active. This is NOT the smart memory management OSX is capable of.

    Any suggestion? Is my system doomed to bleed to death every 3-4 days, until memory went 100% red (wired)? I would expect OS X to be smart enough to indicate memory leakers. I really do not get it.
    I migrated the same settings and applications to my freshly installed (10.7.4) 2007 Macbook. There the majority of RAM is active not wired.
    The only big difference is: On my 2011 Macbook Pro was VMWARE Fusion installed.

  • Why is my MacMini 6.1 always so high in Memory Used?

    Hi,
    I was wondering if anyone could help me figure out why my MacMini keeps running slowly... I think it's to do with Memory Used, but I'm only guessing.
    Thanks.
    EtreCheck version: 2.0.11 (98)
    Report generated 6 November 2014 10:39:57 pm AEDT
    Hardware Information: ℹ️
        Mac mini (Late 2012) (Verified)
        Mac mini - model: Macmini6,1
        1 2.5 GHz Intel Core i5 CPU: 2-core
        16 GB RAM Upgradeable
            BANK 0/DIMM0
                8 GB DDR3 1600 MHz ok
            BANK 1/DIMM0
                8 GB DDR3 1600 MHz ok
        Bluetooth: Good - Handoff/Airdrop2 supported
        Wireless:  en1: 802.11 a/b/g/n
    Video Information: ℹ️
        Intel HD Graphics 4000 -
            TOSHIBA-TV 1920 x 1080 @ 50 Hz
    System Software: ℹ️
        OS X 10.10 (14A389) - Uptime: 11 days 5:12:28
    Disk Information: ℹ️
        APPLE HDD HTS545050A7E362 disk0 : (500.11 GB)
        S.M.A.R.T. Status: Verified
            EFI (disk0s1) <not mounted> : 210 MB
            Macintosh HD (disk0s2) /  [Startup]: 499.25 GB (156.01 GB free)
            Recovery HD (disk0s3) <not mounted>  [Recovery]: 650 MB
    USB Information: ℹ️
        Apple Inc. BRCM20702 Hub
            Apple Inc. Bluetooth USB Host Controller
        Apple, Inc. IR Receiver
        Microsoft Microsoft 5-Button Mouse with IntelliEye(TM)
    Thunderbolt Information: ℹ️
        Apple Inc. thunderbolt_bus
            Promise Technology, Inc. Pegasus R-Series
    Configuration files: ℹ️
        /etc/hosts - Count: 45
    Gatekeeper: ℹ️
        Mac App Store and identified developers
    Kernel Extensions: ℹ️
            /Library/Extensions
        [loaded]    com.promise.driver.stex (5.2.10 - SDK 10.9) Support
            /System/Library/Extensions
        [not loaded]    at.obdev.nke.LittleSnitch (3876 - SDK 10.8) Support
    Launch Agents: ℹ️
        [not loaded]    com.adobe.AAM.Updater-1.0.plist Support
    Launch Daemons: ℹ️
        [failed]    com.adobe.fpsaud.plist Support
        [invalid?]    com.adobe.SwitchBoard.plist Support
        [loaded]    com.promise.bgasched.plist Support
        [running]    com.promise.BGPMain_R.plist Support
        [loaded]    com.promise.emaild.plist Support
    User Launch Agents: ℹ️
        [loaded]    com.adobe.AAM.Updater-1.0.plist Support
        [loaded]    com.adobe.ARM.[...].plist Support
    User Login Items: ℹ️
        iTunesHelper    ApplicationHidden (/Applications/iTunes.app/Contents/MacOS/iTunesHelper.app)
        uTorrent    ApplicationHidden (/Applications/uTorrent.app)
        Dropbox    Application (/Applications/Dropbox.app)
        Catch    UNKNOWN (missing value)
        Catch    UNKNOWN (missing value)
    Internet Plug-ins: ℹ️
        AdobePDFViewerNPAPI: Version: 10.1.12 Support
        FlashPlayer-10.6: Version: 14.0.0.176 - SDK 10.6 Support
        AdobePDFViewer: Version: 10.1.12 Support
        Flash Player: Version: 14.0.0.176 - SDK 10.6 Mismatch! Adobe recommends 15.0.0.189
        QuickTime Plugin: Version: 7.7.3
        Default Browser: Version: 600 - SDK 10.10
    User Internet Plug-ins: ℹ️
        Picasa: Version: 1.0 - SDK 10.4 Support
    Safari Extensions: ℹ️
        AdBlock
        Facebook Cleaner
        Awesome Screenshot
        RSS Menu
    3rd Party Preference Panes: ℹ️
        Flash Player  Support
    Time Machine: ℹ️
        Auto backup: YES
        Volumes being backed up:
            Macintosh HD: Disk size: 499.25 GB Disk used: 343.24 GB
        Destinations:
            PROMISE PEGASUS [Local]
            Total size: 3.00 TB
            Total number of backups: 131
            Oldest backup: 2013-02-12 01:21:04 +0000
            Last backup: 2014-11-06 10:40:18 +0000
            Size of backup disk: Excellent
                Backup size 3.00 TB > (Disk size 499.25 GB X 3)
    Top Processes by CPU: ℹ️
            15%    backupd
            5%    iVI Pro
            3%    Finder
            2%    WindowServer
            2%    firefox
    Top Processes by Memory: ℹ️
        515 MB    firefox
        223 MB    mds_stores
        206 MB    iVI Pro
        206 MB    Finder
        172 MB    softwareupdated
    Virtual Memory Information: ℹ️
        5.28 GB    Free RAM
        5.26 GB    Active RAM
        4.92 GB    Inactive RAM
        1.73 GB    Wired RAM
        80.28 GB    Page-ins
        8 MB    Page-outs

    When you have the problem, note the exact time: hour, minute, second.  
    These instructions must be carried out as an administrator. If you have only one user account, you are the administrator.
    Launch the Console application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Console in the icon grid.
    The title of the Console window should be All Messages. If it isn't, select
              SYSTEM LOG QUERIES ▹ All Messages
    from the log list on the left. If you don't see that list, select
              View ▹ Show Log List
    from the menu bar at the top of the screen.
    Each message in the log begins with the date and time when it was entered. Scroll back to the time you noted above.
    Select the messages entered from then until the end of the episode, or until they start to repeat, whichever comes first.
    Copy the messages to the Clipboard by pressing the key combination command-C. Paste into a reply to this message by pressing command-V.
    The log contains a vast amount of information, almost all of it useless for solving any particular problem. When posting a log extract, be selective. A few dozen lines are almost always more than enough.
    Please don't indiscriminately dump thousands of lines from the log into this discussion.
    Please don't post screenshots of log messages—post the text.
    Some private information, such as your name, may appear in the log. Anonymize before posting.

  • High memory use when checking downloads folder through browser

    High memory use when checking downloads folder through browser.
    I have a total of 3 DDR2 Gbytes of ram. Pentium(R) Dual-Core CPU T4500 @ 2.30GHz Win 7 home pr. 64bit. Firefox 27.0 beta
    I right click on a file to "open containing folder" from the drop down menu in downloads.
    When the folder has been opened, explorer is trying to index the folder (which it never does completely or well after 5 minutes I close the folder and shut down the dllhost process cause laptop is blazing hot) and memory keeps increasing till no more is available.
    I checked task manager and see that dllhost is the particular process that is causing the spike in memory usage even after closing the folder I right click and stop the process and memory is restored after awhile.

    Hello,
    '''Try Firefox Safe Mode''' to see if the problem goes away. Safe Mode is a troubleshooting mode, which disables most add-ons.
    ''(If you're not using it, switch to the Default theme.)''
    * On Windows you can open Firefox 4.0+ in Safe Mode by holding the '''Shift''' key when you open the Firefox desktop or Start menu shortcut.
    * On Mac you can open Firefox 4.0+ in Safe Mode by holding the '''option''' key while starting Firefox.
    * On Linux you can open Firefox 4.0+ in Safe Mode by quitting Firefox and then going to your Terminal and running: firefox -safe-mode (you may need to specify the Firefox installation path e.g. /usr/lib/firefox)
    * Or open the Help menu and click on the '''Restart with Add-ons Disabled...''' menu item while Firefox is running.
    [[Image:FirefoxSafeMode|width=520]]
    ''Once you get the pop-up, just select "'Start in Safe Mode"''
    [[Image:Safe Mode Fx 15 - Win]]
    '''''If the issue is not present in Firefox Safe Mode''''', your problem is probably caused by an extension, and you need to figure out which one. Please follow the [[Troubleshooting extensions and themes]] article for that.
    ''To exit the Firefox Safe Mode, just close Firefox and wait a few seconds before opening Firefox for normal use again.''
    ''When you figure out what's causing your issues, please let us know. It might help other users who have the same problem.''
    Thank you.

  • Using XMLDOM to process document in XML DB

    I am new to XML and especially XML DB which I however see as an excellent platform on which to base XML based solutions. I have a specific question and apologise beforehand should any of my assumptions be incorrect.
    I wish to create an application which from a number of XML fragments, together with rules governing the behaviour of the fragments (insertion points, overwrite rules etc) are merged together to finally leave me with a complete and valid XML document in XML DB.
    I thought at first that I could use DBMS_XMLDOM to perform this low level processing required. I have however not managed to understand how this can be used together with XMLDB. I am reluctant to use XMLDOM without XMLDB as I am afraid that I will surpass the limits in XML document size apparently imposed by XMLDOM.
    I see a solution where I create a schema based resource in XML DB containing the initial XML structure and then processing any number of the above mentioned fragments to finaly be left with a complete XML document.
    Can I use XMLDOM to do this or am I barking up the wrong tree?
    I would be grateful for any input on techniques that I can apply to perform elementary search/replace/insert on an XML document which I am, from PLSQL, compiling.
    Thanks
    Hans Christiansen

    Hi
    The size of the documents I want to compose are expected vary from a few Kb to 1 or 2 Gb! In a FAQ found somewhere on OTN there was an entry which mentioned that somebody was having trouble with a 50Mb XML document. The recommendation was to use SAX but I am under the impression that this is more useful when the processing is of a more sequential nature.
    The main thread of my question is to gain clarity in the most suitable technique to use when actualy compsing the XML.
    What I want to do is:
    Create resource (XML document) in XML DB.
    Loop through XML fragments together with rules:
    For each fragment process according to rules and insert
    fragment or update existing XML based on fragment contents.
    At the end of the loop the XML document is complete and ready for further processing.
    XMLDOM seems to give me the tools to do this but I am unsure of how to do this and have XMLDOM work directly against the contents in the resource controlled by XML DB (making use of possible indexes and the scalable nature of XMLDB). I get the feeling that if I simply read the XML from XMLDB resource into a DOM document I am still using the memory based representation of the XML until I write the XML back to XMLDB - is this a correct assumption.
    Alternatively is it the functionality offered by XPath, extract(), updatexml() etc. that I should be looking at?
    Does this make my question more understandable?
    Hans

  • Mail is using 100% CPU processes - wondering if I possibly have the answer?

    Hi...
    I have a big problem with Mail using all the CPU processes but may just have found a possible solution. I'm posting to see if anyone else shares this problem or can shed some light on whether or not this is a possible solution.
    _*The Problem*_
    Over the past couple of weeks, I've noticed that Mail is using on average 100% of the processes and sometimes up to 168% (I have screenshots to prove it). My 17" MacBookPro gets very, very hot and the fans spin up to cool it down so it's obviously not right as it's never done this before. I can only use Mail intermittently now as the machine overheats quickly soon after Mail starts up. As a result, the CPU is being hammered so I can't now use Mail or other CPU intensive applications properly, which is a big problem.
    I've used the iStatPro widget to verify that Mail is constantly using 100% of the CPU processes. I've also verified this using Utilities / Activity Monitor. When the Activity Monitor application loads, I've selected Mail from the list of Process Names and then clicked Inspect. I've managed to identify the parent process as being launchd (110) which is using all the CPU power. Here are some other stats for this parent process:
    %CPU 95.56 (at that specific instance)
    Threads 15
    Ports 275
    CPU Time 3:30.55
    Context Switches 310968
    Faults 65795
    Page Ins 1
    Mach Messages In 272627
    Mach Messages Out 65025
    Mach System Calls 1459878
    Unix System Calls 103120
    I guess the important bit is the first bit that says 95.56%.
    I have screenshots to back this up but no way of posting them here. I have also managed to use Activity Monitor to generate sample data that the process is creating and again there is no way of posting an attachment here but there is lots of sample data from the process to look at. I've compared the sample data from my MacBookPro to a colleagues machine and the difference between the sample data is enormous. There is obviously something very wrong happening.
    Here's some basic info about my machine, with the serial number removed:
    Hardware Overview:
    Model Name: MacBook Pro 17"
    Model Identifier: MacBookPro2,1
    Processor Name: Intel Core 2 Duo
    Processor Speed: 2.33 GHz
    Number Of Processors: 1
    Total Number Of Cores: 2
    L2 Cache: 4 MB
    Memory: 2 GB
    Bus Speed: 667 MHz
    Boot ROM Version: MBP21.00A5.B08
    SMC Version: 1.14f5
    Sudden Motion Sensor:
    State: Enabled
    System Software Overview:
    System Version: Mac OS X 10.5.6 (9G55)
    Kernel Version: Darwin 9.6.0
    Boot Mode: Normal
    Time since boot: 1:44
    _*The Possible Solution??*_
    I recently installed a Beta version of Daylite 3 as I was interested in the application and remembered that it integrates closely with Mail. I wondered if Daylite was constantly trying to communicate with Mail and having problems. Having uninstalled Daylite 3, the problem of Mail using all the processes has so far not reappeared. Mail is now using very little of the CPU processes as is usual. However, I'm currently at home instead of on my network at the office so I'll wait to see if the problem still fails to appear when at work.
    I know other people have had problems with Mail using 100% of the processes. Have you also installed Daylite 3? There has been some talk of Flip4Mac being a possible culprit but I use Flip4Mac and haven't previously had the problem. The only recent change and connection I can think of is an install of Daylite 3.
    I don't want to talk down Daylite 3 but it's the only thing I can think of and having uninstalled it, the problem hasn't occurred. I hope I have stumbled across the solution but any thoughts, shared experiences or feedback would be greatly appreciated...
    Many Thanks,
    Nigel

    Hi...
    Thanks for the post. Not sure what you mean when you say "What does Mail say it's doing?" Can you be more specific and supply specific instructions to follow so that I can give you the information you need?
    I've sampled the process but can't post any attachments on the forum. I've listed what the Activity Monitor stats are saying at the top level in the post above.
    This is a serious problem that's hammering my machine and making it overheat and almost making it unusable. Any feedback or instructions anyone can give me for what info to supply to help you determine what the issue is would be greatly appreciated. I'm hoping to find a solution here rather than have the machine overheat permanently and eventually fail, leaving me to sort it out with AppleCare.
    Help!
    Clown Guy

  • One or more ports used by the Compute Emulator are currently used by other processes

    Environment:
    VS 2012 Professional
    Azure SDK October 2012
    Windows 8
    I lost the last few days of my life struggling with a weird issue in the emulator. I just ran out of options and I would really appreciate if someone could help me figure out what's wrong.
    I am trying to debug a service package from Visual Studio 2012. It's really just about any package -- even the ones generated from a Windows Azure Cloud Service VS template. Any. The VS debugger starts, and in parallel there's "Starting the Windows Azure Debugging
    Environment" dialog which shows "Deploying service package to the Windows Azure compute emulator..." message.
    The progress bar shown in the dialog gets stuck for a long time (possibly even for an hour or longer!) at some 60% and then the following error message is shown:
    "One or more ports used by the Compute Emulator are currently used by other processes. To resolve this, please see MSDN documentation at http://msdn.microsoft.com/en-us/library/hh472164.aspx"
    There doesn't seem to be anything else listening on the ports mentioned on the above MSDN page. I did nevertheless try to re-map devfabric and agent ports by specifying different values in the .config files mentioned on the page, but that did not help.
    What I also tried and did not help:
    - reinstalled SDK, IIS Express, Local DB
    - reinstalled VS 2012 (yes, I got that desperate)
    - tried using IIS instead
    - used SysInternals TcpView to check if there are any conflicts
    - rebooted the machine: the deployment works initially (*once*), and the subsequent deployments fail (!)
    - tried to kill all Azure-related processes in memory and restart debugging
    - tried looking into log files under the user directory (dftmp\...); no errors in *any* log
    - tried looking into Event Viewer logs (Azure-related and in general); no errors either
    Since the conflict seems to be related to my current network settings, below is my IP
    configuration. I am behind a router and I have DHCP activated, but again that should not matter since none of that has changed in the last few years (and the emulator did work until few days ago).
    C:\WINDOWS\system32>ipconfig /all
    Windows IP Configuration
       Host Name . . . . . . . . . . . . : MYCOMPUTER
       Primary Dns Suffix  . . . . . . . :
       Node Type . . . . . . . . . . . . : Hybrid
       IP Routing Enabled. . . . . . . . : No
       WINS Proxy Enabled. . . . . . . . : No
    Ethernet adapter Ethernet:
       Connection-specific DNS Suffix  . :
       Description . . . . . . . . . . . : Marvell Yukon 88E8056 PCI-E Gigabit Ethernet Controller
       Physical Address. . . . . . . . . : 32-AB-30-66-BC-56
       DHCP Enabled. . . . . . . . . . . : Yes
       Autoconfiguration Enabled . . . . : Yes
       IPv6 Address. . . . . . . . . . . : 2a01:e35:8a3a:9970:edd9:b989:b67a:5a8a(Preferred)
       Temporary IPv6 Address. . . . . . : 2a01:e35:8a3a:9970:dc7a:4fe6:62a5:e54a(Preferred)
       Link-local IPv6 Address . . . . . : fe80::edd9:b989:b67a:5a8a%12(Preferred)
       IPv4 Address. . . . . . . . . . . : 192.168.0.1(Preferred)
       Subnet Mask . . . . . . . . . . . : 255.255.255.0
       Lease Obtained. . . . . . . . . . : Sunday, December 16, 2012 21:26:30 PM
       Lease Expires . . . . . . . . . . : Tuesday, December 18, 2012 09:26:14 AM
       Default Gateway . . . . . . . . . : fe80::224:d4ff:fea2:9722%12
                                           192.168.0.254
       DHCP Server . . . . . . . . . . . : 192.168.0.254
       DHCPv6 IAID . . . . . . . . . . . : 253808432
       DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-18-1B-EE-4D-20-CF-30-66-BC-46
       DNS Servers . . . . . . . . . . . : 192.168.0.254
       NetBIOS over Tcpip. . . . . . . . : Enabled
    Tunnel adapter isatap.{7A96B710-3107-48B9-A7B2-2F261DDD91AD}:
       Media State . . . . . . . . . . . : Media disconnected
       Connection-specific DNS Suffix  . :
       Description . . . . . . . . . . . : Microsoft ISATAP Adapter
       Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0
       DHCP Enabled. . . . . . . . . . . : No
       Autoconfiguration Enabled . . . . : Yes
    Tunnel adapter Local Area Connection* 11:
       Connection-specific DNS Suffix  . :
       Description . . . . . . . . . . . : Teredo Tunneling Pseudo-Interface
       Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0
       DHCP Enabled. . . . . . . . . . . : No
       Autoconfiguration Enabled . . . . : Yes
       IPv6 Address. . . . . . . . . . . : 2001:0:5ef5:79fb:1caf:12ff:a75c:5668(Preferred)
       Link-local IPv6 Address . . . . . : fe80::1caf:12ff:a75c:5668%14(Preferred)
       Default Gateway . . . . . . . . . :
       NetBIOS over Tcpip. . . . . . . . : Disabled
    Below are the Azure SDK emulator configuration files, unmodified (as created by the SDK installation).
    DevFC.exe.config
    <configuration>
        <configSections>
            <section name="DevFCSettings"        type="System.Configuration.NameValueSectionHandler" />
        </configSections>
        <!-- The following are options related to the SimulatorSetup -->
        <DevFCSettings>
            <add key="StartMACAddress" value="00155D201928" />
            <add key="EndMACAddress" value="155D20193C" />
            <add key="StartIPAddress" value="192.168.0.20" />
            <add key="EndIPAddress" value="192.168.0.40" />
            <add key="DipPoolStartIPAddress" value="127.255.0.0" />
            <add key="DipPoolEndIPAddress" value="127.255.255.255" />
            <add key="VipPoolStartIPAddress" value="127.0.0.1" />
            <add key="VipPoolEndIPAddress" value="127.0.0.255" />
            <add key="DefaultGateway" value="192.168.0.1" />
            <add key="SubnetMask" value="255.255.255.0" />
            <add key="InternalSwitchName" value="{F3C577E3-8256-4bb9-8F54-256F84E227DE}-DevFabricSwitch" />
            <add key="InternalSwitchPortName" value="{F3C577E3-8256-4bb9-8F54-256F84E227DE}-DevFabricHostSwitchPort" />
            <add key="InternalEthernetNICName" value="{F3C577E3-8256-4bb9-8F54-256F84E227DE}-DevFabricEthernetNIC" />
            <add key="InternalEthernetPortMACAddress" value="00155D201927" />
            <add key="InternalEthernetPortIPAddress" value="192.168.0.2" />
            <add key="InternalEthernetPortSubnetMask" value="255.255.255.0" />
            <add key="StorageRoot" value="DFTemp" />
            <add key="LogsDirName" value="DevFCLogs" />
            <add key="DynamicPortAllocStart" value="20000" />
            <add key="ManagementServicePort" value="15095" />
            <add key="RepositoryServicePort" value="15096" />
            <add key="AgentCallbackPort" value="15097" />
            <add key="AgentPort" value="15098" />
            <add key="PxeResponderPort" value="15100" />
        </DevFCSettings>
        <startup>
            <supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
        </startup>
    </configuration>
    DFAgent.exe.config
    <configuration>
      <startup>
        <supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
      </startup>
      <appSettings>
        <add key="AgentMAC" value="00155D201927"/>
        <add key="AgentIP" value="192.168.0.2"/>
        <add key="EnableActiveNotification" value="false"/>
        <add key="StorageRoot" value="C:\DFTemp"/>
        <add key="CopyFilesInStartRole" value="false"/>
        <add key="LogsDirName" value="DFAgentLogs" />
        <add key="EnableFileLog" value="true" />
        <add key="AgentPort" value="15098" />
        <add key="RuntimePort" value="15099" />
        <add key="AgentCallbackPort" value="15097" />
      </appSettings>
    </configuration>
    DFService.exe.config
    <configuration>
      <configSections>
        <section
          name="dfservice"
          allowExeDefinition="MachineToLocalUser"
          type="Microsoft.ServiceHosting.Tools.DevelopmentFabric.DfServiceConfigurationSection, DfService, Version=1.8.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35"
        />
      </configSections>
      <dfservice
        ManagementServicePort="15095"
        RepositoryServicePort="15096"
       />
      <startup>
        <supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
      </startup>
    </configuration>
    Finally, here's what TcpView shows while the emulator is stuck:
    devenv.exe    3736    TCP      MYCOMPUTER    7240    localhost    15095    SYN_SENT
    devenv.exe    3736    TCP      MYCOMPUTER    7245    localhost    15095    SYN_SENT
    svchost.exe   4332    TCP      MYCOMPUTER    7438    MYCOMPUTER    0    LISTENING
    System        4        TCP      MYCOMPUTER    10000    MYCOMPUTER    0    LISTENING       
    System        4        TCP      MYCOMPUTER    10001    MYCOMPUTER    0    LISTENING       
    System        4        TCP      MYCOMPUTER    10002    MYCOMPUTER    0    LISTENING       
    DevFC.exe      4380    TCP      MYCOMPUTER    15095    MYCOMPUTER    0    LISTENING              
    DevFC.exe      4380    TCP      MYCOMPUTER    15096    MYCOMPUTER    0    LISTENING              
    DevFC.exe      4380    TCP      MYCOMPUTER    15097    MYCOMPUTER    0    LISTENING              
    DFAgent.exe    14472    TCP      MYCOMPUTER    15098    MYCOMPUTER    0    LISTENING
    DFAgent.exe    14472    TCPV6    mycomputer    15098    mycomputer    0    LISTENING              
    DFAgent.exe    14472    TCPV6    mycomputer    15098    mycomputer    6399    ESTABLISHED         
    System        4        TCP      MYCOMPUTER    15099    MYCOMPUTER    0    LISTENING       
    System        4        TCPV6    mycomputer    15099    mycomputer    0    LISTENING            
    DevFC.exe      4380    TCP      MYCOMPUTER    15100    MYCOMPUTER    0    LISTENING
    Thanks in advance for help!



    Hi,
    Unfortunately I already tried all kinds of re-installs (the full list is in my original message). The only one remaining is the reinstall of Windows 8 itself, which I would really like to avoid.
    What I find really strange is the time it takes for the above error message to appear. It's like one hour or even more (never measured exactly, I left the computer running).
    What kind of a timeout is that? I would expect that, if ports are really used by some other application, I get the message in less than a minute (seconds, actually). To me this looks like the emulator itself for some reason believes there's a problem with
    some port while in reality there isn't.
    I'll eventually contact Microsoft Support, thanks for the suggestion.

  • CFMX 6.1's Virtual Memory Use problem!!

    I appologise for the long post in advance...
    Ok... so I have this script that, using cfdirectory, will
    check a directory for any files that may have been uploaded, if
    there are files, it loops through the results and reads the files
    one at a time, line by line, using the FileReader.cfc (Uses the
    Java FileInputStream, InputStreamReader, and BufferedReader to
    provide a way to incrementally read large files). The files are
    just pipe "|" delimited data, each line represents a record for a
    db table.
    Now as it's reading each line, it will perform some basic
    string parsing to clean up the file line to make sure the data is
    valid, blah blah blah and then it will write that "cleaned" line to
    another file using FileWriter.cfc (Java component once again). Once
    it's completely done reading the original file, it will close it
    and it will open the new "cleaned" version of the file, read it
    (FileReader.cfc), create an INSERT statement and then update the
    database table.
    Now... this all works GREAT... until it has to loop through
    more than a few files... 3 - 4 files are NO problem! works like a
    charm, but throw 6 - 8 files at it and it dies, not a timeout mind
    you but an actual "java.lang.OutOfMemoryError" (now, I've tried
    making all the files exactly the same (just changed the name) and
    the weird thing is, it takes longer and longer to process each as
    it goes through the loop... I have the script write some stats as
    it's looping:
    FILE 1 STATS
    Name: COA0607_Intranet1.DAT
    Status: Import Successfull
    Line Count: 32,971
    Processing Time: 74,237ms
    FILE 2 STATS
    Name: COA0607_Intranet2.DAT
    Status: Import Successfull
    Line Count: 32,971
    Processing Time: 82,018ms
    FILE 3 STATS
    Name: COA0607_Intranet3.DAT
    Status: Import Successfull
    Line Count: 32,971
    Processing Time: 94,476ms
    FILE 4 STATS
    Name: COA0607_Intranet4.DAT
    Status: Import Successfull
    Line Count: 32,971
    Processing Time: 145,108ms
    I know what you guy are probably thinking; "Woah man... CF
    isn't really meant to do that kind of processing...", I know, trust
    me I know... however, I really neeeeeed it too lol.
    Ok, so as the script is running, I watch the Virtual Memory
    use of jrun.exe, processing say 3 - 4 of these files brings up the
    usage to approx 300,000k which yes, is a LOT but that's fine...
    this process is meant to run at night via a Scheduled Task...
    When I run more than 4 files, things start to get ugly, keep
    in mind that these are EXACTLY the same files just re-named
    differently. The script will start lagging BIG time and on the last
    file (usually the last file) I'll see the memory usage spike from
    350,000K all the way up to 600,000K and that's when it throws the
    "java.lang.OutOfMemoryError" and dies... I've tried commenting out
    the part of the script that updates the db, but still get the same
    problem...
    So... what gives? How come CF Server does this??? I mean, it
    runs fine for the first few files... and then WAM, it dies... sorry
    for the long post... any insight here is VERY much appreciated...
    it would be AWESOME if the wonderful folks at Adobe could shed some
    light on this for me : )
    CFMX 6.1 version: 6,1,0,83762
    Windows XP Pro SP2
    Intel P4 2.8Ghz
    1Gb of Ram

    quote:
    Originally posted by:
    Mr Black
    300M memory usage while using "incremental" file reader??
    Looks like it is "incremental" only in the sense that it increments
    memory usage. Did you try non-Java C/C++ file reader tags?
    Well I did try cffile originally... and it didn't even run...
    lol

  • The amount of memory used for data is a lot larger than the saved file size why is this and can I get the memory usage down without splitting up the file?

    I end up having to take a lot of high sample rate data for relativily long periods of time. When I save the data it is usually over 100 MB. When I load the data for post-processing though the amount of memory used is excessively higher than the file size. This causes my computer to crash because 1.5 GB is not enough. Is there a way to stop this from happening withoput splitting up the file into smaller files.

    LabVIEW can efficiently handle large files, far beyond 100Mb, provided that care is taken in the coding of the loading/processing routines. Here are several suggestions:
    1) Check out the resources National Instruments has put together (NI Developer Zone > Development Library > Measurement and Automation Software > LabVIEW > Development System > Optimizing Applications > Managing Memory), specifically the article entitled "Managing Large Data Sets in LabVIEW".
    2) Load and process the data in chunks if possible.
    3) Avoid sending the data to front panel indicators, using local/global variables for data storage, or changing data types unless absolutely necessary.
    4) If using LabVIEW 7.1, use the "show buffer" tool to determine when LabVIEW is creating extra
    copies of data in memory.

  • Is it possible to config memory size for a process?

    Dear experts,
    I would like to control the memory size assigned for a process on Solaris 9. Can i config memory size assigned for process??
    Many thanks,
    Shun

    You can use ulimit/limit to assign a bound on the amount of space that a process and its children can allocate.
    I'm not sure if that's what you're asking though.
    Darren

Maybe you are looking for

  • Photo gallery built with adobe edge can not be seen on mobile devices.

    photo gallery built with adobe edge can not be seen on mobile devices. ps: I do not have any email attachment, I do not understand a thing of referring

  • Regarding authorization in solution manager for Central system monitoring

    Hi, I want to Prevent users from deleting Task logs in central system monitoring in solution manager I have assigned the roles SAP_SV_SOLUTION_MANAGER_DISP But it gives display authorization for everything unable to keep track of changes in monitorin

  • HRMS sign on page issue with PIA

    Hi all. I've installed Peoplesoft 9.1, PT8.52 (Oracle 11G 64 bit database) on windows 2008 server 64bit and an HRMS DEMO DB on a Virtual machine PSDEMOVM. I also installed Oracle 11G client 32, and configured a PS client workstation on another virtua

  • Multiple index entries for single object.

    Hi, Can someone guide me whether coherence allows multiple keys to be inserted in an index for given record(value)? I mean I will insert a single 'value' in the cache and multiple keys for it in the index, and I should be able to search that 'value'

  • Change Properties by ADF JavaScript

    Hello Experts, I am trying to change two properties styleClass and shortDesc of a panelGroupLayout. I have a clientListener attached to that panelGroupLayout. <af:panelGroupLayout id="dc_pgl3" styleClass="carousel-player-panel start" layout="vertical