Memory used by unknown processes
Hey all,
I have a serious problem on my 2008 model macbook running snow leopard 10.6.8 with 4GB of memory
Used memory continuosly grows even though no work is being done (i.e. no application opened).
It gets to a point where free memory goes almost to zero and only then system apparently frees some of it.
Using free memory app I can free memory manually but still after freeing, free memory continue to decline.
What really bothers me is that the sum of all memory used by processes (from both activity monitor and ps command) does not sum up to total used memory.
Can some "invisible" process be using my memory? or ps/activity monitor outputs are not correct?
Not exactly sure what you mean.
Here's output from top (the header):
Processes: 74 total, 3 running, 1 stuck, 70 sleeping, 535 threads 13:40:42
Load Avg: 0.36, 0.22, 0.35 CPU usage: 8.33% user, 41.66% sys, 50.0% idle SharedLibs: 5888K resident, 8800K data, 0B linkedit.
MemRegions: 13884 total, 1746M resident, 28M private, 380M shared.
PhysMem: 590M wired, 2219M active, 1025M inactive, 3834M used, 261M free.
VM: 178G vsize, 1043M framework vsize, 738071(0) pageins, 235(0) pageouts. Networks: packets: 660846/677M in, 332007/37M out.
Disks: 327320/5791M read, 154559/5840M written.
And here's the sum of RSS from ps:
# ps -axm -o "rss,comm"|grep -v COMM|awk 'BEGIN{a=0}{a+=$1}END{print a}'
2537976
As you can see, top reports 3834MB as used, while sum of RSS from ps shows ~2.5GB
Similar Messages
-
Increasing memory used by java process when calling Runtime.exec()
Hi everyone!
I'm running a servlet Oracle iAS 9i, Jserv. It receives an image posted by a user and does a System.exec() which performs a call to convert (an image processing utility included in ImageMagick).
After a few hours, java process start taking more and more RAM, until it crashes with an error like this:
Memory: 5394008 free of 134217728 total. (I log this myself)
Exception: java.io.IOException: Not enough space
java.lang.UNIXProcess.forkAndExec(), line -2.
java.lang.UNIXProcess.<init>(), line 54.
java.lang.Runtime.execInternal(), line -2.
java.lang.Runtime.exec(), line 553.
ImageProcessor.convert(), line 235.
ImageProcessor.createItemPics(), line 124.
Uploader.doPost(), line 69.
As you can see, this is not an OutOfMemoryError, but something else in connection with O/S.
This is not related to hard disk space, since there is a lot of free space in every filesystems
After restarting the webserver, everything goes back to normal and start increasing RAM again.
Is there anything I can do? Any help will be gratly appreciated... Thanks!!!
Dani.-Have you had any solutions to this pal?
I am also suffering. I tried closing the processes by:
Runtime runtime = Runtime.getRuntime();
Process proc = runtime.exec("/opt/sta_rpms.sh " + sFileName);
proc.waitFor();
proc.getInputStream().close();
proc.getOutputStream().close();
proc.getErrorStream().close();
proc.destroy();
proc = null;
but still after like a day...Though our codes are not alike, it sounds like the same reason.
Cheers! -
Memory used by oracle 11g processes on solaris 10
I am running oracle 11.1.0.7 on solaris 10. The database uses some 280M virtual memory size for each oracle backup or user process. See the SZ column in output of ps -efl below.
I just wonder how come oracle that much of memory for each process. Is that something we can control through some system/database parameters or is that the way oracle 11g on solaris works?
oracle@taut $ ps -efl|grep cttrain6
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
0 S oracle 2490 1 0 40 20 ? 284111 ? 12:23:37 ? 0:01 ora_q001_cttrain6
0 S oracle 9698 1 0 40 20 ? 283837 ? 13:37:51 ? 0:00 ora_w000_cttrain6
0 S oracle 2147 1 0 40 20 ? 285464 ? 12:18:11 ? 0:15 ora_lgwr_cttrain6
0 S oracle 2135 1 0 40 20 ? 283878 ? 12:18:09 ? 0:17 ora_dia0_cttrain6
0 S oracle 9979 11472 0 50 20 ? 211 ? 13:40:24 pts/2 0:00 grep cttrain6
0 S oracle 2157 1 0 40 20 ? 283942 ? 12:18:13 ? 0:47 ora_mmnl_cttrain6
0 S oracle 2129 1 0 40 20 ? 283830 ? 12:18:09 ? 0:06 ora_diag_cttrain6
0 S root 2159 1 0 40 20 ? 263214 ? 12:18:13 ? 3:52 ora_dism_cttrain6
0 S oracle 9565 1 0 40 20 ? 283861 ? 13:35:18 ? 0:00 oraclecttrain6 (LOCAL=NO)
0 S oracle 2482 1 0 40 20 ? 283837 ? 12:22:55 ? 0:01 ora_q000_cttrain6
0 S oracle 2884 1 0 40 20 ? 283830 ? 12:27:46 ? 0:01 ora_smco_cttrain6
0 S oracle 2153 1 0 40 20 ? 283846 ? 12:18:12 ? 0:01 ora_reco_cttrain6
0 S oracle 2464 1 0 40 20 ? 284150 ? 12:22:42 ? 0:01 ora_fbda_cttrain6
0 S oracle 2123 1 0 40 20 ? 284270 ? 12:18:08 ? 0:14 ora_pmon_cttrain6
0 S oracle 2454 1 0 40 20 ? 285190 ? 12:22:34 ? 0:01 ora_arc1_cttrain6
0 S oracle 2145 1 0 40 20 ? 284792 ? 12:18:11 ? 0:06 ora_dbw3_cttrain6
0 S oracle 2141 1 0 40 20 ? 284792 ? 12:18:10 ? 0:08 ora_dbw1_cttrain6
0 S oracle 2149 1 0 40 20 ? 284112 ? 12:18:11 ? 0:25 ora_ckpt_cttrain6
0 S oracle 9513 1 0 40 20 ? 283885 ? 13:34:18 ? 0:02 oraclecttrain6 (LOCAL=NO)
0 S oracle 2125 1 0 0 RT ? 283830 ? 12:18:08 ? 0:07 ora_vktm_cttrain6
0 S oracle 2143 1 0 40 20 ? 284792 ? 12:18:10 ? 0:04 ora_dbw2_cttrain6
0 S oracle 2459 1 0 40 20 ? 285198 ? 12:22:35 ? 0:01 ora_arc3_cttrain6
0 S oracle 2451 1 0 40 20 ? 285190 ? 12:22:33 ? 0:01 ora_arc0_cttrain6
0 S oracle 2131 1 0 40 20 ? 283838 ? 12:18:09 ? 0:02 ora_dbrm_cttrain6
0 S oracle 2139 1 0 40 20 ? 284872 ? 12:18:10 ? 0:03 ora_dbw0_cttrain6
0 S oracle 2466 1 0 40 20 ? 283830 ? 12:22:44 ? 0:01 ora_qmnc_cttrain6
0 S oracle 2151 1 0 40 20 ? 283974 ? 12:18:12 ? 0:05 ora_smon_cttrain6
0 S oracle 2457 1 0 40 20 ? 285198 ? 12:22:34 ? 0:01 ora_arc2_cttrain6
0 S oracle 2133 1 0 40 20 ? 283830 ? 12:18:09 ? 0:02 ora_psp0_cttrain6
0 S oracle 2155 1 0 40 20 ? 284656 ? 12:18:12 ? 0:11 ora_mmon_cttrain6
0 S oracle 2137 1 0 40 20 ? 283830 ? 12:18:09 ? 0:02 ora_mman_cttrain6user567271 wrote:
I am running oracle 11.1.0.7 on solaris 10. The database uses some 280M virtual memory size for each oracle backup or user process. See the SZ column in output of ps -efl below.
I just wonder how come oracle that much of memory for each process. Is that something we can control through some system/database parameters or is that the way oracle 11g on solaris works?As you have already said, it is "virtual" memory. This is not real, "physical" memory. Solaris has a virtual memory sub-system layer in it, as do almost all other modern operating systems. Google "operating system virtual memory" to find out more on what virtual memory is and how it works.
In terms of your question, virtual memory means that not all of a process's memory space needs to be in physical memory for it to run and execute. The process virtual memory space is broken up into equal sized pages, and only those pages currently being referenced (used) are mapped and read into physical memory pages. Thus the virtual size of a process is irrelevant to how much physical memory is being used. Look at the RSS column (ps -ely) for the physical memory used by each process - Resident Set Size.
Furthermore, an Oracle shadow server process (oracle) uses a large segment of shared memory for the SGA. This shared memory only exists once in physical memory, and is shared amongst all the shadow server processes. But it is mapped into the address space of each process, and so appears and is counted in the virtual and physical memory of each process.
So each reported virtual size (SZ) of each oracle process is also counting the mapped shared memory pages in each process, and so counting the same pages multiple times across all the oracle processes. You need to subtract the size of the SGA shared memory from the virtual size of each oracle process to determine the private, local memory per shadow process.
If you want a further breakdown of the memory map of each process, look at the manual pages for pmap (man pmap), which will break it down by text, private data, zero initialized, shared and other types. By subtracting the shared size from the resident size you can get a true view of the private, local memory per oracle shadow server process.
John -
How to find memory taken by a process using top command
I wanted to know how to find the memory taken by a process using top command. The output of the top command is as follows as an example:
Mem: 13333364k total, 13238904k used, 94460k free, 623640k buffers
Swap: 25165816k total, 112k used, 25165704k free, 4572904k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
16514 applmgr 25 0 2197m 1.7g 10m S 0.3 13.0 15:20.67 java
30692 crestelo 22 0 2901m 1.4g 9284 S 0.0 11.0 3:03.68 java
30431 crestelo 25 0 2043m 1.4g 161m S 50.9 11.0 79:02.73 java
30869 crestelo 25 0 2860m 1.2g 9292 S 0.0 9.6 7:11.18 java
16655 applmgr 23 0 1934m 1.1g 10m S 0.3 8.9 2:17.49 java
16319 crestelo 19 0 1541m 299m 44m S 0.0 2.3 2:52.11 java
I hope, my question is clear as to how to find the memory taken by a process using top command.
Please revert with the reply to my query.
RegardsHave you tried "man top" to see the documentation for the top command?
How about the following: http://lmgtfy.com/?q=show+memory+with+top+command
The 5th column (VIRT) shows the amount of RAM + swap
The 6th column (RES) shows RAM
The 7th column (SHR) shows memory shared between processes -
How to find memory taken by Oracle processes using top command
I wanted to know how to find the memory taken by Oracle processes using top command. The output of the top command is as follows as an example:
Mem: 16436072k total, 16215708k used, 220364k free, 395128k buffers
Swap: 25165816k total, 1168288k used, 23997528k free, 13366520k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
27281 oraprod 15 0 6705m 1.3g 1.3g S 0.0 8.6 61:44.71 oracle
27383 oraprod 15 0 6702m 1.2g 1.2g S 0.0 7.7 2:22.75 oracle
5199 oraprod 16 0 6745m 1.1g 1.0g S 0.0 6.8 2:51.23 oracle
The different Oracle processes could be Oracle database, Oracle listener, Oracle enterprise manager etc.
I hope, my question is clear as to how to find the memory taken by a process using top command.
Please revert with the reply to my query.
Regardsa short and correct answer would be: you can't.
As oracle uses a fair amount of shared memory, and that shared memory is attached to most of the oracle processes, the same memory appears a number of times.
you should rephrase your question / what is it you want to achieve?
you can ask oracle how much memory is assigned to it, v$sga, v$sgastat, v$process (for PGA). moreover, you as DBA are the one who configured that.
you can look at major an minor faults per process to see what is causing the paging (if you have any).
you can also look at the /proc/pid/statm pseudofilesystem for your oracle pids. -
How many memory is used for the process of one connection?
Hi,
how many memory is used for the process of one connection in unix
when the user connects to the database?
Thanks,Write some queries using v$sesstat, v$statname, v$session to find the statistics for different stats. Query name from v$statname and find whatever you wants. I don't think there is a common rule that tells how much memory will be used for each connection, it depends on different factors like , resources available, type of databases, database memory settings etc.
Example query.
select s.osuser osuser,s.serial# serial,se.sid,n.name,
max(se.value) maxmem
from v$sesstat se,
v$statname n
,v$session s
where n.statistic# = se.statistic#
and n.name in ('session pga memory','session pga memory max',
'session uga memory','session uga memory max')
and s.sid=se.sid
group by n.name,se.sid,s.osuser,s.serial#
order by 2
; -
Wired memory counts up to 100%, how to find unknown process leaking memory
Hi,
On my Macbook Pro 2011, 8GB wired memory counts up to 100% over a period of 4-5 regular usage days. The more I use the macbook, the more wired memory grows until I have to restart again, otherwise the machine becomes slow because it uses the harddrive for memory. This is not normal behavior!
Attached is a screenshot of the activity monitor. I'm not able to identify the process which leaks the wired memory.
I had once an eyeopening experience: I was about to restart my macbook totally overloaded by wired memory but then I canceled the shutdown because of some reason. Some of the processes and programmes were already terminated and SURPRISE, the wired memory was down to 10%! The 8 Gb were all of a sudden shared by free, active and inactive memory, as it should be! So some process was terminated during shutdown which caused the leak and even freed all of the wired memory. I did work with the macbook for 2 more days without any memory problem. Once I restarted, the leaking problem started again.
My gut-feeling says the hole problem started when I installed VM Ware Fusion a while ago. But I did a clean uninstall.
The solution could be to identify the leaking process, but how should I do this? It is also not clear to me wether wired memory is real, virtual, private or shared memory displayed in the activity monitor. Is there any tool which identify memory leaks?
According to g_wolfman, the only process with a hugh difference between real and virtual memory is the kernel_task and the many Chrome Renderer processes. I have always 30 tabs open in chrome plus Safari (Flash disabled). I'm not able to terminate the kernel_task of course.
Is there any way to isolate the troublesome process? There is no save start mode like in Microsoft Windows possible? This would be the first think I would do, checking if the problem persists in save mode.
Disabled every start login objects btw.
See in the image the amount of wired memory compared to the processes which are active. This is NOT the smart memory management OSX is capable of.Any suggestion? Is my system doomed to bleed to death every 3-4 days, until memory went 100% red (wired)? I would expect OS X to be smart enough to indicate memory leakers. I really do not get it.
I migrated the same settings and applications to my freshly installed (10.7.4) 2007 Macbook. There the majority of RAM is active not wired.
The only big difference is: On my 2011 Macbook Pro was VMWARE Fusion installed. -
Why is my MacMini 6.1 always so high in Memory Used?
Hi,
I was wondering if anyone could help me figure out why my MacMini keeps running slowly... I think it's to do with Memory Used, but I'm only guessing.
Thanks.
EtreCheck version: 2.0.11 (98)
Report generated 6 November 2014 10:39:57 pm AEDT
Hardware Information: ℹ️
Mac mini (Late 2012) (Verified)
Mac mini - model: Macmini6,1
1 2.5 GHz Intel Core i5 CPU: 2-core
16 GB RAM Upgradeable
BANK 0/DIMM0
8 GB DDR3 1600 MHz ok
BANK 1/DIMM0
8 GB DDR3 1600 MHz ok
Bluetooth: Good - Handoff/Airdrop2 supported
Wireless: en1: 802.11 a/b/g/n
Video Information: ℹ️
Intel HD Graphics 4000 -
TOSHIBA-TV 1920 x 1080 @ 50 Hz
System Software: ℹ️
OS X 10.10 (14A389) - Uptime: 11 days 5:12:28
Disk Information: ℹ️
APPLE HDD HTS545050A7E362 disk0 : (500.11 GB)
S.M.A.R.T. Status: Verified
EFI (disk0s1) <not mounted> : 210 MB
Macintosh HD (disk0s2) / [Startup]: 499.25 GB (156.01 GB free)
Recovery HD (disk0s3) <not mounted> [Recovery]: 650 MB
USB Information: ℹ️
Apple Inc. BRCM20702 Hub
Apple Inc. Bluetooth USB Host Controller
Apple, Inc. IR Receiver
Microsoft Microsoft 5-Button Mouse with IntelliEye(TM)
Thunderbolt Information: ℹ️
Apple Inc. thunderbolt_bus
Promise Technology, Inc. Pegasus R-Series
Configuration files: ℹ️
/etc/hosts - Count: 45
Gatekeeper: ℹ️
Mac App Store and identified developers
Kernel Extensions: ℹ️
/Library/Extensions
[loaded] com.promise.driver.stex (5.2.10 - SDK 10.9) Support
/System/Library/Extensions
[not loaded] at.obdev.nke.LittleSnitch (3876 - SDK 10.8) Support
Launch Agents: ℹ️
[not loaded] com.adobe.AAM.Updater-1.0.plist Support
Launch Daemons: ℹ️
[failed] com.adobe.fpsaud.plist Support
[invalid?] com.adobe.SwitchBoard.plist Support
[loaded] com.promise.bgasched.plist Support
[running] com.promise.BGPMain_R.plist Support
[loaded] com.promise.emaild.plist Support
User Launch Agents: ℹ️
[loaded] com.adobe.AAM.Updater-1.0.plist Support
[loaded] com.adobe.ARM.[...].plist Support
User Login Items: ℹ️
iTunesHelper ApplicationHidden (/Applications/iTunes.app/Contents/MacOS/iTunesHelper.app)
uTorrent ApplicationHidden (/Applications/uTorrent.app)
Dropbox Application (/Applications/Dropbox.app)
Catch UNKNOWN (missing value)
Catch UNKNOWN (missing value)
Internet Plug-ins: ℹ️
AdobePDFViewerNPAPI: Version: 10.1.12 Support
FlashPlayer-10.6: Version: 14.0.0.176 - SDK 10.6 Support
AdobePDFViewer: Version: 10.1.12 Support
Flash Player: Version: 14.0.0.176 - SDK 10.6 Mismatch! Adobe recommends 15.0.0.189
QuickTime Plugin: Version: 7.7.3
Default Browser: Version: 600 - SDK 10.10
User Internet Plug-ins: ℹ️
Picasa: Version: 1.0 - SDK 10.4 Support
Safari Extensions: ℹ️
AdBlock
Facebook Cleaner
Awesome Screenshot
RSS Menu
3rd Party Preference Panes: ℹ️
Flash Player Support
Time Machine: ℹ️
Auto backup: YES
Volumes being backed up:
Macintosh HD: Disk size: 499.25 GB Disk used: 343.24 GB
Destinations:
PROMISE PEGASUS [Local]
Total size: 3.00 TB
Total number of backups: 131
Oldest backup: 2013-02-12 01:21:04 +0000
Last backup: 2014-11-06 10:40:18 +0000
Size of backup disk: Excellent
Backup size 3.00 TB > (Disk size 499.25 GB X 3)
Top Processes by CPU: ℹ️
15% backupd
5% iVI Pro
3% Finder
2% WindowServer
2% firefox
Top Processes by Memory: ℹ️
515 MB firefox
223 MB mds_stores
206 MB iVI Pro
206 MB Finder
172 MB softwareupdated
Virtual Memory Information: ℹ️
5.28 GB Free RAM
5.26 GB Active RAM
4.92 GB Inactive RAM
1.73 GB Wired RAM
80.28 GB Page-ins
8 MB Page-outsWhen you have the problem, note the exact time: hour, minute, second.
These instructions must be carried out as an administrator. If you have only one user account, you are the administrator.
Launch the Console application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Console in the icon grid.
The title of the Console window should be All Messages. If it isn't, select
SYSTEM LOG QUERIES ▹ All Messages
from the log list on the left. If you don't see that list, select
View ▹ Show Log List
from the menu bar at the top of the screen.
Each message in the log begins with the date and time when it was entered. Scroll back to the time you noted above.
Select the messages entered from then until the end of the episode, or until they start to repeat, whichever comes first.
Copy the messages to the Clipboard by pressing the key combination command-C. Paste into a reply to this message by pressing command-V.
The log contains a vast amount of information, almost all of it useless for solving any particular problem. When posting a log extract, be selective. A few dozen lines are almost always more than enough.
Please don't indiscriminately dump thousands of lines from the log into this discussion.
Please don't post screenshots of log messages—post the text.
Some private information, such as your name, may appear in the log. Anonymize before posting. -
High memory use when checking downloads folder through browser
High memory use when checking downloads folder through browser.
I have a total of 3 DDR2 Gbytes of ram. Pentium(R) Dual-Core CPU T4500 @ 2.30GHz Win 7 home pr. 64bit. Firefox 27.0 beta
I right click on a file to "open containing folder" from the drop down menu in downloads.
When the folder has been opened, explorer is trying to index the folder (which it never does completely or well after 5 minutes I close the folder and shut down the dllhost process cause laptop is blazing hot) and memory keeps increasing till no more is available.
I checked task manager and see that dllhost is the particular process that is causing the spike in memory usage even after closing the folder I right click and stop the process and memory is restored after awhile.Hello,
'''Try Firefox Safe Mode''' to see if the problem goes away. Safe Mode is a troubleshooting mode, which disables most add-ons.
''(If you're not using it, switch to the Default theme.)''
* On Windows you can open Firefox 4.0+ in Safe Mode by holding the '''Shift''' key when you open the Firefox desktop or Start menu shortcut.
* On Mac you can open Firefox 4.0+ in Safe Mode by holding the '''option''' key while starting Firefox.
* On Linux you can open Firefox 4.0+ in Safe Mode by quitting Firefox and then going to your Terminal and running: firefox -safe-mode (you may need to specify the Firefox installation path e.g. /usr/lib/firefox)
* Or open the Help menu and click on the '''Restart with Add-ons Disabled...''' menu item while Firefox is running.
[[Image:FirefoxSafeMode|width=520]]
''Once you get the pop-up, just select "'Start in Safe Mode"''
[[Image:Safe Mode Fx 15 - Win]]
'''''If the issue is not present in Firefox Safe Mode''''', your problem is probably caused by an extension, and you need to figure out which one. Please follow the [[Troubleshooting extensions and themes]] article for that.
''To exit the Firefox Safe Mode, just close Firefox and wait a few seconds before opening Firefox for normal use again.''
''When you figure out what's causing your issues, please let us know. It might help other users who have the same problem.''
Thank you. -
Using XMLDOM to process document in XML DB
I am new to XML and especially XML DB which I however see as an excellent platform on which to base XML based solutions. I have a specific question and apologise beforehand should any of my assumptions be incorrect.
I wish to create an application which from a number of XML fragments, together with rules governing the behaviour of the fragments (insertion points, overwrite rules etc) are merged together to finally leave me with a complete and valid XML document in XML DB.
I thought at first that I could use DBMS_XMLDOM to perform this low level processing required. I have however not managed to understand how this can be used together with XMLDB. I am reluctant to use XMLDOM without XMLDB as I am afraid that I will surpass the limits in XML document size apparently imposed by XMLDOM.
I see a solution where I create a schema based resource in XML DB containing the initial XML structure and then processing any number of the above mentioned fragments to finaly be left with a complete XML document.
Can I use XMLDOM to do this or am I barking up the wrong tree?
I would be grateful for any input on techniques that I can apply to perform elementary search/replace/insert on an XML document which I am, from PLSQL, compiling.
Thanks
Hans ChristiansenHi
The size of the documents I want to compose are expected vary from a few Kb to 1 or 2 Gb! In a FAQ found somewhere on OTN there was an entry which mentioned that somebody was having trouble with a 50Mb XML document. The recommendation was to use SAX but I am under the impression that this is more useful when the processing is of a more sequential nature.
The main thread of my question is to gain clarity in the most suitable technique to use when actualy compsing the XML.
What I want to do is:
Create resource (XML document) in XML DB.
Loop through XML fragments together with rules:
For each fragment process according to rules and insert
fragment or update existing XML based on fragment contents.
At the end of the loop the XML document is complete and ready for further processing.
XMLDOM seems to give me the tools to do this but I am unsure of how to do this and have XMLDOM work directly against the contents in the resource controlled by XML DB (making use of possible indexes and the scalable nature of XMLDB). I get the feeling that if I simply read the XML from XMLDB resource into a DOM document I am still using the memory based representation of the XML until I write the XML back to XMLDB - is this a correct assumption.
Alternatively is it the functionality offered by XPath, extract(), updatexml() etc. that I should be looking at?
Does this make my question more understandable?
Hans -
Mail is using 100% CPU processes - wondering if I possibly have the answer?
Hi...
I have a big problem with Mail using all the CPU processes but may just have found a possible solution. I'm posting to see if anyone else shares this problem or can shed some light on whether or not this is a possible solution.
_*The Problem*_
Over the past couple of weeks, I've noticed that Mail is using on average 100% of the processes and sometimes up to 168% (I have screenshots to prove it). My 17" MacBookPro gets very, very hot and the fans spin up to cool it down so it's obviously not right as it's never done this before. I can only use Mail intermittently now as the machine overheats quickly soon after Mail starts up. As a result, the CPU is being hammered so I can't now use Mail or other CPU intensive applications properly, which is a big problem.
I've used the iStatPro widget to verify that Mail is constantly using 100% of the CPU processes. I've also verified this using Utilities / Activity Monitor. When the Activity Monitor application loads, I've selected Mail from the list of Process Names and then clicked Inspect. I've managed to identify the parent process as being launchd (110) which is using all the CPU power. Here are some other stats for this parent process:
%CPU 95.56 (at that specific instance)
Threads 15
Ports 275
CPU Time 3:30.55
Context Switches 310968
Faults 65795
Page Ins 1
Mach Messages In 272627
Mach Messages Out 65025
Mach System Calls 1459878
Unix System Calls 103120
I guess the important bit is the first bit that says 95.56%.
I have screenshots to back this up but no way of posting them here. I have also managed to use Activity Monitor to generate sample data that the process is creating and again there is no way of posting an attachment here but there is lots of sample data from the process to look at. I've compared the sample data from my MacBookPro to a colleagues machine and the difference between the sample data is enormous. There is obviously something very wrong happening.
Here's some basic info about my machine, with the serial number removed:
Hardware Overview:
Model Name: MacBook Pro 17"
Model Identifier: MacBookPro2,1
Processor Name: Intel Core 2 Duo
Processor Speed: 2.33 GHz
Number Of Processors: 1
Total Number Of Cores: 2
L2 Cache: 4 MB
Memory: 2 GB
Bus Speed: 667 MHz
Boot ROM Version: MBP21.00A5.B08
SMC Version: 1.14f5
Sudden Motion Sensor:
State: Enabled
System Software Overview:
System Version: Mac OS X 10.5.6 (9G55)
Kernel Version: Darwin 9.6.0
Boot Mode: Normal
Time since boot: 1:44
_*The Possible Solution??*_
I recently installed a Beta version of Daylite 3 as I was interested in the application and remembered that it integrates closely with Mail. I wondered if Daylite was constantly trying to communicate with Mail and having problems. Having uninstalled Daylite 3, the problem of Mail using all the processes has so far not reappeared. Mail is now using very little of the CPU processes as is usual. However, I'm currently at home instead of on my network at the office so I'll wait to see if the problem still fails to appear when at work.
I know other people have had problems with Mail using 100% of the processes. Have you also installed Daylite 3? There has been some talk of Flip4Mac being a possible culprit but I use Flip4Mac and haven't previously had the problem. The only recent change and connection I can think of is an install of Daylite 3.
I don't want to talk down Daylite 3 but it's the only thing I can think of and having uninstalled it, the problem hasn't occurred. I hope I have stumbled across the solution but any thoughts, shared experiences or feedback would be greatly appreciated...
Many Thanks,
NigelHi...
Thanks for the post. Not sure what you mean when you say "What does Mail say it's doing?" Can you be more specific and supply specific instructions to follow so that I can give you the information you need?
I've sampled the process but can't post any attachments on the forum. I've listed what the Activity Monitor stats are saying at the top level in the post above.
This is a serious problem that's hammering my machine and making it overheat and almost making it unusable. Any feedback or instructions anyone can give me for what info to supply to help you determine what the issue is would be greatly appreciated. I'm hoping to find a solution here rather than have the machine overheat permanently and eventually fail, leaving me to sort it out with AppleCare.
Help!
Clown Guy -
One or more ports used by the Compute Emulator are currently used by other processes
Environment:
VS 2012 Professional
Azure SDK October 2012
Windows 8
I lost the last few days of my life struggling with a weird issue in the emulator. I just ran out of options and I would really appreciate if someone could help me figure out what's wrong.
I am trying to debug a service package from Visual Studio 2012. It's really just about any package -- even the ones generated from a Windows Azure Cloud Service VS template. Any. The VS debugger starts, and in parallel there's "Starting the Windows Azure Debugging
Environment" dialog which shows "Deploying service package to the Windows Azure compute emulator..." message.
The progress bar shown in the dialog gets stuck for a long time (possibly even for an hour or longer!) at some 60% and then the following error message is shown:
"One or more ports used by the Compute Emulator are currently used by other processes. To resolve this, please see MSDN documentation at http://msdn.microsoft.com/en-us/library/hh472164.aspx"
There doesn't seem to be anything else listening on the ports mentioned on the above MSDN page. I did nevertheless try to re-map devfabric and agent ports by specifying different values in the .config files mentioned on the page, but that did not help.
What I also tried and did not help:
- reinstalled SDK, IIS Express, Local DB
- reinstalled VS 2012 (yes, I got that desperate)
- tried using IIS instead
- used SysInternals TcpView to check if there are any conflicts
- rebooted the machine: the deployment works initially (*once*), and the subsequent deployments fail (!)
- tried to kill all Azure-related processes in memory and restart debugging
- tried looking into log files under the user directory (dftmp\...); no errors in *any* log
- tried looking into Event Viewer logs (Azure-related and in general); no errors either
Since the conflict seems to be related to my current network settings, below is my IP
configuration. I am behind a router and I have DHCP activated, but again that should not matter since none of that has changed in the last few years (and the emulator did work until few days ago).
C:\WINDOWS\system32>ipconfig /all
Windows IP Configuration
Host Name . . . . . . . . . . . . : MYCOMPUTER
Primary Dns Suffix . . . . . . . :
Node Type . . . . . . . . . . . . : Hybrid
IP Routing Enabled. . . . . . . . : No
WINS Proxy Enabled. . . . . . . . : No
Ethernet adapter Ethernet:
Connection-specific DNS Suffix . :
Description . . . . . . . . . . . : Marvell Yukon 88E8056 PCI-E Gigabit Ethernet Controller
Physical Address. . . . . . . . . : 32-AB-30-66-BC-56
DHCP Enabled. . . . . . . . . . . : Yes
Autoconfiguration Enabled . . . . : Yes
IPv6 Address. . . . . . . . . . . : 2a01:e35:8a3a:9970:edd9:b989:b67a:5a8a(Preferred)
Temporary IPv6 Address. . . . . . : 2a01:e35:8a3a:9970:dc7a:4fe6:62a5:e54a(Preferred)
Link-local IPv6 Address . . . . . : fe80::edd9:b989:b67a:5a8a%12(Preferred)
IPv4 Address. . . . . . . . . . . : 192.168.0.1(Preferred)
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Lease Obtained. . . . . . . . . . : Sunday, December 16, 2012 21:26:30 PM
Lease Expires . . . . . . . . . . : Tuesday, December 18, 2012 09:26:14 AM
Default Gateway . . . . . . . . . : fe80::224:d4ff:fea2:9722%12
192.168.0.254
DHCP Server . . . . . . . . . . . : 192.168.0.254
DHCPv6 IAID . . . . . . . . . . . : 253808432
DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-18-1B-EE-4D-20-CF-30-66-BC-46
DNS Servers . . . . . . . . . . . : 192.168.0.254
NetBIOS over Tcpip. . . . . . . . : Enabled
Tunnel adapter isatap.{7A96B710-3107-48B9-A7B2-2F261DDD91AD}:
Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . :
Description . . . . . . . . . . . : Microsoft ISATAP Adapter
Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0
DHCP Enabled. . . . . . . . . . . : No
Autoconfiguration Enabled . . . . : Yes
Tunnel adapter Local Area Connection* 11:
Connection-specific DNS Suffix . :
Description . . . . . . . . . . . : Teredo Tunneling Pseudo-Interface
Physical Address. . . . . . . . . : 00-00-00-00-00-00-00-E0
DHCP Enabled. . . . . . . . . . . : No
Autoconfiguration Enabled . . . . : Yes
IPv6 Address. . . . . . . . . . . : 2001:0:5ef5:79fb:1caf:12ff:a75c:5668(Preferred)
Link-local IPv6 Address . . . . . : fe80::1caf:12ff:a75c:5668%14(Preferred)
Default Gateway . . . . . . . . . :
NetBIOS over Tcpip. . . . . . . . : Disabled
Below are the Azure SDK emulator configuration files, unmodified (as created by the SDK installation).
DevFC.exe.config
<configuration>
<configSections>
<section name="DevFCSettings" type="System.Configuration.NameValueSectionHandler" />
</configSections>
<!-- The following are options related to the SimulatorSetup -->
<DevFCSettings>
<add key="StartMACAddress" value="00155D201928" />
<add key="EndMACAddress" value="155D20193C" />
<add key="StartIPAddress" value="192.168.0.20" />
<add key="EndIPAddress" value="192.168.0.40" />
<add key="DipPoolStartIPAddress" value="127.255.0.0" />
<add key="DipPoolEndIPAddress" value="127.255.255.255" />
<add key="VipPoolStartIPAddress" value="127.0.0.1" />
<add key="VipPoolEndIPAddress" value="127.0.0.255" />
<add key="DefaultGateway" value="192.168.0.1" />
<add key="SubnetMask" value="255.255.255.0" />
<add key="InternalSwitchName" value="{F3C577E3-8256-4bb9-8F54-256F84E227DE}-DevFabricSwitch" />
<add key="InternalSwitchPortName" value="{F3C577E3-8256-4bb9-8F54-256F84E227DE}-DevFabricHostSwitchPort" />
<add key="InternalEthernetNICName" value="{F3C577E3-8256-4bb9-8F54-256F84E227DE}-DevFabricEthernetNIC" />
<add key="InternalEthernetPortMACAddress" value="00155D201927" />
<add key="InternalEthernetPortIPAddress" value="192.168.0.2" />
<add key="InternalEthernetPortSubnetMask" value="255.255.255.0" />
<add key="StorageRoot" value="DFTemp" />
<add key="LogsDirName" value="DevFCLogs" />
<add key="DynamicPortAllocStart" value="20000" />
<add key="ManagementServicePort" value="15095" />
<add key="RepositoryServicePort" value="15096" />
<add key="AgentCallbackPort" value="15097" />
<add key="AgentPort" value="15098" />
<add key="PxeResponderPort" value="15100" />
</DevFCSettings>
<startup>
<supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
</startup>
</configuration>
DFAgent.exe.config
<configuration>
<startup>
<supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
</startup>
<appSettings>
<add key="AgentMAC" value="00155D201927"/>
<add key="AgentIP" value="192.168.0.2"/>
<add key="EnableActiveNotification" value="false"/>
<add key="StorageRoot" value="C:\DFTemp"/>
<add key="CopyFilesInStartRole" value="false"/>
<add key="LogsDirName" value="DFAgentLogs" />
<add key="EnableFileLog" value="true" />
<add key="AgentPort" value="15098" />
<add key="RuntimePort" value="15099" />
<add key="AgentCallbackPort" value="15097" />
</appSettings>
</configuration>
DFService.exe.config
<configuration>
<configSections>
<section
name="dfservice"
allowExeDefinition="MachineToLocalUser"
type="Microsoft.ServiceHosting.Tools.DevelopmentFabric.DfServiceConfigurationSection, DfService, Version=1.8.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35"
/>
</configSections>
<dfservice
ManagementServicePort="15095"
RepositoryServicePort="15096"
/>
<startup>
<supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.0"/>
</startup>
</configuration>
Finally, here's what TcpView shows while the emulator is stuck:
devenv.exe 3736 TCP MYCOMPUTER 7240 localhost 15095 SYN_SENT
devenv.exe 3736 TCP MYCOMPUTER 7245 localhost 15095 SYN_SENT
svchost.exe 4332 TCP MYCOMPUTER 7438 MYCOMPUTER 0 LISTENING
System 4 TCP MYCOMPUTER 10000 MYCOMPUTER 0 LISTENING
System 4 TCP MYCOMPUTER 10001 MYCOMPUTER 0 LISTENING
System 4 TCP MYCOMPUTER 10002 MYCOMPUTER 0 LISTENING
DevFC.exe 4380 TCP MYCOMPUTER 15095 MYCOMPUTER 0 LISTENING
DevFC.exe 4380 TCP MYCOMPUTER 15096 MYCOMPUTER 0 LISTENING
DevFC.exe 4380 TCP MYCOMPUTER 15097 MYCOMPUTER 0 LISTENING
DFAgent.exe 14472 TCP MYCOMPUTER 15098 MYCOMPUTER 0 LISTENING
DFAgent.exe 14472 TCPV6 mycomputer 15098 mycomputer 0 LISTENING
DFAgent.exe 14472 TCPV6 mycomputer 15098 mycomputer 6399 ESTABLISHED
System 4 TCP MYCOMPUTER 15099 MYCOMPUTER 0 LISTENING
System 4 TCPV6 mycomputer 15099 mycomputer 0 LISTENING
DevFC.exe 4380 TCP MYCOMPUTER 15100 MYCOMPUTER 0 LISTENING
Thanks in advance for help!
▼
▲
▼
▲Hi,
Unfortunately I already tried all kinds of re-installs (the full list is in my original message). The only one remaining is the reinstall of Windows 8 itself, which I would really like to avoid.
What I find really strange is the time it takes for the above error message to appear. It's like one hour or even more (never measured exactly, I left the computer running).
What kind of a timeout is that? I would expect that, if ports are really used by some other application, I get the message in less than a minute (seconds, actually). To me this looks like the emulator itself for some reason believes there's a problem with
some port while in reality there isn't.
I'll eventually contact Microsoft Support, thanks for the suggestion.
▼
▲ -
CFMX 6.1's Virtual Memory Use problem!!
I appologise for the long post in advance...
Ok... so I have this script that, using cfdirectory, will
check a directory for any files that may have been uploaded, if
there are files, it loops through the results and reads the files
one at a time, line by line, using the FileReader.cfc (Uses the
Java FileInputStream, InputStreamReader, and BufferedReader to
provide a way to incrementally read large files). The files are
just pipe "|" delimited data, each line represents a record for a
db table.
Now as it's reading each line, it will perform some basic
string parsing to clean up the file line to make sure the data is
valid, blah blah blah and then it will write that "cleaned" line to
another file using FileWriter.cfc (Java component once again). Once
it's completely done reading the original file, it will close it
and it will open the new "cleaned" version of the file, read it
(FileReader.cfc), create an INSERT statement and then update the
database table.
Now... this all works GREAT... until it has to loop through
more than a few files... 3 - 4 files are NO problem! works like a
charm, but throw 6 - 8 files at it and it dies, not a timeout mind
you but an actual "java.lang.OutOfMemoryError" (now, I've tried
making all the files exactly the same (just changed the name) and
the weird thing is, it takes longer and longer to process each as
it goes through the loop... I have the script write some stats as
it's looping:
FILE 1 STATS
Name: COA0607_Intranet1.DAT
Status: Import Successfull
Line Count: 32,971
Processing Time: 74,237ms
FILE 2 STATS
Name: COA0607_Intranet2.DAT
Status: Import Successfull
Line Count: 32,971
Processing Time: 82,018ms
FILE 3 STATS
Name: COA0607_Intranet3.DAT
Status: Import Successfull
Line Count: 32,971
Processing Time: 94,476ms
FILE 4 STATS
Name: COA0607_Intranet4.DAT
Status: Import Successfull
Line Count: 32,971
Processing Time: 145,108ms
I know what you guy are probably thinking; "Woah man... CF
isn't really meant to do that kind of processing...", I know, trust
me I know... however, I really neeeeeed it too lol.
Ok, so as the script is running, I watch the Virtual Memory
use of jrun.exe, processing say 3 - 4 of these files brings up the
usage to approx 300,000k which yes, is a LOT but that's fine...
this process is meant to run at night via a Scheduled Task...
When I run more than 4 files, things start to get ugly, keep
in mind that these are EXACTLY the same files just re-named
differently. The script will start lagging BIG time and on the last
file (usually the last file) I'll see the memory usage spike from
350,000K all the way up to 600,000K and that's when it throws the
"java.lang.OutOfMemoryError" and dies... I've tried commenting out
the part of the script that updates the db, but still get the same
problem...
So... what gives? How come CF Server does this??? I mean, it
runs fine for the first few files... and then WAM, it dies... sorry
for the long post... any insight here is VERY much appreciated...
it would be AWESOME if the wonderful folks at Adobe could shed some
light on this for me : )
CFMX 6.1 version: 6,1,0,83762
Windows XP Pro SP2
Intel P4 2.8Ghz
1Gb of Ramquote:
Originally posted by:
Mr Black
300M memory usage while using "incremental" file reader??
Looks like it is "incremental" only in the sense that it increments
memory usage. Did you try non-Java C/C++ file reader tags?
Well I did try cffile originally... and it didn't even run...
lol -
I end up having to take a lot of high sample rate data for relativily long periods of time. When I save the data it is usually over 100 MB. When I load the data for post-processing though the amount of memory used is excessively higher than the file size. This causes my computer to crash because 1.5 GB is not enough. Is there a way to stop this from happening withoput splitting up the file into smaller files.
LabVIEW can efficiently handle large files, far beyond 100Mb, provided that care is taken in the coding of the loading/processing routines. Here are several suggestions:
1) Check out the resources National Instruments has put together (NI Developer Zone > Development Library > Measurement and Automation Software > LabVIEW > Development System > Optimizing Applications > Managing Memory), specifically the article entitled "Managing Large Data Sets in LabVIEW".
2) Load and process the data in chunks if possible.
3) Avoid sending the data to front panel indicators, using local/global variables for data storage, or changing data types unless absolutely necessary.
4) If using LabVIEW 7.1, use the "show buffer" tool to determine when LabVIEW is creating extra
copies of data in memory. -
Is it possible to config memory size for a process?
Dear experts,
I would like to control the memory size assigned for a process on Solaris 9. Can i config memory size assigned for process??
Many thanks,
ShunYou can use ulimit/limit to assign a bound on the amount of space that a process and its children can allocate.
I'm not sure if that's what you're asking though.
Darren
Maybe you are looking for
-
Photo gallery built with adobe edge can not be seen on mobile devices.
photo gallery built with adobe edge can not be seen on mobile devices. ps: I do not have any email attachment, I do not understand a thing of referring
-
Regarding authorization in solution manager for Central system monitoring
Hi, I want to Prevent users from deleting Task logs in central system monitoring in solution manager I have assigned the roles SAP_SV_SOLUTION_MANAGER_DISP But it gives display authorization for everything unable to keep track of changes in monitorin
-
HRMS sign on page issue with PIA
Hi all. I've installed Peoplesoft 9.1, PT8.52 (Oracle 11G 64 bit database) on windows 2008 server 64bit and an HRMS DEMO DB on a Virtual machine PSDEMOVM. I also installed Oracle 11G client 32, and configured a PS client workstation on another virtua
-
Multiple index entries for single object.
Hi, Can someone guide me whether coherence allows multiple keys to be inserted in an index for given record(value)? I mean I will insert a single 'value' in the cache and multiple keys for it in the index, and I should be able to search that 'value'
-
Change Properties by ADF JavaScript
Hello Experts, I am trying to change two properties styleClass and shortDesc of a panelGroupLayout. I have a clientListener attached to that panelGroupLayout. <af:panelGroupLayout id="dc_pgl3" styleClass="carousel-player-panel start" layout="vertical