ZFS file cache and available memory

In one of our application, we use the Solaris calls 'sysconf' and 'swapctl' with appropriate parameters to find out the amount of total and free physical and swap memories on the machine at any moment.
1. I would like to know whether these calls would account for the memory reserved for the ZFS file cache, in the sense, would the above calls consider the memory
that is a part of the ZFS file cache within the total/used physical and swap memory?
2. Would the ZFS file cache be accounted in the in the output of command 'vmstat'?

frankrinmelrose,
With only 1.5 GBs free on your HD, it is not surprising that you are having difficulties. In fact, it is rather dangerous to operate your computer with this little space. While later versions of OS X are much better at dealing with too-little disk space, there is still a risk that you could suffer a major disk error. This is a common and well-known problem, and could result in a loss of all your data.
I consider around 10 GBs of free HD space a good target to shoot for, but certainly no less than 5 GBs. This should give OS X enough "flex" space on the boot volume. If you are using all of your available disk space, it might be time to migrate some of that data to an external HD.
I could give a long-winded explanation of how inactive memory fits into this equation, but the short version is that it just doesn't matter in this case. In this case, Safari (following your example) has been given all of the physical and virtual memory it is ever going to get, and the issue is not with what physical memory it occupies, but with how the HD is being accessed.
Scott

Similar Messages

  • Difference between nio-file-manager  and nio-memory-manager

    Hi,
    what's the difference between nio-file-manager and nio-memory-manager? The documentation doesn't really discuss the differences as far as I know. They both use nio to store memory-mapped files don't they? What are the advantages/disadvantages of both?
    When to choose the first one and when the second when storing a large amount of data? Can both be used to query data with the Filter API? Are there size limits on both?
    Best regards
    Jan

    Hi Jan,
    The difference is that one uses a memory mapped file and one uses direct nio memory (as part of the memory allocated by the JVM process) to store the data. Both allow storing cache data off heap making it possible to store more data with a single cache node (JVM) without long GC pauses.
    If you are using a 32 bit JVM, the JVM process will be limited to a total of ~3GB on Windows and 4GB on Linux/Solaris. This includes heap and off heap memory allocation.
    Regarding the size limitations for the nio-file manager Please see the following doc for more information.
    With the release of 3.5 there is now the idea of a Partitioned backing map which helps create larger (up to 8GB of capacity) for nio storage. Please refer to the following doc.
    Both can be used to query data but it should be noted that the indexes will be stored in heap.
    hth,
    -Dave

  • Smart paging Question , What happen if i don't enable smart paging and available Memory is about 1GB and the VM need 3GB for Booting ?

    Hi ,
    I configure a dynamic memory With 512 MB for a VM , and available memory 1GB
    what happen when I boot the VM , While it actually need 3GB for booting - Note I don't configure Smart Paging ?
    Thanks.

    You won't be able to boot at all.
    pagefile and dynamic memory only comes into play when you don't have enough memory on the host, to support the 'startup RAM' on the VM, and when the VM does a
    reboot.
    -kn
    Kristian (Virtualization and some coffee: http://kristiannese.blogspot.com )

  • Impdp and available memory

    Just a quick one on how available memory can affect datapump imp.
    Will increasing the SGA from 2GB to 8GB of a database on which data is being imported affect the total import time?
    Just a bit curious!
    Thanks

    Hi,
    What is the method of the Import Method. Whether it is External Path or Direct Path. If it is Direct Path it will not use buffer cache, it will directly insert after the HWM. If it is External Path it will use the SGA. I dont find a point to increase the size of SGA for the import process alone. If you have a luxury of having 8GB instance for import process you can have it for the normal databse operations too. Rather you can do the import process on the less peak time or you need to address the below questions to increase the size of SGA for this process
    1) how much data are you going to insert?
    2) how many users are going to be connected to the Oracle database when import is going to happen?
    3) how big is your improting data and how it wll affect the performance
    You can go for direct path insert which will be faster than the external path
    Thanks,
    Vijay

  • IPad available memory NOT consistent with available memory shown in iTunes and available memory reduced after a connected sync...doesn't make sense.

    I was looking through my pictures on iPhoto on my iPad 2 and noticed in some of my albums there were duplicate pictures, but on iPhoto on my iMac there wasn't. I had also noticed that my 64GB iPad 2 had only a little over 14GB left for available memory. I decided to connect my iPad2 to my iMac and sync it with itunes but this time I unchecked Sync Photos. I was asked to remove photos which I agreed to. My intnet was to re-install my photos in hopes that I would no longer see the duplicate photos and quite possibly free up some memory. In short, none of that worked and instead the pictures remained on my iPad2 and my available memory jumped to 956MB. I then tried selecting a " Selected Events, Faces, Albums..." in the Photo section of iTunes but I did not select any albums or events or faces. The sync ended and I still had all of the pictures on my iPad2 with 7GB left of available memory showing on my iPad2 but now showing 12GB on my iTunes on the iMac.
    I then tried to do a sync again, syncing all photos and the sync cancelled. I tried it again and it went through. This sync ended with 14GB of available memory showing on iTunes on my iMac, BUT on my iPad2 it showed 7.1GB.
    None of this makes any sense. I guess I could have left it alone and viewed duplicate photos but if duplicate photos were causing available memory to be reduced, I wanted the memory to come back up for future use.
    Also, I noticed that the amount of photos being synced has randomly changed on a couple of these occassions as if I had more or less photos to sync and I haven't. I'm not sure what would cause this either.
    Where it says "Other" in the memory bar in ITunes on my iMac is 26.34 GB. Before I did the first sync it was a little over 7GB. What would cause the "Other" to consume so much memory? and what is "Other" Why did it fluctuate so drastically when I've made no changes to my iPad?
    I hope I can get some help to this.
    Thanks!

    Brock_DB wrote:
    Where it says "Other" in the memory bar in ITunes on my iMac is 26.34 GB. Before I did the first sync it was a little over 7GB. What would cause the "Other" to consume so much memory? and what is "Other" Why did it fluctuate so drastically when I've made no changes to my iPad?
    "Other" can be the cause of this storage capacity snafu that you have going on with your iPad. "Other" is pretty much what it sounds like it should be with regard to what is stored on your iPad. It is "stuff" associated with apps but not the apps themselves or any other media. It consists of Safari Bookmarks and history, Notes, text messages, email messages, contacts, photos associated with contacts and items of that nature. It should not be anywhere near 26 GB and the fact that you have much is a little bit of a problem.
    Sometimes the only way to rid your device of that bloated "other" is by restoring as a new device without using the backup. There could be something corrupt on your iPad and if you restore from a corrupted backup, you will just end up back where you started. Also, sometimes this issue is caused by syncing photos and while I don't know this for a fact, it might have something to do with the metadata associated with the photos that gets corrupted and then that might cause this "other" storage problem.
    Take a look at some of these and see if something in one of them helps.
    https://www.google.com/search?q=What%20is%20%22Other%22%20on%20my%20iPad%20and%2 0how%20do%20I%20get%20rid%20of%20it?#q=What%20is%20%22Other%22%20on%20my%20iPad% 20and%20how%20do%20I%20get%20rid%20of%20it%3F

  • Secure banking session pages cached and available to 'swipe back' to

    I completed and logged out of an Internat Banking session this morning, then navigated to some other sites. I was using the 'swipe back' feature in Lion Safari, and wondered, "how far back can I go"?
    Sure enough - I swiped back through the entire Secure Internet banking session! I could see all details from the session but couldn't do anything that required a new action. Really bad!
    James

    Why not engage 'Private Browsing' before logging on to sensitive sites?  You can cancel it when you are finished.
    Frank

  • Data File Cache / Data Cache

    I have a few Questions regarding Data File cache and data cache. based on teh size of the application.
    All the settings are changed by using a maxl script.
    1. Data File cache-50MB,Data Cache - 100MB
    I am using Buffered I/O, then will memory be allocated to Data File cache?
    2. It is given in DBAG that data cache & index cache should be set as small as
    possbile for both buffered & Direct I/O. The size of one of my application is
    around 11 GB. data file :11GB,index File :450MB
    I have set my index cache to 450MB and data cache to 700MB.
    Is it OK or a. what should be my data cache size?
    b. How do I calculate the optimal Data cache and index cache?
    3. the memory size of our AIX server is 6GB. If i use Directo I/O, can my sum of
    all caches be 4GB?
    4. If I use buffered I/O, according to (2), what should be my cache sizes?
    Thanks
    Amarnath

    In the DBAG it states data file cache is not used with buffered IO so the answere to 1) should be NO.
    For 2) there is a hint in the DBAG that you should check the hit ratio of the caches to verify sizing, only calculatory advice for sizing is given on the calulator cache :-( This would mean for 2b) look at the hit ration if it stays around 1.0 try to decrease it until it drops slightly. Inspect the ratios from time to time.
    3) don't know, 64bit should be no problem. But why would you do this anyway?
    Example form our settings pag total ~20GB ind ~2GB
    outline hat 11 dimensions with a block size of ~340KB largest dense ~400 members, largest sparse ~4000 members, existing blocks ~2.7 milions
    The data cache is set to 256 MB, the index cache to 64MB our hit ratios are 1.0 for index cache and 0.77 for data chache. so our data cache could be larger, but the performace of retrievals is around 3.0 seconds which is fine for our users..
    4) Check your hit ratios and try to increase or decrease the cahces in small steps (first I'd do the index cache, the if it's fine I'd tune the data cache).
    hope it helped a bit..

  • Activity monitor file cache

    In activity monitor it shows that I have 16GB of physical memory, 12.77 GB used memory, 16GB virtual memory.
    It also shows App memory 1.9GB, FILE CACHE 9.56GB and wired memory 1.31GB.
    My question is in regards to file cache at 9.56GB.  What is file cache and why is it so high?  Does this mean I should install more memory?  I looked file cache up and I think it's memory that has been used but is not being used currently, it's waiting to be used again.  Not sure if that's right though, or what it really means.  Thanks for any help.
    Late 2013 27" iMac, 3.4 GHz i5
    16GB ram
    OSX 10.9.4

    Thank you, that helps.  I'm not super tech savvy, but this is what I took from that article.
    The app memory + wired memory + file cache = memory used.  So since the memory used includes file cache, I'm not really running out of memory as I thought I was.  The file cache is basically RAM on stand by in case it's needed by any app.  God, I hope I got that right!
    The memory pressure on my activity monitor shows green.

  • File cache causing problems?

    Since installing Mavericks I experience pauses when switching between apps. I have the full16 meg capacity RAM and have not had this problem in prior versions of OS X. I note I have 8.3 meg of "file cache" and 3  meg of free memory. Is the file cache causing the problem? Any other ideas?

    When you have the problem, note the exact time: hour, minute, second.   
    These instructions must be carried out as an administrator. If you have only one user account, you are the administrator.
    Launch the Console application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Console in the icon grid.
    The title of the Console window should be All Messages. If it isn't, select
              SYSTEM LOG QUERIES ▹ All Messages
    from the log list on the left. If you don't see that list, select
              View ▹ Show Log List
    from the menu bar at the top of the screen.
    Each message in the log begins with the date and time when it was entered. Scroll back to the time you noted above. Select the messages entered from then until the end of the episode, or until they start to repeat, whichever comes first. Copy the messages to the Clipboard by pressing the key combination command-C. Paste into a reply to this message by pressing command-V.
    The log contains a vast amount of information, almost all of it useless for solving any particular problem. When posting a log extract, be selective. A few dozen lines are almost always more than enough.
    Please don't indiscriminately dump thousands of lines from the log into this discussion.
    Please don't post screenshots of log messages—post the text.
    Some private information, such as your name, may appear in the log. Anonymize before posting.

  • How to change permissions on a raw partition in ZFS file to write in zone

    I created ZFS file system and create a raw partition( size 100m) in it like below.
    // fnzone0 - name of zpool
    global# zfs create -V 100m fnzone0/data0
    global# zfs set reservatiion=100m fnzone0/data0
    zonecfg:zone1>add device
    zonecfg:zone1:device> set match=/dev/zvol/rdsk/fnzone0/data0
    zonecfg:zone1:device>end
    I would like to write to '/dev/zvol/rdsk/fnzone0/data0' from the local zone.
    What permission should I change in the global zone and local zone?
    Additional question:
    Can I export zpool 'fnzone0' to a local zone and create a raw partition like above without createing filesystems?
    Thank you.
    -Yong

    It was not a problem. The raw partition with the soft partition or ZFS filesystem works fine in the local zone.
    Thank you for your help.
    -Yong

  • Available Memory displays 2 devices. Is this right?

    Hi, I'm new to this format, and hope someone can help.  
    I've done a hard reset on my T5 after saving my data to my MAC.  Before adding anything back, I'd like to see if I've got a problem or am good to go.  On the screen that shows battery level and available memory, I'm seeing two devices, one reports 97% and the other 85%.  After doing a hard reset, I expected there be only one empty (but for OS data) device?   What have I done wrong, and more importantly, how do I proceed?
    Post relates to: Tungsten T5

    CLose. The T5 has a built is storage card. Like an SD card built into the device. This shows as separate memory. One is the device itself, the other is this built in storage card. If you inserted a SD card, there would be three devices showing.
    Post relates to: None

  • Zfs cache vs. Physical and swap memory

    On Solaris 10: We are calculating the available physical and swap memories by using these
    @ system calls 'sysconf' and 'swapctl' with appropriate parameters.
    I don'tthink these system calls explicitly take the 'zfs cache' into account.
    Can you please confirm, Or do we have any other command set to include 'zfs cache pool' also.
    regards,
    -ashokM
    Edited by: aMohanty on Sep 8, 2009 3:24 AM

    Not exactly sure what you are asking - Total VM = Real RAM + swap. The ZFS arc (as well as the UFS cache) competes to get RAM, as does running processes and kernel memory allocation. The arc will not add anything to the Total VM amount.

  • Hidden cache files (imovie) - lost 60gb memory - can you help me recover?

    Ok so here is my problem.  Using the Panasonic GH2 for filming and decided to import the .mov files to my external drives via imovie, easy right?  Over the period of some 800gb of imports I slowly lost 60+ gb of drive space that I have not been able to recover and am now in dire need of deleting as I am down to zero drive space on my main drive.
    What I have done:
    Pulled and deleted all imovie cache files (i.e. user/movies/imovie...etc.)
    Deleted a my .plist
    Deleted all user cache files
    Deleted imovie files from iphoto library
    There are probably other items I am leaving out, but I have gone to great lengths to fine this cache of thumbnails or some strange hidden series of files that imovie produces for back up or something.  Need help here. 
    Can someone tell me what other measures I should consider for recovering this lost space???
    Thanks a million!

    EUREKA!!!
    I don't know how old this post is but I hope this will be helpful for anyone who stumbles around here.
    So, I had the same issue with phantom memory being guzzled up by some unknown videos that I could not find and iMovie was the culprit. So with that being said, the short answer that will most probably fix this is to delete your projects. Even if you erased the clips that you used, the program seems to keep the cache and encrypting, etc of every video you made with these projects. For me, I only had 2 projects on the mac and I kept deleting the clips and adding new ones. 1 of them I was using for months and it had 100 GB of data stored within that 1 project!!
    I know that this may be a pain since you lose your format if you make videos regularly but unfortunately, this is the only way that I found to delete this dead space. The better fix would be to know how to get rid of the dead data without deleting the projects. My movies are usually very small and have a simple format so it doesn't bother me much to have to delete my project after I make my clips.
    Another thing, the clips you import to iMovie stay in a semi-hidden area and it keeps ALL your clips there. You can find these clips by going to File - Reveal in Event. You can also go to Reveal in Finder as well but they are the same clips so you only need to delete them from 1 of these 2 areas.
    If this option is grayed out, go to All Events first, select the event(s) and then see if the option is now available.
    I hope this helps!

  • Monitoring ZFS arc cache value and application interaction

    Hello,
    I have a question regarding the interaction between the ZFS ARC cache memory consumption and application memory interactions running on a server. I am running into a situation where I believe the primary enterprise application using an Oracle DB running on the server is not able to access any additional RAM when it requires more memory. I have read ZFS documentation and it is supposed to release ram for applications, but I am unsure if this is happening. How can I test this? I am running a T5120 Solaris 10, 32 GB of ram.
    The primary application documentation says to size the server for 16 GB, it is usually running with 6 GB on a day to day basis. That is 17% of the memory. ZFS ARC cache is always around the 69-70% of the memory (23GB). I need to figure out if I am not seeing additional memory utilisation on the part of the application because it is poorly written and the ARC is not being released when requested. That is my running theory.
    Also, polling the server for data, I found a high rate of page faults/second. The server seams to be running from 350 to 650 PageFaults/second and can spike to 1.8k during periodes of high load.
    Is lowering the maximum value of the ARC the only option? This is suggested when using a DB. I would appreciate any suggestions. This is my first run in with ZFS.
    Page Summary                Pages                MB  %Tot
    Kernel                     319422              2495    8%
    ZFS File Data             2890547             22582   70%
    Anon                       703625              5497   17%
    Exec and libs               28374               221    1%
    Page cache                  35260               275    1%
    Free (cachelist)             9518                74    0%
    Free (freelist)            114959               898    3%
    Total                     4101705             32044
    Physical                  4070897             31803

    From my experience, ZFS arc cache doesn't always release memory when there is contention (theoretically yes).
    I always reduce the ZFS cache to bare minimal if the app data is on a shared storage like SAN or in other words, you don't use JBODs for your app data (be it DB or a file server). If you do use local storage for your app then should give it a reasonable amount of memory for better performance.

  • When I publish my site on one specific page where i've added {tag_pagecontent} I get the error:Some files on the server may be missing or incorrect. Clear browser cache and try again. If the problem persists please contact website author.

    When I publish my site on one specific page where I've added {tag_pagecontent} I get the error:
    'Some files on the server may be missing or incorrect. Clear browser cache and try again. If the problem persists please contact website author.'
    I'm trying to get a blog module going, I've even deleted the html insert bog with the tag in and re-published which then I don't get the error but as a result no blog either. But then I add the tag in again and publish the error comes back. I've used the dev console and it says that my musicians sample.css is out of date but why is it only out of date when I add in html to my muse site?
    HELP!!!! I've searched other threads and to no avail I'm publishing so no direct ftp going on. the only thing I changed in business catalyst was the module stylesheet in order to style the blog. I've tried uploading and replacing all files nothing seems to work. the site is here:
    http://www.musicstudentsforhire.co.uk/musicians-samples.html
    It's only this page as it has the blog on. Also I've noticed when I've re-published occasionally it will show the mobile version on my desktop and not the desktop version??? no idea why that's happening so I've had to turn that off. any explanation on why that is happening would also be much appreciated.

    I haven't received an answer as of yet, I'll post t on here when I do. I de-activated the mobile site because it's my clients site so he needs it to be operational during the day. I hope someone gives me an answer soon.

Maybe you are looking for