BerkeleyDB not cleaning up old db files

Good morning.
We've been noticing a scenario where BerkeleyDB is retaining (not removing) old db files. These files are well outside the largest window for data retention (over a month old, where the longest window for data is 7 days). There should be no active data in these files. As they are starting to take up signifcant disk space, I'd like to investigate possible methods for manually removing them.
Note that modifications have been made to the pruning & cleaner thread settings and they are now keeping up with active data. I'm primarily concerned with removal of these old, inactive files.
As we see it, there's a few options.
1. Manually rm the files which are known to be outside the longest window
2. The old files can't be cleaned up by the cleaning/pruning threads for some reason, but there is a utility which can clean them up which we don't know about?
3. The old files can't be cleaned up by the cleaning/pruning thread, there is no utility, and we actually will need Oracle to investigate.
Any thoughts?
Many thanks!

Good morning.
We've been noticing a scenario where BerkeleyDB is retaining (not removing) old db files. These files are well outside the largest window for data retention (over a month old, where the longest window for data is 7 days). There should be no active data in these files. As they are starting to take up signifcant disk space, I'd like to investigate possible methods for manually removing them.
Note that modifications have been made to the pruning & cleaner thread settings and they are now keeping up with active data. I'm primarily concerned with removal of these old, inactive files.
As we see it, there's a few options.
1. Manually rm the files which are known to be outside the longest window
2. The old files can't be cleaned up by the cleaning/pruning threads for some reason, but there is a utility which can clean them up which we don't know about?
3. The old files can't be cleaned up by the cleaning/pruning thread, there is no utility, and we actually will need Oracle to investigate.
Any thoughts?
Many thanks!

Similar Messages

  • I recently upgraded to a G5 and Logic Pro 8. My previous system was a Power Mac 7200 with Logic Platinum 3.5.3. I can not open the old song files unless they are first saved in Logic 6 or 7. Where do I get a dongle for Logic 7?

    I recently upgraded to a G5 and Logic Pro 8. My previous system was a Power Mac 7200 with Logic Platinum 3.5.3. I can not open the old song files unless they are first saved in Logic 6 or 7. Where do I get a dongle for Logic 7?

    eBay or Craigslist would be the only choice.

  • Cleaning up old FrontPage files

    Am converting over from FP to DW and am starting to clean up
    (delete) old FP files in the site. Folders like Borders and Themes
    and FPClass were the first to go. What else can I just get rid of?
    Also, I notice that there are folders called _vti_cnf that
    show up every so often. What are they and can they also be deleted?
    Thanks
    Tom

    > Am noticing that you are a regular contributor. Thanks.
    No problems, you are welcome.
    >
    > Thanks for the educ. on the FP files. As long as I've
    got you, what about
    > some of the other folders? Maybe the best way to ask
    this question is
    > instead
    > of asking what can be deleted from FP sites, what does
    DW need?
    Dreamweaver doesn't need any specific folders to work on your
    server.
    Nothing like Front Page at all. A host doesn't have to
    'support' DWeaver
    for you to use that particular host (as may be the case if
    you run a FP
    site)
    You create your folder system - containing your files on your
    local machine
    and then upload the folder structure as is to the remote
    site.. the
    important factor is that the folder structure is pretty much
    identical on
    the remote so that your links are not broken.
    Even if you use the DW Template funciton, the template (dwt
    file and the
    Templates folder) do not need to be uploaded.
    > Also, I think I remember that the underscore before a
    folder name means
    > something like it's invisible or something like that.
    When would I want
    > to use an underscore for a folder?
    It is generally not recommended that you beging a folder name
    with an
    underscore or a numeral.
    Nothing wrong with a folder named: images_thumbs for example,
    but I
    wouldn't use _images_thumbs.
    > BTW I noticed the rather bizarre thread that developed
    from your question
    > about pt, em, and px. I put a post in there that tried
    to help that may
    > have been missed.
    Probably was missed in all the 'toing and froing', but you
    learn to live
    with these type of threads ;)
    > I'm sure you're familiar with cssZenGarden. There is a
    wonderful
    > companion book that goes with it.
    I believe you are referring to: The Zen of CSS Design" ??
    I've had it for a while... It was a good read for a once off,
    otherwise I
    find it more of a coffee table book I'm afraid :)
    >One of the chapters is on Text and goes into a pretty
    thorough discussion
    >of em, pt, and px and the tradeoffs (or perhaps more
    importantly, the
    >considerations) when deciding to use each.
    It was a while ago, so I'll go back and refresh my memory
    thanks !
    Nadia
    Adobe� Community Expert : Dreamweaver
    http://www.DreamweaverResources.com
    - CSS Templates|Tutorials
    http://www.csstemplates.com.au
    http://www.perrelink.com.au
    - Web Dev
    http://www.adobe.com/devnet/dreamweaver/css.html
    CSS Tutorials for Dreamweaver

  • Why does the new Quicktime NOT play my old MOV files?

    Hi Folks.
    I'm using the lasted updated Yosemite on a 3-year old iMac.
    Back in my early iMac days (3 years ago), I imported my camcorder's AVCHD files
    into iMove or Final Cut Express and converted them to Quicktime MOV files.
    Turns out they were rendered by Apple or Final Cut into MOV files using the
    Apple Intermediate codec.  I had no choice over this.
    Until I upgraded to Yosemite, I was able to preview any of these movies
    very easily in the Finder.  Simply highlight the movie, press the spacebar,
    and it opens, in a real-time, real-size screen, with a simple play-pause button
    in the progress bar at the bottom.  Never had a problem with any previous
    Mac OS.
    Now when I click on the file in the finder, instead of a movie preview, I get a
    big, silent QT "Mov" icon that just sits there looking silly.
    I double click it to open it up in Quicktime, and it attempts to go through this
    lengthy conversion process, taking at least as long as the movie is in minutes,
    then asking me if I want to save this new "converted" version.
    Fortunately, I have an old version of Quicktime 7 on my Mac, and QT 7 opens it
    and plays it no problem.  No "conversion" necessary.  No cumbersome and
    space-hogging needs to create a "cloned" copy, just so the new, lame version
    of Quicktime can play it.
    What's up, Apple?  AIC was YOUR codec that YOUR SOFTWARE chose to
    transcode into.  Now, your new Quicktime does NOT support this codec?
    And your old version does?  And why might THAT be?
    Really, this is so elementary.  This is not rocket science.  Just like JPG images
    not displaying properly in Mac Mail now.  It begs the question "why" ...?
    I mean, for the elementary preview abilities that always made Mac such a
    friendly computer ... *uh* ... where is that?
    And here we go, wasting hours of time, looking for fixes that should not
    have to be "fixed"...
    Did I miss something?  Or did you?

    Aeclay: here's a couple of ideas.  And an answer to your earlier post.
    Basically two options to work with here:
    Store the files as native AVCHD files... OR
    Convert the files to Quicktime
    I keep two archives of my AVCHD recordings, partly for backup, and partly for Sony's ability to archive nicely in it's own native format on it's PC-friendly utility called "PMB".  (came wtih both my NEX and ALPHA cameras).   I have an old PC that I use for my complete archive; Sony's PMB utility works only on PC's and will do a good job both of archiving, providing a thumbnail database, and re-writing your choice to removable media in it's typical Sony hierarchy.
    If you've only got Mac's, you can still archive your AVCHD recordings; copy them to folders named or organized to your own spec's.   AVCHD is a high-quality compression format, and they'll take up way less disk space than converted Quicktime MOV files.   You can open and play all AVCHD movies quite easily with VLC player.
    The only extra trick to be aware of here is this.  The only reason you would need to preserve the intact "sony" folders (named "AVCHD" / "BMDV" etc) is is you were using Adobe Premiere as a video editor.  Somehow, it needs the hierarchical folder stuff in place to properly index the files.  Not mandatory, but helpful if  you are a Premiere user.  Otherwise, forget the weird "package" folders; just right-click (ctrl-click) on them, choose "view package contents" and MOVE the MTS files out of the Sony hierarchy for permanent storage.  Use VLC player to open and view them.
    From that point on,  you have control over how you manage the files and what intermediate or end-user format you convert them to for your own use.
    I'm not clear on your other question about the files that add the word "converted" on.  Of course Mac will convert to Quicktime MOV files.  Not sure what codec they're using now, likely H.264.  Anyway, don't bother converting.  It'll take up a lot of time and waste a lot of disk space.
    ps. I just found this free utility on the internet.  It's called "MTS CONVERTER". I have not tried it, but it claims to be able to convert all AVCHD files to various useable formats.
    Good luck!  (and happy Valentine's Day!)

  • Can i transfer music from ipod to a new computer i do not have my old computer

    Can i transfer music from ipod to a new computer i do not have my old computer files as it crashed.

    For purchased songs you can plug the iPod into you new computer and use the "File > Transfer Purchases from iPod" feature in iTunes. For music not purchased from the iTunes store you will need a third party program to help. There are a few of them out there, and they are easy to find on Google.

  • FTP help! - "skipped because the old remote file could not be deleted."

    I have been using Dreamweaver to administer a dedicated
    server for a large client running 6 copies of Contribute and an ASP
    CMS on the same server. For some reason, out of the blue with no
    changes on the server side or on my side, Dreamweaver refused to
    put files (any type of file) to the server. Permissions haven't
    changed on the box, all is as it was. Here's a copy of the end of
    the FTP Log. The file default_new.asp that it refers to has never
    existed on the server before now, but the same is happening for all
    files (pre-existing or otherwise). Any help would be appreciated...
    < drwxrwxrwx 1 owner group 0 May 26 2005 YPM
    < -rwxrwxrwx 1 owner group 22206 May 29 16:08 ypm.html
    < -rwxrwxrwx 1 owner group 1939 Sep 17 2004 YPM-home.htm
    < 226 Transfer complete.
    The file "default_new.asp" was skipped because the old remote
    file could not be deleted.

    Apparently you get this because the remote disk you are
    trying to write to is full. Try deleting some files on the server
    and do it again. Otherwise, if it's a hosted account, contact your
    host and ask them to check available disk space on your server.
    This was exactly my problem. Logged on to the remote machine
    using RDC and cleaned out some of the clients archive files.

  • I have a old excel file that does not show hiding cell boxes on my Mac.

    I have a old excel file that has some hiding info. in some of the cell boxes.  I can not see them on my Mac computers.  When I click on the cells to see the hidden info. it does not show up.

    Are you using Mac OSX version of Excel or the Windows version of Excel?  Regardless being specific to Excel, it would be best to ask in the Microsoft Office forums.
    Microsoft Office for Mac forums
    http://www.officeformac.com/productforums/
    Microsoft Office for Windows forums
    http://answers.microsoft.com/en-us/office

  • Empty file not cleaned out by the cleaner

    Another day, another post about cleaner. Let me describe a problem on this sample dataset I have.
    I have a small BDB with the following 4 files
    -rw-rw-r-- 1 apps apps 34M Jul 18 21:58 00000061.jdb
    -rw-rw-r-- 1 apps apps 53K Jul 18 22:00 00000062.jdb
    -rw-rw-r-- 1 apps apps 34M Jul 18 22:00 00000063.jdb
    -rw-rw-r-- 1 apps apps 664K Aug 1 00:22 00000064.jdb
    When I run DBSpace on it, it reports this
    File 0x61: <summary totalCount="1" totalSize="35022741" totalINCount="0" totalINSize="0" totalLNCount="1" totalLNSize="35022741" obsoleteINCount="0" obsoleteLNCount="1" obsoleteLNSize="35022741" obsoleteLNSizeCounted="1"/>
    Recalculated File 0x61: <summary totalCount="1" totalSize="35022741" totalINCount="0" totalINSize="0" totalLNCount="1" totalLNSize="35022741" obsoleteINCount="0" obsoleteLNCount="1" obsoleteLNSize="0" obsoleteLNSizeCounted="0"/><extended-info recalcObosleteINSize="0" recalcObosletedLNSize="35022741"/>
    File 0x62: <summary totalCount="52" totalSize="53253" totalINCount="9" totalINSize="1493" totalLNCount="27" totalLNSize="50211" obsoleteINCount="9" obsoleteLNCount="23" obsoleteLNSize="1556" obsoleteLNSizeCounted="23"/>
    Recalculated File 0x62: <summary totalCount="52" totalSize="53253" totalINCount="9" totalINSize="1493" totalLNCount="27" totalLNSize="50211" obsoleteINCount="9" obsoleteLNCount="23" obsoleteLNSize="0" obsoleteLNSizeCounted="0"/><extended-info recalcObosleteINSize="1493" recalcObosletedLNSize="1556"/>
    File 0x63: <summary totalCount="1" totalSize="35603241" totalINCount="0" totalINSize="0" totalLNCount="1" totalLNSize="35603241" obsoleteINCount="0" obsoleteLNCount="0" obsoleteLNSize="0" obsoleteLNSizeCounted="0"/>
    Recalculated File 0x63: <summary totalCount="1" totalSize="35603241" totalINCount="0" totalINSize="0" totalLNCount="1" totalLNSize="35603241" obsoleteINCount="0" obsoleteLNCount="0" obsoleteLNSize="0" obsoleteLNSizeCounted="0"/><extended-info recalcObosleteINSize="0" recalcObosletedLNSize="0"/>
    File 0x64: <summary totalCount="521" totalSize="689233" totalINCount="115" totalINSize="24425" totalLNCount="165" totalLNSize="646260" obsoleteINCount="107" obsoleteLNCount="79" obsoleteLNSize="5132" obsoleteLNSizeCounted="79"/>
    Recalculated File 0x64: <summary totalCount="521" totalSize="689233" totalINCount="115" totalINSize="24425" totalLNCount="165" totalLNSize="646260" obsoleteINCount="107" obsoleteLNCount="79" obsoleteLNSize="0" obsoleteLNSizeCounted="0"/><extended-info recalcObosleteINSize="22468" recalcObosletedLNSize="5132"/>
    File Size (KB) % Used % Used (recalculated)
    00000061 34201 0 0
    00000062 52 91 91
    00000064 673 93 93
    00000063 34768 100 100
    TOTALS 69695 50 50
    To me this looks like file 61 could be compacted out.
    In a separate program, I try to clean/compact it.
                   props.put("je.log.fileMax", "1000000");
                   props.put("je.cleaner.minUtilization", "90");
                   props.put("je.cleaner.minFileUtilization", "5");
                   props.put("je.cleaner.minAge", "1");
                   props.put("je.cleaner.readSize", "64000000");
                   props.put("je.cleaner.lookAheadCacheSize", "64000");
                   props.put("je.maxMemory", "64000000");
    followed by open and do something like this
    boolean anyCleaned = false;
    while (bdbEnv.cleanLog() > 0) {
    anyCleaned = true;
    if (anyCleaned) {
    CheckpointConfig force = new CheckpointConfig();
    force.setForce(true);
    bdbEnv.checkpoint(force);
    cleanLog() does not indicate that anything can be cleaned.
    If I force it with this property (bad practice), it does clean up and create 2 nicely compacted 30M files.
    props.put("je.cleaner.forceCleanFiles", "0-1000");
    I have the following questions
    1) How can I get it to clean without forcing it? I am okay with extra resources to be used in cleaning it, because we have a set of files produced every hour that we never write to again, so once they are produced, I can spend some time on compacting/cleaning them for good. I can see that we are using 50% more space here, and that would be fine, but I did specify je.cleaner.minFileUtilization to be 5% so empty files should be removed.
    2) I also thought that setting je.log.fileMax would create files that are no more than 10M, but I am getting files that are 33M for some reason. The BDBs were created using same set of parameters.
    We are using 3.3.75 version. There is a newer version, but release notes do not make me think that this is going to be affected.
    P.S. We actually have a support contract, but I thought I'd post here first. We use BDB quite a lot in our large scale distributed system.
    -Emile

    Emile and I resolved this over email and I'd like to let everyone else know what happened, for the record and in case you run into it.
    This is a case where there is only one JE log file that has low utilization and needs cleaning -- all other log files have high utilization. A separate program is run that calls Environment.cleanLog and checkpoint in order to force the cleaning to occur. It closes the environment immediately after performing the cleaning.
    Here's what happened. File 61 is the file that needs cleaning.
    1. When the environment is opened, the built-in log cleaner daemon thread starts. It determines that log cleaning is needed, so it selects file 61 and starts cleaning it.
    2. Then the app calls cleanLog, which returns 0 because there are no files to be cleaned. File 61 is already being cleaned by the daemon thread.
    3. The app very quickly finishes and closes the environment, which aborts any log cleaning that is in progress. The cleaning of file 61 in the daemon thread is aborted.
    This is solved by disabling the cleaner daemon thread during the batch cleaning process. This is done by setting
    je.env.runCleaner=false
    in je.properties. You can also use EnviornmentConfig.ENV_RUN_CLEANER with EnvironmentConfig.setConfigParam.
    We'll add a note to the documentation of the cleanLog method about this.
    Emile, thanks for reporting this and working with me on it.
    --mark                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • Old html files (done on Page Mill) do not open in latest Dreamweaver

    I have a large website with many html pages, all developed on the old Adobe Page Mill application.  When I try to open any of those html pages onto my new Dreamweaver CS5.5 on my new iMac, those html files are not recognized as "openable" (their titles appear in light gray, and clicking on them does not open them.  I can't even click and drag them into the Dreamweaver window.  How can I open those old html files in Dreamweaver?

    May I recommend you to read this article first to get the basics of "Defining a site" in DW.
    <http://www.adobe.com/devnet/dreamweaver/articles/first_website_pt1.html>
    This article will give you a head start in Working with DW.  Page Mill files are simple text file and they should open readily in DW but who knows what has gone with your system that nothing seems to work.
    Good luck.

  • After updating to firefox 5 all my bookmarks are lost, and I can not find an old places.sqlite file. What happened to my bookmarks?

    I updated from Firefox 3 to Firefox 5 (Windows XP), and all my bookmarks are lost. Maybe I should have thought of making a backup but I did not think of this and previously after an update I could find them again. Now I can not find my bookmarks anywhere, all files in my profile have a date and time from the new installation. Is there any chance of finding my bookmarks somewhere else on my computer? If so, where are they and how can I restore them?

    Thanks for the answer. I read the article but it seems that the solution to my problem is not in there. Apart from the lost bookmarks Firefox is working fine, also I can make new bookmarks and delete them without problems. When I restart Firefox I don't loose them.
    Apparently after installing Firefox 5 everything of Firefox 3 was deleted including my profile. The only bookmark .json file I have is from the new installation, which means it does not contain any of my old bookmarks. It now has today's date and time.
    In my profile I have three 'places' files, now all with today's date and time:
    - places.sqlite (10240 kb)
    - places.sqlite-shm (32 kb)
    - places.sqlite-wal (865 kb)
    But even though places.sqlite is large, it apparently does not contain my old information. Or could it? Then how to get to it?

  • Old fh7 files not valid Freehand documents

    Does anyone know why some of my old FH7 files cannot open in either of versions 7, 9 or 11?
    The error message tells me that they are not valid Freehand documents.
    I already have at least a dozen of these, with potentially dozens more.
    As i have no idea whats contained in these, I can't even re-create if necessary.

    Sorry Judy,
    No luck I'm afraid. I've tried opening these old files in a trial
    version of the new Illustrator
    but to no avail. I think you're right when you say they may have been
    saved to a bad disk at some stage.
    I know our storage systems have changed a few times over the years since
    these files were last accessed.
    I will try seeing how far our backup tapes go back before finally giving
    up I think.
    thanks for your suggestions though.
    alan
    Alan Morris
    Petrotech - Cartographer
    Global IT & Technology  - Petrotech
    Phone:  +44 (0) 118 925 5572
    Helpdesk:  +44 (0) 118 929 3883
    E-mail: [email protected]
    Petrotech
    Visit our portal pages
    Please conserve the environment by trying not to print this e-mail.

  • Just upgraded to MacBook Pro running 10.8.4.  Want to convert old movie files to put in Itunes.  Can't upgrade QT player preinstalled, so downloaded QT Player 7 and purchased QTPlayer 7 Pro registration code.  Can not get it to upgrade.  Called Apple 2x.

    Just upgraded to MacBook Pro running 10.8.4.  Want to convert old movie files to put in Itunes.  Can't upgrade QT player preinstalled, so downloaded QT Player 7 and purchased QTPlayer 7 Pro registration code.  Can not get it to upgrade.  Called Apple 2x.  If you have a fix, you can email me direct at [email protected]

    Want to convert old movie files to put in Itunes.
    What does "old movies" mean to you? File type, audio and/or video compression format(s)?
    Can't upgrade QT player preinstalled, so downloaded QT Player 7 and purchased QTPlayer 7 Pro registration code.  Can not get it to upgrade.
    Did you follow the instructions found here?
    If you have a fix, you can email me direct at [email protected]
    To which fix do you refer? Activatng QT 7 Pro or converting the files? Even with QT 7 Pro activated you may need to modify your QT codec component configuration depending on the file type and compression formats used to encode your "old movies." There may be many different problems here with each having one or more "fixes." Please try to be more specific regarding your questions. Converting a muxed VOB MPEG2/AC3 file would be very different different from converting an AVI DivX5/MP3 file depending on which application you are attempting to use.

  • Error message: file was skipped because the old remote file could not be deleted.. Later it will up

    Error message: file was skipped because the old remote file could not be deleted.. Later it will upload after i try a few more times. Not at my size quota for website (I have lots of room) , have toggled Passive FTP ...keeps happening. Is there a way to fix this? Thanks! I am using DW CS5 on Windows 7 platform. This does not happen when I upload otherwise on my computer - only when using DW.
    It also only happens with the html files - it does not happen with my jpeg files

    Do you have notes in your site?  DW's local and remote site synching might be off.   Try clearing your cache.
    http://forums.adobe.com/thread/494811
    Nancy O.

  • Boot up - Error Message: "File System not clean"

    <blockquote>Locked by Moderator as a duplicate/re-post.
    Please continue the discussion in this thread: [tiki-view_forum_thread.php?locale=en-US&comments_parentId=667528&forumId=1]
    Thanks - c</blockquote>
    == Issue
    ==
    I have another kind of problem with Firefox
    == Description
    ==
    At start up displays error message: File System not Clean"
    == start up computer
    ==
    == Troubleshooting information
    ==
    WebOfTrust, AdBlock Plus 1.2, Ubuntu Firefox Modifications 0.7, Firefox Universal Uploader (fireuploader) 0.4.1, Foxytunes 4.0.6
    == Firefox version
    ==
    3.0.19
    == Operating system
    ==
    Linux
    == User Agent
    ==
    Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.19) Gecko/2010040116 Ubuntu/9.04 (jaunty) Firefox/3.0.19 GTB7.0
    == Plugins installed
    ==
    *-The default plugin handles plugin data for mimetypes and extensions that are not specified and facilitates downloading of new plugins.
    *The demo print plugin for unix.
    *Shockwave Flash 10.0 r45
    *DivX Web Player version 1.4.0.233
    *The Totem 2.26.1 plugin handles video and audio streams.

    http://ubuntuforums.org/

  • I have quicken 2000 for mac on an old mac and wish to upgrade to a new laptop running snow leopard.  Quicken 2006 on my new laptop runs, but will not recognize the old data qif files.  What version of quicken for mac will recognize files from 2000?

    I have quicken 2000 for mac on an old mac and wish to upgrade to a new laptop running snow leopard.  Quicken 2006 on my new laptop runs, but will not recognize the old data qif files.  What version of quicken for mac will recognize files from 2000?  Or, is there a special procedure I should be following?

    can't open Quicken 2000 files in classic mode on new MacBook Pro version 10.6.7

Maybe you are looking for