Deleting Old Scratch Files Immediately

I've got QMaster working OK with Compressor so far. However, I had started a very large batch render on a Friday, only to come back to find the scratch disk full, with some files done and some not done. After investigating, I found out that the scratch disk (170GB free when I left) was full, and that none of the files were cleaned up after the successful jobs were finished, leaving a bunch of useless files on the drive, and causing the remaining files in the batch to die. I've got about 750GB of video to compress and send to a client, and I'd rather not have to do it one small batch at a time (24GB largest single file).
So, since this is not a matter of deleting files that are 1 day old (the lowest setting in the QMaster CP AFAIK), is there an easy way to clean out files that are no longer needed after a successful completion?
(Send a e-mail message on completion that will trigger a shell script? I can do that, but I'd really rather not have to, especially since the computers in the cluster are not my department's machines.)
p.s. I'd love to be able to avoid QMaster copying the originals to the scratch drive as well, say by sharing the volume, but that doesn't seem avoidable, and since it's automated, I'll live with it

You can try moving your cluster storage directory to a volume with more space. Where is your destination for the output files? The only time I see files in the cluster storage directory is when a batch failed. Running out of disk space would definitely cause a failure.

Similar Messages

  • HT4007 I have just transferred all my raw, jpeg & tiff files into LR4 and using to opportunity to delete old raw files to free up disc space. How can i completely remove a raw file from my msc disc??

    I have just transferred all my raw, jpeg & tiff files into LR4 and using the  opportunity to delete old raw files to free up disc space. How can i completely remove a raw file from my mac disc??

    I'd be careful here: LR references files. It can copy them, like from an SD card to your hard drive, but it doesn't necessarily make duplicates. So when you say you "transferred" those files "into" LR it just means you referenced existing files. And if you delete those they're gone, unless you've made copies. LR does not import files by copying them into a managed library like Aperture does.

  • Ola Hallengren maintenance solution TSQL script not deleting old backup files from my local SQL server

    I have looked on Ola's site (https://ola.hallengren.com/frequently-asked-questions.html) and I did see this:
    DatabaseBackup is not deleting old backup files. What could the problem be?
    Verify that the SQL Server and SQL Server Agent service accounts have full control of the backup directory.
    If that directory is a network share, verify that the SQL Server and SQL Server Agent service accounts have full control of the network share.
    If you are using a proxy account, verify that the account is a member of the sysadmin server role and that it has full control of the backup directory and network share.
    Verify that the file is not locked in the file system; for example, a backup or antivirus software could be locking the file.
    DatabaseBackup has been designed not to delete transaction log backups that are newer than the most recent full or differential backup. This could explain why transaction log backups are not being deleted.
    I followed these instructions and then I right clicked the "sp_delete_backuphistory" job under "SQL Server Agent > Jobs" folder and clicked the "Start job at step ..." option. The job successfully ran, but my .bak backup
    files were still on located on my separate drive partition I use specifically for these backups. 
    The SQL Server and the SQL Server Agent are both using the same AD account. 
    Would any of you SQL gurus out there know how to resolve this?
    Thank you 

    The sp_delete_backuphistory job only deletes the historical info from the backup & restore tables in the msdb database. It does not do anything to the files on disk.
    https://msdn.microsoft.com/en-us/library/ms188328.aspx
    The code to actually purge the backup files from disk is inside the DatabaseBackup stored procedure. It is controlled by using the @CleanupTime parameter for that stored proc. Verify the value for that parameter is low enough to delete your files on disk. The
    value is in hours, and I believe the default is 48 hours. The SQL agent job name usually starts with "DatabaseBackup...".

  • Deleting old flat files inside a SSIS package - SSIS 2005

    Hi,
    after each flat file import, I need to move the acquired file into an history folder and deleting old files of 1 week ago.
    How can I cancel these files, acting inside my SSIS 2005 pckg?
    Many thanks

    While in foreach loop, after a successful import just move the file with the File System Task. Deleting old files is a little trickier, you can also loop thru the files and delete those older than based on name (if the date in the name of the file) or use
    File Properties Task to get file's age to a variable and then use a precedence constraint to decide on deleting or not
    conditionally.
    Your question is general. Many devs did this before, just Bing/Google examples out.
    Arthur My Blog

  • Accidently deleted capture scratch files

    Hello All,
    In my effort to be tidy, and not understanding the FCP system, I accidently deleted Capture Scratch footage. Now I have clips with the red line through them, and "reconnect media" does nothing. Any hope, or just the school of hard knocks?
    Thanks.
    DG

    DG
    I think you'll not reuse a tape in your life again, right?
    Now you can try with some kind of application to recover deleted files from your system. Hal pointed to one application in this thread:
    http://discussions.apple.com/thread.jspa?threadID=1281615
    Hope that helps !
      Alberto

  • Trouble burning cd - delete old/temp files?

    Hi there - I am having issues burning cds. Burning stops mid way due to an unknown error. I thought in the past, I rectified this by deleting old files, but cannot remember where to find them. Any suggestions on this? I am using the most recent version of iTunes, and have successfully run the cd burner diagnostics, with successful test results. Thanks!

    Yes...in iTunes and I also tried burning via Sonic, and got the same result

  • My Macbook Pro won't auto delete old TM files

    My wife's Macbook pro won't auto delete old files on the TM disc. I think it has to do with using a time capsule. I'd rather stop that and just use the WD Passport but how do I do that?

    Hi..
    My power cord has been trying to go out on me for a few weeks and tonight it just went capooey
    If there's a power issue on your Mac, it's doubtful uninstalling and reinstalling software will make any difference.
    Try Troubleshooting MagSafe adapters
    If the adapter is ok, try Resetting the System Management Controller (SMC)

  • Delete old application files  after update?

    I downloaded the 3.4.1 update and want to delete the 3.4 application files to free up more space on my laptop's hard drive.  Is this OK?
    Also, what aboout deleting older versions of catalogs?  Thanks.

    When you update, this removes the previous application files and replaces them with new ones. It will leave an empty folder.
    If you no longer use a particular catalog you can delete it, but make sure you really don't want the catalog any more. Installing an update doesn't change the catalog only the application.
    The only time a new catalog is created by LR (rather than by yourself), is when upgrading (rather than updating) from LR 2 to 3 and in this case LR creates a new catalog from your old one, leaving the old one intact. Once you are happy with everything you can remove the LR 2 catalog. Personally I don't. I kept the LR 1 catalog until LR 3 came out and will keep the LR 2 catalog until LR 4 comes out, but I am cautious like that and have loads of hard drives, so space isn't a problem. I just move the old catalog to a backup location...you never know what is going to happen and I may for some completely unknown reason need it some day..

  • How we will delete old recording files in ES2  ?.

    Hi ,
    The error ::
    2010-02-26 16:25:16,811 ERROR [STDERR] Feb 26, 2010 4:25:16 PM com.adobe.idp.auditworkflow.dsc.service.storage.ProcessRecordingStorageImpl manageRecordingFileSizes
    WARNING: deleting oldest recording(s) due to space limitation.
    I  am seeing above error many times in log file. Then googled i got  http://forums.adobe.com/thread/506674?tstart=0 thread. But  i know this one.
    Is there any page in adminui  ,  where i can delete all old recording  at a shot.
    Is there any  way  where i can improve  buffer size of server ?   Becuase some times  i am getting error like below :
    2010-02-26 16:12:12,558 WARN  [com.adobe.idp.dsc.workmanager.workload.policy.MemoryPolicy] Memory threshold exceeded: maximum limit 95.0, current value 106.0
    2010-02-26 16:12:12,559 WARN  [com.adobe.idp.dsc.workmanager.workload.policy.WorkPolicyEvaluationBackgroundTask] Policies violated for statistics on 'adobejb_server1:wm_default'. Cause: com.adobe.idp.dsc.workmanager.workload.policy.WorkPolicyViolationException: Work policy violated. Will attempt to recover in 60000 ms
    Please help me out !!

    Here's the help topic:
    http://help.adobe.com/en_US/livecycle/9.0/workbenchHelp/000375.html#1548929
    Here's how to configure the number of recordings to keep:
    http://help.adobe.com/en_US/livecycle/9.0/workbenchHelp/001482.html#1608026
    scott

  • How to delete old stat files automatically

    Hi folks,
    I noticed that the stat files generated in the /usr/sap/<SID>D*/data are huge and the file system gets full faster.
    Is there any way to delete those old files and decrease the stat files size?
    I found the OSS note 6833 but the instructions to check in the ST03, I can not find in my release.
    thanks,
    Má

    Hi Marilia,
    Please share your release first.Meanwhile you can go with below steps:
    1. Run Tranx ST03n -->Collector and Performance DB
    2. Choose Statistics Records and Files ---> Revelant Parameters --> Double click on your Hostname .
    Here just ensure stat_level = 1 is set (Statistical records are active)
    3. Check parameter stat/max_files (Max. no. of stat files to be kept) and its value as default value is 48,if this value is on higher side than you can go with SAP default .
    4.stat/as_max_files with default value 48  (Max. no. of appl. stat files to be kept)
    You can set these parameters according to your needs.
    Hope this will help you.
    Regards,
    Gaurav

  • Deleting old backup files

    I backup to an external HD weekly using Backup (the little umbrella.) This 250 GB HD is almost filled. Can I delete older backups to make more room?

    I assume it would depend on how you use backups. If you need to have old versions of your files available to retrieve, then you might want to burn some older backups to dvd before deleting them. I just need one daily and one weekly backup , so I overwrite the backup each time. In case of hardware failure or corruption, I can always retrieve a file from either one day or one week (at most) prior. Files which need to be permanently archived go onto DVD. In that scenario there's no need for multiple backups of the same files at all.

  • Delete old log files

    Hi,
    on FSCM91, tools 8.52. on Win 2008
    We have several systems on several servers.
    All logs (tuxedo, as and PS start logs) are on a net work map drive.
    \\fileserver\log\system.......
    I want to run a batch regularly to delete the file older than n days.
    forfiles command does not work with \\unc.
    Any other solution ?
    Thank you.

    Is the fileshare on another server or a storage device? If it's on another server, you could just run your clean up script from there rather than the PeopleSoft server. Or alternatively if you don't have access or it's a storage device try using a utility rather than script it yourself. Something like the following would be easy to maintain:
    ROBOCOPY \\fileserver\SourceFolder \\fileserver\deleteFolder /move /minage:14
    then you could zip/archive those files
    then delete everything in the deleteFolder
    For more details on robocopy see http://social.technet.microsoft.com/wiki/contents/articles/1073.robocopy-and-a-few-examples.aspx
    It has a ton of options, (exclusions, logging, UNC support, recursive, etc) and can be used for a ton of stuff including resynching only changed files for $PS_HOME directories like sqr on refreshes.
    You could also just do a net use and map the share as a drive letter; then do your forfiles against the drive letter. But I felt like sharing the functionality of robocopy :)

  • HT5925 deleting old backup files from icloud ?

    How can we view and delete backup files on icloud?

    You can do that e.g. on your iOS device in "Settings > iCloud > Storage & Backup > Manage Storage"
    or on your Mac: System Preferences > iCloud > Manage... .

  • Deleting Old iTunes files w/ lost file locations

    Does anyone know of a quick efficient way to take you entire iTunes library, identify which song files "original file location cannot be found", and then remove them.
    I attempted to restore my library from a iPod I backed up, but no dice. Now I'm left with a ton of songs I can't play because the directory location is lost or they have that obnoxious by them. I really don't want to sort through the whole god forsaken library manually to figure out which ones are playable and which ones are not.
    Grazi,

    Go to the Apple Developer's site and download the iTunes COM for Windows SDK zip file. When you unzip it there is a java script program called RemoveDeadTracks.js running this will do what you want

  • Automatic deletion of old archive files and trace files

    I've got a database that must run 24x7 without being monitored by a DBA.
    Two questions:
    1. Is it possible to get Oracle to automatically delete and uncatalog old archive files?
    2. Is it possible to get Oracle to automatically delete old trace files located in udump and bdump?
    Thanks in advance

    1. When you say 'uncatalog old archives’ do you mean that your database is backed up using RMAN and a catalog? If this is the case then RMAN can delete the backed up archives for you. Just add 'delete input' to the end of the 'backup archive log...' line in your backup script.
    2. Oracle can't delete the trace files. Best way is to write a script that delete all files older than X days and schedule it to run every night.

Maybe you are looking for