CF9 Directory Watcher randomly skips files

I'm using the directory watcher gateway to log changed files as they are pushed (FTP'd) to a development server.  The gateway occassionally misses random files.  I've seen some older post where this was a problem and was looking to see if the problem still exists on CF9. The onAdd/onUpdate methods simply write the file details to a SQL database.  There is very little logic in the .cfc.
If you FTP 10 files to the server it will tell you 8 changed.  If you push the same 10 again it will in some cases it will reconcile the missing files.  I have the intervalconfigured for 60 seconds.

My problem was not "randomly skipping of files".  In the ColdFusion administrator under Event Gateways/Settings a parameter for "Maximum number of events to queue" is configured to 10 by default.  If you FTP more than 10 files in a timeframe under your configured run interval you will lose events.  My directory watcher was running every 60 seconds and it was common to FTP > 10 files in 60 seconds.  My solution was to increase the "Maximum number of events to queue" and decrease my run interval from 60 to 15.  The combination of these two configuration changes has fixed my missing files problem.

Similar Messages

  • Directory Watcher is Skipping files

    I've noticed the directory watcher is skipping files when a
    number of files appear in the directory in less than a minute. The
    first one or 2 are successfully processed, but the next one(s) are
    skipped.
    The timestamps on the files are like:-
    10:28:32 done
    10:29:06 done
    10:29:14 done
    10:29:17 skipped
    What is causing this and what can I do to fix it?
    Chris

    In article <fc5jdn$pjr$[email protected]>
    "105"<[email protected]> wrote:
    > I've noticed the directory watcher is skipping files
    when a number
    > of files appear in the directory in less than a minute.
    The first one
    > or 2 are successfully processed, but the next one(s) are
    skipped.
    Well, the directory watcher is supplied as an *example* and
    is not
    really intended to be production-quality code. The source is
    supplied
    so you are free to modify it yourself as needed.
    Sean A Corfield -- (904) 302-SEAN
    An Architect's View --
    http://corfield.org/
    cf.Objective() 2008
    Early May, near Minneapolis, MN
    The world's ONLY enterprise engineering conference for
    ColdFusion
    http://cfobjective.com/

  • Time Machine skipping files and folders

    Running OS X 10.10.2 on a Early 2009 Mac Pro. System installed on a 256 GB solid state drive. 10 GB of memory.
    I'm having a problem with Time Machine where it's not backing up some of my files and folders. There doesn't seem to be much rhyme or reason to it, but it includes very, very important things like the parent directory for projects I'm working on, arbitrary hash directories in some git repositories, an assortment of emails, Messages attachments, random preferences files, and somehow the entire contents of my Pictures folder. And probably more -- I haven't checked everything.
    I've recently forced Time Machine to do a full traversal when it made a recent backup (and confirmed that it was a full traversal by looking at backupd's output in Console.app), but these files are still missing.
    Does anyone have any suggestions for what I can do to fix Time Machine? I just want it to do a full backup, not skipping anything.
    As a last ditch effort I could blow away my Time Machine drive and start from scratch, but I really, *really* don't want to do that because it contains several months worth of backups, and I occasionally do need to go back and get older versions of files.

    It is a nasty bug of OSX 10.9 and 10.10 . Some workaround is described here: http://apple.stackexchange.com/questions/170219/time-machine-is-skipping-files-a nd-folders-how-to-fix/170336#170336 by Pete.

  • How to read a mixed text and binary random-access file?

    I have a PDF file which I want to decode. The format is a mixture of binary data and text. What I need is to position the file to a particular position, and then to read from that point as a stream either a set of binary bytes or straight ASCII text. I can't see how to do this (if in fact it's possible).
    I can open the file as a SeekableByteChannel and position it, but opening a stream repositions the file to the beginning - just what I don't want.
    Is there any way of opening a stream from part-way through a file?

    I think that I gave this topic a rather misleading title. What it really should be is "How to turn a random access file into a stream"?
    I realise that I can open an InputStream and skip the relevant number of characters - but this is highly inefficient on a large file where I will skipping about within the file. I need a stream so that I can apply other stream functions to it - buffering in memory will I suspect be too big.

  • Directory watch on another server

    OK, we have a weird situation. I am in an environment where
    we have ColdFusion MX 7 on our development server but CF 5 on our
    production servers. I have developed a directory watcher solution
    to automate one of my processes but it will be at least 6 months
    before we have converted our nearly 100 apps to MX. Can I use my
    development server running MX to watch a directory on another
    server? Perhaps using a UNC path in the config file?

    Hi,
    ups - forgotten this one. The running Oracle process does not have access privileges for mapped network drives by default. So you need to
    setup the Oracle service in a manner that the process can "see" the mapped network drives .. That is windows-specific ...
    Maybe these articles help ...
    http://asktom.oracle.com/pls/asktom/f?p=100:11:4352309546273981::::P11_QUESTION_ID:241814624807
    http://www.dbforums.com/oracle/983402-utl_file-network-copy-problem.html
    Does this help ..?
    Best regards
    -Carsten

  • Why is bridge cs4 skipping files when batch renaming images?

    When batch renaming in bridge, I select all the files and then start with the first image to rename them. Over the last few months, it is randomly skipping images. It will also jump the number that image should have gotten, so typically we can manually go through and rename the file so it will line up properly.
    Just wondering why this is happening all of the sudden when it worked perfectly for years!

    Sorry Patrick, Did not see the previews before, only saw the thread via
    email and they don't show the samples you provide.
    After seeing those files it looks definitely like corrupted images. I cannot
    imagine Bridge to cause this. Rereading your post, it more looks the result
    of a bad functioning write/read process on the external HD or a bad USB
    cable.
    Assuming you have back up could you test this on either an other HD or a
    DVD. Just copy the files again to those devices and retry. That would proof
    the fault lies with the external HD.
    Could you report back on that?
    Thanks for your tips. I tried, BUT didnt solve my problem.
    Have you seen how the pictures are distracted ?
    They seem hav gotten some kind of alien-verystrange-crazy-adjusments

  • Randomly skips/fails to play some samples during playback?

    Randomly skips/fails to play some samples during playback?

    You're right that was foolish let me clarify.
    Raising the I/O buffer thing is a good idea, i've tried that already though and no joy
    BASICALLY i've had this problem with a couple of tracks, ones which i have worked on the longest and probably the ones with the most effect plugins and tracks used. Seemingly at random during playback some of the samples dont play (and some even stop playing halfway through the sample). If the regions are bounced, the resulting wav file visibly splits the original sound where the computer 'decided' to stop/restart playing the sample. Again, i haven't found a pattern: - at one point a four bar loop with three tracks solo'd would play all the tracks perfectly during playback for a few seconds, then suddenly switch to only playing one track, then switch back after another few seconds.
    Weird.
    I think it may be related to previous experience which i have had with the Space Designer and Echo effects, where the echo or reverb sound itself cuts out halfway through the sound/after a seemingly random amount of time (and then cuts back in).
    I've seen this reverb and effect problem on more than one computer, but the original problem with the track playback is, in my experience, unique to my system.
    The computer i'm using is not old or at all running out of memory (although i realise this does not exempt it from being the cause of the problem)
    Anyway this has been trolling me for weeks and its driving me mad
    Thanks
    OP

  • How to remove/skip file header

    Hi,
    How remove or skip file header in java.
    Thanks in advance
    suresh
    [email protected]

    To remove it you must rewrite the entire file, leaving out the header.
    To skip it depends on what the file format is.
    If it's text, and the header is a line by itself, when you read the header line ignore it.
    If it's text and the header is part of a line, read the line into a string or stringbuffer and then extract the non-header information.
    If it's any other format, you need to be able to identify the header location and use a method that's valid for the data to ignore the header data.
    If the file format allows - ie, fixed header location and fixed-length header, random access methods can update the file in place without processing the rest of the file.

  • Backup skips files

    Hi
    I have a strange error with my Time Machine backup.
    The backup is skipping newly created files.
    The only way I can get the backup to include the new files is to go in to the very top level "Macintosh HD" or other directory and change a file so that the #changed" date is changed at the top level.
    Sometimes that does not help if files are very deep in the structure i suspect ...
    I did reinstalled the system and started over the time machine backup. Things was going fine for a couple of days. But soon started to skip files again.
    Sometimes a restart does help. And sometimes not.
    I have also tried "safe reboot" and that helped.
    But the problems always comes back after some time.
    What can cause this kind of trouble?
    Could it be that the user account is corrupted?
    I have a test account that seems to be backed up ok. But I have not tested for very long.
    Could it be the actual hard drive? I have one of the Imacs with Seagate drives that is part of exchange program.
    I don't get any error messages or anything.
    Any help would be apreciated.
    Regards
    olle

    If you use the third-party application "Dropbox," you may see files in the Finder that are not present locally, but are actually on a network server. Those files won't be backed up and won't appear in Time Machine, even though they show in a Finder window. If the files in question are in a Dropbox folder, disable the software or refer to its developer for support.
    Continue only if you've ruled out Dropbox or any similar product as a possible cause of the issue.
    Time Machine uses the modification times of folders to determine whether their contents need to be scanned for changes made since the time of the last snapshot. For some reason, that criterion occasionally fails, and TM doesn’t scan folders with contents that have changed. You may be able to get backups to resume by updating the modification times of all your folders.
    Important: This procedure will change the modification times of all folders on the startup volume. It won’t affect anything that’s not a folder, and it won’t change your existing backups at all. If you have a reason to want to keep the modification times of folders as they are, STOP.
    Before proceeding, you must have a current backup of all data. Since your existing Time Machine backups may not be current, you’ll have to back up in some other way; for example, by starting a new TM backup set on another external drive. It’s a good idea to do this anyway, as you always need more than one backup, even if everything is working perfectly.
    Triple-click anywhere in the line below to select it:
    sudo find / -xdev -type d -exec touch {} \;
    Copy the selected text to the Clipboard (command-C).
    Launch the Terminal application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Terminal in the icon grid.
    Paste into the Terminal window (command-V). You'll be prompted for your login password. Nothing will be displayed when you type it. If you don’t have a login password, you’ll need to set one before you can run the command. You may get a one-time warning not to screw up. Confirm. You don't need to post the warning. If you see a message that your username "is not in the sudoers file," then you're not logged in as an administrator.
    The command may take a noticeable amount of time to run. Wait for a new line ending in a dollar sign (“$”) to appear. You can then quit Terminal.
    The next snapshot will take longer than usual, because all folders will be scanned for changes. When it’s complete, check the results to see how much data has been backed up.
    This procedure will only affect the backups of your startup volume. If you back up other source volumes with Time Machine and are having the same problem with those, you’ll need to take additional steps.

  • Cp: skipping file x' as it was replaced while being copied

    Sorry if this has been asked before but:
    While copying files from another server (cifs) I get the following error:
    cp: skipping file `xxxxxxx', as it was replaced while being copied
    dmesg says:
    CIFS VFS: Autodisabling the use of server inode numbers on \\192.168.xx.xx\xxxx. This server doesn't seem to support them properly. Hardlinks will not be recognized on this mount. Consider mounting with the "noserverino" option to silence this message.
    I am unable to copy any files across and if i manage to they are corrupted.
    I have mounted the server as such without luck
    mount -t cifs //192.168.xx.xx/directory /mnt/floppy/ -o username=xxxxxxxx,password=xxxxxxxxxx,noserverino
    Any ideas?
    Regards,
    Mike.
    Last edited by DrMikeDuke (2010-08-04 18:58:02)

    An "other" that large usually indicates that the "other" includes corrupted files.  Usually restoring from backup eliminated the corrupted files. However, sometimes restoring to factory settings/new iPod is required.
    To restore from backup see:
    iOS: How to back up
    To restore to factory settings/new iPod see:
    iTunes: Restoring iOS software

  • ITunes still random skipping

    Since Apple has locked the original "Random Skipping" thread I'll start a new one. I tried their fix and it does not work. When I responded that it still did not work I received a message asking me to verify that my computer meets the minimum requirements. I have an HP dv5000 with 2GB and an Intel T2500 Dual Core processor running at 2.00 GHz. Obviously my computer meets the iTunes minimum requirements.

    rcb17 - not sure about purchased videos as I haven't purchased any. I use it for video clips on my digi camera (.mov) and pretty much anything else. Its free so its got to be worth a try.
    MetalMilitia606x - Nice idea but I'm struggling to get this to work as there a format clash. My itunes tracks show as M4a files and WMP doesn't seem to like them. I could convert them but given I've got 28gb of music I'd rather not. Seems more of a workaround than a solution.
    shopson - Think this is the way to go but I'm going to contact the retailer I got the ipod from at Christmas and see how I stand for a refund. I accept the ipod is not faulty but given that it can't be used in the way it was designed owing to what would appear to be a fault in the manufacturers related product, then I think theres probably a case there. I've given the manufacturer an opportunity to address this and they clearly aren't interested. What else can I do.
    (Cue the sound of another lock being applied imminently)
    Windows XP
    Windows XP
      Windows XP  

  • HT1349 iTunes randomly skips hlaf a song in the middle of playing them, how do I change this?

    While playing a song, iTunes randomly skips to the next song.This only happens with cirtian songs and I'm using a pc if that makes a difference. Is there a setting somewhere where I can turn this action off? This does not happen with my other computer.
    Can someone explain why this is happening and how I can it to stop doing that? Thanks

    Now, is it synced via wireless or USB?
    When I upgraded my 4 to iOS 7, I had that very problem. The phone said all my music was on it, but when I tapped on a song, it would show the icon as though it was playing and after a couple if seconds, it would skip to the next song.
    Here's what I did: Reconnect and do another sync. Or, back-up your phone, do a restore and then trying syncing your files again.
    I hope this helps

  • ITunes Randomly Skipping to Next Track

    Just upgraded to the latest iTunes (9.0.3), and every single one of my songs skips.
    Mostly happening around the 10 second mark, but it has been completely random also. The song displays the full length, but will randomly skip to the next track. I have been able to drag to anywhere in any song and have it play, but sometime it will skip randomly after that.
    I have never had this issue before, and have not found a solution. After exhaustive searching, I have found that this was a bug in iTunes 7, especially for Windows. Since neither of these things is true for me, I am very confused.
    Nobody has yet provided a functional solution to this ridiculous problem, and other threads of this type have been locked.
    I would like somebody to either give me a working solution, or for Apple to admit that it is a problem and release a patch, instead of locking threads and pretending it doesn't happen.
    -- Dakota

    Hi Dakota--
    This is not a universal problem. For example, my iTunes will play for hours and hours and it will never skip.
    I noticed in some posts you made to the other, already answered, thread that your iTunes library is on an external drive. And that you've had some problems with the files where you get error -36, which is a disk I/O error.
    That could be caused by a problem with the external drive or the FireWire cable. First thing I would do is try a different FireWire cable. Also make sure the cable is seated firmly in both the computer and the drive.
    If that doesn't help, post back and I'll help you see if we can figure out if there's a problem with the external drive.
    charlie

  • Is the directory watcher multi-threaded once it calls the cfc?

    the docs say there's a single thread that watches the directory.  But say for example it finds 3 files and calls the cfc.  At that point do all 3 files run one at a time on a single thread in the order they came in, or do they run at the same time on multi-threads?

    I think I understood your questions. There were more than one, some implicit. Here are my answers:
    ColdFusion runs the directory-watcher in a single thread.
    During the execution of the same thread, ColdFusion detects whether of not a file has, or any number of files have, been added, deleted or changed.
    When ColdFusion calls the CFC, it does so in that same single thread. My guess is that any file add-events, delete-events and change-events are queued and handled one after the other.

  • Remote Directory Watcher

    Hi!
    I have to implement a directory watcher, the directory being on a different remote server.
    I found [this solution|http://twit88.com/blog/2007/10/02/develop-a-java-file-watcher/] (http://twit88.com/blog/2007/10/02/develop-a-java-file-watcher/) and was wondering if the directory declaration using the java.io.File class would accept, and if so how, a remote pathname?
    If not, would there be another solution?
    Thx.

    If you're on a Windows machine and you're trying to access shared folders, then using the usual [UNC syntac|http://en.wikipedia.org/wiki/Path_(computing)#Uniform_Naming_Convention] for Windows will work with File objects i.e. you can create a new File() for \\myServerName\mySharedFolder
    But keep in mind that this works because Windows handles the access to that folder, not Java. So if you're prompted for a username/password when you try to access the share in Windows Explorer, it'll most probably not work from within your Java app. And like I mentioned earlier, this will not work for non-Windows systems. You could give jCIFS a shot if you want to access Samba shares (this is what normal Windows shares also use) from any platform.
    On a related note, keep in mind that Windows maintains a separate creation timestamp for files. But Java only lets you read the lastModified timestamp. Consider that I create a file at 4 PM (creation time) and then edit it at 5 PM (last modified). If I then make a copy of this file at 6 PM, this copy will have it's creation time set to 6 PM, but it'll have its last modified time set to 5 PM, the modified time of the original. Makes sense when you look it one way, but it could trip you up (like it did me :) ). If you must have the creation time instead of the last modified time, you can check out FileTimes by Roedy Green (of Canadian Mind Products fame) which uses JNI to get it.

Maybe you are looking for