Cluster Mini Render Farm

I'm terrible at server things, I wanted to start with that and be rather upfront about it.  But that's why I'm asking out to you in the community.  I'm a video editor and in Final Cut Pro it takes literally forever sometimes for things to render when adding effects.  Unfortuantly rather than buying a Mac Pro, I instead bought a MacBook Pro.  Which don't get me wrong I love wholeheartedly, except the graphics card inside just is embarrassing, plus with how quickly the processors heat up it's hard for me to work constantly and quickly.  So I was curious, I asked out in the general communities last week about putting some minis together and using them as a small "render farm" and what I got back was some more or less maybes... so before I continue on I thought that I should pose the question to those that are basically lord in the mac tech services for help or rather "how to".  Because finding out just how much work that would have to go in it would really set the tone of whether or not I should do it. 
I was thinking just purchasing two of the Mac Mini Servers (Quad Cores each) and using them. 
So finally, is it indeed possible to even use two minis to process the graphical outputs of Final Cut Pro X that I'm running?  And if so, just how do I go about doing such a project?
Thanks so much!

I think your best bet is simply to schedule it yourself. Set up a simple automater script that reads from a folder and performs the conversion. Simply drop a bunch of files into the watch folder and let it run. You can experiment with how many concurrent processes you can run on each machine before it bogs down.
Don't expect much out of the G3's.

Similar Messages

  • Building a "render farm"

    Okay, so after reading the threads here I have qmaster distributing the tasks between 2 G5 desktop machines and it's going much faster than with one. (it seems like its about 3x faster)
    Now I want to build a mini render farm to speed things up even more.
    My question is this. Do I NEED to use OSX servers and cluster nodes? The engineer at Apple said I would be better off but I can buy more dual 2ghz G5 desktops with my budget than servers and it would seem they do the same jobs.
    I could string 4-5 new G5's together as a start or 3-4 servers. Not to mention I would have to learn the server OS and everything before getting started.
    Any advice is appreciated

    PowerMacs are faster than Xserves. Just not as convienent space wise. You don't need xserves. Any mac will work, just don't have a mix of really slow machines and really fast, cause they slow machines will really slow things down. Let me qualify that: With compressor slow machines will really slow things down. Frame renderers like Shake and Maya would be fine when you adjust the segment size.
    Server OS is not needed. In fact, there is no difference between server and regular OS X, just the admin tools that come with server. You can run all the "server" services on the consumer version.

  • How to make a render farm with FCP X / Compressor??

    Wondering how to setup a min render farm with FCP X on three machines. Played around with setting in Compressor but never see any machine available when I go to render on each machine?

    Ok, so I'm using the wrong terminology.
    I want to have all my machines transcode for me, is this possible, yes or no and how do I set it up. I've buggered around with all the settings in the link above but I'd get anything to show up?
    Also I believe that compressor needs to copy the entire file to be rendered over the network for the other machine to work on it - is this correct ? I'm on wifi guess I could connect machines together via ethernet.
    I'm looking at 4x time to do a simple render on prores proxy material and when I have to do it on a 2 hour wedding video I'll be looking for the nearest bridge to jump off!

  • Question on potential configurations for resource cluster as virtual machine server / beowulf / render farm

    I am looking for a starting point on where to focus my efforts in researching a desired configuration.  Of course anyone who spends anytime researching in forums knows that one thing that people hate is for people
    to ask questions that can be easily answered with a simple Google search, so let me start by saying I have done many hours of research on this already.  The problem I am having is that although there is a huge amount of information out there on what I
    am looking to do, I don't believe many people have attempted this on as small of a scale as a single user system.  Also, the amount of routes to go down seems endless, which for me so far has led to many hours of wasted trial and error.  So keep
    in mind that I am not so much looking for a handout on answers but rather a more narrowed path of searching and researching.
    What I am looking to do is take the current equipment that I have and consolidate it into a 9-12U server rack using mounted 2 or 3U atx cases so that I can have a more organized, space saving setup.  That is the
    easy part, what I have been looking into though is the combining of cores and processing power to make a "super computer" yet I use this term very loosely.  From what I have read, the closest thing I can compare the idea in my head to is referred
    to as a Beowulf Cluster, or a Render farm but I believe as the name suggests that this is more dedicated to a single task of rendering.  I like the idea of a virtual machine server where I would never actually locally use this machine but rather set up
    many virtual machines that I can remote into.  I started to compile a ProxMox Server, and this was the right idea, however when running a VM, that VM is constrained to the hardware resources of the single node that it is assigned to.  If there is
    a way to be able to have a machine that would utilize the 20 some odd cores that I would have in the cluster, along with the 40-50 gigs of ram, well that would be ideal but sounds too good to be possible. Also, ProxMox isnt quite there in compatibility for
    a home/home office user. I understand that the programs that are used have to be written in a way where the architecture allows for such, but if it could even be used for speeding up my render time with Adobe and Autodesk (which I know do have such functionality)
    that would be wonderful. 
    So without writing a whole book I am looking for suggestions on how to proceed.  Can I literally build a "super computer" that is not really that super... more mediocre super... or am I better off just consolidating the hardware but not the
    OS's and programs.   Also, I do currently use three or four different distros of Linux, mostly for ethical hacking and security type work like pen testing.  One thing I have never been a fan of though is dual booting.   Perhaps investing
    in a hot-swap HDD chassis that I could load all the different OS's on where I could just pop in whatever OS I am looking to use.  As you can see I am far from knowing where to spend my efforts in research.... THANK YOu for ANY help.
    I was recently suggested Microsoft HPC Pack as a platform?  Anything?
    Here is what I currently have:
    these are all fully built)
    Intel i5 3.7 quad core
    Nvidia (ASUS) GTX-760
    16 Gb DDR3 @ 1600 Corsair
    ASUS Sabertooth Z87 MoBo
    Autodesk - Inventor, Revit, 3Ds Max, Maya, Fusion 360, Flow, etc.
    Adobe - PhotoShop, After Effects, Dreamweaver, Illustrator, etc.
    Basically as you can see this is used for my work in 3d modeling, rendering, and drafting along with 3D printing.
    Sys. #2
    AMD 4.7-5.0 8 Core
    Nvidia GTX 760 (Same as sys #1)
    16 Gb DDR3 @ 2400 Mhz
    ASUS Crosshair V Formula Z
    Various programs for programming, app development, gaming, etc.  (This is my daily driver)
    Sys #3
    AMD 4.5-4.7 8 core
    16 Gb DDR3 @ 1600 Mhz
    Asus Crosshair V Formula Z MoBo
    Not currently using this one but is fully functional.
    Sys #4
    HP built i5 3.4 quad core
    12 Gb DDR3 @ 1600
    Nothing Special - this is the one I was using for school work but being that school and programming became one and the same I have all but abandoned it.
    THANK YOU AGAIN TO ANYONE WHO HAS MADE IT THIS FAR in reading this.

    The cluster works only for standalone webcache and httpserver installations types.
    If you want to do this you have to use dcmctl command to change from one farm to another.
    try checking with dcmctl command with out options an dyou will get a full list of options.
    then run dcmctl usage(orhelp) option to see what you need.
    As far as I remember
    you have to check the farm id of the server you want to be the master
    then in the second, you have to run dcmctl joinfarm or something like that.
    Regards.

  • New Mac Owner - Render Farm Question

    I am new to the mac world. I have purchased the macbook pro, 17" with 2 gig ram and 7200 rpm HDD. I am using the machine for video editing, effects, and DVD authoring. I have read through several files about compressor2 and Qmaster and their ability to improve render time when producing a video file. Being new to the mac world, I do not have multiple machines to link together via network to utilize these amazing applications. I do, however, have several PC's that are high speed, dual processor, with loads of ram (previous video editing systems). Can a PC run the Qmaster and/or compressor software and allow for the render farming? Any input and advice is greatly appreciated.

    By default you CANNOT run anything called "QMaster" or "Compressor" on a Windows PC.
    BUT!
    There is something buried deep in the Apple QMaster documentation that describes how to use Terminal on your Mac and the command line to set up any Unix or Linux machine as an external [what Apple calls,] "EXTENDED NODE."
    But to do this, you have to have at least ONE extra Mac to use as the "INTERMEDIATE NODE."
    How it works is that you use Terminal and command line codes to make the EXTENDED (non-mac) nodes talk to (and offer their processors to) the INTERMEDIATE node, which then says to the Cluster Controller, "Hey! I've got more SERVICES NODES to offer you."
    So, in a manner of speaking, this process tricks the Cluster Controller into thinking that the Intermediate node has more services to offer than it really does, because the Intermediate node is kinda "subleting" the processors of the Extended Node(s).
    So, it's up to you to decide if it would be worth it to install Unix or Linux on all those PC boxes you have, but it would be possible, provided you purchased another mac to use as an Intermediate Node. Perhaps an Intel Mac Mini would do the trick.
    Good Luck.

  • Render Farm PowerPC

    Hello!
    I need to convert a ton of files from .dv format to .m4v .mov or similar. Since it will take years to do it (almost 3TB of videos) with my current Mac Mini (first Intel version) I was thinking to set up a render farm with all my desktop PowerPC Macs. I've never tried this before, so I don't know how to do it. I've heard that Apple uses Qmaster to do that. I've also read something about Xgrid, but Xgrid seems to be for different tasks (I would like to know wich ones, because I want to do something useful with my old PowerPC Macs and a distributed computing solution may be the answer).
    My macs:
    - PowerMac G3 B&W (400Mhz)
    - PowerMac G3 B&W (450Mhz)
    - PowerMac G4 PCI Graphics (450Mhz)
    - PowerMac G4 Digital Audio (733Mhz)
    - PowerMac G4 Quicksilver (933Mhz)
    - PowerMac G4 Mirrored Drive Doors (Dual 867Mhz)
    All of them with at least a bootable partition of Tiger 10.4.11. The PowerMac G4 MDD also has Mac OS X Tiger Server installed.
    Thanks!

    I think your best bet is simply to schedule it yourself. Set up a simple automater script that reads from a folder and performs the conversion. Simply drop a bunch of files into the watch folder and let it run. You can experiment with how many concurrent processes you can run on each machine before it bogs down.
    Don't expect much out of the G3's.

  • Render Farm - How do nodes Work?

    Hello,
    My name is Anatoly and I've recently set up a rendering farm connected to an I-Mac as a file-server.
    The Problem: Not all nodes come to work together on a project, some arbitrarily choosing to render the assets while others just watching the watch folder idly.
    The Computer Setup: There are six headless nodes (all Mac-Minis). The hardware and OS specifications are below.
    MAC-MINI Farm:
    2.66Ghz Core 2 Duo, 4Gb 1067 Mhz DDR3 RAM, NVIDIA Geforce 320M 256Mb, OSX 10.8
    2.66Ghz Core 2 Duo, 4Gb 1067 Mhz DDR3 RAM, NVIDIA Geforce 320M 256Mb, OSX 10.8
    2.3Ghz Intel i5, 4Gb 1333Mhz DD3 RAM, Intel HD Graphics 3000 384Mb, OSX 10.7.5
    2.3Ghz Intel i5, 4Gb 1333Mhz DD3 RAM, Intel HD Graphics 3000 384Mb, OSX 10.8.5
    2.3Ghz Intel i5, 4Gb 1333Mhz DD3 RAM, Intel HD Graphics 3000 384Mb, OSX 10.7.5
    2.3Ghz Intel i5, 4Gb 1333Mhz DD3 RAM, Intel HD Graphics 3000 384Mb, OSX 10.7.5
    I-MAC File Server:
    2.5Ghz Intel i5, 4Gb 1333Mhz DD3 RAM, AMD Radeon HD 6750M 512Mb, OSX 10.7.4
    The Software Setup:
    Each MAC-MINI node has a copy of After Effect CC Render Engine (version 12.0.0.404) running at startup and set to run in Watch Folder mode.
    On the machine that is used to manipulate assets for rendering the following procedure is used:
    Open a project
    Add assets to render queue
    Set Render Settings to Multi-Machine Settings
    Check box in settings to “Skip existing files (allows multi-machine rendering)
    Set Output Module to Multi-Machine Sequence
    Select my desired output settings
    Then I click File – Dependencies – Collect Files
    In Collect Files Setup the following is chosen:
    Collect Source Files: All
    Change Render Output to: “custom name” folder
    Enable Watch Folder render
    Reveal collected project in Finder when finished
    Maximum Number of Machines: 10
    I then click Collect and save my project to a Watch Folder
    From there-onwards, presumably, the Render Farm is now supposed to render out my project, but not all nodes of my 6-node farm work together. More often than not, a single (or two) node(s) render the projects while the others wait idly, watching the Watch Folder.
    Can anyone please advise me of why this happens, and perhaps what step I’m missing if any to get all my nodes to render until the project is done?
    Thank you,
    -Anatoly

    Here's a picture of render items in my queue, follwed by a picture of how many nodes are working on it:

  • Creating a render farm

    I need help creating a render farm. I have 5 24" imac, 1 G5 tower and 4 G5 iMac. I still need to network them all togeether but I will when I get a chance. I have created a cluster before but it always came up with an I/O error I think it has to do with the permissions to the outher computer. This is for a school and I do not no if I'm going to make a seprate network in the classroom or connect it to the schools network or maby bouth.

    One thing you'll need to keep in mind is that you'll need a shared storage location, and that location will need to be mounted on each service node.
    Regarding setting up clusters, I posted some links in a different thread that you may find helpful:
    http://discussions.apple.com/thread.jspa?messageID=8922045#8922045

  • Is there any point in a G4 render farm?

    Hi all.
    I've been getting quite intrested in the idea of setting up a very small render farm laterly as I have the option of getting some old G4s for free.
    I currently have a 2.0Ghz DP G5 as my main mac running FCP2 and Shake and was already grabbing a G4 466 digital audio to set up as a file/print and back up server running tiger server, a postscript RIP and retrospect. I have the possibility of getting atleast one more G4 466 DA and maybe a couple of G4 400 AGPs with Gigbit ethernet cards. As the main use would be farming out DV to mpg2 compression via compressor and shake renders (though not large shake stuff to begin with as very new to this) is there any point in looking into this or am I going to need to lots of G4s to make a real improvement in render times.
    Also is RAM a major consideration. For example if I got 4 G4s with say 512Mb ram would it be better runing all four or using three but nicking the fours ram to give more ram in the three machine set up?
    Any advice would be appreciated
    Cheers
    Steve

    I vote no. G4 isn't the problem so much as 400mhz is. The ram shouldn't be a problem.
    But you could test if you set up Compressor on one G4. Compress a job. Compress the same job with the same settings on the G5.
    If the G5 is 4 times (or even 3, since time is spent sending the render data over the network between the G4's slow system busses) as fast the single G4, a render farm will not help you.
    Using the G4 and G5 together in the same cluster does not work because Compressor looks at all processors and divides the job into twice as many segments. In this case, the G5 finishes it's two segments years before the G4's and then sits around waiting. You could try splitting the G5 into 4 instances, but then you have 8 slow processors attacking your job. Not very efficient.
    Good luck though. You should test the one G4 just so you know. Report back if you do.

  • Hardware Encoder for H.264?  Encoder for Flash?  Render Farm?

    I use Compressor to create H.264 QuickTime files, and have setup Qmaster to use a 8 core cluster to expedite the process, but it is not reliable, and fails quite often. I have a total of 3 Mac Pros in my facility which can all share their resources to help this process be quicker. I was wondering if anyone knew of a hardware encoder that will encode H.264 files very quickly? I have a bid on a project that if granted, I will need to encode a VAST amount of H.264 QuickTime files. Is the best solution a dedicated Mac Pro render farm with a Qmaster setup?
    Next, on to the Flash. I currently use Sorenson Squeeze 5 to encode 2 pass VBR flash files, and it takes forever even on my 2.8ghz Octo with 10gb of RAM. Does anyone know of a piece of software or hardware that can expedite this process? Maybe a Flash render farm? Maybe a gnome with a wand?
    Thanks in advance.

    Keep your eyes open for when the Matrox CompressHD goes on sale.
    While it probably won't be available to use on the job you've just bid on (tentative sale date is May 2009 but who knows if that can be trusted), it otherwise seems like the answer your prayers - it speeds up h.264 and Flash encoding. It will, supposedly, list for $495.
    Otherwise, as mentioned, the Turbo264HD is the way to go for now.

  • Render Farm fails in compressor 3.5.3 with host failed quicktime error -36

    I have been having regular problems while render farming in Compressor 3.5.3 the Host computer is running OSX 10.8.5 and the other computers are running 10.8.4 and 10.7.5. after about compressor is about half way done. the job fails. I get this error
    Failed - HOST [mc-21-imac.local] QuickTime Error: -36
    The file being compressed is 1080 24p and is exported with the timeline settings then brought into compressor
    here is the log from the most recent batch.
    <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
    <services>
       <service type="jobcontroller:com.apple.qmaster.cluster.admin" displayName="NCC’s iMac" address="tcp://127.0.0.1:49244" hostName="mc-27-thin-imac.local">
          <logs tms="405381920.683" tmt="11/05/2013 14:05:20.683" pnm="unknown">
             <log tms="405381920.683" tmt="11/05/2013 14:05:20.683" pid="290" kind="mrk" sub="error" what="get-log" avail="false" msg="Not logging to file."/>
          </logs>
       </service>
       <service type="requestprocessor:com.apple.qmaster.contentcontroller" displayName="NCC’s iMac" address="tcp://172.20.12.15:49302" hostName="mc-27-thin-imac.local">
          <logs tms="405381176.354" tmt="11/05/2013 13:52:56.354" pnm="ContentController">
             <mrk tms="405381177.690" tmt="11/05/2013 13:52:57.690" pid="324" kind="begin" what="service-request" req-id="1BBA659D-7474-481A-A70E-8CB5E633C8E5:1" msg="Preprocessing job."></mrk>
             <log tms="405381177.699" tmt="11/05/2013 13:52:57.699" pid="324" msg="Source file is local - we will try hard-linking."/>
             <log tms="405381177.700" tmt="11/05/2013 13:52:57.700" pid="324" msg="Hard-linked source file to cluster storage."/>
             <mrk tms="405381182.693" tmt="11/05/2013 13:53:02.693" pid="324" kind="end" what="service-request" req-id="1BBA659D-7474-481A-A70E-8CB5E633C8E5:1" msg="Preprocessing job request end."></mrk>
             <mrk tms="405381182.722" tmt="11/05/2013 13:53:02.722" pid="324" kind="begin" what="service-request" req-id="FDC914D3-4A0A-4431-948A-137D9A76AD03:1" msg="Preprocessing."></mrk>
             <mrk tms="405381187.725" tmt="11/05/2013 13:53:07.725" pid="324" kind="end" what="service-request" req-id="FDC914D3-4A0A-4431-948A-137D9A76AD03:1" msg="Preprocessing service request end."></mrk>
          </logs>
       </service>
       <service type="servicecontroller:com.apple.stomp.transcoder" displayName="mc-12-core" hostName="mc-12-core.local" managed="false" address="tcp://172.20.10.25:54056">
          <logs tms="405381194.382" tmt="11/05/2013 13:53:14.382" pnm="CompressorTranscoderX">
             <mrk tms="405381224.941" tmt="11/05/2013 13:53:44.941" pid="738" kind="begin" what="service-request" req-id="C10642AE-6B51-45BE-9235-8A5DDE3C1743:1" msg="Processing."></mrk>
             <mrk tms="405381224.942" tmt="11/05/2013 13:53:44.942" pid="738" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <log tms="405381224.942" tmt="11/05/2013 13:53:44.942" pid="738" msg="Cluster storage URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared" />
             <log tms="405381224.942" tmt="11/05/2013 13:53:44.942" pid="738" msg="Local subscribe path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <log tms="405381224.942" tmt="11/05/2013 13:53:44.942" pid="738" msg="Subscribing to shared storage."/>
             <mrk tms="405381224.957" tmt="11/05/2013 13:53:44.957" pid="738" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <mrk tms="405381224.957" tmt="11/05/2013 13:53:44.957" pid="738" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381224.958" tmt="11/05/2013 13:53:44.958" pid="738" msg="Source file /var/spool/qmaster/87C75A89-72519530/shared/Checklist-A9A8BE65-F4F2-4BB5-AA92-8 75CA53F8D9A.mov is directly accessible."/>
             <log tms="405381224.958" tmt="11/05/2013 13:53:44.958" pid="738" msg="Source file can be opened."/>
             <log tms="405381224.960" tmt="11/05/2013 13:53:44.960" pid="738" msg="Source file can be read."/>
             <mrk tms="405381224.961" tmt="11/05/2013 13:53:44.961" pid="738" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381224.968" tmt="11/05/2013 13:53:44.968" pid="738" msg="starting _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-2"/>
             <log tms="405381224.968" tmt="11/05/2013 13:53:44.968" pid="738" msg="Writing transcode segment: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-2"/>
             <log tms="405381225.158" tmt="11/05/2013 13:53:45.158" pid="738" msg="QuickTime Transcode, rendering in YUV 8 bit 422"/>
             <mrk tms="405381275.202" tmt="11/05/2013 13:54:35.202" pid="738" what="service-request" req-id="C10642AE-6B51-45BE-9235-8A5DDE3C1743:1" msg="Cancelling."></mrk>
             <log tms="405381275.345" tmt="11/05/2013 13:54:35.345" pid="738" msg="QuickTime Transcode aborted by user: 50.1812 seconds.  status = 0"/>
             <log tms="405381275.348" tmt="11/05/2013 13:54:35.348" pid="738" msg="Done _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-2"/>
             <log tms="405381275.348" tmt="11/05/2013 13:54:35.348" pid="738" msg="Unsubscribing to shared storage: URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared, local path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <mrk tms="405381279.982" tmt="11/05/2013 13:54:39.982" pid="738" kind="end" what="service-request" req-id="C10642AE-6B51-45BE-9235-8A5DDE3C1743:1" msg="Processing service request end."></mrk>
          </logs>
       </service>
       <service type="servicecontroller:com.apple.stomp.transcoder" displayName="NCC’s iMac" hostName="mc-27-thin-imac.local" managed="false" address="tcp://172.20.12.15:49168">
          <logs tms="405380926.271" tmt="11/05/2013 13:48:46.271" pnm="CompressorTranscoderX">
             <mrk tms="405381224.968" tmt="11/05/2013 13:53:44.968" pid="172" kind="begin" what="service-request" req-id="9796F993-EC7C-4BF4-98ED-5456258940CE:1" msg="Processing."></mrk>
             <mrk tms="405381224.969" tmt="11/05/2013 13:53:44.969" pid="172" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <log tms="405381224.969" tmt="11/05/2013 13:53:44.969" pid="172" msg="Cluster storage URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared" />
             <log tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" msg="Local subscribe path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <log tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" msg="Not subscribing, cluster storage is local and its path matches the local subscribe path."/>
             <mrk tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <mrk tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" msg="Source file /var/spool/qmaster/87C75A89-72519530/shared/Checklist-A9A8BE65-F4F2-4BB5-AA92-8 75CA53F8D9A.mov is directly accessible."/>
             <log tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" msg="Source file can be opened."/>
             <log tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" msg="Source file can be read."/>
             <mrk tms="405381224.979" tmt="11/05/2013 13:53:44.979" pid="172" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381224.984" tmt="11/05/2013 13:53:44.984" pid="172" msg="starting _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-3"/>
             <log tms="405381224.985" tmt="11/05/2013 13:53:44.985" pid="172" msg="Writing transcode segment: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-3"/>
             <log tms="405381225.053" tmt="11/05/2013 13:53:45.053" pid="172" msg="QuickTime Transcode, rendering in YUV 8 bit 422"/>
             <mrk tms="405381275.178" tmt="11/05/2013 13:54:35.178" pid="172" what="service-request" req-id="9796F993-EC7C-4BF4-98ED-5456258940CE:1" msg="Cancelling."></mrk>
             <log tms="405381275.402" tmt="11/05/2013 13:54:35.402" pid="172" msg="QuickTime Transcode aborted by user: 50.3491 seconds.  status = 0"/>
             <log tms="405381275.404" tmt="11/05/2013 13:54:35.404" pid="172" msg="Done _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-3"/>
             <mrk tms="405381280.007" tmt="11/05/2013 13:54:40.007" pid="172" kind="end" what="service-request" req-id="9796F993-EC7C-4BF4-98ED-5456258940CE:1" msg="Processing service request end."></mrk>
          </logs>
       </service>
       <service type="servicecontroller:com.apple.stomp.transcoder" displayName="mc-27-imac" hostName="mc-27-imac-2.local" managed="false" address="tcp://172.20.10.8:49166">
          <logs tms="403310666.066" tmt="10/12/2013 15:44:26.066" pnm="CompressorTranscoderX">
             <mrk tms="405381297.306" tmt="11/05/2013 13:54:57.306" pid="122" kind="begin" what="service-request" req-id="FDC914D3-4A0A-4431-948A-137D9A76AD03:7" msg="Preprocessing."></mrk>
             <mrk tms="405381297.306" tmt="11/05/2013 13:54:57.306" pid="122" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <log tms="405381297.306" tmt="11/05/2013 13:54:57.306" pid="122" msg="Cluster storage URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared" />
             <log tms="405381297.307" tmt="11/05/2013 13:54:57.307" pid="122" msg="Local subscribe path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <log tms="405381297.307" tmt="11/05/2013 13:54:57.307" pid="122" msg="Subscribing to shared storage."/>
             <mrk tms="405381297.322" tmt="11/05/2013 13:54:57.322" pid="122" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <mrk tms="405381297.322" tmt="11/05/2013 13:54:57.322" pid="122" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381297.323" tmt="11/05/2013 13:54:57.323" pid="122" msg="Source file /var/spool/qmaster/87C75A89-72519530/shared/Checklist-A9A8BE65-F4F2-4BB5-AA92-8 75CA53F8D9A.mov is directly accessible."/>
             <log tms="405381297.324" tmt="11/05/2013 13:54:57.324" pid="122" msg="Source file can be opened."/>
             <log tms="405381297.326" tmt="11/05/2013 13:54:57.326" pid="122" msg="Source file can be read."/>
             <mrk tms="405381297.326" tmt="11/05/2013 13:54:57.326" pid="122" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381297.331" tmt="11/05/2013 13:54:57.331" pid="122" msg="preProcess for job target: file://localhost/Users/nccvideo/Desktop/Checklist-Vimeo%20HD.mov"/>
             <log tms="405381297.865" tmt="11/05/2013 13:54:57.865" pid="122" msg="done preProcess for job target: file://localhost/Users/nccvideo/Desktop/Checklist-Vimeo%20HD.mov"/>
             <log tms="405381297.891" tmt="11/05/2013 13:54:57.891" pid="122" msg="Unsubscribing to shared storage: URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared, local path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <mrk tms="405381302.310" tmt="11/05/2013 13:55:02.310" pid="122" kind="end" what="service-request" req-id="FDC914D3-4A0A-4431-948A-137D9A76AD03:7" msg="Preprocessing service request end."></mrk>
             <mrk tms="405381302.505" tmt="11/05/2013 13:55:02.505" pid="122" kind="begin" what="service-request" req-id="B07BFEAB-40E3-4136-A4EC-027048E1E2DC:1" msg="Processing."></mrk>
             <mrk tms="405381302.506" tmt="11/05/2013 13:55:02.506" pid="122" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <log tms="405381302.506" tmt="11/05/2013 13:55:02.506" pid="122" msg="Cluster storage URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared" />
             <log tms="405381302.506" tmt="11/05/2013 13:55:02.506" pid="122" msg="Local subscribe path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <log tms="405381302.506" tmt="11/05/2013 13:55:02.506" pid="122" msg="Subscribing to shared storage."/>
             <mrk tms="405381302.519" tmt="11/05/2013 13:55:02.519" pid="122" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <mrk tms="405381302.519" tmt="11/05/2013 13:55:02.519" pid="122" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381302.520" tmt="11/05/2013 13:55:02.520" pid="122" msg="Source file /var/spool/qmaster/87C75A89-72519530/shared/Checklist-A9A8BE65-F4F2-4BB5-AA92-8 75CA53F8D9A.mov is directly accessible."/>
             <log tms="405381302.520" tmt="11/05/2013 13:55:02.520" pid="122" msg="Source file can be opened."/>
             <log tms="405381302.522" tmt="11/05/2013 13:55:02.522" pid="122" msg="Source file can be read."/>
             <mrk tms="405381302.522" tmt="11/05/2013 13:55:02.522" pid="122" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381302.528" tmt="11/05/2013 13:55:02.528" pid="122" msg="starting _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-5"/>
             <log tms="405381302.528" tmt="11/05/2013 13:55:02.528" pid="122" msg="Writing transcode segment: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-5"/>
             <log tms="405381302.580" tmt="11/05/2013 13:55:02.580" pid="122" msg="QuickTime Transcode, rendering in YUV 8 bit 422"/>
             <mrk tms="405381352.679" tmt="11/05/2013 13:55:52.679" pid="122" what="service-request" req-id="B07BFEAB-40E3-4136-A4EC-027048E1E2DC:1" msg="Cancelling."></mrk>
             <log tms="405381352.776" tmt="11/05/2013 13:55:52.776" pid="122" msg="QuickTime Transcode aborted by user: 50.1935 seconds.  status = 0"/>
             <log tms="405381352.777" tmt="11/05/2013 13:55:52.777" pid="122" msg="Done _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-5"/>
             <log tms="405381352.777" tmt="11/05/2013 13:55:52.777" pid="122" msg="Unsubscribing to shared storage: URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared, local path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <mrk tms="405381357.538" tmt="11/05/2013 13:55:57.538" pid="122" kind="end" what="service-request" req-id="B07BFEAB-40E3-4136-A4EC-027048E1E2DC:1" msg="Processing service request end."></mrk>
          </logs>
       </service>
       <service type="servicecontroller:com.apple.stomp.transcoder" displayName="NCC’s iMac" address="tcp://127.0.0.1:49243" hostName="mc-27-thin-imac.local">
          <logs tms="405381920.887" tmt="11/05/2013 14:05:20.887" pnm="CompressorTranscoder">
             <log tms="405381920.887" tmt="11/05/2013 14:05:20.887" pid="289" kind="mrk" sub="error" what="get-log" avail="false" msg="Not logging to file."/>
          </logs>
       </service>
       <service type="servicecontroller:com.apple.stomp.transcoder" displayName="mc-21-imac" hostName="mc-21-imac.local" managed="false" address="tcp://172.20.10.4:49160">
          <logs tms="403310199.775" tmt="10/12/2013 15:36:39.775" pnm="CompressorTranscoderX">
             <mrk tms="405381225.047" tmt="11/05/2013 13:53:45.047" pid="150" kind="begin" what="service-request" req-id="10FFCD5A-52B4-460C-B651-63414EE146EA:1" msg="Processing."></mrk>
             <mrk tms="405381225.072" tmt="11/05/2013 13:53:45.072" pid="150" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <log tms="405381225.072" tmt="11/05/2013 13:53:45.072" pid="150" msg="Cluster storage URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared" />
             <log tms="405381225.106" tmt="11/05/2013 13:53:45.106" pid="150" msg="Local subscribe path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <log tms="405381225.106" tmt="11/05/2013 13:53:45.106" pid="150" msg="Subscribing to shared storage."/>
             <mrk tms="405381225.390" tmt="11/05/2013 13:53:45.390" pid="150" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <mrk tms="405381225.390" tmt="11/05/2013 13:53:45.390" pid="150" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381225.392" tmt="11/05/2013 13:53:45.392" pid="150" msg="Source file /var/spool/qmaster/87C75A89-72519530/shared/Checklist-A9A8BE65-F4F2-4BB5-AA92-8 75CA53F8D9A.mov is directly accessible."/>
             <log tms="405381225.393" tmt="11/05/2013 13:53:45.393" pid="150" msg="Source file can be opened."/>
             <log tms="405381225.395" tmt="11/05/2013 13:53:45.395" pid="150" msg="Source file can be read."/>
             <mrk tms="405381225.395" tmt="11/05/2013 13:53:45.395" pid="150" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381225.402" tmt="11/05/2013 13:53:45.402" pid="150" msg="starting _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-6"/>
             <log tms="405381225.402" tmt="11/05/2013 13:53:45.402" pid="150" msg="Writing transcode segment: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-6"/>
             <log tms="405381225.495" tmt="11/05/2013 13:53:45.495" pid="150" msg="QuickTime Transcode, rendering in YUV 8 bit 422"/>
             <log tms="405381270.026" tmt="11/05/2013 13:54:30.026" pid="150" msg="Time for QuickTime transcode: 44.5298 seconds.  status = -36"/>
             <log tms="405381270.028" tmt="11/05/2013 13:54:30.028" pid="150" msg="Done _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-6"/>
             <log tms="405381270.029" tmt="11/05/2013 13:54:30.029" pid="150" msg="Unsubscribing to shared storage: URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared, local path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <mrk tms="405381275.107" tmt="11/05/2013 13:54:35.107" pid="150" kind="end" what="service-request" req-id="10FFCD5A-52B4-460C-B651-63414EE146EA:1" msg="Processing service request error: QuickTime Error: -36"></mrk>
             <mrk tms="405381275.162" tmt="11/05/2013 13:54:35.162" pid="150" kind="begin" what="service-request" req-id="A9E024F4-2FCB-4355-B7AD-C5A69764BD46:1" msg="Processing."></mrk>
             <mrk tms="405381275.162" tmt="11/05/2013 13:54:35.162" pid="150" kind="begin" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <log tms="405381275.162" tmt="11/05/2013 13:54:35.162" pid="150" msg="Cluster storage URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared" />
             <log tms="405381275.163" tmt="11/05/2013 13:54:35.163" pid="150" msg="Local subscribe path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <log tms="405381275.163" tmt="11/05/2013 13:54:35.163" pid="150" msg="Subscribing to shared storage."/>
             <mrk tms="405381275.180" tmt="11/05/2013 13:54:35.180" pid="150" what="service-request" req-id="A9E024F4-2FCB-4355-B7AD-C5A69764BD46:1" msg="Cancelling."></mrk>
             <mrk tms="405381275.207" tmt="11/05/2013 13:54:35.207" pid="150" kind="end" what="CServiceControllerServer::mountClusterStorage"></mrk>
             <mrk tms="405381275.207" tmt="11/05/2013 13:54:35.207" pid="150" kind="begin" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381275.209" tmt="11/05/2013 13:54:35.209" pid="150" msg="Source file /var/spool/qmaster/87C75A89-72519530/shared/Checklist-A9A8BE65-F4F2-4BB5-AA92-8 75CA53F8D9A.mov is directly accessible."/>
             <log tms="405381275.214" tmt="11/05/2013 13:54:35.214" pid="150" msg="Source file can be opened."/>
             <log tms="405381275.220" tmt="11/05/2013 13:54:35.220" pid="150" msg="Source file can be read."/>
             <mrk tms="405381275.220" tmt="11/05/2013 13:54:35.220" pid="150" kind="end" what="CServiceControllerServer::checkRequiredFiles"></mrk>
             <log tms="405381275.227" tmt="11/05/2013 13:54:35.227" pid="150" msg="starting _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-7"/>
             <log tms="405381275.228" tmt="11/05/2013 13:54:35.228" pid="150" msg="Writing transcode segment: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-7"/>
             <log tms="405381275.774" tmt="11/05/2013 13:54:35.774" pid="150" msg="QuickTime Transcode, rendering in YUV 8 bit 422"/>
             <log tms="405381346.861" tmt="11/05/2013 13:55:46.861" pid="150" msg="Time for QuickTime transcode: 71.0861 seconds.  status = 0"/>
             <log tms="405381346.863" tmt="11/05/2013 13:55:46.863" pid="150" msg="Done _processRequest for job target: file://localhost/var/spool/qmaster/87C75A89-72519530/shared/Checklist-Vimeo%20H D-F12CF6CD-0DCA-41EB-9BD6-557B63EB3E41.mov-7"/>
             <log tms="405381346.863" tmt="11/05/2013 13:55:46.863" pid="150" msg="Unsubscribing to shared storage: URL = nfs://mc-27-thin-imac.local/private/var/spool/qmaster/87C75A89-72519530/shared, local path = /var/spool/qmaster/87C75A89-72519530/shared"/>
             <mrk tms="405381350.222" tmt="11/05/2013 13:55:50.222" pid="150" kind="end" what="service-request" req-id="A9E024F4-2FCB-4355-B7AD-C5A69764BD46:1" msg="Processing service request end."></mrk>
          </logs>
       </service>
    </services>

    digital rebellion has a crash analyzer that's part of Pro Maintenance Tools
    http://www.digitalrebellion.com/promaintenance/
    There's a free trial, but it's worth every penny.

  • What is a render farm?

    I read a post that said build a render farm and it will be faster....
    What is a render farm?
    How do you build one?
    JKai

    I read a post that said build a render farm and it will be faster....
    It will. But only for certain things. QMASTER allows you to spread the render across several processors and several machines, but only COMPRESSOR in the Final Cut Studio packages can utilize it. FCP cannot, Motion and Color cannot.
    What is a render farm?
    Several machines connected together, say via Ethernet for example, that all put their processing power towards completing a task of crunching data.
    How do you build one?
    Well, in your case, and in mine...hire someone to do it. This is a seriously technical thing. But as I said, it really doesn't help to have one with FCS. Only Compressor can utilize it. Get your network IT guy to connect all the computers via Ethernet, and install QMASTER on all of them...then you can get one going. But there's more to it than that.
    Shane

  • XGRID render farms?

    Anyone doing this?
    Any good?
    tempted to get hold of an xserve and a couple minis....

    FCP and Motion will not work with Render Farms. Shake and Compressor will...
    Patrick

  • After Effects Render Farm CS5

    Hello,
    I have just set up a mini rendering farm, well, basically my MacBook Pro is the master and my 8 core MacPro is 1 node.  I have the CS5 Master Suite set up on both computers both up to date.
    After finding some instructions on the Adobe help website, I set my MacPro to watch a folder called "AE Watch Folder" on my Netgear network HD, the MacPro and the Netgear are hard wired to a gigabit switch.
    I tried 2 sequences at the same time using collect folders and it worked spot on, i could see the progress by using Apple Remote Desktop 3.3.
    After deleting the folder on the network hd, i tried rendering all 8 sequences then i monitored the MacPro and seen it was searching for all the files, after waiting 5 mins it kept repeating the process reading the same files over and over again, so then i cancelled the watch selected watch folder again and then it started rendering? Basically got it working but with lots of fiddling.
    All files rendered okay but was wondering if theres is a proper technique i should be carrying out when i do the same task again, which will be soon.  I thought maybe because i was messing around binning files out of the watch folder on the network drive?
    Also how will it work when i add another node to the network which is going to happen soon, does it divide the workload up?  Also can you do the same process with Premiere Pro CS5 as i need to put all the rendered files in premiere and stitch them all together but i don't fancy waiting years for my MacBook Pro to render lol.
    P.s all files were encoded using Quicktime Apple Intermidiate Codec.
    Thanks

    Hi,
    iv'e done some searching and can't find anything on solving the problem with the file scanning prob, both my machines are up to date also.  Is there any other sites that might be worth visiting
    Thanks

  • Hardware recommendations for render farm?

    Hello,
    what would you recommend for a small render farm for mixed AE projects (mostly HD content, short projects with only a few seconds and layers and bigger ones with multiple HD layers and up to 15min or longer.)
    is it better to have more cores (AMD opteron servers with 48 cores for example) or better more performance per core but less cores (Intel Xeon servers)?
    And how much memory would be optimal?
    What can you recommend for network connection to the shared storaged, how fast shall this be?

    I like Harm's analogy better then mine. One prize cow vs. 20 regular cows. The imagery is very clear. In a production environment, where volume counts, more is better then a single top notch one. A single cow can only produce so much mik per day, no matter how extraordinary it is.  But 20 can theoretically produce 20 times more (practically, maybe  17 to 18). Quantity, not quality. I'm not saying that you should get crappy hardware. Just good hardware, not high performance ones.
    As you know, it's not because you buy a computer that costs twice as much, that you'll get twice the processing power. First of all, forget dual CPU computers for a render farm, it's not worth it. Get a regular quad core. As you compare prices vs. performance (do a chart), get the CPU that gives you the best bang for the buch (just before the price curve goes up).
    I personally think 32GB is overkill in a render farm environment. 16GB is way more then enough. Remember that you're not doing a RAM preview farm (if such a thing exists), but rather, fractioning the render process to various computers. While 16GB is good, 2GB isn't. But 8GB can be an nice compromise. Remember, you're trying to drive the cost down of a computer, so you can buy many computers. But RAM is cheap, so, best bang for the buck, 16GB can be possible. Then again, it depends on other overall factors to keep the price for the computer down.
    Network speed. Yes you could get 10GB NICs and a 10GB switch. But that can drive the price up substantially. If you can get a good price on them, great. If not, stick to 1GB. Get a motherboard that has 2x 1GB NICs on board, so you can aggregate the network connections together to get 2GB. You could eventually add a quad 1GB PCIe card down the road. The computer that has the project assets should have an aggregated quad (or more) NIC inside. You want to be able to push the media as fast as possible to the render farm.
    Other things to consider... or rather, not consider. Graphic card is a non issue on a server farm. AE is all about CPU. Some mobos come with on-board graphics. Usually, it's cheaper, and consumes less power. You also want to drive the energy costs down when you multiply by X number of computers. Just get a KVM solution that will be able handle X computers. You don't need a RAID on render farm computers. A regular hard drive will do. I'd even go with a green drive that consumes less power.
    And depending on how many computers you have, to reduce the footprint, you might want to get low profile rackmount casings and put them in a rack.  Plus think of putting it in it's own room, because it'll be very noisy!

Maybe you are looking for

  • PAC file not working in IE10

    I recently upgraded to IE10 on my Windows 7 machine on our network, however IE seems to ignore the PAC file. It works on other machines which are running IE9, just not IE10. I also have a Windows 8 machine with IE10 and it doesn't seem to work either

  • I want other fields of table bkpf in T-code FB03

    hi expert. i want other fields of table bkpf in T-code FB03 so i tried to find setting in spro(img) , but i couldn't find that. where is the that?  help me please..

  • Little doubt about xml and jspx, someone would give me a explaiation please

    Hi!! What's the diference between a .jspx and .xml file? do they have the same porpose? can I replace a .jspx for .xml file ? Thanks!!!

  • Disable autocorrect in iphone

    there must be a way to disable auto correct suggestion. It is a nightmare when messaging in another language.

  • Can't update to 8.3 from beta 2

    I have a developer account, and installed iOS 8.3 beta 2 when it's been announced. I'm not sure actually if i installed it with my developer Apple ID or with my personal one. But now i'm not able to update my iOS to 8.3. There is no update available