Setting up virtual clusters Compressor 4

Could someone Please point me to the workflow or set up where I use Quemaster, etc. to take advantage of my Multiple cores on Quadcore 2011 iMac. All I have discovered is info on virtual Clusters wirth Compressor 3. Confused about shared services, etc. No will not be farming out to other Macs. Just want to take advantage of Multicores on my Machine.
Thanks
Message was edited by: GolaniMac

If and when you get this working. I have found for example; using this option to trans-code a video file to ProRes take long to encode. It's some time to rejoin the video file back together. (The same holds ture with having the fast-start option turned on when trans-coding to ProRes.)
This can take up to as much as twice the time to accomplished depending on how fast your drives are...
This opion however works great when encoding to MPEG-2 or h.264.

Similar Messages

3.5.1 on Mac OS X 10.6: no more virtual clusters?

Prior to 10.6 and 3.5.1, I set up virtual clusters with as many instances as I had cores on my MacPro. And this worked great. My H.264 files rendered so much faster with the 8 instance than rendering to the single instance "My Computer" method and it was amazing.
Now with 10.6 and 3.5.1 and with the same 8 instance cluster setting the machine totally chokes. The UI gets really really slow and I tried it with even only 6 instances selected. Is this because 10.6 can utilize multi-cores much more efficiently on the OS level where we don't need to use all those instances in qmaster anymore?
Wanted to see if anyone else noticed this.
Thanks!

HI Jamie just a thought.. are your rendering or TRANSCODING here? try to resolve this by:
• making sure that each instance of COMPRESSOR (from qmaster) is not using a load of REAL MEMORY.
• look for MALLOC errors in the /var/log relating to other apps failures
• avoid any paging/swapping (see activity monitor)
For example if you use COMPRESSOR.app under qmaster for rendering out say MOTION projects (as you do).. it uses the TRANSCODING engines for this apparently.... , you will find that due to motion.apps resource setup that it will use a tonne of REAL MEMORY for all its OBJECTS, and this again for each INSTANCE of the COMPRESSOR task.
YOu can easily see this REAL MEMARY (not virtual) usage in the /utilities/activity monitor.app
SUrprisingly all my 12GB of RAM was swamped by some MOTION projects and I had to back the qmaster tasks instances on this machine to only 6 when I had in fact up to 16 available!. In this case each motion instances wanted 1.4GB of REAL MEMORY .. do the maths is easy.
The slow down can easily be determined if you have a great deal I/O for paging and swapping. You can see that again in the graphic display in the activity monitor. This will grind you system to a snails pace if it does.
SO you need to be either conservative wit the use of virtual clusters or set you batches up in blocks with manual tweaking of the instance numbers for compressor.
I believe the "algorithm" implementation (according to forums) of the 3.5 version of compressor/qmaster has been improved to utilise the cores better for SEGMENTED work.
Summary: I'd start looking here (regardless of use of motion or not) and see if it is a REAL MEMORY over use. YOu wanna leave at least 500MB available else you will start causing crippling slowdowns while OSX pages Virtual memory in and out of the startup disk.
start here I think and look in the /var/logs (console.app) for errors.
hth
w

Export Using Compressor, from FCP, and Virtual Clustering

Has anyone successfully used Virtual Clustering - that is, setting up shared services for multiple instances so that you can use all 4 or 8 cores on a machine - when exporting timelines directly from FCP to Compressor 3?
I know in theory it doesn't seem like it could work (with FCP send frame-by-frame rather slowly and Compressor needing frames much faster) but Compressor 3's manual (pages 119-120) says that it should work.
I believe I'm following the instructions correctly, but it always fails...

Closin' out.

Can you Combine Virtual Clusters from 2 Mac Pros?

Reading, searching support & Googling has not really answered this (perhaps dumb) question. Hopefully someone here would be kind enough to help.
I have a 8-core Mac Pro running FCS2 with a 4-instance Virtual Cluster. I just added another MP 8-core edit seat & setup another 4-instance Virtual Cluster. Each MP compresses great standalone. In the Submit dialogue both clusters are shown as separate choices. I want to be able to combine them into a mondo choice.
I understand how to distribute rendering between 2 machines but how do you distribute rendering to all 8 virtual cluster instances. Ticking share unmanaged resources simply shows each 4-cluster resource.
TIA

Page 27 shows an example of a part-time setup using every available workstation in the network (provided you have installed Apple Qmaster software on every Mac) One computer with FCS2/Compressor installed is the controller & all others are unmanaged nodes "with services only" as described on page-17.
Not sure if you're referencing what your current setup is in comparison to what I was pointing to in the manual, so forgive me, but I don't think you're following what I'm saying.
When you're creating true clusters with Qadministrator (meaning not Auto or QuickClusters), at least some of the services on the host machines must be managed. (And I point this out because you're using managed services on your machines)
So, using Qadministrator, you must create 2 cluster setups on each machine - one where the 8-core box uses only the resources on itself (replacing the Virtual Cluster) and another cluster where the 8-core machine uses its own Compressor resources as well the resources from the neighboring 8-core as well as your MacBookPro. (And yes, you can select to use only 2 of the 4 instances from the neighboring 8-core.) But each cluster would use itself (the 8-core box you're seating at) as the controller.
So is there a particular reason that you're using managed services? I've found Virtual Clusters to work - across machines, even - if you use unmanaged services (as Services Only in the QMaster preferences) then submit to This Computer in Compressor, with the Use Unmanaged Services on other Computers checked. But storage needs to be centralized (networked) in order for it to work reliably. Otherwise, the virtual cluster, in my experience, tends to determine that it'll take too long to copy material over and won't use the neighboring resources.
Or have you covered these bases already?

Setting up Virtual Hosts on a Snow Leopard Development Server

Hi Everybody,
I'm losing hair over this - I thought it would be simple!
I have set up a Mac Mini Server running SLS and would like to host multiple websites for development on the internal network. I require the websites to be stored anywhere on the server, not just in Library/WebServer/Documents/. Ideally, I would like to access them by example.com/mynewsite so I don't have to mess around with DNS.
Currently I'm setting up websites in the Server Admin Web panel but it just doesn't work. I've noticed the error log keeps looking for files located in the Library/WebServer/Documents/ folder even though I have specified a different folder.
What Am I missing? Does anybody know of a tutorial / guide to point out potential issues when setting up virtual hosts? I have checked Apple's guide but it doesn't really help me. Any pointers would be much appreciated!
Cheers

Sites is likely failing here because Sites is based on the DNS and on the HEAD command within the http stream; if the DNS does not match, you won't get to the host, and if the HEAD command doesn't match the entry in the site, then you'll either get the * wildcard or (if no *) you won't be transferred to the target Site.
Check the web server logs, as a start.
If you want to see how this stuff works at the protocol level, you could telnet to port 80 and toss a http 1.1 GET / command and see what you get back for a page.
Per [rfc2616|http://tools.ietf.org/html/rfc2616], this sequence looks like this:
+telnet www.example.com 80+
then:
+GET / HTTP/1.1+
+host: www.example.com+
followed by two presses of the return key, and where www.example.com is your target Site (virtual host) name.
Alternatives to using DNS and virtual hosts are port-based hosting (which is easy), and you can also use IP addresses to establish virtual hosts. The former is set up via the Sites stuff, with various other ports being used for the web servers. Ugly, but easy. The IP-based approach can get ugly fast, too.
If you get DNS going and aliases added, and all this goes away in a puff of greasy orange smoke.

Set up multiple clusters with same nodes

Hello,
I'm trying to set up 2 clusters using qadministrator. One with nodes A,B,C,D and a second with nodes A,B,C. When I drag my nodes into my first cluster, they are gone from qmaster service browser in qadministrator. Does this mean that nodes can only be used for one cluster?
thanks
dan

Hello,
I'm trying to set up 2 clusters using qadministrator. One with nodes A,B,C,D and a second with nodes A,B,C. When I drag my nodes into my first cluster, they are gone from qmaster service browser in qadministrator. Does this mean that nodes can only be used for one cluster?
thanks
dan

I am trying to set up virtual servers with Netscape Enterprise Server 3.6. Can get home page to display but images linked to the page won't display and links to other pages won't work.

hi,
If your home page of the virtual server is displayed then,you have set the virtual server properly.
check the links and source of the images or directories in the HTML source code of the home page.
this should solve ur problem. If not notify me.
Regards
T.Raghulan.
[email protected]

I still distribute most FCP projects via DVD. No matter which MPEG2 setting I use in Compressor 4 I get an error - even Apple's default DVD setting. Has anybody successfully output an FCP X project to compressor and then out on a DVD?

I still distribute most FCP projects via DVD. No matter which MPEG2 setting I use in Compressor 4 I get an error - even Apple's default DVD setting. Has anybody successfully output an FCP X project to compressor and then out on a DVD?

Anthony, thank you very much - this works, though I thought I had tried your process previously without success. I've tried so many things who knows. I've had zero luck going with the Send to Compressor or Export Using Compressor Settings under the Share menu. I'm also finding Compressor 4 to be a real dog on my system even though I have a brand new quad core machine with 8G of RAM. Prior to receiving your post I did come up with a different work process. Using Export Movie from FCP X and then loading the result in Compressor 3 works flawlessly. Thanks again!

Set up virtual memory for 6gb ram

hi ,
can any one please tell me how to set the virtual memory custom size for 6GB ram?

Frederic,
Those rules of thumb stem from the era when is was common to have 2 or 4 GB of memory, but with memory in the range of 12, 16 or 24 GB, I think we can forget about that rule of thumb. I would use a rule of thumb that the sum of installed memory and pagefile need not exceed 32 GB. With disk space being so cheap there is no reason to skimp on pagefile size, but with increasing amounts of installed memory, the pagefile will be used less and less. The general rule that Windows applies would result in a pagefile of 36 GB on a 24 GB system and that is overdone IMO. On a 48 GB system, Windows suggests a whopping 72 GB pagefile! That makes no sense. So, on a 48 GB system even a 4 GB pagefile would likely not be used at all, but Windows requires one to be present, otherwise it will create one for you on C, which is dynamically allocated and that is worse than a fixed, static pagefile as the first file on another disk.
Of course, if you make it a habit to switch between AE, PR, Maya and other applications a lot and work on files with large pixel dimensions, the sum total can easily be increased to 48 GB.
My suggestion is to use common sense.

Best practices for setting up virtual servers on Windows Server 2012 R2

I am creating a Web server from scratch with Windows Server 2012 R2. I expect to have a host server, and then 3 virtual servers...one that runs all of the web apps as a web server, another as a Database Server, and then on for session state. I
expect to use Windows Server 2012 R2 for the Web Server and Database Server, but Windows 7 for the session state.
I have an SATA2 Intel SROMBSASMR RAID card with battery back up that I am attaching a small SSD drive that I expect to use for the session state, and an IBM Server RAID M1015 SATA3 card that I am running Intel 520 Series SSD's that I expect to
use for Web server and Database server.
I have some questions. I am considering using the internal USB with a flash drive to boot the Host off of, and then using two small SSD's in a Raid 0 for the Web server (theory being that if something goes wrong, session state is on a different drive), and
then 2 more for the Database server in a RAID 1 configuration.
please feel free to poke holes in this and tell me of a better way to do it.
I am assuming that having the host running on a slow USB drive that is internal has no effect on the virtual servers after it is booted up, and the virtual servers are booted up?
DCSSR

I am creating a Web server from scratch with Windows Server 2012 R2. I expect to have a host server, and then 3 virtual servers...one that runs all of the web apps as a web server, another as a Database Server, and then on for session state. I
expect to use Windows Server 2012 R2 for the Web Server and Database Server, but Windows 7 for the session state.
I have an SATA2 Intel SROMBSASMR RAID card with battery back up that I am attaching a small SSD drive that I expect to use for the session state, and an IBM Server RAID M1015 SATA3 card that I am running Intel 520 Series SSD's that I expect to
use for Web server and Database server.
I have some questions. I am considering using the internal USB with a flash drive to boot the Host off of, and then using two small SSD's in a Raid 0 for the Web server (theory being that if something goes wrong, session state is on a different drive), and
then 2 more for the Database server in a RAID 1 configuration.
please feel free to poke holes in this and tell me of a better way to do it.
I am assuming that having the host running on a slow USB drive that is internal has no effect on the virtual servers after it is booted up, and the virtual servers are booted up?
There are two issues about RAID0:
1) It's not as fast as people think. So with a general purpose file system like NTFS or ReFS (choice for Windows is limited) you're not going to have any great benefits as there are very low chances whole RAID stripe would be updated @ the same time (I/Os
need to touch all SSDs in a set so 256KB+ in a real life). Web server workload is quite far away from sequential reads or writes so RAID0 is not going to shine here. Log-structures file system (or at least some FS with logging capabilities, think about ZFS
and ZIL enabled) *will* benefit from SSDs in RAID0 properly assigned.
2) RAID0 is dangerous. One lost SSD would render whole RAID set useless. So unless you build a network RAID1-over-RAID0 (mirror RAID sets between multiple hosts with a virtual SAN like or synchronous replication solutions) - you'll be sitting on a time bomb.
Not good :)
StarWind VSAN [Virtual SAN] clusters Hyper-V without SAS, Fibre Channel, SMB 3.0 or iSCSI, uses Ethernet to mirror internally mounted SATA disks between hosts.

Set custom destination in Compressor?

For reasons I don't understand, Compressor's prefs don't let you set a specific location as the destination for batches other than the built in ones (Source, Desktop, etc).
Does anyone know a way to set a custom location?
For bonus points, why does selecting "Source" mean putting the file at the root of the device it came from. I would think it more logical to have it go to the directory it came from.

Probably do better posting this in the compressor forum.

Set final size in Compressor?

Is there a way in compressor to tell it to take this 5 minute movie, and say make the final compressed size 1 gig? Or just tell it the final size you want and it'll estimate the bit rate and do it for you? I'm speaking using strictly h.264 as a QuickTime movie. Either VBR or CBR. I thought it had this feature?
Or am I mixing Compressor up with another compression company? Like "Episode."
Larry

Not in Compressor. Compressor is based around data rates.
However, when you set a CBR data rate, it will tell you the approx file size per hour of material. If you can do simple math, you should have an good estimate of the final size.
Or, use a bit rate calculator.
x

Setting Up Virtual Hosts

Presently I've got Mountain Lion and Mountain Lion Server.app running and successfully hosting a live website. I've got mail running fine and profile manager, but I've not yet been able to figure out how to host a secondary site on a subdomain of my primary domain (though I suppose www is technically a subdomain).
I'm guessing the main thing I don't understand is if I need a secondary Primary Zone and other DNS settings requirements. Also, anything else I need to do inside Server.app and possibly any items that need to be taken care of in Terminal. I sure wish someone was doing tutorials that went beyond the inital domain out there, but I'm not seeing them.
I just need the steps to walk through, or a link to a tutorial, that I could use.
Thanks in advance!!!

Yes, www.example.com needs a translation that leads to an IP address, as does xyz.www.example.com.
Here's a writeup on DNS on OS X Server and here's one on Apache virtual hosting on OS X Server.
There are a number of ways to set up internal DNS — I'm here assuming you're using NAT — and external DNS.
In general, I'd recommend using one registered domain inside and another registered domain outside, and a firewall that can "reflect" references to your external IP address back into your internal network. This means you can maintain your internal (private) DNS completely separately from external (public) DNS.
But read the articles above and see if you understand a bit better — or if you should have questions on either, ask away.

Best Setting for iTunes using Compressor 4

Can anyone give me a little advice. I have recently purchased a Panasonic X900 camcorder, very happy with the ease of use in FCPX using 1080/50p with surround sound. I use iTunes to play home movies to my television what would be the best compressor settings to make the most of this quality?
Also what would be the best setup to create Blu Ray Discs as previously I have used iDVD but I really want to make the best quality I can.
Thank you in advance.

Hi Ian,
Try one of the Apple TV presets for your movies.
Blu-Ray is a little complicated. There is a template choice in Compressor that will encode and burn either a physical or virtual (disk image) BD. By all means try it. It's a very limited menu and options. You'll need a Blu-Ray burner and a player and, of course, media.. If you want to move up to the kind of menus and selections you can work with in DVD Studio Pro and iDVD, you probably need to look at Adobe.
Good luck.
Russ

Setting up virtual path

hi ,
I have been trying to set up the virtual path for my xsql servlet.The index.html and hello page and employee page works fine when i use xsql-wtg .but i am trying to set it for IIS.
I am using servlet exe 3.0 , my inetpub is in my d drive my oracle client is also in d drive.I am using remote database.
kindly help.
kp

I am using Oracle 9i Jserv on the Sun Solaris Operating system. I just finished an Java application on tomcat located on my PC and want to move it to Unix. How to do that? I mean how to configure that? Should I follow the same directory structure or just install a new tomcat server (unix version tomcat) on Unix?
Thanks a lot!

Setting up virtual clusters Compressor 4

Similar Messages

Maybe you are looking for