Compressor and Clusters - using Cluster Administrator Cores

So I was recently set the task of setting up our small post production studio's double NAT network and Mac Mini Server, FTP and, most importantly, render farm and compressor (farm?). So we have an iMac, 2 Mac Minis, Mac Mini Server and Mac Pro. I managed (with a great deal of trial and error) to get everything set up, I can go into compressor from any machine and submit a task, and the controller (set as the mac mini server) assigns available cores to start transcoding. However, the MMServer itself ONLY submits 1 core of its' own, and that's set to rendering, not compressor. When I look in Qadmin, all of MMServer's cores assigned to Compressor are greyed out stating "Comprssor (unmanaged)" and can't be used. It is set as Cluster Controller AND SERVICES but it doesn't do the SERVICES part.
Any help would be greatly appreciated! Those extra cores/threads are just sitting there doing nothing!
EDIT - Just to clarify all the machines are set to "Services Only" except the MMServer, and also I do need both Rendering as well as Compressor.

Hey I came in to the office today and re-made the whole cluster again and now it's working. If in doubt... turn it off and on again.

Similar Messages

"aboutToUpdate" event hook and clustering using JMS Coordinated Cache

On certain object, In the aboutToUpdate method I'm calling the DescriptorEvent.updateAttributeWithObject to update the object with the last person who update the object and the date.
CODE:
event.updateAttributeWithObject("_lastUpdatedBy", utm.getUser());
event.updateAttributeWithObject("_lastUpdatedByID", new Integer(utm.getUser().getID()));
event.updateAttributeWithObject("_lastUpdateDate", utm.getUpdateDate());
This is somehow making the RCM call
JMSTopicTransportManager.createJMSTopicRemoteConnection
I have no idea why it's doing this but it is. As a workaround I've set the descriptor's cacheSynchronizationType to invalidate and I've noticed that it doesn't call the createJMSTopicRemoteConnection and doesn't break the JMS topics; however, this is a major performance hit.
CODE:
__descriptor.setCacheSynchronizationType(oracle.toplink.descriptors.ClassDescriptor.INVALIDATE_CHANGED_OBJECTS);
I need a solution that will allow normal caching policy with this event hook. Does anyone know of any?
Message was edited by:
esn

The set up in sessions.xml is correct. The error points to a problem with the topic/jms setup in WebLogic, and so if you get this error again, you will need to verify the jms factory and topic configuration. This current problem was resolved by using the default jms factory/topic defined in WLS' example server.
Best Regards,
Chris

IP over Firewire AND Ethernet connected cluster?

Does anyone have any experience with IP over Firewire and Qmaster? What I'm trying to do (for now) is to have a file server connected to a bunch of Firewire HD's, then that connected to two other macs via IP over Firewire, and all that be a cluster.
The file server is the controller. Or I want it to be at least. Connected to this cluster are two workstations, connected to the file server via Ethernet.
So it's File Server with several external Firewire HD's connected to it with the video data. Connected to this file server are two macs via IP over Firewire which will be services only nodes. Connected to ALL of this over ethernet are two editing workstations. Qadmin can't seem to see the two mac nodes connected via IP over Firewire.
The problem is that Qadminstrator can't see the two macs connected to the file server via IP over Firewire. I'm wondering if for some reason data can't go from Ethernet to IP over Firewire and back again.
Any tips or suggestions? I'm just about out of ideas for now.

I was also NOT ABLE to use both nodes connected in a MIX of ETHERNET and FIREWIREover IP.
I WAS able to get a 4 x NODE cluster working using SHAKE & COMPRESSOR/QMASTER using all GbE EThernet - I went out and bought a cheap 8 x PORT ethernet GbE hub and all my problems went away.
HEre's what I had initially and what I did and it DIDN'T work consistently..:
Hardware Initially:
• g5 QUAD and 2 x MBP Dual Core 15's + 1 x MBPDC 17inch.
• G5 QUAD GBE1 connected to #1 x MBPDC 15 on its EN0 with cable
• G5 QUAD GBE2 connected to #2 x MBPDC 15 on its EN0 with cable
• G5 QUAD FW0 connected to 1 x MBPDC 17 on its FW1 with 6 pin FW cable
• G5 QUAD is set as CONTROLLER+SERVICES
• MBPDC's are all SERVICES ONLY.
• thus 3 x SUBNETS
SETUP#1- problem symptoms
• via QMASTERADMIN - G5 CONTROLLER could see MBPDC 17 and ONE of the MBP15;s but not all of them.
•tries various configs on each FW and EN0 for boths FW and EN paths.. never consistent view..
• removed some FW disks from FW400 path that were attached to CONTROLLER G5 host ... could then see ALL as a MIX of THERNET and FW. (Same happens using FW800 - although avoided this because of sperious DISK issues wth external FW800 disks on G5 QUAD).
• created cluster (not a quick cluster)- sent simple long I-FRAME based DV-PAL to smaller DVPAL) codec test to compressor and set the CLUSTER to the QMASTER on I defined.
• set QMASTER controller sys pref to use ALL NETWORK PATHS and disbaled the AIRPORT subnets on each MACHINE)
• PROBLEM was only G5(controller+services) and TWO of the services nodes (MBPDC's) were processing - NEVER all three! It didn't seem to matter what IP path was onnected (EN or FW).
• - all the above was a NO go waster of time. (aggh)
so..
HARDWARE SET UP #2 and what worked first time!
• purchased 1 x GBE Ethernet hub (8xport) w/P/supply and four 1m ethernet cables
• g5 QUAD and 2 x MBP Dual Core 15's + 1 x MBPDC 17inch.
• G5 QUAD GBE1 connected to GBE HUB
• #1 x MBPDC 15 on its EN0 with cable to GBE HUB
• #2 x MBPDC 15 on its EN0 with cable to GBE HUB
• #1 x MBPDC 17 on its EN0 with cable to GBE HUB
• G5 QUAD is set as CONTROLLER+SERVICES
• MBPDC's are all SERVICES ONLY.
• thus 1 x SUBNET....!
WORKS EVERY TIME First time
• all machines work to render or transcode.
• for SHAKE RENDERING, each CPU has a process.. so there seems to be as many as (4 x 1)+2 + 2 + 2 rendering processes at any one time.
• less for COMPRESSOR as one per HOST (4 in my case)
Also.. in QMASTERADMIN - always:
• have the SOURCE and TAGET disk volumes|directories ou need MOUNTED (NFS works for me) and
• set to NEVER COPY.
• set QMASTER sys prefs/Advanced/"USe NEtwork Interface = EN0 (or whatever one you want to use. 'd imagine that a FW hub would also do the job (IPoFW).... but for me I had all free ETHERNETs NICS so I used them.
• oh .. enable all your airports NICS.. .. in the above QMASTER wont use this subnet.
This speeds the WORKFLOW up enormously because the source material does not have to be COPIED to each host (well I think that what it means).
So the solution in my case was to have ALL the HOSTS on a SINGLE subnet..
works for me.
hope that helps
W

Compressor 4.0.3 won't use cluster

OK, I give up. I am running FPX and Compressor on a relatively new iMac. I have set up clusters multiple times (regular and Quick), made sure volumes are mounted, successfully (I think) created a cluster showing processors from my MacBook Pro on the same network and network segment. Compressor and QMaster seem to be happy with what I have done. I have run Compressor Repair on both machines, reset background processing on both machines... BUT no matter what I do, when I click the Submit button, the only option is "This Computer" and the batch only uses the local computer. I can not get my cluster to appear as an option in the pull-down menu next to "Cluster:" after hitting Submit.
Any more ideas on how to actually USE a cluster so I can take advantage of using the other computer to share the load?

I've used Compressor for a few years and my experience is as follows:
Here are my Mac Pro specs:
- Early 2009 (2 x 2.93 GHz Quad-Core Intel Zeon)
- 32GB OWC RAM
- Mountain Lion running on 120GB OWC SSD (installed in one of the optical bays)
- Also, I've used same/similar setting on Lion and Snow Leopard.
- 2 identical internal RAID-0 (2x3TB HDDs & 2x3TB HDDs). 1 RAID for FCP X Events and the other for FCP X Projects.
A little about my video backgrond. My wife and I started our video company in 2005. We have filmed/edited hundreds of weddings, a few big non-wedding events, and maybe 50-60 commercials. Every job was delivered on DVD and/or BluRay. Sometimes the final project is delivered in ProRes, but still, the client wants a DVD copy as well. That means lots and lots of compressor time.
Compressor is absolutly awesome if qmaster is up and running. Keyword "if". Usually (80% of the time) qmaster would run good (using all 16 cores, 8 real cores and 8 virtual cores) at maximum capacity. Today, I can't even get it started 80% of the time. I have bought Compressor Repair tool, I've read hundreds of posts on the web, literally spent days reading blogs, deleting, reinstalling, trashing preferences even downgraded ot Lion to get Compressor/Qmaster working. I cannot pinpoint what exactly worked, but qmaster would start properly once in a while. But then in a week or 2 it would fail and won't start again. Then I would go through the same cycle of trashing preferences, deleting, redownloading and reinstalling compressor. Very much annoying and reminds me of my Windows days.
The only real fix for Compressor I found is Adobe Encoder. The only sort-of drawback to Adobe Encoder is the price for NVIDIA Quadro 4000, which is $700. Encoder does faster and better scaling with CUDA engine. We've used it for the last 4-5 months and it hasn't crashed a single time. Just as fast and just as good quality encoding. We're now in process of moving all of our projects from FCP X to Premiere.

Second mac in cluster uses only one core

Hello all. For some reason the second computer in my render farm is using only one core out of eight.
I'm using 2 Mac Pros linked together directly via giga ethernet wire. Mac one is a Quad Core 3ghz. Mac two is a Octo Core 2009 model. Both computers have the same version of FCS3 with different serial numbers.
In the Qmaster preferance pane: Mac one is set to "Quickcluster with services" with the check boxes for Share and Managed next to "Distributed processing for Compressor" checked. 4 instances selected and "Include unmanaged services from other computers" checked. Mac two is set to "Services only" with check box for Share next to "Distributed processing for Compressor" checked. 8 instances selected and "Include unmanaged services from other computers" checked.
I hit submit in Compressor, select the name of the cluster from Mac one, then in the Batch Monitor I see the video divied into 10 sections with Mac one handling 4 and Mac two handling one. On Mac two I see that the cores aren't fired up 100%, more like 30% on average.
I did a test earlier with a dual core mbp, and again only one core. How do I get my Octo core to use all 8 cores?

Solved the problem. The solution was simple, but somehow went under my radar. On Mac two in the Qmaster preferance pane next to the "Options for selected service" button, the selected service was set to off.
Duh

Array of clusters and in the cluster is a bar meter, how can I change the color individually?

Array of clusters and in the cluster is a bar meter, how can I change the color of the bar meter individually for each element of the array? I have just figured out that you can't change properties of one element of the array without all elements changing. For the scaling I had to make numeric indicators for each tick of the scale so that each bar meter in the clustered array would have individual scales. I also had to do some math to scale each barmeter to display correct proportions from 0 to 100%. Now I'm stumped on the color of the bar meter. Basically, if the value goes over a setpoint, the bar meter needs to turn red. It has to be in an array to be infinitely scalable.
Thanks
Matt
Solved!
Go to Solution.

You can't do that-
without a little trick.
You could consider laying a custom color box over the bar graph in the cluster you can set the color based on the value of the bar graph or even make a "Pseudo"- bar graph using a series of color boxes stacked to look lie a bar and changing values of the Color boxs from empty to full to red.
Here is an example to demonstrate
Jeff
Attachments:
Pseudo bar.vi ‏12 KB

I still distribute most FCP projects via DVD. No matter which MPEG2 setting I use in Compressor 4 I get an error - even Apple's default DVD setting. Has anybody successfully output an FCP X project to compressor and then out on a DVD?

I still distribute most FCP projects via DVD. No matter which MPEG2 setting I use in Compressor 4 I get an error - even Apple's default DVD setting. Has anybody successfully output an FCP X project to compressor and then out on a DVD?

Anthony, thank you very much - this works, though I thought I had tried your process previously without success. I've tried so many things who knows. I've had zero luck going with the Send to Compressor or Export Using Compressor Settings under the Share menu. I'm also finding Compressor 4 to be a real dog on my system even though I have a brand new quad core machine with 8G of RAM. Prior to receiving your post I did come up with a different work process. Using Export Movie from FCP X and then loading the result in Compressor 3 works flawlessly. Thanks again!

What is RID in non clustered index and its use

Hi All,
I need help regarding following articles on sql server
1) what is RID in non clustered index and its use.
2) What is Physical and virtual address space. Difference in 32 bit vs 64 bit Virtual address space
Regards
Rahul

Next time Please ask single question in a thread you will get better response.
1. RID is location of heap. When you create Non clustered index on heap and
lookup happens to get extra records RID is used to locate the records. RID is basically Row ID. This is basic definition for you. Please read
this Thread for more details
2. I have not heard of Physical address space. I Know Virtual address space( VAS)
VAS is simple terms is amount of memory( virtual ) 'visible' to a process, a process can be SQL Server process or windows process. It theoretically depends on architecture of Operating System. 32 bit OS will have maximum range of 4 G VAS, it's calculated
like a process ruining on 32 bit system can address max up to 2^32 locations ( which is equivalent to 4 G). Similarly for 64 bit max VAS will be 2^64 which is theoretically infinite. To make things feasible maximum VAS for 64 bit system is kept to 8 TB. Now
VAS acts as layer of abstraction an intermediate .Instead of all request directly mapping to physical memory it first maps to VAS and then mapped to physical memory so that it can manage request for memory in more coordinated fashion than allowing process
to do it ,if not it will soon cause memory crunch.Any process when created on windows will see virtual memory according to its VAS limit.
Please read
This Article for detailed information
Please mark this reply as answer if it solved your issue or vote as helpful if it helped so that other forum members can benefit from it
My Technet Wiki Article
MVP

Destination disabled. []: [CrystalEnterprise.Ftp]. Please note the name of the job server used for your request and contact your system administrator to make sure the specified destination is enabled. (FWB 00031)

Hi
In BO 4.0 SP 9 when a administrator tries to schedule a report via CMC there is no error
But when a user schedules a report and the destination is FTP location -> Use default settings he gets following error
Destination disabled. []: [CrystalEnterprise.Ftp]. Please note the name of the job server used for your request and contact your system administrator to make sure the specified destination is enabled. (FWB 00031)
There is only one Job Server and the destinations are enabled in it
There is no Job server for Crystal Reports Job Server
Do i need to create it and how.

Please check if you have proper rights to schedule to FTP. You can create a new job server, whenever you schedule it, there are multiple job servers, it will handle based on the load. But it is not mandatory, depends on the load.

Firefox is already running, but is not responding. To open a new window, you must first close the existing Firefox process, or restart your system. I have a wndiws 7 system and use a Intel core processor. I have restarted several times and still ge this

Firefox is already running, but is not responding. To open a new window, you must first close the existing Firefox process, or restart your system. I have a wndows 7 system and use a Intel core processor. I have restarted several times and still ge this error. I have also tried to reinstall firefox and get the same error
== This happened ==
Every time Firefox opened
== today ==
== User Agent ==
Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDS; InfoPath.2; .NET4.0C; AskTbUT2V5/5.8.0.12304)

'''Kill Application'''
In Task Manager, does firefox.exe show in the '''Processes''' tab?
See: [http://kb.mozillazine.org/Kill_application Kill Application]
'''Causes and solutions for Firefox hanging at exit:'''
[[Firefox hangs]]
[http://kb.mozillazine.org/Firefox_hangs#Hang_at_exit Firefox hangs at exit]
[[Firefox is already running but is not responding]]
'''Safe Mode'''
You may need to use '''[[Safe Mode]]''' (click on "Safe Mode" and read) to localize the problem. Firefox Safe Mode is a diagnostic mode that disables Extensions and some other features of Firefox. If you are using a theme, switch to the DEFAULT theme: Tools > Add-ons > Themes '''before''' starting Safe Mode. When entering Safe Mode, do not check any items on the entry window, just click "Continue in Safe Mode". Test to see if the problem you are experiencing is corrected.
See:
'''[[Troubleshooting extensions and themes]]'''
'''[[Troubleshooting plugins]]'''
'''[[Basic Troubleshooting]]'''
If the problem does not occur in Safe-mode then disable all of your Extensions and Plug-ins and then try to find which is causing it by enabling '''one at a time''' until the problem reappears. '''You MUST close and restart Firefox after EACH change''' via File > Restart Firefox (on Mac: Firefox > Quit). You can use "Disable all add-ons" on the Safe mode start window.

My macbook keeps asking me to use an administrator and their password to continue but nobody seems to know who is the administrator for this computer...does anyone know how to avoid this this or figure out who the administrator is?

My macbook keeps asking me to use an administrator and their password to continue but nobody seems to know who is the administrator for this computer...does anyone know how to avoid this this or figure out who the administrator is?

Lynne130,
to figure out which users have administrative privileges, open the Users & Groups pane of System Preferences; each user other than the Guest User will be shown with a description of either “Admin” or “Standard”. It’s typical for the first user created on a Mac to be an administrative user.

Trying to get my fcp project to burn to dvd at the highest quality? Ive used compressor and then tried to put it in dvdsp put its not working. I am having problems with the audio or when i burn it , i cant play the dvd? any help would be appreciated

Ive used compressor and then tried to put it in dvdsp put its not working. I am having problems with the audio or when i burn it , i cant play the dvd? any help would be appreciated

I suspect you are attempting to burn an HD DVD, which will not play on a DVD player...
But if you provide more details such as the settings you are applying in Compressor, then we would be able to provide you more accurate information.
How are you adding the files to Compressor?
In FCP, what are your footage properties (command-9) and sequence settings (command-0)

Hardware compressor and am not quite sure how to use it in logic express 9. Please help???

I recently bought a dbx hardware compressor and am not quite sure how to use it in logic express 9. I hav a focusrite saffire 6 usb audio interface and am not sure how to use it in logic. Please help???

Hi Ujjawal,
Use the Tab-order property of IR object.
In design mode, select the any command button, right click and select the property. you will find the window for "Tab-Order". It lists all the objects available in that dashboard. Here you can arrange the tab order..
Hope it will help you.
Thanks & Regards,
Mohit Jain

I recently bought a dbx hardware compressor and am not quite sure how to use it in logic express 9. I hav a focusrite saffire 6 usb audio interface and am not dont how to use it in logic. Please help???

I recently bought a dbx hardware compressor and am not quite sure how to use it in logic express 9. I hav a focusrite saffire 6 usb audio interface and am not dont how to use it in logic. Please help???

MUYconfundido wrote:
Pancenter,
Thanks for the response, but I do not have a midi interface. I am using a midi to usb connector cable, thus bypassing the need for a Midi interface.
The Mac reads the USB cable as a midi device, but not the keyboard that I am trying to use as a controller. I have tried it with my korg sp 300 and with my Nord Electro 2.
Thoughts?
Thanks,
Tristan
Tristan...
This is what you have, correct?
http://www.alesis.com/usbmidicable
This from Alesis..
"The AudioLink Series USB cable receives and outputs MIDI signal thanks to its internal interface. The USB-MIDI Cable connects plug-and-play to your Mac or PC for an all-in-one USB-MIDI solution."
Notice, -internal interface-. What you have is a simple USB MIDI Interface. Most MIDI interfaces are USB.
My point is (was), MIDI OUT of the Korg goes to the connector marked MIDI IN on the Alesis, those new to MIDI often get this wrong.
pancenter-

Apache 1.3.27 with plugin WL7 and concurrent use of WLS5.1 and WLS7.0 SP1 cluster server

We plan to use WLS 5.1 and WLS 7.0 for different applications (and
clusters), but with the same Apache Webservers.
The installation of the Apache HTTP Server Plug-In is documented in
http://e-docs.bea.com/wls/docs70/plugins/apache.html, but I could not
find information about downward compatibility from the mod_wl.so. Can we
upgrade the Plugin to 7.0 to serve both, the WLS 5.1 and WLS 7.0 ?

You are in unchartered territory. But check the common "gotcha" and
make sure that all the Oracle environment variables are set in the
shell that starts Apache. Load the script <?php phpinfo(); ?> in a
browser and see that whatever variables you need are set in the
Environment section. See the section "Oracle Environment Variables
for Connections" in Underground PHP and Oracle Manual
I suspect it would be beneficial to migrate the PHP code to oci8.
Check table 16-1 in Underground PHP and Oracle Manual for the mapping
between 'oracle' and 'oci8' functions.
-- cj

Compressor and Clusters - using Cluster Administrator Cores

Similar Messages

Maybe you are looking for