PriorityProcessor's timeout ignored

Question

Dear all,
I can't get the PriorityProcessor timeout working with Coherence 3.5.3/465 invoking on long EntryProcessor on a partionned/distributed cache. The timeout (both unlimited and MAX_LONG) seem to be ignored, after about 30 seconds, my entry processor is interrupted by an InterruptedException and Coherence emmits the following error message :
2010-05-21 12:44:00.385/36.954 Oracle Coherence GE 3.5.3/465 <Error> (thread=Cluster, member=1):
   Attempting recovery (due to soft timeout) of Guard{Daemon=DistributedCache}Does anyone knows how to prevent timeouts on an entry processor ?
Thanks,
Cyrille
Cyrille Le Clerc
[email protected]
Here is a test case to reproduce this InterruptedTimeout.
import org.junit.Test;
import com.tangosol.net.CacheFactory;
import com.tangosol.util.InvocableMap.Entry;
import com.tangosol.util.processor.AbstractProcessor;
import com.tangosol.util.processor.PriorityProcessor;
* @author Cyrille Le Clerc
public class PriorityProcessorTest {
  public static class SleepProcessor extends AbstractProcessor {
    private final long sleepDurationInMillis;
    public SleepProcessor(long sleepDurationInMillis) {
      super();
      this.sleepDurationInMillis = sleepDurationInMillis;
    @Override
    public Object process(Entry entry) {
      try {
        Thread.sleep(sleepDurationInMillis);
      } catch (InterruptedException e) {
        throw new RuntimeException(e);
      return null;
  @Test
  public void testPriorityProcessorWithLongRunningEntryProcessor() {
    System.setProperty("tangosol.coherence.wka", "localhost");
    long threeMinutesInMillis = 3 * 60 * 1000;
    SleepProcessor sleepProcessor = new SleepProcessor(threeMinutesInMillis);
    PriorityProcessor priorityProcessor = new PriorityProcessor(sleepProcessor);
    priorityProcessor.setExecutionTimeoutMillis(2 * threeMinutesInMillis);
    priorityProcessor.setRequestTimeoutMillis(2 * threeMinutesInMillis);
    long timeBefore = System.currentTimeMillis();
    try {
      CacheFactory.getCache("dist-test").invoke("test", priorityProcessor);
    } finally {
      System.out.println("Execution duration: " + (System.currentTimeMillis() - timeBefore) +
        " ms, expected duration: " + threeMinutesInMillis + " ms");
}The output is :
2010-05-21 12:44:00.385/36.954 Oracle Coherence GE 3.5.3/465 <Error> (thread=Cluster, member=1):
   Attempting recovery (due to soft timeout) of Guard{Daemon=DistributedCache}
Execution duration: 36563 ms, expected duration: 180000 ms
(Wrapped: Failed request execution for DistributedCache service on Member(...))
   java.lang.RuntimeException: java.lang.InterruptedException: sleep interrupted
  at c.t.util.Base.ensureRuntimeException(Base.java:293)
  at c.t.c.c.util.daemon.queueProcessor.service.Grid.tagException(Grid.CDB:36)
  at c.t.c.c.util.daemon.queueProcessor.service.grid.DistributedCache.onInvokeRequest(DistributedCache.CDB:80)
  at c.t.c.c.util.daemon.queueProcessor.service.grid.DistributedCache$InvokeRequest.run(DistributedCache.CDB:1)
  at c.t.c.c.net.message.requestMessage.DistributedCacheKeyRequest.onReceived(DistributedCacheKeyRequest.CDB:12)
  at c.t.c.c.util.daemon.queueProcessor.service.Grid.onMessage(Grid.CDB:9)
  at c.t.c.c.util.daemon.queueProcessor.service.Grid.onNotify(Grid.CDB:136)
  at c.t.c.c.util.daemon.queueProcessor.service.grid.DistributedCache.onNotify(DistributedCache.CDB:3)
  at c.t.c.c.util.Daemon.run(Daemon.CDB:42)
  at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.RuntimeException: java.lang.InterruptedException: sleep interrupted
  at PriorityProcessorTest$SleepProcessor.process(PriorityProcessorTest.java:28)
  at c.t.util.processor.PriorityProcessor.process(PriorityProcessor.java:77)
  at c.t.c.c.util.daemon.queueProcessor.service.grid.DistributedCache$Storage.invoke(DistributedCache.CDB:20)
  at c.t.c.c.util.daemon.queueProcessor.service.grid.DistributedCache.onInvokeRequest(DistributedCache.CDB:50)
  ... 7 more
Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at PriorityProcessorTest$SleepProcessor.process(PriorityProcessorTest.java:26)
  ... 10 more

Answer 1

Thanks Mark,
You solved my problem. I din't declare a thread pool on my Cache configuration and the timeout was ignored. This makes sense as my request was running on the service thread.
If fixed this adding a "<thread-count>" element to my distributed "<distributed-scheme>". It looks like :
[xml]<distributed-scheme>
<scheme-name>example-distributed</scheme-name>
<service-name>DistributedCache</service-name>
<!-- THREAD-COUNT IS REQUIRED TO BENEFIT OF PRIORITY_PROCESSOR.TIMEOUT -->
<thread-count>50</thread-count>
<backing-map-scheme>
<local-scheme>
<scheme-ref>example-binary-backing-map</scheme-ref>
</local-scheme>
</backing-map-scheme>
<autostart>true</autostart>
</distributed-scheme>[xml]
Thanks for your help,
Cyrille