Error: Attempting recovery (due to soft timeout) of Guard

Question

I'm getting this error...
2009-07-31 18:02:03.311/735.778 Oracle Coherence GE 3.5/459 <Error> (thread=Cluster, member=1): Attempting recovery (due to soft timeout) of Guard{Daemon=DistributedCache}...from this code. I get to the aggregate() command and then it's wait.. wait..wait.. until the recovery error above shows up and execution continues. There are no items in the NamedCache returned by Position.getCache() so it's not like this aggregator is legitimately taking ages to run.
public class MyProcessor extends AbstractProcessor {
public Object process(InvocableMap.Entry entry) {
   final LongSum sizeSumAgg= new com.tangosol.util.aggregator.LongSum("getSize");
   final Filter f = new EqualsFilter("getSymbol", o.getSymbol());
   if (threadExecutor == null) {
     threadExecutor = Executors.newFixedThreadPool(1);
   Future<Integer> f = threadExecutor.submit( new Callable<Integer>() {
     public Integer call() {
       Long p = (Long)Position.getCache().aggregate(f, sizeSumAgg); //takes ages!
       return p.intValue();
   int positionSize=0;
   try {
     positionSize = f.get();
   } catch (InterruptedException e) {
   } catch (ExecutionException e) {
...Thanks,
Andrew

Answer 1

Hi Andrew,
The message that you are seeing is indicating that the DistributedCache service thread is unresponsive (actually most likely deadlocked).
In this case, I think the service thread is blocked while invoking an EP, waiting on a Future to complete (presumably on a different thread). The future, in turn, is trying to do an aggregation, the result of which is waiting on the DistributedCache service thread to be free.
See: http://wiki.tangosol.com/display/COH34UG/Constraints+on+Re-entrant+Calls
thanks,
-Rob