Cluster services UNKNOWN state
Hi,
I am having two node cluster database. I have some doubt
If cluster services will go UNKNOWN state in first node existing connection will failover to second node?
New connections will try to connect first node?
user2017273 wrote:
Hi,
I am having two node cluster database. I have some doubtQuit doubting and TEST it for yourself. Also actually reading the documentation will help
>
If cluster services will go UNKNOWN state in first node existing connection will failover to second node?
Maybe...
New connections will try to connect first node?If nodex is down any connection attempt should go to the remaining nodes.
Similar Messages
-
Hello All,
I have a 2 node RAC cluster running on Oracle 11G on Windows 2003. Everything appears to be working fine, but I have some services in an unknown state.
If I stop all services using CRSCTL STOP CRS on any node, all services go offline as expected and OEM shows the fact that one of the nodes (instances) is no longer available.
If I then issue CRSCTL START CRS on any node all services start up OK except for the .INST and .DB services. Issuing the CRS_STAT -T the .INST service shows as 'online' but its state is 'unknown'. The .DB service for the database shows as 'offline'.
The stopped DB Instance does not start up automatically. If I try to start it using SRVCTL I get a CRS-0223 'Placement' error message . To get my stopped DB Instance to startup the only way I have found is to log on to sqlplus as SYS and issue the startup command. The instance then starts up with no problems
I'm confused as to why the above mentioned .INST and .DB services dont appear to be in a correct state yet my RAC cluster appears to function correctly. Any advice on this would be greatly appreciated .
Thanks,
ShaunI wouldn't use crsctl stop crs to stop the services, that shutdown the entire clusterware environment. Use "crs_stop -all" instead.
As for your issue, did you check the alert log just after clusterware tries to start up the db?
Check the alert log on the databases that are not coming up automatically. There's probably an error in there. -
Replica nodes going in 'UNKNOWN' state
Hello,
I have a 4 node cluster with 2 nodes assigned to 2 replica groups. When master node of one of my replicas failed, as mentioned in document, I expected my other node (replica) to become master but instead it went into UNKNOWN state. Hence I am unable to write data.
Kindly help.
-Rishabh Agrawal
Edited by: Rishabh Agrawal on Jun 25, 2012 5:05 AMHello Charles,
Following is the log u asked:
06-25-12 17:13:21:90 UTC+5:30 INFO [rg1-rn2] JE: Shutting down node rg1-rn2(2)
06-25-12 17:13:21:90 UTC+5:30 INFO [rg1-rn2] JE: Refreshed 0 monitors.
06-25-12 17:13:21:91 UTC+5:30 INFO [rg1-rn1] JE: Exiting inner Replica loop.
06-25-12 17:13:21:90 UTC+5:30 INFO [rg1-rn2] JE: Elections shutdown initiated
06-25-12 17:13:21:91 UTC+5:30 INFO [rg1-rn1] JE: Replica stats - Lag waits: 0 Lag wait time: 0ms. VLSN waits: 0 Lag wait time: 0ms.
06-25-12 17:13:21:90 UTC+5:30 INFO [rg1-rn2] JE: Elections shutdown completed
06-25-12 17:13:21:91 UTC+5:30 INFO [rg1-rn1] State change event: Mon Jun 25 17:13:21 IST 2012, State: UNKNOWN, Master: none
06-25-12 17:13:21:90 UTC+5:30 INFO [rg1-rn2] JE: Feeder manager soft shutdown.
06-25-12 17:13:21:91 UTC+5:30 INFO [rg1-rn1] JE: Election initiated; election #2
06-25-12 17:13:21:90 UTC+5:30 INFO [rg1-rn2] JE: Shutting down feeder for replica rg1-rn1 write time: 36ms Avg write time: 62us
06-25-12 17:13:21:91 UTC+5:30 INFO [rg1-rn1] JE: Election in progress. Waiting....
06-25-12 17:13:21:91 UTC+5:30 INFO [rg1-rn1] JE: Started election thread Mon Jun 25 17:13:21 IST 2012
06-25-12 17:14:02:22 UTC+5:30 INFO [admin1] [admin1] sn2: Service status: UNREACHABLE 06-25-12 17:14:02
06-25-12 17:14:02:22 UTC+5:30 INFO [admin1] [admin1] rg1-rn2: Service status: UNREACHABLE 06-25-12 17:14:00
-Rishabh
Edited by: Rishabh Agrawal on Jun 25, 2012 5:30 AM
Edited by: Rishabh Agrawal on Jun 25, 2012 5:31 AM -
Weblogic servers - Unknown state - Coherence error - OutOfMemory
Dear members,
Weblogic servers are going to unknown state after the failure of ORA-OSB-Deployments(which is used by Oracle Coherence) and OutOfMemory exception.
Server version - 10.3.6.0
Coherence Version - Oracle Coherence 3.7.1.1
Scenario - While retrieving the value from coherence cache via sb protocol.
Error Stack
com.bea.wli.sb.service.resultcache.ResultCacheException: An unexpected exception was thrown while using the result cache: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED) The exception message should provide more detail.
java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.get(PartitionedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.get(SafeNamedCache.CDB:1)
at com.bea.alsb.coherence.impl.CoherenceCache.get(CoherenceCache.java:83)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:201)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:68)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatchCachedResponse(PipelineContextImpl.java:730)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:611)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:84)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:141)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:55)
at com.bea.wli.sb.pipeline.Node.processMessage(Node.java:67)
Caused By: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
<Notice> <Diagnostics> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'SERVER_NAME' has triggered at 25-Mar-2015 14:04:50 o'clock GMT. Notification details:
WatchRuleType: Log
WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'WL-101020') OR (MSGID = 'WL-101017') OR (MSGID = 'WL-000802') OR (MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))
WatchData: DATE = 25-Mar-2015 14:03:55 o'clock GMT SERVER = SERVER_NAME MESSAGE = ExecuteRequest failed
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 4K.
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 4K
at weblogic.utils.io.Chunk.<init>(Chunk.java:318)
at weblogic.utils.io.Chunk.getChunk(Chunk.java:153)
at weblogic.utils.io.ChunkedOutputStream.<init>(ChunkedOutputStream.java:28)
at weblogic.utils.io.ChunkedDataOutputStream.<init>(ChunkedDataOutputStream.java:15)
at weblogic.servlet.internal.ResponseHeaders$1.<init>(ResponseHeaders.java:397)
at weblogic.servlet.internal.ResponseHeaders.writeHeaders(ResponseHeaders.java:397)
at weblogic.servlet.internal.ServletResponseImpl.writeHeaders(ServletResponseImpl.java:1288)
at weblogic.servlet.internal.ServletOutputStreamImpl.sendHeaders(ServletOutputStreamImpl.java:281)
at weblogic.servlet.internal.ServletOutputStreamImpl.flush(ServletOutputStreamImpl.java:118)
at weblogic.servlet.internal.ServletOutputStreamImpl.commit(ServletOutputStreamImpl.java:491)
at weblogic.servlet.internal.ServletResponseImpl.send(ServletResponseImpl.java:1531)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1498)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
Kindly help
Regards
RamSri - Thanks for your response.
Please find below the JVM memory setting of the managed server where the OSB application is deployed
-Xms:2048m -Xmx:2048m -Xns:700m -Xgc:gencon -XX:+UseNewHashFunction
I don't think there is any problem with the JVM settings as it is working in other domains. PFB full stack trace
<25-Mar-2015 13:36:20 o'clock GMT> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '248' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "633" seconds working on the request "Workmanager: weblogic.kernel.Default, Version: 1, Scheduled=false, Started=true, Started time: 633240 ms
", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-819 "[STUCK] ExecuteThread: '248' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, parked, priority=1, DAEMON> {
java.util.concurrent.locks.LockSupport.park(LockSupport.java:154)
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:811)
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:957)
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1278)
java.util.concurrent.Semaphore.acquire(Semaphore.java:286)
com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invoke(SBDispatcherBean.java:118)
com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invokeNoTxWithImmutable(SBDispatcherBean.java:518)
com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.__WL_invoke(Unknown Source)
weblogic.ejb.container.internal.SessionRemoteMethodInvoker.invoke(SessionRemoteMethodInvoker.java:21)
com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.invokeNoTxWithImmutable(Unknown Source)
com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_WLSkel.invoke(Unknown Source)
weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:136)
weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:338)
weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:237)
com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_1036_WLStub.invokeNoTxWithImmutable(Unknown Source)
com.bea.wli.sb.transports.client.impl.SBClientConnection.invoke(SBClientConnection.java:152)
com.bea.wli.sb.transports.sb.SBOutboundConnection.invoke(SBOutboundConnection.java:159)
com.bea.wli.sb.transports.client.impl.SBConnectionBase.send(SBConnectionBase.java:67)
com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper$1.run(SBOutboundMessageContext.java:567)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:142)
weblogic.security.Security.runAs(Security.java:60)
com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper.invoke(SBOutboundMessageContext.java:583)
com.bea.wli.sb.transports.sb.SBOutboundMessageContext.send(SBOutboundMessageContext.java:178)
com.bea.wli.sb.transports.sb.SBTransportProvider.sendMessageAsync(SBTransportProvider.java:1017)
sun.reflect.GeneratedMethodAccessor29293.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.bea.wli.sb.transports.Util$1.invoke(Util.java:57)
com.sun.proxy.$Proxy127.sendMessageAsync(Unknown Source)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:135)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:477)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:444)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:528)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:432)
com.bea.alsb.flow.messaging.dispatcher.servicebus.TransportDispatcherDelegate.send(TransportDispatcherDelegate.java:54)
com.bea.alsb.flow.messaging.dispatcher.servicebus.TransactionalDispatcherDelegate.send(TransactionalDispatcherDelegate.java:47)
com.bea.alsb.flow.messaging.dispatcher.servicebus.ResultCacheDispatcherDelegate.send(ResultCacheDispatcherDelegate.java:47)
com.bea.alsb.flow.messaging.dispatcher.ServiceBusDispatcherHandler.send(ServiceBusDispatcherHandler.java:80)
com.bea.bpel.services.messaging.OutboundDispatcherServiceImpl.send(OutboundDispatcherServiceImpl.java:72)
com.bea.bpel.internal.dispatcher.OutboundDispatcherImpl.dispatch(OutboundDispatcherImpl.java:83)
com.bea.bpel.interpreter.internal.instruction.messaging.InvokeRequest.enter(InvokeRequest.java:63)
com.bea.bpel.interpreter.internal.process.ProcessNodeImpl.enter(ProcessNodeImpl.java:181)
com.bea.bpel.interpreter.internal.Interpreter.interpret(Interpreter.java:141)
com.bea.bpel.interpreter.internal.Interpreter.invoke(Interpreter.java:79)
com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:56)
com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:44)
com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEventJobScheduled(SchedulerServiceContextImpl.java:79)
com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEvent(SchedulerServiceContextImpl.java:65)
com.bea.alsb.flow.scheduler.SchedulerServiceImpl$1.run(SchedulerServiceImpl.java:33)
weblogic.work.ContextWrap.run(ContextWrap.java:39)
com.bea.alsb.platform.weblogic.WlsWorkManagerServiceImpl$WorkAdapter.run(WlsWorkManagerServiceImpl.java:152)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:250)
weblogic.work.ExecuteThread.run(ExecuteThread.java:213)
>
<25-Mar-2015 13:38:13 o'clock GMT> <Error> <Socket> <BEA-000405> <Uncaught Throwable in processSockets
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 4K.
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 4K
at weblogic.utils.io.Chunk.<init>(Chunk.java:318)
at weblogic.utils.io.Chunk.getChunk(Chunk.java:153)
at weblogic.servlet.internal.ChunkOutput.<init>(ChunkOutput.java:114)
at weblogic.servlet.internal.ChunkOutput.create(ChunkOutput.java:160)
at weblogic.servlet.internal.ServletOutputStreamImpl.<init>(ServletOutputStreamImpl.java:102)
Truncated. see log file for complete stacktrace
>
<25-Mar-2015 13:38:36 o'clock GMT> <Error> <OSB Transform> <BEA-382515> <Callout to java method "public static final void com.bt.util.logging.E2EStaticTransaction.startInboundCall(com.bt.util.logging.E2ETransaction)" resulted in exception: null
java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor180625.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at stages.transform.runtime.JavaCalloutRuntimeStep$1.run(JavaCalloutRuntimeStep.java:183)
at stages.transform.runtime.JavaCalloutRuntimeStep.processMessage(JavaCalloutRuntimeStep.java:205)
Truncated. see log file for complete stacktrace
Caused By: java.lang.OutOfMemoryError: allocLargeObjectOrArray: [C, size 2224
at com.bt.util.logging.TextFileLogDriver.log(TextFileLogDriver.java:539)
at com.bt.util.logging.LogDirector.logAsync(LogDirector.java:143)
at com.bt.util.logging.LogDirector.log(LogDirector.java:79)
at com.bt.util.logging.LogManager.log(LogManager.java:363)
at com.bt.util.logging.MessagesBundle.log(MessagesBundle.java:69)
Truncated. see log file for complete stacktrace
>
<25-Mar-2015 13:46:44 o'clock GMT> <Warning> <OSB Kernel> <BEA-398300> <Checking result cache for service BusinessService CoherenceCache caused an exception:
com.bea.wli.sb.service.resultcache.ResultCacheException: An unexpected exception was thrown while using the result cache: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED) The exception message should provide more detail.
java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.get(PartitionedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.get(SafeNamedCache.CDB:1)
at com.bea.alsb.coherence.impl.CoherenceCache.get(CoherenceCache.java:83)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:201)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:68)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatchCachedResponse(PipelineContextImpl.java:730)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:611)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:84)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:141)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:55)
at com.bea.wli.sb.pipeline.Node.processMessage(Node.java:67)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Router.processMessage(Router.java:214)
at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:101)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:597)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:595)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at com.bea.wli.sb.security.WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:594)
at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean$SBRequestTask.run(SBDispatcherBean.java:822)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invoke(SBDispatcherBean.java:282)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invokeNoTxWithImmutable(SBDispatcherBean.java:522)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionRemoteMethodInvoker.invoke(SessionRemoteMethodInvoker.java:40)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:174)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:345)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:259)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_1036_WLStub.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.client.impl.SBClientConnection.invoke(SBClientConnection.java:169)
at com.bea.wli.sb.transports.sb.SBOutboundConnection.invoke(SBOutboundConnection.java:165)
at com.bea.wli.sb.transports.client.impl.SBConnectionBase.send(SBConnectionBase.java:81)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper$1.run(SBOutboundMessageContext.java:567)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at weblogic.security.Security.runAs(Security.java:61)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper.invoke(SBOutboundMessageContext.java:606)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext.send(SBOutboundMessageContext.java:266)
at com.bea.wli.sb.transports.sb.SBTransportProvider.sendMessageAsync(SBTransportProvider.java:1026)
at sun.reflect.GeneratedMethodAccessor29293.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.bea.wli.sb.transports.Util$1.invoke(Util.java:83)
at com.sun.proxy.$Proxy127.sendMessageAsync(Unknown Source)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransportDispatcherDelegate.send(TransportDispatcherDelegate.java:66)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransactionalDispatcherDelegate.send(TransactionalDispatcherDelegate.java:51)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.ResultCacheDispatcherDelegate.send(ResultCacheDispatcherDelegate.java:50)
at com.bea.alsb.flow.messaging.dispatcher.ServiceBusDispatcherHandler.send(ServiceBusDispatcherHandler.java:93)
at com.bea.bpel.services.messaging.OutboundDispatcherServiceImpl.send(OutboundDispatcherServiceImpl.java:73)
at com.bea.bpel.internal.dispatcher.OutboundDispatcherImpl.dispatch(OutboundDispatcherImpl.java:91)
at com.bea.bpel.interpreter.internal.instruction.messaging.InvokeRequest.enter(InvokeRequest.java:90)
at com.bea.bpel.interpreter.internal.process.ProcessNodeImpl.enter(ProcessNodeImpl.java:181)
at com.bea.bpel.interpreter.internal.Interpreter.interpret(Interpreter.java:155)
at com.bea.bpel.interpreter.internal.Interpreter.invoke(Interpreter.java:87)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:66)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:44)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEventJobScheduled(SchedulerServiceContextImpl.java:87)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEvent(SchedulerServiceContextImpl.java:68)
at com.bea.alsb.flow.scheduler.SchedulerServiceImpl$1.run(SchedulerServiceImpl.java:33)
at weblogic.work.ContextWrap.run(ContextWrap.java:41)
at com.bea.alsb.platform.weblogic.WlsWorkManagerServiceImpl$WorkAdapter.run(WlsWorkManagerServiceImpl.java:152)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
com.bea.wli.sb.service.resultcache.ResultCacheException: An unexpected exception was thrown while using the result cache: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED) The exception message should provide more detail.
java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.get(PartitionedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.get(SafeNamedCache.CDB:1)
at com.bea.alsb.coherence.impl.CoherenceCache.get(CoherenceCache.java:83)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:201)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:68)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatchCachedResponse(PipelineContextImpl.java:730)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:611)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:84)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:141)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:55)
at com.bea.wli.sb.pipeline.Node.processMessage(Node.java:67)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Router.processMessage(Router.java:214)
at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:101)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:597)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:595)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at com.bea.wli.sb.security.WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:594)
at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean$SBRequestTask.run(SBDispatcherBean.java:822)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invoke(SBDispatcherBean.java:282)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invokeNoTxWithImmutable(SBDispatcherBean.java:522)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionRemoteMethodInvoker.invoke(SessionRemoteMethodInvoker.java:40)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:174)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:345)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:259)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_1036_WLStub.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.client.impl.SBClientConnection.invoke(SBClientConnection.java:169)
at com.bea.wli.sb.transports.sb.SBOutboundConnection.invoke(SBOutboundConnection.java:165)
at com.bea.wli.sb.transports.client.impl.SBConnectionBase.send(SBConnectionBase.java:81)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper$1.run(SBOutboundMessageContext.java:567)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at weblogic.security.Security.runAs(Security.java:61)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper.invoke(SBOutboundMessageContext.java:606)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext.send(SBOutboundMessageContext.java:266)
at com.bea.wli.sb.transports.sb.SBTransportProvider.sendMessageAsync(SBTransportProvider.java:1026)
at sun.reflect.GeneratedMethodAccessor29293.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.bea.wli.sb.transports.Util$1.invoke(Util.java:83)
at com.sun.proxy.$Proxy127.sendMessageAsync(Unknown Source)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransportDispatcherDelegate.send(TransportDispatcherDelegate.java:66)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransactionalDispatcherDelegate.send(TransactionalDispatcherDelegate.java:51)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.ResultCacheDispatcherDelegate.send(ResultCacheDispatcherDelegate.java:50)
at com.bea.alsb.flow.messaging.dispatcher.ServiceBusDispatcherHandler.send(ServiceBusDispatcherHandler.java:93)
at com.bea.bpel.services.messaging.OutboundDispatcherServiceImpl.send(OutboundDispatcherServiceImpl.java:73)
at com.bea.bpel.internal.dispatcher.OutboundDispatcherImpl.dispatch(OutboundDispatcherImpl.java:91)
at com.bea.bpel.interpreter.internal.instruction.messaging.InvokeRequest.enter(InvokeRequest.java:90)
at com.bea.bpel.interpreter.internal.process.ProcessNodeImpl.enter(ProcessNodeImpl.java:181)
at com.bea.bpel.interpreter.internal.Interpreter.interpret(Interpreter.java:155)
at com.bea.bpel.interpreter.internal.Interpreter.invoke(Interpreter.java:87)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:66)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:44)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEventJobScheduled(SchedulerServiceContextImpl.java:87)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEvent(SchedulerServiceContextImpl.java:68)
at com.bea.alsb.flow.scheduler.SchedulerServiceImpl$1.run(SchedulerServiceImpl.java:33)
at weblogic.work.ContextWrap.run(ContextWrap.java:41)
at com.bea.alsb.platform.weblogic.WlsWorkManagerServiceImpl$WorkAdapter.run(WlsWorkManagerServiceImpl.java:152)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:205)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:69)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1394)
Truncated. see log file for complete stacktrace
Caused By: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
Truncated. see log file for complete stacktrace
>
<25-Mar-2015 13:47:06 o'clock GMT> <Warning> <OSB Kernel> <BEA-398300> <Checking result cache for service BusinessService CoherenceCache caused an exception:
com.bea.wli.sb.service.resultcache.ResultCacheException: An unexpected exception was thrown while using the result cache: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED) The exception message should provide more detail.
java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.get(PartitionedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.get(SafeNamedCache.CDB:1)
at com.bea.alsb.coherence.impl.CoherenceCache.get(CoherenceCache.java:83)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:201)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:68)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatchCachedResponse(PipelineContextImpl.java:730)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:611)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:84)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:141)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:55)
at com.bea.wli.sb.pipeline.Node.processMessage(Node.java:67)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Router.processMessage(Router.java:214)
at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:101)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:597)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:595)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at com.bea.wli.sb.security.WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:594)
at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean$SBRequestTask.run(SBDispatcherBean.java:822)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invoke(SBDispatcherBean.java:282)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invokeNoTxWithImmutable(SBDispatcherBean.java:522)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionRemoteMethodInvoker.invoke(SessionRemoteMethodInvoker.java:40)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:174)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:345)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:259)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_1036_WLStub.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.client.impl.SBClientConnection.invoke(SBClientConnection.java:169)
at com.bea.wli.sb.transports.sb.SBOutboundConnection.invoke(SBOutboundConnection.java:165)
at com.bea.wli.sb.transports.client.impl.SBConnectionBase.send(SBConnectionBase.java:81)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper$1.run(SBOutboundMessageContext.java:567)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at weblogic.security.Security.runAs(Security.java:61)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper.invoke(SBOutboundMessageContext.java:606)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext.send(SBOutboundMessageContext.java:266)
at com.bea.wli.sb.transports.sb.SBTransportProvider.sendMessageAsync(SBTransportProvider.java:1026)
at sun.reflect.GeneratedMethodAccessor29293.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.bea.wli.sb.transports.Util$1.invoke(Util.java:83)
at com.sun.proxy.$Proxy127.sendMessageAsync(Unknown Source)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransportDispatcherDelegate.send(TransportDispatcherDelegate.java:66)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransactionalDispatcherDelegate.send(TransactionalDispatcherDelegate.java:51)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.ResultCacheDispatcherDelegate.send(ResultCacheDispatcherDelegate.java:50)
at com.bea.alsb.flow.messaging.dispatcher.ServiceBusDispatcherHandler.send(ServiceBusDispatcherHandler.java:93)
at com.bea.bpel.services.messaging.OutboundDispatcherServiceImpl.send(OutboundDispatcherServiceImpl.java:73)
at com.bea.bpel.internal.dispatcher.OutboundDispatcherImpl.dispatch(OutboundDispatcherImpl.java:91)
at com.bea.bpel.interpreter.internal.instruction.messaging.InvokeRequest.enter(InvokeRequest.java:90)
at com.bea.bpel.interpreter.internal.process.ProcessNodeImpl.enter(ProcessNodeImpl.java:181)
at com.bea.bpel.interpreter.internal.Interpreter.interpret(Interpreter.java:155)
at com.bea.bpel.interpreter.internal.Interpreter.invoke(Interpreter.java:87)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:66)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:44)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEventJobScheduled(SchedulerServiceContextImpl.java:87)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEvent(SchedulerServiceContextImpl.java:68)
at com.bea.alsb.flow.scheduler.SchedulerServiceImpl$1.run(SchedulerServiceImpl.java:33)
at weblogic.work.ContextWrap.run(ContextWrap.java:41)
at com.bea.alsb.platform.weblogic.WlsWorkManagerServiceImpl$WorkAdapter.run(WlsWorkManagerServiceImpl.java:152)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
com.bea.wli.sb.service.resultcache.ResultCacheException: An unexpected exception was thrown while using the result cache: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED) The exception message should provide more detail.
java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.get(PartitionedCache.CDB:1)
at com.tangosol.coherence.component.util.SafeNamedCache.get(SafeNamedCache.CDB:1)
at com.bea.alsb.coherence.impl.CoherenceCache.get(CoherenceCache.java:83)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:201)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:68)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatchCachedResponse(PipelineContextImpl.java:730)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:611)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1391)
at stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:236)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:346)
at com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:84)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:141)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:55)
at com.bea.wli.sb.pipeline.Node.processMessage(Node.java:67)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:1095)
at com.bea.wli.sb.pipeline.Router.processMessage(Router.java:214)
at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:101)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:597)
at com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:595)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at com.bea.wli.sb.security.WLSSecurityContextService.runAs(WLSSecurityContextService.java:55)
at com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:594)
at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:398)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean$SBRequestTask.run(SBDispatcherBean.java:822)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invoke(SBDispatcherBean.java:282)
at com.bea.wli.sb.transports.sb.bean.SBDispatcherBean.invokeNoTxWithImmutable(SBDispatcherBean.java:522)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionRemoteMethodInvoker.invoke(SessionRemoteMethodInvoker.java:40)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:174)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:345)
at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:259)
at com.bea.wli.sb.transports.sb.bean.SBDispatcher_nwlqik_EOImpl_1036_WLStub.invokeNoTxWithImmutable(Unknown Source)
at com.bea.wli.sb.transports.client.impl.SBClientConnection.invoke(SBClientConnection.java:169)
at com.bea.wli.sb.transports.sb.SBOutboundConnection.invoke(SBOutboundConnection.java:165)
at com.bea.wli.sb.transports.client.impl.SBConnectionBase.send(SBConnectionBase.java:81)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper$1.run(SBOutboundMessageContext.java:567)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at weblogic.security.Security.runAs(Security.java:61)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext$SBInvokeHelper.invoke(SBOutboundMessageContext.java:606)
at com.bea.wli.sb.transports.sb.SBOutboundMessageContext.send(SBOutboundMessageContext.java:266)
at com.bea.wli.sb.transports.sb.SBTransportProvider.sendMessageAsync(SBTransportProvider.java:1026)
at sun.reflect.GeneratedMethodAccessor29293.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.bea.wli.sb.transports.Util$1.invoke(Util.java:83)
at com.sun.proxy.$Proxy127.sendMessageAsync(Unknown Source)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:148)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToServiceAsync(LoadBalanceFailoverListener.java:510)
at com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageToService(LoadBalanceFailoverListener.java:445)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:582)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:449)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransportDispatcherDelegate.send(TransportDispatcherDelegate.java:66)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.TransactionalDispatcherDelegate.send(TransactionalDispatcherDelegate.java:51)
at com.bea.alsb.flow.messaging.dispatcher.servicebus.ResultCacheDispatcherDelegate.send(ResultCacheDispatcherDelegate.java:50)
at com.bea.alsb.flow.messaging.dispatcher.ServiceBusDispatcherHandler.send(ServiceBusDispatcherHandler.java:93)
at com.bea.bpel.services.messaging.OutboundDispatcherServiceImpl.send(OutboundDispatcherServiceImpl.java:73)
at com.bea.bpel.internal.dispatcher.OutboundDispatcherImpl.dispatch(OutboundDispatcherImpl.java:91)
at com.bea.bpel.interpreter.internal.instruction.messaging.InvokeRequest.enter(InvokeRequest.java:90)
at com.bea.bpel.interpreter.internal.process.ProcessNodeImpl.enter(ProcessNodeImpl.java:181)
at com.bea.bpel.interpreter.internal.Interpreter.interpret(Interpreter.java:155)
at com.bea.bpel.interpreter.internal.Interpreter.invoke(Interpreter.java:87)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:66)
at com.bea.bpel.internal.dispatcher.EngineManagerImpl.dispatch(EngineManagerImpl.java:44)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEventJobScheduled(SchedulerServiceContextImpl.java:87)
at com.bea.bpel.internal.dispatcher.SchedulerServiceContextImpl.fireEvent(SchedulerServiceContextImpl.java:68)
at com.bea.alsb.flow.scheduler.SchedulerServiceImpl$1.run(SchedulerServiceImpl.java:33)
at weblogic.work.ContextWrap.run(ContextWrap.java:41)
at com.bea.alsb.platform.weblogic.WlsWorkManagerServiceImpl$WorkAdapter.run(WlsWorkManagerServiceImpl.java:152)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
at com.bea.wli.sb.service.resultcache.ResultCache.get(ResultCache.java:205)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.checkCache(ServiceResultCacheImpl.java:148)
at com.bea.wli.sb.service.resultcache.ServiceResultCacheImpl.processRequest(ServiceResultCacheImpl.java:69)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:560)
at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1394)
Truncated. see log file for complete stacktrace
Caused By: java.lang.RuntimeException: Failed to start Service "ORA-OSB-deployments" (ServiceState=SERVICE_STOPPED)
at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.waitAcceptingClients(Service.CDB:12)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:9)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.poll(Grid.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.get(PartitionedCache.CDB:26)
at com.tangosol.util.ConverterCollections$ConverterMap.get(ConverterCollections.java:1655)
Truncated. see log file for complete stacktrace
>
<25-Mar-2015 14:05:06 o'clock GMT> <Notice> <Diagnostics> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'SERVER_NAME' has triggered at 25-Mar-2015 14:04:50 o'clock GMT. Notification details:
WatchRuleType: Log
WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'WL-101020') OR (MSGID = 'WL-101017') OR (MSGID = 'WL-000802') OR (MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))
WatchData: DATE = 25-Mar-2015 14:03:55 o'clock GMT SERVER = SERVER_NAME MESSAGE = ExecuteRequest failed
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 4K.
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 4K
at weblogic.utils.io.Chunk.<init>(Chunk.java:318)
at weblogic.utils.io.Chunk.getChunk(Chunk.java:153)
at weblogic.utils.io.ChunkedOutputStream.<init>(ChunkedOutputStream.java:28)
at weblogic.utils.io.ChunkedDataOutputStream.<init>(ChunkedDataOutputStream.java:15)
at weblogic.servlet.internal.ResponseHeaders$1.<init>(ResponseHeaders.java:397)
at weblogic.servlet.internal.ResponseHeaders.writeHeaders(ResponseHeaders.java:397)
at weblogic.servlet.internal.ServletResponseImpl.writeHeaders(ServletResponseImpl.java:1288)
at weblogic.servlet.internal.ServletOutputStreamImpl.sendHeaders(ServletOutputStreamImpl.java:281)
at weblogic.servlet.internal.ServletOutputStreamImpl.flush(ServletOutputStreamImpl.java:118)
at weblogic.servlet.internal.ServletOutputStreamImpl.commit(ServletOutputStreamImpl.java:491)
at weblogic.servlet.internal.ServletResponseImpl.send(ServletResponseImpl.java:1531)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1498)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
SUBSYSTEM = Kernel USERID = <WLS Kernel> SEVERITY = Error THREAD = [STUCK] ExecuteThread: '26' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-000802 MACHINE = blp10865069 TXID = CONTEXTID = 582d5d390322c8f7:-346f60f0:14ae3e7dc81:-7ffd-0000000000897f09 TIMESTAMP = 1427292235779
WatchAlarmType: AutomaticReset
WatchAlarmResetPeriod: 30000
Many thanks in advance
Ram -
Composites in "Unknown" state after managed soa server restart
Hi,
I am using SOA suite 11.1.1.6 version on 64 bit OEL Linux. I am getting following error in managed server output log files:
Feb 20, 2013 5:59:32 AM IST> <Error> <oracle.integration.platform> <SOA-20003> <Unable to register service.
oracle.fabric.common.FabricException: Error in getting XML input stream: oramds:/deployed-composites/WirelessEnterprise/svcEnrichSEARequest_rev1.0/svcEnrichSEARequest.wsdl: oracle.mds.exception.MDSException: MDS-00054: The file to be loaded oramds:/deployed-composites/WirelessEnterprise/svcEnrichSEARequest_rev1.0/svcEnrichSEARequest.wsdl does not exist.
Though this composites gets loaded, the composites dependent on this composite goes into "Unknown" state. Other composites are properly loaded on server restart.
Please let us know if anybody has any solution to this problem.Hi,
Thanks for your help.
we have narrowed down to problem now.
The actual problem occurs while redeploying same composite on same revision.
E.g 3 composites A, B and C are deployed on and in "Up" state.
B And C composites depends on A.
B composite composite.xml has following entry
<import namespace="http://xmlns.oracle.com/A"
location="oramds:/deployed-composites/Enterprise/A_rev1.0/A.wsdl"
importType="wsdl"/>
same entry exist for C composite.xml as well.
Now whenever composite A is redeployed with same revision (1.0 in our case), and managed servers are restarted, B and C composites goes in to "Unknown" state.
Moving A.wsdl to /apps/wsdl/* in MDS works but it duplicates the A.wsdl file beacause it also exists in MDS @ /deployed-composites/Enterprise/A_rev1.0/A.wsdl
Please let us know if anyone has any solution.
Thanks,
Rupesh. -
Resources in UNKNOWN state after failover
Hi,
I'm new to RAC and trying to understand how to bring a node back online. See crsctl output below.
I've noted that the listener, ons and the database on the db01 node are all in an UNKNOWN state. The vip state is INTERMEDIATE.
The cause was activating a virtual NIC on the db01 node. The vNIC was deactivated but not before a failover.
I see oc4j is offline also which I believe is contributing to OEM dbconsole being unnavailable.
Please advise/suggest the best way forward to remedy this.
Mr C
[oracle@db01 ~]$ $ORACLE_HOME/bin/crsctl status resource -t
NAME TARGET STATE SERVER STATE_DETAILS
Local Resources
ora.DATA.dg
ONLINE ONLINE db01
ONLINE ONLINE db02
ora.FRA.dg
ONLINE ONLINE db01
ONLINE ONLINE db02
ora.LISTENER.lsnr
ONLINE UNKNOWN db01
ONLINE ONLINE db02
ora.VOTE.dg
ONLINE ONLINE db01
ONLINE ONLINE db02
ora.asm
ONLINE ONLINE db01 Started
ONLINE ONLINE db02 Started
ora.eons
ONLINE ONLINE db01
ONLINE ONLINE db02
ora.gsd
OFFLINE OFFLINE db01
OFFLINE OFFLINE db02
ora.net1.network
ONLINE ONLINE db01
ONLINE ONLINE db02
ora.ons
ONLINE UNKNOWN db01
ONLINE ONLINE db02
ora.registry.acfs
ONLINE ONLINE db01
ONLINE ONLINE db02
Cluster Resources
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE db02
ora.LISTENER_SCAN2.lsnr
1 ONLINE UNKNOWN db01
ora.LISTENER_SCAN3.lsnr
1 ONLINE UNKNOWN db01
ora.e1oradb.db
*1 OFFLINE UNKNOWN db01*
2 ONLINE ONLINE db02 Open
ora.db01.vip
*1 ONLINE INTERMEDIATE db02 FAILED OVER*
ora.db02.vip
1 ONLINE ONLINE db02
ora.oc4j
*1 OFFLINE OFFLINE*
ora.scan1.vip
1 ONLINE ONLINE db02
ora.scan2.vip
1 ONLINE ONLINE db02
ora.scan3.vip
1 ONLINE ONLINE db02
[oracle@db01 ~]$Thanks Sebastian,
I was a little busy so only now do I have the time to reply.
Another DBA was able to troubleshoot the root cause of the issue, which I will put here for the benefit of all.
Essentially the hosts file (see snippet below) contained multiple entries for the node name, both on the "localhost" line and also in the "Public" section. A quick edit solved the problem.
# Do not remove the following line, or various programs
# that require network functionality will fail.
#127.0.0.1 db02.placeholder.com.au db02 localhost.localdomain
localhost
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
# Public
ww.xx.yy.zzz db01.placeholder.com.au db01
ww.xx.yy.zzz db02.placeholder.com.au db02
# Private
ww.xx.yy.z db01-priv.placeholder.com.au db01-priv
ww.xx.yy.z db02-priv.placeholder.com.au db02-priv
# Virtual
ww.xx.yy.zzz db01-vip.placeholder.com.au db01-vip
ww.xx.yy.zzz db02-vip.placeholder.com.au db02-vip
Mr C -
DAG issue - Unable to start cluster service
Hello,
Let me brief my environment.
- 2 Sites
- 1 DAG, 4 Servers
- 2 Servers each site
Situation:
I have just updated the OS for all the servers in DAG and update all the Exchange Versions to SP3 RU3. One of the server in the DAG/cluster is down/unavailable. I figured that the cluster service on that server is disabled and not able to Start.
Errors:
Event ID:
- 7024 - The Cluster Service service terminated with service-specific error. The system cannot find the file specified..
- 7031 -
- in to ensure that this machine is a member of a cluster. If you intend to add this machine to an existing cluster use the Add Node Wizard. Alternatively, if this machine has been configured as a member of a cluster, it will be necessary to restore the
missing configuration data that is necessary for the Cluster Service to identify that it is a member of a cluster. Perform a System State Restore of this machine in order to restore the configuration data.
Please help meee....Hi,
From the error you provided above, it seems that a node(one server in DAG you mentioned above) doesn't belong to existing cluster. I recommend you join this node to cluster using
cluster node nodename /forcecleanup cmdlet and then restart cluster service.
Best regards,
Belinda
Belinda Ma
TechNet Community Support -
How do I restart Cluster services?
Can some one tell me ho do I restart Cluster Services?
Name Type Target State Host
ora....DB1.srv application ONLINE OFFLINE
ora....MSDB.cs application ONLINE OFFLINE
ora....B1.inst application ONLINE ONLINE fms-db1
ora....B2.inst application ONLINE ONLINE fms-db2
ora.FMSDB.db application ONLINE ONLINE fms-db2
ora....B1.lsnr application ONLINE ONLINE fms-db1
ora....db1.gsd application ONLINE OFFLINE
ora....db1.ons application ONLINE ONLINE fms-db1
ora....db1.vip application ONLINE ONLINE fms-db1
ora....B2.lsnr application ONLINE ONLINE fms-db2
ora....db2.gsd application ONLINE OFFLINE
ora....db2.ons application ONLINE ONLINE fms-db2
ora....db2.vip application ONLINE ONLINE fms-db2
????What did you mean Cluster Service?
If you mean Oracle Cluster,
1. You must root user.
2. use crsctl command-line
./crsctl stop crs
./crsctl start crs
Your Database and listener , they have resisted in Oracle Cluster, that down.
If you mean database service. You can use srvctl command-line to help you -
Ethernet showing 'Unknown state'
I have just bought a time Capsule wanted to backup using ethernet, but my iMac wouldn't detect the capsule. I tested it with my laptop and it found it fine, so the cable and capsule aren't the problem.
I found both ethernet and firewire ports showing 'inactive'. I activated them but now they both show 'unknown state'. I have always used wireless so don't know if the ethernet was always like this.
Any help would be greatly appreciated.
MikeI don't see where you said AirPort was OFF in the first post. And I did not mean to imply that you did not already have it connected with a Ethernet cable. Obviously, if you want it wired, there has to be a wire...
Try going to System Preferences Network pane. In the sidebar, if AirPort is listed above Ethernet, click on the little gear icon and select +Set Service Order+. Make Ethernet appear first on the list. Then try restarting. -
Cluster service is requested to stop on all nodes when DNS is unavailable
Our 6 node coherence cluster has been running fine for few days. All coherence nodes were requested to stop the cluster service when the DNS server was not available for few mins due to a scheduled maintenance activity. Cluster services didn’t come back up until the DNS server is available. Why would it need a DNS server when the cluster is already started and running fine for few days?
Here’s the error message and thread dump from the logs:
2010-12-18 18:07:18.819/3464791.277 Oracle Coherence GE 3.6.0.3 <Error> (thread=IpMonitor, member=7): Detected hard timeout) of {WrapperGuardable Guard{Daemon=Cluster} Service=ClusterService{Name=Cluster, State=(SERVICE_STARTED, STATE_JOINED), Id=0, Version=3.6, OldestMemberId=5}}
2010-12-18 18:07:18.823/3464791.281 Oracle Coherence GE 3.6.0.3 <Error> (thread=Termination Thread, member=7): Full Thread Dump
Thread[Invocation:Management:EventDispatcher,5,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.daemon.queueProcessor.Service$EventDispatcher.onWait(Service.CDB:7)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
Thread[Logger@9250962 3.6.0.3,3,main]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
Thread[Signal Dispatcher,9,system]
Thread[Finalizer,8,system]
java.lang.Object.wait(Native Method)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
Thread[Invocation:Management,5,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.onWait(Grid.CDB:6)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
ThreadCluster
java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:850)
java.net.InetAddress.getAddressFromNameService(InetAddress.java:1201)
java.net.InetAddress.getAllByName0(InetAddress.java:1154)
java.net.InetAddress.getAllByName(InetAddress.java:1084)
java.net.InetAddress.getAllByName(InetAddress.java:1020)
java.net.InetAddress.getByName(InetAddress.java:970)
java.net.InetSocketAddress.<init>(InetSocketAddress.java:124)
com.tangosol.net.ConfigurableAddressProvider$AddressHolder.getAddress(ConfigurableAddressProvider.java:426)
com.tangosol.net.ConfigurableAddressProvider$1.next(ConfigurableAddressProvider.java:167)
java.util.AbstractCollection.contains(AbstractCollection.java:89)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.isWellKnown(ClusterService.CDB:5)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.compareImportance(ClusterService.CDB:7)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.getWitnessMemberSet(ClusterService.CDB:49)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.verifyMemberLeft(ClusterService.CDB:91)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.onNotifyTcmpTimeout(ClusterService.CDB:11)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService$NotifyTcmpTimeout.onReceived(ClusterService.CDB:1)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.onMessage(Grid.CDB:11)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.onNotify(Grid.CDB:33)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.onNotify(ClusterService.CDB:3)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
java.lang.Thread.run(Thread.java:619)
Thread[main,5,main]
java.lang.Object.wait(Native Method)
com.tangosol.net.DefaultCacheServer.monitorServices(DefaultCacheServer.java:270)
com.tangosol.net.DefaultCacheServer.startAndMonitor(DefaultCacheServer.java:56)
com.tangosol.net.DefaultCacheServer.main(DefaultCacheServer.java:197)
Thread[PacketReceiver,7,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketReceiver.onWait(PacketReceiver.CDB:2)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
Thread[PacketSpeaker,8,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.queue.ConcurrentQueue.waitForEntry(ConcurrentQueue.CDB:16)
com.tangosol.coherence.component.util.queue.ConcurrentQueue.remove(ConcurrentQueue.CDB:7)
com.tangosol.coherence.component.util.Queue.remove(Queue.CDB:1)
com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketSpeaker.onNotify(PacketSpeaker.CDB:21)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
java.lang.Thread.run(Thread.java:619)
Thread[Termination Thread,6,Cluster]
java.lang.Thread.dumpThreads(Native Method)
java.lang.Thread.getAllStackTraces(Thread.java:1487)
com.tangosol.net.GuardSupport.logStackTraces(GuardSupport.java:810)
com.tangosol.coherence.component.net.Cluster$DefaultFailurePolicy.onGuardableTerminate(Cluster.CDB:4)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid$WrapperGuardable.terminate(Grid.CDB:1)
com.tangosol.net.GuardSupport$Context$2.run(GuardSupport.java:677)
java.lang.Thread.run(Thread.java:619)
Thread[Reference Handler,10,system]
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:485)
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
Thread[PacketPublisher,6,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketPublisher.onWait(PacketPublisher.CDB:2)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
Thread[DistributedCache,5,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.onWait(Grid.CDB:6)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
Thread[IpMonitor,6,Cluster]
java.lang.Object.wait(Native Method)
com.tangosol.coherence.component.util.Daemon.onWait(Daemon.CDB:18)
com.tangosol.coherence.component.util.daemon.IpMonitor.onWait(IpMonitor.CDB:4)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:39)
java.lang.Thread.run(Thread.java:619)
Thread[PacketListener1P,8,Cluster]
java.net.PlainDatagramSocketImpl.receive0(Native Method)
java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
java.net.DatagramSocket.receive(DatagramSocket.java:725)
com.tangosol.coherence.component.net.socket.UdpSocket.receive(UdpSocket.CDB:22)
com.tangosol.coherence.component.net.UdpPacket.receive(UdpPacket.CDB:1)
com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketListener.onNotify(PacketListener.CDB:20)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
java.lang.Thread.run(Thread.java:619)
Thread[PacketListener1,8,Cluster]
java.net.PlainDatagramSocketImpl.receive0(Native Method)
java.net.PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)
java.net.DatagramSocket.receive(DatagramSocket.java:725)
com.tangosol.coherence.component.net.socket.UdpSocket.receive(UdpSocket.CDB:22)
com.tangosol.coherence.component.net.UdpPacket.receive(UdpPacket.CDB:1)
com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketListener.onNotify(PacketListener.CDB:20)
com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:42)
java.lang.Thread.run(Thread.java:619)
2010-12-18 18:07:18.823/3464791.281 Oracle Coherence GE 3.6.0.3 <Warning> (thread=Termination Thread, member=7): Terminating Guard{Daemon=Cluster}
2010-12-18 18:07:18.823/3464791.281 Oracle Coherence GE 3.6.0.3 <Error> (thread=StopService, member=7): Requested to stop cluster service.
2010-12-18 18:07:18.826/3464791.284 Oracle Coherence GE 3.6.0.3 <D5> (thread=DistributedCache, member=7): Service DistributedCache left the cluster
2010-12-18 18:07:18.826/3464791.284 Oracle Coherence GE 3.6.0.3 <D5> (thread=Invocation:Management, member=7): Service Management left the cluster
2010-12-18 18:07:24.904/3464797.362 Oracle Coherence GE 3.6.0.3 <Error> (thread=main, member=7): Failed to restart services: com.tangosol.net.RequestTimeoutException: Timeout while waiting for cluster to stop.
2010-12-18 18:07:33.915/3464806.373 Oracle Coherence GE 3.6.0.3 <Error> (thread=main, member=7): Failed to restart services: com.tangosol.net.RequestTimeoutException: Timeout while waiting for cluster to stop.
2010-12-18 18:07:42.924/3464815.382 Oracle Coherence GE 3.6.0.3 <Error> (thread=main, member=7): Failed to restart services: com.tangosol.net.RequestTimeoutException: Timeout while waiting for cluster to stop.
2010-12-18 18:07:51.936/3464824.394 Oracle Coherence GE 3.6.0.3 <Error> (thread=main, member=7): Failed to restart services: com.tangosol.net.RequestTimeoutException: Timeout while waiting for cluster to stop.The log file shows that list of the addresses are formed by IP, but they are configured by using hostname in override file.
Here's the log entry:
WellKnownAddressList(Size=2,
WKA{Address=165.X.X.XX7, Port=8088}
WKA{Address=165.X.X.XX8, Port=8088}
Here's the configuration from tangosol-coherence-override-prod.xml:
<well-known-addresses>
<socket-address id="1">
<address system-property="tangosol.coherence.wka">serverA</address>
<port system-property="tangosol.coherence.wka.port">8088</port>
</socket-address>
<socket-address id="2">
<address system-property="tangosol.coherence.wka">serverB</address>
<port system-property="tangosol.coherence.wka.port">8088</port>
</socket-address>
</well-known-addresses>
Thanks,
Ramesh -
I am experiencing this error with one of our cluster environment. Can anyone help me in this issue.
The Cluster Service function call 'ClusterResourceControl' failed with error code '1008(An attempt was made to reference a token that does not exist.)' while verifying the file path. Verify that your failover cluster is configured properly.
Thanks,
Venu S.
Venugopal S ----------------------------------------------------------- Please click the Mark as Answer button if a post solves your problem!Hi Venu S,
Based on my research, you might encounter a known issue, please try the hotfix in this KB:
http://support.microsoft.com/kb/928385
Meanwhile since there is less information about this issue, before further investigation, please provide us the following information:
The version of Windows Server you are using
The result of SELECT @@VERSION
The scenario when you get this error
If anything is unclear, please let me know.
Regards,
Tom Li -
Here is the description of the PRD cluster scenario. ( windows 2008 + oracle)
We have 2 nodes .
1. host-erpn01 ( Have ASCS , Database instance, Enqueue and Dialog
Instance installed)
2. host-erp02 ( Have Central Instance, Dialog Instance and Enqueue installed)
When we move "SAP SID" service using "failover cluster management tool" from one node to another its fails and we have to manually select the "SAP SID cluster service" and "SAP SID cluster instance" to online.
These both service and instance were coming online after manual selection, however after some time in the mmc console of node 2 the sap instances hosted on node1 are in red cross and are giving " cannot connect to sap service dcom interface error 800706BA"
We replaced the sapstartsrv.exe from working directory of ASCS instance to CI executable directory.
Now the disp+work is stopped for CI instance. Also in the CI instance executable directory we can see five files with name of sapstartsrv i.e
sapstartsrv.exe.new , sapstartsrv.exe.tmp, sapstartsrv.new, sapstartsrv.pdb and actual sapstartsrv.exe file.
Here is the log of sapstartsrv.log CI work directory from node2.
trc file: "sapstartsrv.log", trc level: 0, release: "701"
pid 1968
Mon Oct 11 15:55:33 2010
SAP HA Trace: Build in SAP Microsoft Cluster library '701, patch 32, changelist 1046543' initialized
Initializing SAPControl Webservice
SapSSLInit failed => https support disabled
Starting WebService Named Pipe thread
Starting WebService thread
Webservice named pipe thread started, listening on port
.\pipe\sapcontrol_01
Webservice thread started, listening on port 50113
GCCIA\csrvadmin is starting SAP System at 2010/10/11 16:09:07
SAP HA Trace: FindClusterResource: SAP resource not found [sapwinha.cpp, line 334]
SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_NOT_CLUSTERED [sapwinha.cpp, line 907]"
or you can view other logs from the work directory dump at
http://s000.tinyupload.com/index.php?file_id=45384422007535688902
Now when we try to start the SAPSID_00 service manually its giving error "The SAPSID_00 service failed to start due to the following error: The system cannot find the path specified.
Please advice.
Regards
Edited by: Tech GCCIA on Oct 11, 2010 3:27 PM
Edited by: Tech GCCIA on Oct 11, 2010 3:28 PMHi Sunil ,
On node 1 there is no listener.trc at /oracle_home/network/trace folder , here is the log of listener.log file in case if it is helpful.
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 10:37:37
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=3116
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=gccia-erpn01.gccia.com.sa)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 11:59:37
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=5036
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
10-OCT-2010 12:00:31 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=60592)) * establish * GCP * 0
10-OCT-2010 12:00:31 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=60593)) * establish * GCP * 0
10-OCT-2010 12:00:31 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=60594)) * establish * GCP * 0
10-OCT-2010 12:00:31 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=60595)) * establish * GCP * 0
10-OCT-2010 12:00:31 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=60596)) * establish * GCP * 0
10-OCT-2010 13:01:19 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61336)) * establish * GCP * 0
10-OCT-2010 13:01:37 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61340)) * establish * GCP * 0
10-OCT-2010 13:01:37 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61341)) * establish * GCP * 0
10-OCT-2010 13:01:37 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61342)) * establish * GCP * 0
10-OCT-2010 13:01:37 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61343)) * establish * GCP * 0
10-OCT-2010 13:01:37 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61344)) * establish * GCP * 0
10-OCT-2010 13:08:27 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61485)) * establish * GCP * 0
10-OCT-2010 13:08:42 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61489)) * establish * GCP * 0
10-OCT-2010 13:08:42 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61490)) * establish * GCP * 0
10-OCT-2010 13:08:42 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61491)) * establish * GCP * 0
10-OCT-2010 13:08:42 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61492)) * establish * GCP * 0
10-OCT-2010 13:08:42 * (CONNECT_DATA=(SID=GCP)(GLOBAL_NAME=GCP.WORLD)(CID=(PROGRAM=D:\oracle\OFS\SRV\fs\fssvr\bin\FsSurrogate.exe)(HOST=GCCIA-ERPN01)(USER=csrvadmin))) * (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=61493)) * establish * GCP * 0
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 13:09:57
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=2336
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 13:14:34
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=4948
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 13:38:12
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=2456
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 14:03:35
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=2756
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 10-OCT-2010 14:10:42
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=4812
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCP.WORLDipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=
.\pipe\GCPipc)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 11-OCT-2010 09:34:05
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=1920
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE
TNSLSNR for 64-bit Windows: Version 10.2.0.4.0 - Production on 11-OCT-2010 21:12:29
Copyright (c) 1991, 2007, Oracle. All rights reserved.
System parameter file is D:\oracle\GCP\102\network\admin\listener.ora
Log messages written to D:\oracle\GCP\102\network\log\listener.log
Trace information written to D:\oracle\GCP\102\network\trace\listener.trc
Trace level is currently 0
Started with pid=1952
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.11.13)(PORT=1527)))
Listener completed notification to CRS on start
TIMESTAMP * CONNECT DATA [* PROTOCOL INFO] * EVENT [* SID] * RETURN CODE -
The Cluster service is shutting down because quorum was lost
Hi, we recently experienced the above issue and after looking for explanations I haven't been able to find any satisfying answers when other people have posted this issue.
Our problem is as follows:
2 node 2008R2 cluster running SQL 2012
Each node is a HP BL460c running in a HP C7000 Blade Chassis.
We were updating the flexfabric cards on one of the chassis. The other chassis had been patched the previous week with no problems.
During the update process the flexfabric cards, which hold the Ethernet and FC connections, reboot so before work had begun all active cluster services had been failed over to the node in the chassis not being worked on. However despite this the cluster
service shut down on this one particular cluster. All other clusters running across these 2 chassis continued to run as expected.
As other people have posted before we saw the following errors in the system log.
1564: File share witness resource 'File Share Witness' failed to arbitrate for the file share
1069: Cluster resource 'File Share Witness' in clustered service or application 'Cluster Group' failed.
1172: The Cluster service is shutting down because quorum was lost. This could be due to the loss of network connectivity between some or all nodes in the cluster, or a failover of the witness disk.
Run the Validate a Configuration wizard to check your network configuration. If the condition persists, check for hardware or software errors related to the network adapter. Also check for failures in any other network components to which the node is connected
such as hubs, switches, or bridges.
However we cant understand what could cause this to happen when the service is running on the node in the chassis not being updated, especially when the same update was performed the week before with no issues. How can both nodes lose connectivity
to the File Share Witness at the same time?
Cluster Validation tests run fine and don't highlight any issues. The file share witness is accessible from both servers.Hi,
Please confirm you have install the Recommended hotfixes and updates for Windows Server 2008 R2 SP1 Failover Clusters update, especially the following hotfix.
The network location profile changes from "Domain" to "Public" in Windows 7 or in Windows Server 2008 R2
http://support.microsoft.com/kb/2524478/EN-US
A hotfix is available that adds two new cluster control codes to help you determine which cluster node is blocking a GUM update in Windows Server 2008 R2 and Windows Server
2012
http://support.microsoft.com/kb/2779069/EN-US
Hope this helps.
We
are trying to better understand customer views on social support experience, so your participation in this
interview project would be greatly appreciated if you have time.
Thanks for helping make community forums a great place. -
Hi,
We are trying to send idoc from r3 to Xi but in sm58 (r3 side) the error keeps hanging with following error :
CPIC-CALL: 'ThSAPCMINIT' : cmRc=20 thRc=665#Service inconnu
665 -> Gateway service unknown.
The FM involved is IDOC_INBOUND_ASYNCHRONOUS
Where is system checking for the service?
Best regards,
LaurentHi,
if you are configuring it to XI side try this blog,
/people/michal.krawczyk2/blog/2005/03/29/configuring-the-sender-rfc-adapter--step-by-step
else
- You need to get Basis to register your program on the destination system.
- Give the program Id in your communication channel then save and activate ur channel. Now test ur connection in SM59.
- use this blog /people/shabarish.vijayakumar/blog/2008/01/08/troubleshooting--rfc-and-soap-scenarios-updated-on-20042009
Regards
Aashish Sinha
PS : reward points if helpful -
Novell Cluster Services on VMWARE
I am currently running a 3 node cluster (oes2sp2 Linux) connected to an EMC SAN. This cluster was commissioned, fully patched, etc 250 days ago. It's been running smoothly and hasn't missed a beat :-) The nodes are bare-metal installs.
Now I've been tasked with investigating the possibility of virtualizing the nodes using VMWare (and making use of VMotion).
This will give us the ability to have 6 virtual nodes rather than 3 physical nodes.
What is the general feeling of the community with regards to:
1. Virtualizing cluster nodes
2. How complex is the setup on VMWare
3. Could I do a rolling migration from physical to virtual
Many thanks in advance for any comments, tips, advice, etcOn 11.03.2011 14:06, laurabuckley wrote:
>
> Now I've been tasked with investigating the possibility of virtualizing
> the nodes using VMWare (and making use of VMotion).
>
> This will give us the ability to have 6 virtual nodes rather than 3
> physical nodes.
>
> What is the general feeling of the community with regards to:
>
> 1. Virtualizing cluster nodes
> 2. How complex is the setup on VMWare
> 3. Could I do a rolling migration from physical to virtual
lot of talks about this, many things to consider.. here are few atleast;
If you have (or buy) VMware HA and vMotion, do you even need Novell
Cluster Services anymore?
if you want vMotion, you need to use vmdk for storage, which might be an
issue for large volumes.. or not?
For large storage you could use RDM LUNs directly from SAN. But then you
cannot use vMotion or run many nodes (of the same cluster) on one
physical server.
We are running multiple three node OES2 NCS clusters on three VMware
servers, using RDM LUNs from EMC SAN. Did a rolling migration from
physical Netware clusters using the same LUNs.
-sk
Maybe you are looking for
-
i'm trying to release a hold on internal sales order items that are backorders, but i'm getting an error saying " this is a system seeded hold cannot be released by user" please help
-
Unable to set default program for .pdf
CURRENT PROBLEM: As show in print screen, when i attempt to set default program nth happens at all. The only way i can open any .pdf file now is by 1st opening adobe reader 9 and select the .pdf file manually INITIAL STAGE OF PROBLEM: Problem started
-
Quick Look Filter not working in OS 10.6.8
I really like the ability to preview files by simply pressing the spacebar. I was able to do this fine on a previous iMac using OS 10.6.8, but when I installed the QuarkXpress.qlgenerator file on the new iMac running OS 10.6.8 it does not work unless
-
Why can't reproduce an itunes stream movie over airplay to apple tv?
I have a MacBook Pro with retina display and OS X 10.10.2 (Yosemite). I tried to reproduce my itunes movies on apple tv (2nd generation) over airplay but I get an error message about protection.
-
How can I get java for os x 10.5.8 version
any valid links for Java for os x 10.5.8 version thanks