Cannot restart SAP NW04s j2ee : open cluster failed

Question

Hi,
I can't start SAP j2ee, the dispatcher is in yellow light in SAPMMC.
this is my sapstartsrv.log file:
trc file: "sapstartsrv.log", trc level: 0, release: "700"
pid        2028
Thu Dec 18 10:32:26 2008
SAP HA Trace: Build in SAP Microsoft Cluster library '700, patch 175, changelist 1007059' initialized
Initializing SAPControl Webservice
SapSSLInit failed => https support disabled
Starting WebService Named Pipe thread
Starting WebService thread
Webservice named pipe thread started, listening on port
.\pipe\sapcontrol_00
Webservice thread started, listening on port 50013
LJBW\bwdadm is starting SAP System at 2008/12/18 10:45:49
SAP HA Trace: FindClusterResource: OpenCluster failed: 1753 [sapwinha.cpp, line 212]
SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 907]
LJBW\bwdadm is stopping SAP System at 2008/12/18 11:28:24
SAP HA Trace: FindClusterResource: OpenCluster failed: 1753 [sapwinha.cpp, line 212]
SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 907]
LJBW\bwdadm is starting SAP System at 2008/12/18 11:32:13
Many thanks
George

Answer 1

it says failed to update service environment from user environment.
here is the dev_w0 file.
trc file: "dev_w0", trc level: 1, release: "700"
ACTIVE TRACE LEVEL           1
ACTIVE TRACE COMPONENTS      all, MJ
B 
B Thu Dec 18 11:32:24 2008
B  create_con (con_name=R/3)
B  Loading DB library 'E:\usr\sap\BWD\DVEBMGS00\exe\dbmssslib.dll' ...
B  Library 'E:\usr\sap\BWD\DVEBMGS00\exe\dbmssslib.dll' loaded
B  Version of 'E:\usr\sap\BWD\DVEBMGS00\exe\dbmssslib.dll' is "700.08", patchlevel (0.171)
B  New connection 0 created
M sysno      00
M sid        BWD
M systemid   560 (PC with Windows NT)
M relno      7000
M patchlevel 0
M patchno    175
M intno      20050900
M make:      multithreaded, ASCII, optimized
M pid        4224
M
M  kernel runs with dp version 241(ext=110) (@(#) DPLIB-INT-VERSION-241)
M  length of sys_adm_ext is 364 bytes
M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 0 4224) [dpxxdisp.c   1323]
I  MtxInit: 30000 0 0
M  DpSysAdmExtCreate: ABAP is active
M  DpSysAdmExtCreate: VMC (JAVA VM in WP) is not active
M  DpShMCreate: sizeof(wp_adm)          43512     (1176)
M  DpShMCreate: sizeof(tm_adm)          3786880     (18840)
M  DpShMCreate: sizeof(wp_ca_adm)          18048     (60)
M  DpShMCreate: sizeof(appc_ca_adm)     6000     (60)
M  DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528040/528048
M  DpShMCreate: sizeof(comm_adm)          528048     (1048)
M  DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
M  DpShMCreate: sizeof(slock_adm)          0     (96)
M  DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
M  DpShMCreate: sizeof(file_adm)          0     (72)
M  DpShMCreate: sizeof(vmc_adm)          0     (1296)
M  DpShMCreate: sizeof(wall_adm)          (22440/34344/56/100)
M  DpShMCreate: sizeof(gw_adm)     48
M  DpShMCreate: SHM_DP_ADM_KEY          (addr: 05510040, size: 4446512)
M  DpShMCreate: allocated sys_adm at 05510040
M  DpShMCreate: allocated wp_adm at 05511BA8
M  DpShMCreate: allocated tm_adm_list at 0551C5A0
M  DpShMCreate: allocated tm_adm at 0551C5D0
M  DpShMCreate: allocated wp_ca_adm at 058B8E50
M  DpShMCreate: allocated appc_ca_adm at 058BD4D0
M  DpShMCreate: allocated comm_adm at 058BEC40
M  DpShMCreate: system runs without slock table
M  DpShMCreate: system runs without file table
M  DpShMCreate: allocated vmc_adm_list at 0593FAF0
M  DpShMCreate: allocated gw_adm at 0593FB30
M  DpShMCreate: system runs without vmc_adm
M  DpShMCreate: allocated ca_info at 0593FB60
M  DpShMCreate: allocated wall_adm at 0593FB68
M  rdisp/queue_size_check_value :  -> off
M  ThTaskStatus: rdisp/reset_online_during_debug 0
X  EmInit: MmSetImplementation( 2 ).
X  MM global diagnostic options set: 0
X  <ES> client 0 initializing ....
X  Using implementation view
X  <EsNT> Using memory model view.
M  <EsNT> Memory Reset disabled as NT default
X  ES initialized.
M 
M Thu Dec 18 11:32:25 2008
M  ThInit: running on host bwdev
M 
M Thu Dec 18 11:32:26 2008
M  calling db_connect ...
C  Thread ID:5228
C  Thank You for using the SLOLEDB-interface
C  Using dynamic link library 'E:\usr\sap\BWD\DVEBMGS00\exe\dbmssslib.dll'
C  dbmssslib.dll patch info
C    patchlevel   0
C    patchno      171
C    patchcomment ODBC DBSL Error handling in DSQL batches (1233665)
C  Local connection used on BWDEV to named instance: np:BWDEV\BWD
C  CopyLocalParameters: dbuser is 'bwd'
C  Using Provider SQLNCLI
C  OpenOledbConnection: MARS property was set successfully.
C  Provider Release:9.00.3042.00
C  Using Provider SQLNCLI
C  OpenOledbConnection: MARS property was set successfully.
C  Cache sizes: header 52 bytes, 20000 names (26880000 bytes), 500 dynamic statements (2728000 bytes), total 29608052 bytes
C  Using shared procedure name cache BWDEV_BWD_BWDBWD_BWD_MEM initialized by another process.
C  Connected to db server : [BWDEV\BWD] server_used : [np:BWDEV\BWD], dbname: BWD, dbuser: bwd
C  pn_id:BWDEV_BWD_BWDBWD_BWD
C  Using MARS (on sql 9.0)
B  Connection 0 opened (DBSL handle 0)
B  Wp  Hdl ConName          ConId     ConState     TX  PRM RCT TIM MAX OPT Date     Time   DBHost         
B  000 000 R/3              000000000 ACTIVE       NO  YES NO  000 255 255 20081218 113226 BWDEV\BWD      
C  The IRow interface is supported by this OLEDB provider
M  db_connect o.k.
M  ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip,.uue,.bz2,.iso,.sda,.sar,.gif
I 
I Thu Dec 18 11:32:28 2008
I  MtxInit: 0 0 0
M  SHM_PRES_BUF               (addr: 0B550040, size: 4400128)
M  SHM_ROLL_AREA          (addr: 9C490040, size: 61865984)
M  SHM_PAGING_AREA          (addr: 0B990040, size: 33554432)
M  SHM_ROLL_ADM               (addr: 0D9A0040, size: 618548)
M  SHM_PAGING_ADM          (addr: 0DA40040, size: 525344)
M  ThCreateNoBuffer          allocated 324144 bytes for 1000 entries at 0DAD0040
M  ThCreateNoBuffer          index size: 3000 elems
M  ThCreateVBAdm          allocated 7424 bytes (50 server) at 09590040
X  EmInit: MmSetImplementation( 2 ).
X  MM global diagnostic options set: 0
X  <ES> client 0 initializing ....
X  Using implementation view
X  ES initialized.
B  dbntab: NTAB buffers attached
B  dbntab: Buffer FTAB(hash header)  (addr: 0DBB0088, size: 456)
B  dbntab: Buffer FTAB(anchor array) (addr: 0DBB0250, size: 159884)
B  dbntab: Buffer FTAB(item array)   (addr: 0DBD72E0, size: 719172)
B  dbntab: Buffer FTAB(data area)    (addr: 0DC86C28, size: 30724096)
B  dbntab: Buffer IREC(hash header)  (addr: 10770088, size: 456)
B  dbntab: Buffer IREC(anchor array) (addr: 10770250, size: 159884)
B  dbntab: Buffer IREC(item array)   (addr: 107972E0, size: 179784)
B  dbntab: Buffer IREC(data area)    (addr: 107C3128, size: 6144000)
B  dbntab: Buffer STAB(hash header)  (addr: 0F9E0088, size: 456)
B  dbntab: Buffer STAB(anchor array) (addr: 0F9E0250, size: 159884)
B  dbntab: Buffer STAB(item array)   (addr: 0FA072E0, size: 179784)
B  dbntab: Buffer STAB(data area)    (addr: 0FA33128, size: 3072000)
B  dbntab: Buffer TTAB(hash header)  (addr: 10DA0088, size: 4304)
B  dbntab: Buffer TTAB(anchor array) (addr: 10DA1158, size: 159884)
B  dbntab: Buffer TTAB(item array)   (addr: 10DC81E8, size: 479448)
B  dbntab: Buffer TTAB(data area)    (addr: 10E3D2C0, size: 3755676)
B  db_con_shm_ini:  WP_ID = 0, WP_CNT = 37, CON_ID = -1
B  dbstat: TABSTAT buffer attached (addr: 119415D0)
B  dbtbxbuf: Buffer TABL  (addr: 125B00C8, size: 30000128, end: 1424C4C8)
B  dbtbxbuf: Buffer TABLP (addr: 142500C8, size: 10240000, end: 14C140C8)
B  dbexpbuf: Buffer EIBUF (addr: 14C200D0, size: 4194304, end: 150200D0)
B  dbexpbuf: Buffer ESM   (addr: 150300D0, size: 4194304, end: 154300D0)
B  dbexpbuf: Buffer CUA   (addr: 111E00D0, size: 3072000, end: 114CE0D0)
B  dbexpbuf: Buffer OTR   (addr: 154400D0, size: 4194304, end: 158400D0)
B  dbcalbuf: Buffer CALE  (addr: 0FD40040, size: 500000, end: 0FDBA160)
M  CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
S  *** init spool environment
S  initialize debug system
T  Stack direction is downwards.
T  debug control: prepare exclude for printer trace
T  new memory block 0B45B140
S  spool kernel/ddic check: Ok
S  using table TSP02FX for frontend printing
S  2 spool work process(es) found
S  frontend print via spool service enabled
S  printer list size is 150
S  printer type list size is 50
S  queue size (profile)   = 300
S  hostspool list size = 3000
S  option list size is 30
S      found processing queue enabled
S  found spool memory service RSPO-RCLOCKS at 1D630098
S  doing lock recovery
S  setting server cache root
S  found spool memory service RSPO-SERVERCACHE at 1D6308E8
S    using messages for server info
S  size of spec char cache entry: 165020 bytes (timeout 100 sec)
S  size of open spool request entry: 1216 bytes
S  immediate print option for implicitely closed spool requests is disabled
A 
A Thu Dec 18 11:32:29 2008
A 
A  -PXA--
A  PXA INITIALIZATION
A  PXA: Locked PXA-Semaphore.
A  System page size: 4kb, total admin_size: 34956kb, dir_size: 17352kb.
A  Attached to PXA (address 4D080040, size 600000K, 2 fragments of 282524K )
A  abap/pxa = shared protect gen_remote
A  PXA INITIALIZATION FINISHED
A  -PXA--
A 
A 
A Thu Dec 18 11:32:30 2008
A  ABAP ShmAdm attached (addr=BACA6000 leng=20955136 end=BC0A2000)
A  >> Shm MMADM area (addr=BB025338 leng=134016 end=BB045EB8)
A  >> Shm MMDAT area (addr=BB046000 leng=17154048 end=BC0A2000)
A  RFC Destination> destination bwdev_BWD_00 host bwdev system BWD systnr 0 (bwdev_BWD_00)
A  RFC Options> H=bwdev,S=00,d=1,
A  RFC FRFC> fallback activ but this is not a central instance.
A   
A  RFC rfc/signon_error_log = -1
A  RFC rfc/dump_connection_info = 0
A  RFC rfc/dump_client_info = 0
A  RFC rfc/cp_convert/ignore_error = 1
A  RFC rfc/cp_convert/conversion_char = 23
A  RFC rfc/wan_compress/threshold = 251
A  RFC rfc/recorder_pcs not set, use defaule value: 1
A  RFC rfc/delta_trc_level not set, use default value: 0
A  RFC rfc/no_uuid_check not set, use default value: 0
A  RFC rfc/bc_ignore_thcmaccp_retcode not set, use default value: 0
A  RFC Method> initialize RemObjDriver for ABAP Objects
M  ThrCreateShObjects          allocated 76458 bytes at 0FF30040
N  SsfSapSecin: putenv(SECUDIR=E:\usr\sap\BWD\DVEBMGS00\sec): ok
N 
N  =================================================
N  === SSF INITIALIZATION:
N  ===...SSF Security Toolkit name SAPSECULIB .
N  ===...SSF trace level is 0 .
N  ===...SSF library is E:\usr\sap\BWD\DVEBMGS00\exe\sapsecu.dll .
N  ===...SSF hash algorithm is SHA1 .
N  ===...SSF symmetric encryption algorithm is DES-CBC .
N  ===...completed with return code 5.
N  =================================================
B  dbtran INFO (init_connection '<DEFAULT>' [MSSQL:700.08]):
B   max_blocking_factor =  50,  max_in_blocking_factor      = 255,
B   min_blocking_factor =   5,  min_in_blocking_factor      =  10,
B   prefer_union_all    =   1,  prefer_join                 =   1,
B   prefer_fix_blocking =   0,  prefer_in_itab_opt          =   0,
B   convert AVG         =   1,  alias table FUPD            =   0,
B   escape_as_literal   =   0,  opt GE LE to BETWEEN        =   0,
B   select *            =0x00,  character encoding          =SBCS / []:X,
B   use_hints           = abap->1, dbif->0x1, upto->0, rule_in->0,
B                         rule_fae->0, concat_fae->0, concat_fae_or->0
N  MskiInitLogonTicketCacheHandle: Logon Ticket cache pointer retrieved from shared memory.
N  MskiInitLogonTicketCacheHandle: Workprocess runs with Logon Ticket cache.
M  JrfcVmcRegisterNativesDriver o.k.
W  =================================================
W  === ipl_Init() called
W    ITS Plugin: Path dw_gui
W    ITS Plugin: Description ITS Plugin - ITS rendering DLL
W    ITS Plugin: sizeof(SAP_UC) 1
W    ITS Plugin: Release: 700, [7000.0.175.20050900]
W    ITS Plugin: Int.version, [33]
W    ITS Plugin: Feature set: [17]
W    ===... Calling itsp_Init in external dll ===>
W  === ipl_Init() returns 0, ITSPE_OK: OK
W  =================================================
N  VSI: WP init in ABAP VM completed with rc=0
E  Enqueue Info: rdisp/wp_no_enq=1, rdisp/enqname=<empty>, assume bwdev_BWD_00
E  Enqueue Info: enque/disable_replication = 2
E  Enqueue Info: replication disabled
E  EnqCcInitialize: local lock table initialization o.k.
E  EnqId_SuppressIpc: local EnqId initialization o.k.
E  EnqCcInitialize: local enqueue client init o.k.
M  MBUF info for hooks: MS component UP
M  ThSetEnqName: set enqname by server list
M  ThISetEnqname: enq name = >bwdev_BWD_00                            <
E 
E  *************** EnqId_EN_ActionAtMsUpHook ***************
E  Hook on upcoming Ms (with EnqSrv), get auth EnqId and check it locally
E 
E  *************** ObjShMem_CheckAuthoritativeEnqId ***************
E  Checking authoritative EnqId from EnqSrv into ObjShMem
E  ObjShMem_CheckAuthoritativeEnqId: ObjShMem ...
E  EnqId.EnqTabCreaTime    = -999
E  EnqId.RandomNumber      = -999
E  ReqOrd.TimeInSecs       = -999
E  ReqOrd.ReqNumberThisSec = -999
E  ObjShMem_CheckAuthoritativeEnqId: ObjShMem ...
E  EnqId.EnqTabCreaTime    = -999
E  EnqId.RandomNumber      = -999
E  ReqOrd.TimeInSecs       = -999
E  ReqOrd.ReqNumberThisSec = -999
E  ObjShMem_CheckAuthoritativeEnqId: EnqId is initial in ShMem
E  ObjShMem_CheckAuthoritativeEnqId: Overwrite incoming auth EnqId, continue
E  EnqId inscribed into initial ObjShMem: (ObjShMem_CheckAuthoritativeEnqId)
E  -SHMEM--
E  EnqId:          EnqTabCreaTime/RandomNumber    = 18.12.2008 11:32:30  1229571150 / 4224
E  ReqOrd at Srv:  TimeInSecs/ReqNumberThisSec    = 18.12.2008 11:32:30  1229571150 / 2
E  ReqOrd at Cli:  TimeInSecs/ReqNumberThisSec    = 18.12.2008 11:32:30  1229571150 / 1
E  Status:         STATUS_OK
E  -
M  ThActivateServer: state = STARTING
L  BtcSysStartRaise: Begin
L  Raise event SAP_SYSTEM_START with parameter <bwdev_BWD_00        >
L  BtcSysStartRaise: End
M 
M Thu Dec 18 11:32:31 2008
M  SosICreateNewAnchorArray: sos_search_anchor_semantics = 1
C 
C Thu Dec 18 11:32:33 2008
C  The IRow interface is supported by this OLEDB provider
B 
B Thu Dec 18 11:32:36 2008
B  table logging switched off for all clients
M 
M Thu Dec 18 11:32:37 2008
M  SecAudit(RsauShmInit): WP attached to existing shared memory.
M  SecAudit(RsauShmInit): addr of SCSA........... = 05300040
M  SecAudit(RsauShmInit): addr of RSAUSHM........ = 05300490
M  SecAudit(RsauShmInit): addr of RSAUSLOTINFO... = 053004C8
M  SecAudit(RsauShmInit): addr of RSAUSLOTS...... = 053004D4