CRM 5.0 not booting up after IP Address change to Static

Question

Hi Experts:
I really hope that you can help me out with this.
We had/have a CRM 5.0 system, we changed its IP from Dynamic to Static (that went fine).  We rebooted the system up (that also went fine)
The next morning we noticed that some of the processes were showing red (in SAP MMC).  We waited on that hoping that it would resolve it self. 
HOwever, till early evening, the system was still showing red processes.  So, we decided to reboot the system up.  HOwever, the dispatcher is not starting up.  Essentially none of the java applications (SDM, Dispatcher, and Server) are starting up. 
I have opened up a ticket with SAP, and they beleive that the issue is with Oracle Listener as that is refusing to recognize the SID from our SAP system.
Since then I have turned off the static IP and tried restarting the CI, but still it continues to give the same error.
During the Disp+Work.exe start up protocol...it continues to show "J2EE status info unavailable". 
Have any of you encountered something like this in regards to NetWeaver 2004s or anyother SAP application.
Any help would be appreciated.....
Imran

Answer 1

HI Shaun:
Thanks for your reply, however it is still giving the same error.  As requested I am attaching the trace file:
Again..I really appreciate this.
trc file: "dev_disp", trc level: 1, release: "700"
sysno      02
sid        CRM
systemid   560 (PC with Windows NT)
relno      7000
patchlevel 0
patchno    48
intno      20050900
make:      multithreaded, Unicode, optimized
pid        2584
Tue May 23 14:32:51 2006
kernel runs with dp version 210000(ext=109000) (@(#) DPLIB-INT-VERSION-210000-UC)
length of sys_adm_ext is 572 bytes
SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (02 2584) [dpxxdisp.c   1231]
     shared lib "dw_xml.dll" version 48 successfully loaded
     shared lib "dw_xtc.dll" version 48 successfully loaded
     shared lib "dw_stl.dll" version 48 successfully loaded
     shared lib "dw_gui.dll" version 48 successfully loaded
rdisp/softcancel_sequence :  -> 0,5,-1
use internal message server connection to port 3902
Tue May 23 14:32:56 2006
WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  5233]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is active
DpIPCInit2: start server >TWATSCRM1001_CRM_02                     <
DpShMCreate: sizeof(wp_adm)          14080     (1408)
DpShMCreate: sizeof(tm_adm)          3954072     (19672)
DpShMCreate: sizeof(wp_ca_adm)          24000     (80)
DpShMCreate: sizeof(appc_ca_adm)     8000     (80)
DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064
DpShMCreate: sizeof(comm_adm)          528064     (1048)
DpFileTableSize: max/headSize/ftSize/tableSize=2000/8/160056/160064
DpShMCreate: sizeof(file_adm)          160064     (72)
DpShMCreate: sizeof(vmc_adm)          14520     (1452)
DpShMCreate: sizeof(wall_adm)          (38456/34360/64/184)
DpShMCreate: sizeof(gw_adm)     48
DpShMCreate: SHM_DP_ADM_KEY          (addr: 05EF0040, size: 4783504)
DpShMCreate: allocated sys_adm at 05EF0040
DpShMCreate: allocated wp_adm at 05EF1E28
DpShMCreate: allocated tm_adm_list at 05EF5528
DpShMCreate: allocated tm_adm at 05EF5558
DpShMCreate: allocated wp_ca_adm at 062BAAF0
DpShMCreate: allocated appc_ca_adm at 062C08B0
DpShMCreate: allocated comm_adm at 062C27F0
DpShMCreate: allocated file_adm at 063436B0
DpShMCreate: allocated vmc_adm_list at 0636A7F0
DpShMCreate: allocated gw_adm at 0636A830
DpShMCreate: allocated vmc_adm at 0636A860
DpShMCreate: allocated ca_info at 0636E118
DpShMCreate: allocated wall_adm at 0636E120
MBUF state OFF
DpSesCreateTable: created session table at 063F0040 (len=138424)
EmInit: MmSetImplementation( 2 ).
MM diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 1024 kByte.
Using implementation flat
<EsNT> Memory Reset disabled as NT default
<ES> 511 blocks reserved for free list.
ES initialized.
J2EE server info
  start = TRUE
  state = STARTED
  pid = 3192
  argv[0] = D:\usr\sap\CRM\DVEBMGS02\exe\jcontrol.EXE
  argv[1] = D:\usr\sap\CRM\DVEBMGS02\exe\jcontrol.EXE
  argv[2] = pf=D:\usr\sap\CRM\SYS\profile\CRM_DVEBMGS02_TWATSCRM1001
  argv[3] = -DSAPSTART=1
  argv[4] = -DCONNECT_PORT=3927
  argv[5] = -DSAPSYSTEM=02
  argv[6] = -DSAPSYSTEMNAME=CRM
  argv[7] = -DSAPMYNAME=TWATSCRM1001_CRM_02
  argv[8] = -DSAPPROFILE=D:\usr\sap\CRM\SYS\profile\CRM_DVEBMGS02_TWATSCRM1001
  argv[9] = -DFRFC_FALLBACK=ON
  argv[10] = -DFRFC_FALLBACK_HOST=localhost
  start_lazy = 0
  start_control = SAP J2EE startup framework
DpJ2eeStart: j2ee state = STARTED
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c   1617]
***LOG Q0K=> DpMsAttach, mscon ( TWATSCRM1001) [dpxxdisp.c   11349]
DpStartStopMsg: send start message (myname is >TWATSCRM1001_CRM_02                     <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
CCMS: Initalizing shared memory of size 60000000 for monitoring segment.
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 7000, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1050]
DpMsgAdmin: Set patchno for this platform to 48
Release check o.K.
DpJ2eeLogin: j2ee state = CONNECTED
Tue May 23 14:33:00 2006
***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4235]
ERROR => NiIRead: SiRecv failed for hdl 4 / sock 1412
     (SI_ECONN_BROKEN; I4; ST; 127.0.0.1:3929) [nixxi.cpp    4235]
DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)
DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=3192)
ERROR => DpProcKill: kill failed [dpntdisp.c   371]
DpIJ2eeShutdown: j2ee state = SHUTDOWN
Tue May 23 14:33:36 2006
ERROR => W0 (pid 1088) died [dpxxdisp.c   13947]
ERROR => W1 (pid 3392) died [dpxxdisp.c   13947]
ERROR => W2 (pid 3560) died [dpxxdisp.c   13947]
ERROR => W3 (pid 3460) died [dpxxdisp.c   13947]
my types changed after wp death/restart 0xbf --> 0xbe
ERROR => W4 (pid 3972) died [dpxxdisp.c   13947]
my types changed after wp death/restart 0xbe --> 0xbc
ERROR => W5 (pid 1052) died [dpxxdisp.c   13947]
my types changed after wp death/restart 0xbc --> 0xb8
ERROR => W6 (pid 2608) died [dpxxdisp.c   13947]
ERROR => W7 (pid 3636) died [dpxxdisp.c   13947]
my types changed after wp death/restart 0xb8 --> 0xb0
ERROR => W8 (pid 424) died [dpxxdisp.c   13947]
my types changed after wp death/restart 0xb0 --> 0xa0
ERROR => W9 (pid 3356) died [dpxxdisp.c   13947]
my types changed after wp death/restart 0xa0 --> 0x80
DP_FATAL_ERROR => DpWPCheck: no more work processes
DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:46 2006
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long)               Tue May 23 18:33:46 2006
========================
No Ty. Pid      Status  Cause Start Err Sem CPU    Time  Program  Cl  User         Action                    Table
0 DIA     1088 Ended         no      1   0             0                                                             
1 DIA     3392 Ended         no      1   0             0                                                             
2 DIA     3560 Ended         no      1   0             0                                                             
3 DIA     3460 Ended         no      1   0             0                                                             
4 UPD     3972 Ended         no      1   0             0                                                             
5 ENQ     1052 Ended         no      1   0             0                                                             
6 BTC     2608 Ended         no      1   0             0                                                             
7 BTC     3636 Ended         no      1   0             0                                                             
8 SPO      424 Ended         no      1   0             0                                                             
9 UP2     3356 Ended         no      1   0             0                                                             
Dispatcher Queue Statistics               Tue May 23 18:33:46 2006
===========================
--------++++--
+
Typ
now
high
max
writes
reads
--------++++--
+
NOWP
0
2
2000
6
6
--------++++--
+
DIA
6
6
2000
6
0
--------++++--
+
UPD
0
0
2000
0
0
--------++++--
+
ENQ
0
0
2000
0
0
--------++++--
+
BTC
0
0
2000
0
0
--------++++--
+
SPO
0
0
2000
0
0
--------++++--
+
UP2
0
0
2000
0
0
--------++++--
+
max_rq_id          13
wake_evt_udp_now     0
wake events           total     9,  udp     7 ( 77%),  shm     2 ( 22%)
since last update     total     9,  udp     7 ( 77%),  shm     2 ( 22%)
Dump of tm_adm structure:               Tue May 23 18:33:46 2006
=========================
Term    uid  man user    term   lastop  mod wp  ta   a/i (modes)
Workprocess Comm. Area Blocks               Tue May 23 18:33:46 2006
=============================
Slots: 300, Used: 1, Max: 0
--------++--
+
id
owner
pid
eyecatcher
--------++--
+
0
DISPATCHER
-1
WPCAAD000
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:51 2006
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >TWATSCRM1001_CRM_02                     < (normal)
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (2340) (SOFT_KILL)
Stop icman
killing process (3380) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives  (PID:2340  HANDLE:1496)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:52 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died  (PID:2340  HANDLE:1496)
wait for end of icman
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:53 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:54 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:55 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:56 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:57 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:58 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:33:59 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:34:00 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:34:01 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:34:02 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives  (PID:3380  HANDLE:1504)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue May 23 14:34:03 2006
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died  (PID:3380  HANDLE:1504)
[DpProcDied] Process died  (PID:3192  HANDLE:1480)
DpStartStopMsg: send stop message (myname is >TWATSCRM1001_CRM_02                     <)
NiIMyHostName: hostname = 'TWATSCRM1001'
AdGetSelfIdentRecord: >                                                                           <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name                    -, type 4, key -
DpStartStopMsg: stop msg sent
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c   11633]
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0
SiSelNSet: set events of sock 1436 to: ---
NiBufISelRemove: remove hdl 3 from set0
SiSelNRemove: removed sock 1436 (pos=3)
SiSelNRemove: removed sock 1436
NiSelIRemove: removed hdl 3
MBUF state OFF
AdGetSelfIdentRecord: >                                                                           <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/10
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 16)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 3 / sock 1436
NiBufIClose: clear extension for hdl 3
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Em2Cleanup: Cleanup EM2
Eg2Cleanup: Cleanup EG2
Es2Cleanup: Cleanup ES2
Es2ResLocSlotClear: clear slot 0
Es2ResLocSlotClear: clear slot 0
Es2ResLocSlotClear: clear slot 0
Es2ResLocSlotClear: clear slot 0
***LOG Q05=> DpHalt, DPStop ( 2584) [dpxxdisp.c   10022]
Good Bye .....