Adclonectx.pl fails on db tier with RC-50004: Error occurred in CloneContext - using options addnode noprompt

Question

I'm trying to run adclonectx.pl non-interactively using a pairsfile and noprompt to automate my clone, this is to create the second node context file on the db tier of a 2 node Linux RAC environment and is the only bit that's still interactive so it would be really cool to get this working!
I'm using a pairsfile with all the variables from a sucessfull interactive run, I probably need to add more variables to this file though I can't figure out what.
Has anyone else got this working?
EBS 12.1.3 DB 11.2.0.3 RAC.
This is the command I run, I'm using host variables which are defined beforehand.
--this bit just shows the variables are valid
[orebsdba@dxd1client02 clone_dev]$ echo $CONTEXT_NAME2
EBSDBA2_dxd1db02-ib
[orebsdba@dxd1client02 clone_dev]$ echo $SRCCTX
/u01/EBSDBA/product/11.2.0/appsutil/EBSDBA1_dxd1db01-ib.xml
[orebsdba@dxd1client02 clone_dev]$ echo $NEWCTX
/u01/EBSDBA/product/11.2.0/appsutil/EBSDBA2_dxd1db02-ib.xml
[orebsdba@dxd1client02 clone_dev]$ cd ${ORACLE_HOME}/appsutil/clone/bin
[orebsdba@dxd1client02 bin]$ cp ${SRCCTX} ${DBMNT}/${SID}/tmp
[orebsdba@dxd1client02 bin]$ export APPSPWD=**********
echo \$APPSPWD | perl ./adclonectx.pl \
> contextfile=$SRCCTX \
> template=$ORACLE_HOME/appsutil/template/adxdbctx.tmp \
> outfile=$NEWCTX \
> pairsfile=$PAIRSFILE \
> addnode noprompt
Copyright (c) 2002 Oracle Corporation
Redwood Shores, California, USA
Oracle Applications Rapid Clone
Version 12.0.0
adclonectx Version 120.23.12010000.1
Running:
/u01/EBSDBA/product/11.2.0/appsutil/clone/bin/../jre/bin/java -Xmx600M -classpath /u01/EBSDBA/product/11.2.0/appsutil/clone/bin/../jlib/ojdbc5.jar:/u01/EBSDBA/product/11.2.0/appsutil/clone/bin/../jlib/xmlparserv2.jar:/u01/EBSDBA/product/11.2.0/appsutil/clone/bin/../jlib/java oracle.apps.ad.context.CloneContext -e /u01/EBSDBA/product/11.2.0/appsutil/EBSDBA1_dxd1db01-ib.xml -tmpl /u01/EBSDBA/product/11.2.0/appsutil/template/adxdbctx.tmp -pairsfile /u01/EBSDBA/product/11.2.0/appsutil/clone/pairsfile2.txt -out /u01/EBSDBA/product/11.2.0/appsutil/EBSDBA2_dxd1db02-ib.xml -addnode -noprompt
Log file located at /u01/EBSDBA/product/11.2.0/appsutil/log/CloneContext_0916151900.log
RC-50004: Error occurred in CloneContext:
null
Check Clone Context logfile /u01/EBSDBA/product/11.2.0/appsutil/log/CloneContext_0916151900.log for details.
ERROR: context creation not completed successfully.
Log contains this:
Using admin directory: /u01/EBSDBA/product/11.2.0/appsutil
#------Log File time stamp: 0916151900------------
# $Header: CloneContext.java 120.92.12010000.26 2013/05/06 12:02:01 mmanku ship $
# Running on          - dxd1client02
# Source Host         - null
# Domain Name         - mgmt.shared.health.nz
# Context Location    - /u01/EBSDBA/product/11.2.0/appsutil/EBSDBA1_dxd1db01-ib.xml
# Context Type        - null
# Context Template    - /u01/EBSDBA/product/11.2.0/appsutil/template/adxdbctx.tmp
# Clone Stage Area    - null
# Pairs File          - /u01/EBSDBA/product/11.2.0/appsutil/clone/pairsfile2.txt
# Destination Context - /u01/EBSDBA/product/11.2.0/appsutil/EBSDBA2_dxd1db02-ib.xml
# Validation          - false
# Platform Migration  - false
# no prompt           - true
Variables extracted from pairsfile: /u01/EBSDBA/product/11.2.0/appsutil/clone/pairsfile2.txt
****************************************************/n
  s_undo_tablespace  =  APPS_UNDOTS2
  s_dbClusterInst  =  2
  s_db_oh  =  /u01/EBSDBA/product/11.2.0
  s_dbhost  =  dxd1db02-ib
  s_dbSid  =  EBSDBA2
  s_hostname  =  dxd1db02-ib
  s_dbGlnam  =  EBSDBA
  s_database_type  =  RAC
  s_virtual_hostname  =  dxd1db02-ib
  s_clusterInterConnects  =  dxd1db02-priv
  s_base  =  /u01/EBSDBA
  s_dbuser  =  orebsdba
  s_dbgroup  =  oinstall
  s_db_util_filedir  =  /u01/EBSDBA/tmp
  s_dbhome1  =  +DATA_DXD1
  s_display  =  dxd1db02-ib:0.0
  s_instName  =  EBSDBA2
  s_domainname  =  mgmt.shared.health.nz
  s_instThread  =  2
  s_dbCluster  =  true
  s_contextname  =  EBSDBA2_dxd1db02-ib
  s_dbdomain  =  mgmt.shared.health.nz
  s_instNumber  =  2
  s_db_ons_remoteport  =  6414
  s_db_ons_localport  =  6314
  s_cmanport  =  1535
  s_dbport  =  1535
  s_port_pool  =  14
StackTrace:
java.lang.NullPointerException
at oracle.apps.ad.context.CloneContext$RACContext.checkRACDBConnection(CloneContext.java:6424)
at oracle.apps.ad.context.CloneContext$RACContext.access$400(CloneContext.java:5655)
at oracle.apps.ad.context.CloneContext.getInputDBRACAdd(CloneContext.java:1587)
at oracle.apps.ad.context.CloneContext.getInputFromUsers(CloneContext.java:988)
at oracle.apps.ad.context.CloneContext.doClone(CloneContext.java:601)
at oracle.apps.ad.context.CloneContext.main(CloneContext.java:5266)
RC-50004: Error occurred in CloneContext:
null
Context file creation not succesful
I have been trying to work my way through the stack trace and the source code.  I can see that getInputFromUsers() is called and that then calls getInputDBRACAdd().   That will then call checkRACDBConnection().  The question is where in checkRACDBConnection() – source code below – is it finding the NULL?
I am guessing that as we don’t see the following in the log file:
LogFile.getLogFile().info("Attempting to connect to database using :\n");
the NULL has to happen before this line.  This gives us to work with:
s = CloneContext.access$2000(CloneContext.this).getReplValIgnoreCase("s_apps_user").toString();
        if(CloneContext.access$2500(CloneContext.this) == null)
            CloneContext.access$2502(CloneContext.this, CloneContext.access$1400(CloneContext.this, "APPS password is required to validate database connection \nEnter APPS Password [APPS]"));
        i = 0;
_L2:
        String s1;
        if(i >= m_racHostList.length)
            break; /* Loop/switch isn't completed */
        s1 = (new StringBuilder()).append("jdbc:oracle:thin:@").append(m_racHostList[i]).append(".").append(m_racdomain).append(":").append(m_racPortList[i]).append(":").append(m_racSidList[i]).toString();
Not  much.
Could it be this?
if(i >= m_racHostList.length)
In which case perhaps s_rachostlist needs to be set?  But I think the length function should return 0 not NULL if something is unset, so perhaps not.
I am not sure there would be a problem with s_apps_user or the string assignment.
So perhaps it’s the loop.
i = 0;
_L2:
        String s1;
        if(i >= m_racHostList.length)
            break; /* Loop/switch isn't completed */
‘i’ is set to 0.  If m_racHostList.length is 0 that means it breaks out of the conditional and, though I don’t know enough Java to be sure, as the function throws an exception, perhaps it goes into the exception handler:
catch(Exception exception)
            Object obj1 = null;
            String as[] = {
                m_racSidList[i]
            String s2 = MessageHandler.getMessage("RC-40201", as, 0, false);
            LogFile.getLogFile().printStackTrace(exception);
            LogFile.getLogFile().info(s2);
            i++;
But that gives us an RC-40201 message, which isn’t what I'm seeing.
So I just don’t know, unless s_rachostlist is the key, I am out of ideas.
Has anyone else done this?
I've also raised an SR but haven't had a response yet.
Thanks in advance.
Jeremy

Answer 1

further info..
I've pulled these variables out of the java code and added them to the pairsfile which gets rid of the null value problem but now it returns a tns error..
s_isDBCluster=Y
s_rachostlist=dxd1db01-ib
s_racdomain=xxxxxxxxxxxxxxx
s_racsidlist=EBSDBA
s_racportlist=1535
s_rachostlist=dxd1db02-ib                      
s_racvirtualhostlist=dxd1db02-ib                      
s_racinstnumlist=2
s_clusterInterConnects=dxd1db02-priv
we noticed that s_rachostlist is used for two different values in the java code, interactilvey this value is prmpted for twice using the same variable - this may be causing our problem.
strangely when run interactively the tns connectivity details are the same as when run interactively, the first works the latter doesn't ...
we're thinking this could be a bug...
Cheers
Jeremy