Manual of adding the new node on RAC with ASM
Hello everbody
Someone have the manual of the adding a new node on RAC with ASM for Solaris ?
regards
Spaulonci
Go to http://www.oracle.com/technology/documentation/index.html, select your unknown database version and search for a manual named 'Oracle Clusterware and Oracle Real Application Clusters Administration and Deployment Guide'.
Werner
Similar Messages
-
Error when adding a new node to RAC 10g
Hi all,
I have a RAC 10g environment test in Linux Red Hat Umbreakble 5 with two nodes. This RAC is fine on 2 nodes.
I want to add a new node (rac3) of the following way:
- The node 1 (rac1) is started and the instance ORCL1 is online.
- The node 2 (rac2) is offline. i.e the machine is off.
- The node 3 (rac3). The machine is on and already configured
So that when I execute the CRS_home\oui\bin\addnode.bat on node 1 and put the information of node 3 (Public node name, Private node name, Virtual host name) and press next I get the following message:
OUI-35000: Fatal cluster error encountered (PRKC-1071 Nodes rac2 did not respond to ping in 30 seconds) - Sure: The machine is off;
My question is: Can´t I add a new node on RAC if a node is off ?
Anybody can help me.
Thanks.
(Wander Brazil)Interesting question.
You might have better luck getting an answer if you ask where people discuss RAC, instead of asking where people report documentation issues. (Go to http://forums.oracle.com and scroll down to 'Grid Computing' to see RAC forums.) -
System architecture check failed while adding a New Node in RAC
Hi Friends,
Environment:SUN Solris 10
Cluster Version:10.2.0.3
database Version:10.2.0.3.0
Due to H/W failure one of our RAC node(prod1) got formatted.
We have deleted the node(prod1) from RAC successfully.
But When i am again trying to add the node and checking prerequistes i am facing the below issue.
$ cd /software/oracle/product/crs/bin
$ ./cluvfy stage -pre crsinst -n prod1,prod2
Check: System architecture
Node Name Available Required Comment
prod2 unknown 64-bit failed
prod1 64-bit 64-bit passed
Result: System architecture check failed.But issue is that prod2 is my active(running node), so how to resolve this issue?
please suggest..
Regards
UmeshResolved..
Thanks... -
Hi
I am trying to convert a single node 11.1.0.7 database with EBS 12.1.3 version from single to 2-node RAC ASM on Oracle clusterware 11.2.0.3 on AIX 6.1 - 64 bit
I am following Oracle metalink document note id 466649.1 . My 11.2.0.3 clusterware is already setup correctly and working fine as per document E24614-03.
However I am currently stuck in section 3.3:Configure TNS listener (Doc id : 466649.1) . The netca is unable to start the listener and failing with error as below.
However when I start the same locally from lsnrctl command listener starts.
trace_OraDb11g_home1-1212159AM174.log
====================================
[AWT-EventQueue-0] [18:34:31:887] [RuntimeExec.runCommand:144] runCommand: process returns 123
[AWT-EventQueue-0] [18:34:31:887] [RuntimeExec.runCommand:161] RunTimeExec: output>
[AWT-EventQueue-0] [18:34:31:887] [RuntimeExec.runCommand:164] Attempting to start `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr
` on member `jxn-ux-ebs1d1q`
[AWT-EventQueue-0] [18:34:31:887] [RuntimeExec.runCommand:164] Start of `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr` on member
`jxn-ux-ebs1d1q` failed.
[AWT-EventQueue-0] [18:34:31:888] [RuntimeExec.runCommand:164] Attempting to stop `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr`
on member `jxn-ux-ebs1d1q`
[AWT-EventQueue-0] [18:34:31:888] [RuntimeExec.runCommand:164] Stop of `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr` on member
`jxn-ux-ebs1d1q` succeeded.
[AWT-EventQueue-0] [18:34:31:888] [RuntimeExec.runCommand:164] CRS-2632: There are no more servers to try to place resource 'ora.jxn-ux-e
bs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr' on that would satisfy its placement policy
[AWT-EventQueue-0] [18:34:31:888] [RuntimeExec.runCommand:170] RunTimeExec: error>
[AWT-EventQueue-0] [18:34:31:889] [RuntimeExec.runCommand:173] CRS-0223: Resource 'ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr'
has placement error.
[AWT-EventQueue-0] [18:34:31:889] [RuntimeExec.runCommand:173]
[AWT-EventQueue-0] [18:34:31:889] [RuntimeExec.runCommand:192] Returning from RunTimeExec.runCommand
[AWT-EventQueue-0] [18:34:31:890] [HAOperationImpl.runCommand:1221] signed exit value = 123
[AWT-EventQueue-0] [18:34:31:890] [HAOperationImpl.runCommand:1258] set status HA_RES_RELOCATE_ERR
[AWT-EventQueue-0] [18:34:31:891] [HAStartOperation.run:84] Returned from executing the HA Operation
[AWT-EventQueue-0] [18:34:31:891] [HAStartOperation.run:89] OUTPUT> Attempting to start `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q
.lsnr` on member `jxn-ux-ebs1d1q`
[AWT-EventQueue-0] [18:34:31:891] [HAStartOperation.run:89] OUTPUT> Start of `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr` on m
ember `jxn-ux-ebs1d1q` failed.
[AWT-EventQueue-0] [18:34:31:891] [HAStartOperation.run:89] OUTPUT> Attempting to stop `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.
lsnr` on member `jxn-ux-ebs1d1q`
[AWT-EventQueue-0] [18:34:31:892] [HAStartOperation.run:89] OUTPUT> Stop of `ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr` on me
mber `jxn-ux-ebs1d1q` succeeded.
[AWT-EventQueue-0] [18:34:31:892] [HAStartOperation.run:89] OUTPUT> CRS-2632: There are no more servers to try to place resource 'ora.jxn
-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr' on that would satisfy its placement policy
[AWT-EventQueue-0] [18:34:31:893] [HAStartOperation.run:95] ERROR> CRS-0223: Resource 'ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.l
snr' has placement error.
[AWT-EventQueue-0] [18:34:31:893] [LocalCommand.execute:56] LocalCommand.execute: Returned from run method
[AWT-EventQueue-0] [18:34:31:893] [HAOperationResult.getOutputAll:114] outLine is [CRS-2632: There are no more servers to try to place re
source 'ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr' on that would satisfy its placement policy]
[AWT-EventQueue-0] [18:34:31:894] [HAOperationResult.getOutputAll:115] errLine is [CRS-0223: Resource 'ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_
JXN-UX-EBS1D1Q.lsnr' has placement error.]
[AWT-EventQueue-0] [18:36:39:994] [ca.ConfigureListenerOPS.getNodeNameIndex:-1] getNodeNameIndex: Matching LISTENER_EBSQA_JXN-UX-EBS1D1Q
[AWT-EventQueue-0] [18:36:39:994] [ca.ConfigureListenerOPS.getListenerRootName:-1] ListenerName is LISTENER_EBSQA
The crsctl has details as below:
=====================
NAME TARGET STATE SERVER STATE_DETAILS
Cluster Resources
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE jxn-ux-ebs2d1q
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE jxn-ux-ebs1d1q
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE jxn-ux-ebs1d1q
ora.cvu
1 ONLINE ONLINE jxn-ux-ebs1d1q
ora.jxn-ux-ebs1d1q.LISTENER_EBSQA_JXN-UX-EBS1D1Q.lsnr
1 ONLINE OFFLINE
ora.jxn-ux-ebs1d1q.vip
1 ONLINE ONLINE jxn-ux-ebs1d1q
ora.jxn-ux-ebs2d1q.LISTENER_EBSQA_JXN-UX-EBS2D1Q.lsnr
1 ONLINE OFFLINE
Not sure how to fix this .
Regards
RamI am trying to convert a single node 11.1.0.7 database with EBS 12.1.3 version from single to 2-node RAC ASM on Oracle clusterware 11.2.0.3 on AIX 6.1 - 64 bit You don't need to create listeners, after installing 11203 cluster there will be LISTENER running from $GRID_HOME
along with SCAN_LISTENERS -
Binding Luns in red hat linux5 while installing RAC with ASM
Hi All,
I am in the process of installing RAC with ASM. Our OS team have presented the shared LUN's on the cluster nodes. Now that i need to bound/map them to the raw partitions. I did the below step. Could you please let me know the next steps to be done for the binding to be completed?
# cat /etc/udev/rules.d/60-raw.rules
# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
# Enter raw device bindings here.
# An example would be:
# ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N"
# to bind /dev/raw/raw1 to /dev/sda, or
# ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"
# to bind /dev/raw/raw2 to the device with major 8, minor 1.
ACTION=="add", KERNEL=="/dev/emcpowerg", RUN+="/bin/raw /dev/raw/OCR.dbf %N"
ACTION=="add", KERNEL=="/dev/emcpowerd", RUN+="/bin/raw /dev/raw/VOTING.dbf %N"
ACTION=="add", KERNEL=="/dev/emcpowerf", RUN+="/bin/raw /dev/raw/ASM1 %N"
ACTION=="add", KERNEL=="/dev/emcpowerc", RUN+="/bin/raw /dev/raw/ASM2 %N"
ACTION=="add", KERNEL=="/dev/emcpowere", RUN+="/bin/raw /dev/raw/ASM3 %N"
ACTION=="add", KERNEL=="/dev/emcpowerb", RUN+="/bin/raw /dev/raw/ASM4 %N"
# cd /etc/udev/rules.d/
# udevtest /dev/raw/OCR.dbf | grep mode
# raw -qa
# start_udev
Starting udev: OK
# raw -qa
# ls -l /dev/raw
ls: /dev/raw: No such file or directory
Thanks for all your support,
Sravanhi
you should have got feedback on your other post refereing to the same question
Bindind raw partitions in Red hat linux5 for Oracle RAC with ASM install
regards,
hub -
Hello,
Say, I have a 3 nodes RAC, I want to add a new node to current cluster... while the new node's CPUs are slower than the others.. what will happen?
(my concern is : can I add this new node successfully? if yes, can it anyway improve the whole cluster performance or not?)
Thank you
s9225Also you can refer MOS note : RAC: Frequently Asked Questions (Doc ID 220970.1)
Can I have different servers in my Oracle RAC? Can they be from different vendors? Can they be different sizes? -
I need to add a new node to RAC Oracle 10g R2
I need to add a new node to RAC Oracle 10g R2.
what is the best mode.
cloning or step by step?
SO: Solaris 64bit
Message was edited by:
ACSHi All,
I get the following error eventhough I have followed the instruction for Solaris R2. The instruction is enclosed. Please Advise! Thanks.
/app/cluvfy/runcluvfy.sh stage -post hwos -n nod1 -verbose
Result: User equivalence check failed for user "oracle".
ERROR:
User equivalence unavailable on all the nodes.
Verification cannot proceed.
Post-check for hardware and operating system setup was unsuccessful on all the nodes.
=========================
1. Log in as the oracle user.
2. If necessary, create the .sshdirectory in the oracle user’s home directory and
set the correct permissions on it:
$ mkdir ~/.ssh
$ chmod 700 ~/.ssh
3. Enter the following commands to generate an RSA key for version 2 of the SSH
protocol:
$ /usr/bin/ssh-keygen -t rsa
At the prompts:
¦ Accept the default location for the key file.
¦ Enter and confirm a pass phrase that is different from the oracle user’s
password.
This command writes the public key to the ~/.ssh/id_rsa.pub file and the
private key to the ~/.ssh/id_rsafile. Never distribute the private key to anyone.
4. Enter the following commands to generate a DSA key for version 2 of the SSH
protocol:
$ /usr/bin/ssh-keygen -t dsa
At the prompts:
¦ Accept the default location for the key file
Pre-Installation Tasks 2-11
Creating Required Operating System Groups and User
¦ Enter and confirm a pass phrase that is different from the oracle user’s
password
This command writes the public key to the ~/.ssh/id_dsa.pub file and the
private key to the ~/.ssh/id_dsa file. Never distribute the private key to
anyone.
Add keys to an authorized key file: Complete the following steps:
1. On the local node, determine if you have an authorized key file
(~/.ssh/authorized_keys). If the authorized key file already exists, then
proceed to step 2. Otherwise, enter the following commands:
$ touch ~/.ssh/authorized_keys
$ cd ~/.ssh
$ ls
You should see the id_dsa.pub and id_rsa.pubkeys that you have created.
2. Using SSH, copy the contents of the ~/.ssh/id_rsa.puband
~/.ssh/id_dsa.pubfiles to the file ~/.ssh/authorized_keys, and provide
the Oracle user password as prompted. This process is illustrated in the following
syntax example with a two-node cluster, with nodes node1 and node2, where the
Oracle user path is /home/oracle:
[oracle@node1 .ssh]$ ssh node1 cat /home/oracle/.ssh/id_rsa.pub >>
authorized_keys
oracle@node1’s password:
[oracle@node1 .ssh]$ ssh node1 cat /home/oracle/.ssh/id_dsa.pub >>
authorized_keys
oracle@node1 .ssh$ ssh node2 cat /home/oracle/.ssh/id_rsa.pub >>
authorized_keys
oracle@node2’s password:
[oracle@node1 .ssh$ ssh node2 cat /home/oracle/.ssh/id_dsa.pub
authorized_keysoracle@node2’s password:
Note: Repeat this process for each node in the cluster -
I have an external hard drive that I would like to pre-make a new folder before I import photos into it. Even though I added the new folder app to by toolbar, it is not highlighted and I cannot use it. It will only let me create new folders if I upload to iPhoto. That is not where I want to store everything. So I need to figure out how to turn on or activate New Folder on my toolbar for all possible downloading options.
If it's a drive that you've previously used with a PC, just double-check the format - click the drive once on the desktop to highlight it, and click cmd-i (the command key and the i key together) to see the Info window. That will tell you, under Format, how it's formatted.
If it's "NTFS", that's the current Windows format. You can read but not write to it with a Mac. If you want full read/write access, you should look into Paragon NTFS, which allows you to do both. Note that some features of te Mac (Time Machine, for example) will only work with Mac-formatted drives.
Matt -
How do we know the Master Node in RAC ? ?
Hi Experts,
We have implemented 2-Node RAC 11g R2 on Linux Platform. My query is How do we know the Master Node in RAC ? ?
Thanks
VenkatHi,
There is no such thing as "master node" in RAC configurations. All nodes are equal.
Sebastian wrote: The only thing closest to something like a "Master" is that only one node has the role to update the Oracle Cluster Registry (OCR), all other nodes only read the OCR.
{message:id=9827969}
and
{message:id=2154683}
Regards,
Levi Pereira -
Revision: 10587
Author: [email protected]
Date: 2009-09-24 18:42:35 -0700 (Thu, 24 Sep 2009)
Log Message:
Modified the Akamai Plugin Sample app: 1) Added the new MAST plugin; 2) Added support to load the plugins as static or dynamic
Modified Paths:
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/.actionScriptProperties
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/.project
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/src/AkamaiPluginSample.css
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/src/AkamaiPluginSample.mxmlRevision: 10587
Author: [email protected]
Date: 2009-09-24 18:42:35 -0700 (Thu, 24 Sep 2009)
Log Message:
Modified the Akamai Plugin Sample app: 1) Added the new MAST plugin; 2) Added support to load the plugins as static or dynamic
Modified Paths:
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/.actionScriptProperties
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/.project
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/src/AkamaiPluginSample.css
osmf/trunk/apps/samples/plugins/AkamaiPluginSample/src/AkamaiPluginSample.mxml -
Problem in adding the new column in VO : ADF
Hi,
I am using jdev 10.1.3.2 with ADF.
I added a new column in a table in the database. In my ADF application, I right clicked on the entity object of the changed table, and selected ‘Synchronize with DB’ which added the new column in the entity object also.
I had a jsp which uses this view object’s (VO). I had to change the VO also to add this new column.
After all this, in the jsp page, I dragged and dropped this new column as an input text field.
But while running this page, the field is empty. Also when I drag and drop it, this field doesn’t have the ‘id’ attribute.
Below is the code. Please let me know how I can fix this issue.
<af:inputText value="#{bindings.RebillNumber.inputValue}"
label="#{bindings.RebillNumber.label}"
required="#{bindings.RebillNumber.mandatory}"
columns="#{bindings.RebillNumber.displayWidth}">
<af:validator binding="#{bindings.RebillNumber.validator}"/>
</af:inputText>
Thanks,
VenkiHi Venki,
Please check if the object on the page is bound to the same iterator as the other components. Sometimes dragging and dropping new attributes makes JDev create a new iterator, and the two iterators will not be in sync.
You can check this in the pageDef file and correct any strange things you may find.
Jeroen van Veldhuizen -
[svn] 3501: Adding the new CallResponder component.
Revision: 3501
Author: [email protected]
Date: 2008-10-06 17:42:26 -0700 (Mon, 06 Oct 2008)
Log Message:
Adding the new CallResponder component. This is best used from MXML to implement
a specific invocation of a specific RPC service operation. It separates the use of the
RPC operation from its definition.
QE: New class (and MXML component)
Docs: Yes - see the asdoc for info.
Checkintests: pass
Reviewer: Pete, Seth, Ed, Sameer
Modified Paths:
flex/sdk/trunk/frameworks/projects/rpc/manifest.xml
Added Paths:
flex/sdk/trunk/frameworks/projects/rpc/src/mx/rpc/CallResponder.asDid you import the 3 required SC:
SAP-JEE,
SAP_BUILD
SAP_JTECHS
the DC: sap.com/tc/ddic/metamodel/content is part of SC SAP_JTECHS
You can brouse all imported DCs from CBS
SAPs should be 161. The one you are looking for is N:31 in the SAP_JTECHS
If you have problem with the local bild, than you havn't checked out all DC to your NWDS.
Regards, Angel -
Move RAC database - need to format the disk storage having RAC and ASM
Hello,
Short story:
I need to format the disk storage used by a two nodes RAC with ASM.
How can I have the database working the new disk storage.
Long story:
We decided to change the external disk storage formatting from RAID 5 to RAID 10.
Configuration is: 2 Solaris nodes having Oracle software installed on each node and running with ASM
- node1: ORCL1 database and +ASM1 asm instances
- node2: ORCL2 database and +ASM2 asm instances
Available is a NFS storage with plenty of space.
Please tell me which would be the easiest way to move the database?
Thank youThanks alot for your answer.
1) There is more trouble: I also have the Voting disk and the OCR on the same (and only) SAN storage. Do you know about steps to backup/restore and/or recreate these?
As I said I have a NFS file system available with plenty of space.
2) I will need to backup the database, which way would you recommend: RMAN or EXP ? -
Problem inserting new node into JTree with depthFirstEnumeration()
Hello,
I'm currently trying to use depthFirstEnumeration() to add and delete nodes for a simple JTree. I've written a method to handle this, but it keeps coming back with an exception saying that 'new child is an ancestor'.
All I'm trying to do is add and delete nodes from a JTree using add and remove buttons within a swing program. When a user adds the new node the JTree needs to be updated with new labels in sequential order dependent upon a depthFirst traversal of the JTree.
My current code for the add button is as follows,
public void actionPerformed(ActionEvent event)
DefaultMutableTreeNode selectedNode = (DefaultMutableTreeNode)tree.getLastSelectedPathComponent();
Enumeration e = rootNode.depthFirstEnumeration();
if(event.getSource().equals(addButton))
if (selectedNode != null)
while (e.hasMoreElements()) {
// add the new node as a child of a selected node at the end
DefaultMutableTreeNode newNode = (DefaultMutableTreeNode)e.nextElement();
// treeModel.insertNodeInto(newNode, selectedNode, selectedNode.getChildCount());
//System.out.print(newNode.getUserObject() + "" + newNodeSuffix++);
String label = "Node"+i;
treeModel.insertNodeInto(newNode, selectedNode, selectedNode.getChildCount());
i++;
//make the node visible by scrolling to it
TreeNode[] totalNodes = treeModel.getPathToRoot(newNode);
TreePath path = new TreePath(totalNodes);
tree.scrollPathToVisible(path);
//System.out.println();
else if(event.getSource().equals(deleteButton))
//remove the selected node, except the parent node
removeSelectedNode();
} As you can see in the above code, I've tested the incrementing of the new nodes in a System.out.print() statement and they appear to be incrementing correctly. I just can't see how to correctly output the labels for the nodes.
Any help and advice always appreciated.This is about the 5th posting on the same question. Here is the link to the last posting so you can see what has already been suggested so you don't waste your time making the same suggestion.
http://forum.java.sun.com/thread.jspa?threadID=704980
The OP doesn't seem to understand that nodes don't just rename themselves and that renderers will only display the text of the current node. If you want the text displayed to changed, then you need to change the text associated with each node, which means iterating through the entire tree to update each node with new text. Then again, maybe I don't understand the question, but the OP keeps posting the same question without any additional information. -
How do i licence a two node RAC with ASM infrastructure
AM trying to estimate the licensing of two node RAC with ASM as storage manager and GRID control as management tool
Hi,
Oracle license depends on lot of things, Edition of Oracle your running standard or enterprise, the optional packges you need and etc.
Read through http://docs.oracle.com/cd/E11882_01/license.112/e10594/editions.htm#BABDJGGI
also if you license named users or processor. You can get the price for the from online oracle store
https://oraclestore.oracle.com/OA_HTML/ibeCCtdMinisites.jsp?language=US&ref=ibeCZzpHome.jsp
Maybe you are looking for
-
Print format problem in report
I have a tabular reports with several repeating frames.For each record of the outer repeating frame, I have multiple records in the inner repeating frame. My problem is if the inner repeating frame cannot fit within a page , it does not overflow to t
-
Selecting a single column in SQL
Hi all, I am doign a Java application at the moment and I need to select only a single column in a row of a table. I know that I can do something like SELECT column_name FROM table but the fact is, I am not supposed to know the name of the column, bu
-
Search Help for Hierarchy Node in SAP BW 7.3
Hi Experts, We were previously using SAP BW 7.1 system and we had a table which used to be maintained through SM30 which has a customed search help on one of the fields for a hierarchy object. And it was working perfectly. However, one of our systems
-
Unable to install Itunes 7.5
Having recieved an 3rd generation Nano for Xmas, I am more than a little frustrated to learn that it does not seem to work with Itunes 4 (which is already installed on my laptop for my daughter's ipod) I successfully downloaded version 7.5 but have s
-
Hi friends, I am new person. I saw lots of example abouy restore/revovery DB. How do I know a DBID ( for set DBID= ) during recovering DB or control file. Thanks Jim