Cluster Private Interconnect
Hi,
Does Global Cache Services work only when Cluster Private Interconnect is configured? I am not seeing any data in v$cache_transfer. cluster_interconnects parameter is blank. V$CLUSTER_INTERCONNECTS view is missing. Please let me know.
Thanks,
Madhav
HI
If you want to use specif interconnect IP then you can add this in cluster interconnect parameter,
if it is blank then you are using one interconnect which is default , so no need to worry about it is blank
rds
Similar Messages
-
Gig Ethernet V/S SCI as Cluster Private Interconnect for Oracle RAC
Hello Gurus
Can any one pls confirm if it's possible to configure 2 or more Gigabit Ethernet interconnects ( Sun Cluster 3.1 Private Interconnects) on a E6900 cluster ?
It's for a High Availability requirement of Oracle 9i RAC. i need to know ,
1) can i use gigabit ethernet as Private cluster interconnect for Deploying Oracle RAC on E6900 ?
2) What is the recommended Private Cluster Interconnect for Oracle RAC ? GiG ethernet or SCI with RSM ?
3) How about the scenarios where one can have say 3 X Gig Ethernet V/S 2 X SCI , as their cluster's Private Interconnects ?
4) How the Interconnect traffic gets distributed amongest the multiple GigaBit ethernet Interconnects ( For oracle RAC) , & is anything required to be done at oracle Rac Level to enable Oracle to recognise that there are multiple interconnect cards it needs to start utilizing all of the GigaBit ethernet Interfaces for transfering packets ?
5) what would happen to Oracle RAC if one of the Gigabit ethernet private interconnects fails
Have tried searching for this info but could not locate any doc that can precisely clarify these doubts that i have .........
thanks for the patience
Regards,
NileshAnswers inline...
Tim
Can any one pls confirm if it's possible to configure
2 or more Gigabit Ethernet interconnects ( Sun
Cluster 3.1 Private Interconnects) on a E6900
cluster ?Yes, absolutely. You can configure up to 6 NICs for the private networks. Traffic is automatically striped across them if you specify clprivnet0 to Oracle RAC (9i or 10g). That is TCP connections and UDP messages.
It's for a High Availability requirement of Oracle
9i RAC. i need to know ,
1) can i use gigabit ethernet as Private cluster
interconnect for Deploying Oracle RAC on E6900 ? Yes, definitely.
2) What is the recommended Private Cluster
Interconnect for Oracle RAC ? GiG ethernet or SCI
with RSM ? SCI is or is in the process of being EOL'ed. Gigabit is usually sufficient. Longer term you may want to consider Infiniband or 10 Gigabit ethernet with RDS.
3) How about the scenarios where one can have say 3 X
Gig Ethernet V/S 2 X SCI , as their cluster's
Private Interconnects ? I would still go for 3 x GbE because it is usually cheaper and will probably work just as well. The latency and bandwidth differences are often masked by the performance of the software higher up the stack. In short, unless you tuned the heck out of your application and just about everything else, don't worry too much about the difference between GbE and SCI.
4) How the Interconnect traffic gets distributed
amongest the multiple GigaBit ethernet Interconnects
( For oracle RAC) , & is anything required to be done
at oracle Rac Level to enable Oracle to recognise
that there are multiple interconnect cards it needs
to start utilizing all of the GigaBit ethernet
Interfaces for transfering packets ?You don't need to do anything at the Oracle level. That's the beauty of using Oracle RAC with Sun Cluster as opposed to RAC on its own. The striping takes place automatically and transparently behind the scenes.
5) what would happen to Oracle RAC if one of the
Gigabit ethernet private interconnects fails It's completely transparent. Oracle will never see the failure.
Have tried searching for this info but could not
locate any doc that can precisely clarify these
doubts that i have .........This is all covered in a paper that I have just completed and should be published after Christmas. Unfortunately, I cannot give out the paper yet.
thanks for the patience
Regards,
Nilesh -
Oracle Cluster private Interconnect
What are the different speeds and technologies that we can configure the oracle private interconnect for RAC 11g?
ghd wrote:
What are the different speeds and technologies that we can configure the oracle private interconnect for RAC 11g?The recommended technology (looking at what Oracle's Database Machine uses) is QDR (Quad Data Rate/40Gbs) Infiniband, using the RDS (Reliable Datagram Sockets). This provides (according to Oracle testing), a 50% faster cache-to-cache block throughput with 50% less CPU time - in comparison to using UDP as the RAC Interconnect wire protocol.
Oracle presented these results to the Infiniband/OFED members in a presentation called Oracle’s Next-Generation Interconnect Protocol (PDF).
The Infiniband roadmap shows that the NDR (Next Data Rate) will scale to 320Gb/s.
There is absolutely nothing I have seen from the Ethernet vendors that show GigE matching Infiniband.
From Top 500, listing the biggest and fastest 500 clusters on this planet, Infiniband has a 41.8% market share, in comparison with the 41.4% share of GigE.
Compare this to 2005 (when we first got Infiniband for RAC). Back then Infiniband had a 3.2% market share. GigE had a 42.8% share. So there has been an incredible growth in using Infiniband as Interconnect - unlike GigE that has been stagnant and now is the 2nd place as top500 Interconnect family architecture.
What is needed for using Infiniband for Oracle RAC? A HCA (Host Channel Adapter) card for each RAC server (high speed PCI cards, dual port). An Infiniband switch (2 ports per RAC server needed). And cables of course. All these are sold by most server h/w vendors. Costs are quite comparable to 10Gb/s GigE (and even cheaper) in my experience. -
Private interconnect of an Oracle 10g cluster
Can you please answer below questions?
Is a direct connection between two nodes supported on the private interconnect of an Oracle 10g cluster?
We know that crossover cables are not supported, but what about a Gigabit network with a straight cable?”Hi,
I really wouldn't suggest that approach, It is definitely not efficient and not flexible
- If you have 4 nodes, and nodes 1 want to send message to node 4, the package must go through node 2 and 3? Is it efficient? NO absolutely
- If you have e.g 2 nodes, if one of the link down in one of the nodes, the other nodes link will also down, this will most likely evicting both nodes instead of one node
- your clusterware nodes iis limited by the cable which is not efficient
- etc etc etc more disadvantages than advantages
Cheers
FZheng -
Need procedure to change ip address on private interconnect in 11.2.0.3
Could someone please send me the procedure to change the ip address of the private interconnect in 11gr2 rac (11.2.0.3)
The interconnect has been configured using the default HAIP resource during installation of a 2 node cluster on the aix 6.1 platform. I have searched metalink but cannot find a doc with the procedure to make the ip address change.
The sys admins gave us an ip address on the wrong subnet so now we have to change the ip address of the en1 interface.
If anyone has steps in terms of shutting down the clusterware and correct order to make changes this would be very much appreciated.
Thanks.Thanks, I seen this one also but I was just hoping to see some official documentation from oracle on this topic. I searched metalink and there is a doc id called
"Grid infrastructure everything you need to know" but it does not speak to this configuration change or even how to disable the clusterware in the event that you need to perform maintenance and do not want the clusterware to automatically come online.
Although I love google too... but If there are any official documentation on this topic I would really appreciate to know where it can be found?
Thanks. -
INS-20802 Oracle Private Interconnect Configuration Assistant failed
Thought I would post what information I've gathered, after facing this error during install of RAC Grid Infrastructure 11.2.0.1 on Red Hat Enterprise Linux Server release 5.5 64-bit, as Oracle Support is once again unable to help. Maybe this will save someone else some time and the aggravation of dealing with lousy Oracle Support.
The error occurs after root.sh has successfully completed on all nodes. Oracle Net Configuration Assistant runs successfully, then Oracle Private Interconnect Configuration Assistant launches and subsequently fails with the following.
[INS-20802] Oracle Private Interconnect Configuration Assistant failed.
/u01/app/oraInventory/logs/installActions2010-12-13_01-26-10PM.log
INFO: Starting 'Oracle Private Interconnect Configuration Assistant'
INFO: Starting 'Oracle Private Interconnect Configuration Assistant'
INFO: PRIF-26: Error in update the profiles in the cluster
INFO:
WARNING:
INFO: Completed Plugin named: Oracle Private Interconnect Configuration Assistant
INFO: Oracle Private Interconnect Configuration Assistant failed.
INFO: Oracle Private Interconnect Configuration Assistant failed.
I was able to find another error that coincides with the PRIF-26 error: "CRS-2324:Error(s) occurred while trying to push GPnP profile. State may be inconsistent."
I was also able to duplicate the PRIF-26 error by trying to add a non-existent network interface via oifcfg:
./oifcfg setif -global jjj1/192.167.1.0:cluster_interconnect
PRIF-26: Error in update the profiles in the cluster
My best guess is the Oracle Private Interconnect Configuration Assistant makes a call to oifcfg. When oifcfg makes an update or adds a public/private interface, some XML files are also updated or maybe cross-referenced. These files are located here: <grid_home>/gpnp/<host>/profiles/peer
Any updates/changes/addtions to the private or public interfaces include changes for the Grid Plug-n-Play component, which uses the XML files. If the interface name is not contained in the XML files, my best guess is that triggers the "CRS-2324:Error(s) occurred while trying to push GPnP profile. State may be inconsistent.
I verified everything was configured correctly; the cluster verification utility reported everything was ok. I also ran the cluster verifcation utility against the GP-nP:
./cluvfy comp gpnp -verbose
I also reviewed the public and private interfaces via oifcfg and they are correct:
[oracle@ryoradb1 bin]$ ./oifcfg getif -global
eth0 10.10.2.0 global public
eth1 192.167.1.0 global cluster_interconnect
[oracle@ryoradb1 bin]$ ./oifcfg iflist -p
eth0 10.10.2.0 PRIVATE
eth1 192.167.1.0 UNKNOWN
My conclusion is the environment is configured correctly, in spite of the error generated by the Oracle Private Configuration Assistant.I understand that you have installed 11.2.0.1 not 11.2.0.2 because multicating must be enabled if you have installed 11.2.0.2 and you may face these sort of problems because cluster nodes would not be able to communicate with each other.
Please check ocssd.log especially on the first node because this file will give more inforamtion as to why first node is not able to push GPnP file. As you have executed cluvfy to confirm the GPnP but to confirm whether GPnP profile is accurate to just narrow down the problem, I would suggest you to try to start cluster in exclusive mode so that you can sure that GPnP profile is good.
Shutdown CRS on all nodes, if there is any hung processes then kill them before executing the fllowing command to start cluster in exclusive mode.
$GRID_HOME/bin/crsctl start crs -excl
If you are able to start cluster in exclusive then it is sure that GPnP is correct and then next step would be to verify the private network.
See how you goes.
FYI, I was recently analyzing the same sort of problems where cluster was not able to access GPnP profile and finally I found issues on my private network. Customer had enabled IGMP snooping, which was avoiding multicast communication over the private network but it was 11.2.0.2, which is not the case here.
Harish Kumar
http://www.oraxperts.com -
Unplug of private interconnect cable restart the system!
Dear All,
My Database is 2 Node RAC Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production on Linux.
I had a strange experience with my private interconnect between the 2 nodes. I need to replace switch between the nodes with a new and better switch. When i plugged wire from one node, the machine restarted. Similarly while I plugged the wire from the other node, the same machine that was restarted earlier, restarted again.
Have you ever faced such a problem? What can i investigate? Any clue please.
Also I want to know what is the difference of if we update the remote listener with IP instead of scan IP name?
SQL> show parameter remote_listener
NAME TYPE VALUE
remote_listener string 10.168.20.29:1521
This is the only thing i doubt creating the problem. All other configurations are as per documentation.
Your kind help will be appreciated.
Regards,
Imran
Regards,
ImranYeah as far as I have seen this seems to be the problem.
CRS was already not accessible by the nodes and when i un plug the cable from one node it restarted and Scan IP was not accessible for clients to connect the database.
I configured Oracle ASM on SAN device using multipath.
Now in OEM i see:
Serviced Databases
Name Disk Groups Failure Groups Allocated Space (GB) Availability Alerts
racdbdb_racdbdb1 FRA, DATA n/a 288.27 [Availability] 21
RACDB-cluster CRS n/a 0.26 Not Monitored
But when i run this query:
SQL> SELECT NAME, STATE, OFFLINE_DISKS FROM V$ASM_DISKGROUP;
NAME STATE OFFLINE_DISKS
CRS MOUNTED 0
DATA CONNECTED 0
FRA CONNECTED 0
How can i check that voting disk is functional? Kindly help
Regards,
Imran -
Unplug of private interconnect cable but the machine didn't restarted
Dear All,
I have RAC Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit database on Linux.
I had strange experience with my private interconnect between the 2 nodes. When i test unplug private interconnect link in one of the nodes, the machine didn't rebooted. When i check in cluster log, it's stated one of the nodes is rebooted.
2013-10-07 12:34:18.570
[cssd(7565)]CRS-1612:Network communication with node centaurus22 (2) missing for 50% of timeout interval. Removal of this node from cluster in 14.360 seconds
2013-10-07 12:34:25.572
[cssd(7565)]CRS-1611:Network communication with node centaurus22 (2) missing for 75% of timeout interval. Removal of this node from cluster in 7.360 seconds
2013-10-07 12:34:30.573
[cssd(7565)]CRS-1610:Network communication with node centaurus22 (2) missing for 90% of timeout interval. Removal of this node from cluster in 2.360 seconds
2013-10-07 12:34:32.935
[cssd(7565)]CRS-1607:Node centaurus22 is being evicted in cluster incarnation 272740834; details at (:CSSNM00007:) in /opt/app/11.2.0/grid/log/centaurus21/cssd/ocssd.log.
2013-10-07 12:34:34.937
[cssd(7565)]CRS-1625:Node centaurus22, number 2, was manually shut down
2013-10-07 12:34:34.952
[cssd(7565)]CRS-1601:CSSD Reconfiguration complete. Active nodes are centaurus21 .
2013-10-07 12:34:34.965
[crsd(8720)]CRS-5504:Node down event reported for node 'centaurus22'.
2013-10-07 12:34:36.427
[crsd(8720)]CRS-2773:Server 'centaurus22' has been removed from pool 'Generic'.
2013-10-07 12:34:36.428
[crsd(8720)]CRS-2773:Server 'centaurus22' has been removed from pool 'ora.SASDB'.
2013-10-07 18:46:28.633
Have you ever faced this problem ?
Your kindly help will be appreciated.
Thank you
Regards,
Izzudin HanafieRebootless fencing is introduced in 11.2.0.2 Grid Infrastructure, instead of rebooting a node as in pre-11.2.0.2 when eviction happens, it will attempt to stop GI gracefuly on the evicted node to avoid a node reboot.
http://www.trivadis.com/uploads/tx_cabagdownloadarea/Trivadis_oracle_clusterware_node_fencing_v.pdf -
Redundancy at Private interconnect.
Hi,
We are planning to setup a 2 node RAC. Our system admin has provided 2 nics for private interconnect. We were looking to use both as private interconnect.
Operating environment
Solaris 10
Oracle 10g R2 (clusterware, rdbms)
Current configuration of NICs provided for interconnect.
nxge1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 6
inet 192.168.1.119 netmask ffffff00 broadcast 192.168.1.255
ether 0:21:28:69:a7:37
nxge2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 7
inet 192.168.2.119 netmask ffffff00 broadcast 192.168.2.255
ether 0:21:28:69:a7:38
My questions:
As per oracle support note "How to Setup IPMP as Cluster Interconnect (Doc ID 368464.1)"
we can use IPMP grouping for Interconnect, but it is not very clear.
1) If I use IPMP group do i need to specify only one physical ip as cluster_interconnect or all the ips associated to NIC. (Will this allow load balancing or only failover).
2) If we do not want to use IPMP can I specify all the IP address of NICs in cluster_interconnects parameter (This will not allow failover only load balancing).
Regards
Veerauser7636989 wrote:
Hi,
We are planning to setup a 2 node RAC. Our system admin has provided 2 nics for private interconnect. We were looking to use both as private interconnect.
Operating environment
Solaris 10
Oracle 10g R2 (clusterware, rdbms)
Current configuration of NICs provided for interconnect.
nxge1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 6
inet 192.168.1.119 netmask ffffff00 broadcast 192.168.1.255
ether 0:21:28:69:a7:37
nxge2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 7
inet 192.168.2.119 netmask ffffff00 broadcast 192.168.2.255
ether 0:21:28:69:a7:38A prerequsite for IPMP is that the participating IP interfaces should be in the same IP broadcast
subnet, but your output above shows them to be on different subnets (192.168.1.0/24 and
192.168.2.0/24). That would need to be fixed before you can use IPMP (which supports
both failover and loadbalancing). And if you used IPMP, then you would need to set up
the cluster_interconnect to be the data address(es) (the one(s) that is(are) not set up with
the NOFAILOVER flag).
>
My questions:
As per oracle support note "How to Setup IPMP as Cluster Interconnect (Doc ID 368464.1)"
we can use IPMP grouping for Interconnect, but it is not very clear.
1) If I use IPMP group do i need to specify only one physical ip as cluster_interconnect or all the ips associated to NIC. (Will this allow load balancing or only failover).
2) If we do not want to use IPMP can I specify all the IP address of NICs in cluster_interconnects parameter (This will not allow failover only load balancing).
Regards
Veera -
Shared private interconnect between 2 clusters
Hello to everyone.
I am just wondering if somebody could answer me or show proper direction.
Is it allowed for two or more clusters share the same private interconnect network? Or dedicated private interconnect required for each cluster.
Traffic is not matter here because only oracle grid infrastructure ( say 11.2.0.2) will be installed on each cluster (no oracle RAC). We are going to use CRS failover feature.Of course, you can share the network.. make sure that multicast is tested out before the installation..
Again, be careful with too much of sharing.. if the bandwidth is so full that network timeouts happen, the nodes would evict.. but as long as you good network, this is fine. -
Link Based IPMP Private Interconnect - Oracle 10g
I am configuring IPMP for Oracle 10g RAC private and Private Interconnect.
Following an Oracle white paper we are configuring LINK Based IPMP in an Active/Active Configuration
I have information from metalink for configuring the VIP, however I am a little unsure about the configuration of the private interconnect.
Is it just a case of removing the cluster interconnect from oifcfg and using cluster_interconnect for ASM and Database instances.
Is there any other considerations for Oracle 10g RAC deployment beside making change using oifcfg as well as using private_interconnect initialization parameter.
Thanks
PaulThe following notes are of help for you:
How to Setup IPMP as Cluster Interconnect (Doc ID 368464.1)
Configuring Solaris IP Multipathing (IPMP) for the Oracle 10g VIP (Doc ID 283107.1)
White paper on IPMP:
http://www.oracle.com/technetwork/articles/systems-hardware-architecture/ha-rac-networking-ipmp-168440.pdf
Raj Mareddi
http://www.freeoraclehelp.com -
Private Interconnect: Should any nodes other than RAC nodes have one?
The contractors that set up our four-node production 10g RAC (and a standalone development server) also assigned private interconnect addresses to 2 Apache/ApEx servers and a standalone development database server.
There are service names in the tnsnames.ora on all servers in our infrastructure referencing these private interconnects- even the non-rac member servers. The nics on these servers are not bound for failover with the nics bound to the public/VIP addresses. These nics are isolated on their own switch.
Could this configuration be related to lost heartbeats or voting disk errors? We experience rac node expulsions and even arbitrary bounces (reboots!) of all the rac nodes.I do not have access to the contractors. . . .can only look at what they have left behind and try to figure out their intention. . .
I am reading the Ault/Tumha book Oracle 10g Grid and Real Application Clusters and looking through our own settings and config files and learning srvctl and crsctl commands from their examples. Also googling and OTN searching through the library full of documentation. . .
I still have yet to figure out if the private interconnect spoken about so frequently in cluster configuration documents are the binding to the set of node.vip address specifications in the tnsnames.ora (bound the the first eth adaptor along with the public ip addresses for the nodes) or the binding on the second eth adaptor to the node.prv addresses not found in the local pfile, in the tnsnames.ora, or the listener.ora (but found at the operating system level in the ifconfig). If the node.prv addresses are not the private interconnect then can anyone tell me that they are for? -
RAC 11R2 Private Interconnect Issue
Friends
We had setup our Oracle Clusterware on Solaris Sparc with a version 11.2.0.3 PSU 2 patch sets. Some changes happen at the OS level and the private Interconnect IPs were picked wrong by our Oracle Clusterware registry.
The clusterware is down. We are not able to bring up the clusterware. There will be a need to change the private IP configuration at the Oracle Clusterware level and now the clusterware is down.
Is there any way we can change the configuration in private Interconnect ?
Whenever we are trying to do a change. Getting the error message "PRIF-10: failed to initialize the cluster registry"
$ oifcfg setif -global vnet2/10.131.239.0:cluster_interconnect
PRIF-10: failed to initialize the cluster registry
Thank You !
JaiThe clusterware is down. We are not able to bring up the clusterware. There will be a need to change the private IP configuration at the Oracle Clusterware level and now the clusterware is down.
Is there any way we can change the configuration in private Interconnect ?
Whenever we are trying to do a change. Getting the error message "PRIF-10: failed to initialize the cluster registry"
$ oifcfg setif -global vnet2/10.131.239.0:cluster_interconnect
PRIF-10: failed to initialize the cluster registryThis error happen when clusterware is down and you are trying to change Interconnect configuration, then you must start the Oracle Clusterware on the node to make changes.
We are not able to bring up the clusterware. Some changes happen at the OS level and the private Interconnect IPsWhy you clusterware is not starting?...please post alertlog and crsd.log of cluster (only relevant info).
If the error on crsd.log is : PROC-44: Error in network address and interface operations Network address and interface operations error
This errors indicate a mismatch between OS setting (oifcfg iflist) and gpnp profile setting profile.xml.
You will restore the OS network configuration back to the original status, start Oracle Clusterware. Then try make the changes again. -
Private interconnect oracle 10g RAC configuration
Can you please answer below questions?
Why does a private interconnect need a switch, and why is straight through cables not supported.Hi,
Why do you need a switch between the nodes".When network plugs are pulled out from one node on a two node cluster, a split brain scenerio occurs. (just it's enough)
If you are using a crossover cable and you shutdown node (A) you will loose the network (private) link from node (B) (this happens in some servers.), Oracle RAC will not work with private network link down, both nodes will down and will not start until you get link on network private. (Goodbye high availability)
You will be very unhappy with the error ORA-29740. Prelude to suggest this note: Troubleshooting ORA-29740 in a RAC Environment [ID 219361.1]
There is no "why" Oracle RAC does not support crossover cable because RAC depends of SWITCH (it's a Hardware Requirements) and any problems in your environment Oracle will force you to implement a supported solution.
You will have implemented a poor environment, if you not use a GB switch for private network.
Oracle Words:
*Physical Layout of the Private Interconnect*
The basic requirements are described in the Installation Guide for each platform. Additional information about certification can be found on Metalink Certify.
The interconnect as identified by both subnet number and interface name must be configured on all clustered nodes.
*A switch between the clustered nodes is an absolute requirement.*
*Cluster Interconnect in Oracle 10g and 11g [ID 787420.1]*
Regards,
Levi Pereira -
How to check my RAC private interconnect working properly?
All,
Is there any way to check whether my RAC private interconnect is working properly or not?
Thanks,
MahiMahi wrote:
All,
Is there any way to check whether my RAC private interconnect is working properly or not?
Thanks,
MahiCVU verifies the connectivity between all of the nodes in the cluster through those interfaces.
$cluvfy comp nodecon -n all -verbose
http://docs.oracle.com/cd/E11882_01/rac.112/e16794/cvu.htm
Maybe you are looking for
-
HT2822 Can i connect Apple TV to my iPhone 5 network
Can i connect Apple TV to my iPhone 5 network
-
Display cell contents as text instead of evaluating as a numeric expression
If I enter a value such as 21/27 in a cell, Numbers interprets it as 21 divided by 27 and displays the result, but that's not what I want. I want 21/27 to be displayed. How can I do that? Thanks, Pete
-
Can I find files in "Originals" folder which aren't showing in iPhoto
I have found some corrupted photos in some events in my "Originals" folder. I think they came from when I tried to import some files from a corrupted CD, and I have since reimported them from a good copy of the CD. They are corrupted in that they are
-
Managed user account, the dock, and the full finder?
I am creating a simple lab for school (26 computers wired together with CAT 6 switchers and no server...just me as the admin account) and will be creating managed accounts for each period. When I have been testing this, logging in as a student, I can
-
Reversal of cash flow in forward transaction
I have cretaed Forward contract and posted the entries also. But i want to reverse one of the entry. Please help me on reversal of the same