Changing NETMASK, IP address and Device for the Cluster-Interconnect

Configuration and Changes Request

Version Clusterware 11.2.0.4.3 
Change request :
               OLD Config                  New Config    
Device         eth2                        eth3
Address:       192.168.2.101               192.168.3.101
Netmask:       255.255.255.0               255.255.255.192 
Network:       192.168.2.0/24              192.168.3.64/26

Network Configuration


Current Configuration 
Address:   192.168.2.101         11000000.10101000.00000010 .01100101
Netmask:   255.255.255.0 = 24    11111111.11111111.11111111 .00000000
Wildcard:  0.0.0.255             00000000.00000000.00000000 .11111111
=>
Network:   192.168.2.0/24        11000000.10101000.00000010 .00000000 (Class C)
Broadcast: 192.168.2.255         11000000.10101000.00000010 .11111111
HostMin:   192.168.2.1           11000000.10101000.00000010 .00000001
HostMax:   192.168.2.254         11000000.10101000.00000010 .11111110
Hosts/Net: 254                   (Private Internet)

New Configuration
Address:   192.168.3.103         11000000.10101000.00000011.01 100111
Netmask:   255.255.255.192 = 26  11111111.11111111.11111111.11 000000
Wildcard:  0.0.0.63              00000000.00000000.00000000.00 111111
=>
Network:   192.168.3.64/26       11000000.10101000.00000011.01 000000 (Class C)
Broadcast: 192.168.3.127         11000000.10101000.00000011.01 111111
HostMin:   192.168.3.65          11000000.10101000.00000011.01 000001
HostMax:   192.168.3.126         11000000.10101000.00000011.01 111110
Hosts/Net: 62                    (Private Internet)

Note: For oifcfg setif we need the Network Address which is 192.168.3.64 in our case !

Current configuration 
[grid@grac41 ~]$   oifcfg getif
eth1  192.168.1.0  global  public
eth2  192.168.2.0  global  cluster_interconnect
[grid@grac41 ~]$ ifconfig eth2
eth2      Link encap:Ethernet  HWaddr 08:00:27:84:6C:1F  
          inet addr:192.168.2.101  Bcast:192.168.2.255  Mask:255.255.255.0

Configure device eth3 on all nodes

Change/Add to  ifcfg-eth3 /etc/sysconfig/network-scripts
NETMASK=255.255.255.192
BROADCAST=192.168.3.127
PREFIX=26

[root@grac42 network-scripts]# ifdown eth3
Device state: 3 (disconnected)
[root@grac42 network-scripts]# ifup eth3
Active connection state: activated
Active connection path: /org/freedesktop/NetworkManager/ActiveConnection/36
[root@grac42 network-scripts]# ifconfig eth3
eth3      Link encap:Ethernet  HWaddr 08:00:27:AB:00:74  
          inet addr:192.168.3.102  Bcast:192.168.3.127  Mask:255.255.255.192

--> Change the Interface eht3 on all Nodes 
[root@grac41 network-scripts]# ping -I  192.168.3.101  192.168.3.102
[root@grac41 network-scripts]# ping -I  192.168.3.101  192.168.3.103
[root@grac41 network-scripts]# ping -I  192.168.3.101  192.168.3.101

Change CI device from eth2 to eth3

 
Disable the newly configured device eth3
[root@grac42 network-scripts]# ifdown eth3
Device state: 3 (disconnected)

Please take a backup of profile.xml on all cluster nodes before proceeding, as grid user:
[grid@grac41 ~]$ cd $GRID_HOME/gpnp/grac41/profiles/peer/
[grid@grac41 peer]$  cp -p profile.xml profile.xml.bk
--> Repeat steps on grac42 and grac43

Get the existing information
[grid@grac41 peer]$  oifcfg getif
eth1  192.168.1.0  global  public
eth2  192.168.2.0  global  cluster_interconnect

[root@grac41 peer]# oifcfg setif -global eth3/192.168.3.64:cluster_interconnect
[root@grac41 peer]# oifcfg getif
eth1  192.168.1.0  global  public
eth2  192.168.2.0  global  cluster_interconnect
eth3  192.168.3.64  global  cluster_interconnect

Shutdown Oracle Clusterware on all nodes ( grac41, grac42, grac43 )  and disable the Oracle Clusterware as root user
# crsctl stop crs
# crsctl disable crs

Make the network configuration change at OS level as required, ensure the new interface is available on all nodes after the change.
[root@grac41 network-scripts]# cd /etc/sysconfig/network-scripts
[root@grac41 network-scripts]# ifup eth3
[root@grac41 network-scripts]# ping -I  192.168.3.101  192.168.3.102
[root@grac41 network-scripts]# ping -I  192.168.3.101  192.168.3.103
[root@grac41 network-scripts]# ping -I  192.168.3.101  192.168.3.101
[root@grac41 peer]# ifconfig eth3
eth3      Link encap:Ethernet  HWaddr 08:00:27:92:43:5B  
          inet addr:192.168.3.101  Bcast:192.168.3.127  Mask:255.255.255.192
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
--> Repeat above steps on grac42 and grac43

Delete the old cluster_interconnect from OCR 
[grid@grac41 peer]$ oifcfg delif -global  eth2
[grid@grac41 peer]$  oifcfg getif
eth1  192.168.1.0   global  public
eth3  192.168.3.64  global  cluster_interconnect

Leave a Reply

Your email address will not be published. Required fields are marked *