All, Just FYI - this problem was solved by turning off the firewall in Oracle Linux 6.1. (not a good fix in a real environment, but I'm just messing around). Thanks to Andrew Rosati for his help! Jerry -----Original Message----- From: oracle-l-bounce@xxxxxxxxxxxxx [mailto:oracle-l-bounce@xxxxxxxxxxxxx] On Behalf Of Gerald Cunningham Sent: Tuesday, December 06, 2011 10:07 AM To: oracle-l@xxxxxxxxxxxxx Subject: 11.2.0.3 grid install problem on Oracle linux 6.1 VM Hi there, I'm setting up a RAC cluster in two Oracle Linux 6.1 Vm's under Virtual Box (per http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOracleLinux6UsingVirtualBox.php) Installing Oracle Grid Infrastructure on node #1 (ol6-112-rac1) On the screen "Oracle Grid Infrastructure - Setting up Grid Infrastructure - Step 4 of 9", I have: SCAN Name = ol6-112-scan Public Hostname Virtual Hostname ol6-112-rac1.localdomain ol6-112-rac1-vip.localdomain ol6-112-rac2.localdomain ol6-112-rac2-vip.localdomain SSH connectivity is working Identify network interfaces... Interface Name Subnet Interface Type eth0 192.168.0.0 Public eth1 192.168.1.0 Private Hit "OK" When I click "Next", it gets to "Validating Public And Private Interfaces Across Cluster Nodes", then gives me this error: [INS-41112] Specified network interface doesnt maintain connectivity across cluster nodes." Details: Cause - Installer has detected that network interface eth0 does not maintain connectivity on all cluster nodes. Action - Ensure that the chosen interface has been configured across all cluster nodes. Additional Information: PRVF-7617 : Node connectivity between "ol6-112-rac1 : 192.168.0.111" and "ol6-112-rac2 : 192.168.0.112" failed Summary of the failed nodes ol6-112-rac2 ol6-112-rac1 ol6-112-rac1 : 192.168.0.111 === I can't find any problems... what am I missing? Thanks very much for any help! Jerry Excruciating details below... === [oracle@ol6-112-rac1 grid]$ more /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 # Public 192.168.0.111 ol6-112-rac1.localdomain ol6-112-rac1 192.168.0.112 ol6-112-rac2.localdomain ol6-112-rac2 # Private 192.168.1.111 ol6-112-rac1-priv.localdomain ol6-112-rac1-priv 192.168.1.112 ol6-112-rac2-priv.localdomain ol6-112-rac2-priv # Virtual 192.168.0.113 ol6-112-rac1-vip.localdomain ol6-112-rac1-vip 192.168.0.114 ol6-112-rac2-vip.localdomain ol6-112-rac2-vip # SCAN 192.168.0.115 ol6-112-scan.localdomain ol6-112-scan 192.168.0.116 ol6-112-scan.localdomain ol6-112-scan 192.168.0.117 ol6-112-scan.localdomain ol6-112-scan === [oracle@ol6-112-rac2 ~]$ more /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 # Public 192.168.0.111 ol6-112-rac1.localdomain ol6-112-rac1 192.168.0.112 ol6-112-rac2.localdomain ol6-112-rac2 # Private 192.168.1.111 ol6-112-rac1-priv.localdomain ol6-112-rac1-priv 192.168.1.112 ol6-112-rac2-priv.localdomain ol6-112-rac2-priv # Virtual 192.168.0.113 ol6-112-rac1-vip.localdomain ol6-112-rac1-vip 192.168.0.114 ol6-112-rac2-vip.localdomain ol6-112-rac2-vip # SCAN 192.168.0.115 ol6-112-scan.localdomain ol6-112-scan 192.168.0.116 ol6-112-scan.localdomain ol6-112-scan 192.168.0.117 ol6-112-scan.localdomain ol6-112-scan === [oracle@ol6-112-rac1 grid]$ cat /etc/sysconfig/network NETWORKING=yes HOSTNAME=ol6-112-rac1.localdomain GATEWAY=192.168.0.1 === [oracle@ol6-112-rac2 ~]$ cat /etc/sysconfig/network NETWORKING=yes HOSTNAME=ol6-112-rac2.localdomain GATEWAY=192.168.0.1 === [oracle@ol6-112-rac1 grid]$ ifconfig -a | grep eth eth0 Link encap:Ethernet HWaddr 08:00:27:C5:99:61 eth1 Link encap:Ethernet HWaddr 08:00:27:3E:93:E0 === [oracle@ol6-112-rac2 ~]$ ifconfig -a |grep eth eth0 Link encap:Ethernet HWaddr 08:00:27:C3:D4:8D eth1 Link encap:Ethernet HWaddr 08:00:27:9E:67:08 === [oracle@ol6-112-rac1 grid]$ cat /etc/sysconfig/network-scripts/ifcfg-eth0 DEVICE="eth0" NM_CONTROLLED="yes" ONBOOT=yes TYPE=Ethernet BOOTPROTO=none IPADDR=192.168.0.111 PREFIX=24 GATEWAY=192.168.0.1 DEFROUTE=yes IPV4_FAILURE_FATAL=yes IPV6INIT=no HWADDR=08:00:27:C5:99:61 NAME="System eth0" UUID=5fb06bd0-0bb0-7ffb-45f1-d6edd65f3e03 [oracle@ol6-112-rac1 grid]$ cat /etc/sysconfig/network-scripts/ifcfg-eth1 DEVICE="eth1" NM_CONTROLLED="yes" ONBOOT=yes TYPE=Ethernet BOOTPROTO=none IPADDR=192.168.1.111 PREFIX=24 DEFROUTE=yes IPV4_FAILURE_FATAL=yes IPV6INIT=no NAME="System eth1" UUID=9c92fad9-6ecb-3e6c-eb4d-8a47c6f50c04 HWADDR=08:00:27:3E:93:E0 GATEWAY=192.168.0.1 === [oracle@ol6-112-rac2 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-eth0 DEVICE="eth0" NM_CONTROLLED="yes" ONBOOT=yes TYPE=Ethernet BOOTPROTO=none IPADDR=192.168.0.112 PREFIX=24 GATEWAY=192.168.0.1 DEFROUTE=yes IPV4_FAILURE_FATAL=yes IPV6INIT=no NAME="System eth0" HWADDR=08:00:27:C3:D4:8D UUID=5fb06bd0-0bb0-7ffb-45f1-d6edd65f3e03 [oracle@ol6-112-rac2 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-eth1 DEVICE="eth1" NM_CONTROLLED="yes" ONBOOT=yes TYPE=Ethernet BOOTPROTO=none IPADDR=192.168.1.112 PREFIX=24 DEFROUTE=yes IPV4_FAILURE_FATAL=yes IPV6INIT=no NAME="System eth1" HWADDR=08:00:27:9E:67:08 GATEWAY=192.168.0.1 UUID=9c92fad9-6ecb-3e6c-eb4d-8a47c6f50c04 === I can ping and ssh the public and private IP's from both VM's: [oracle@ol6-112-rac1 logs]$ ping -c 1 ol6-112-rac2 PING ol6-112-rac2.localdomain (192.168.0.112) 56(84) bytes of data. 64 bytes from ol6-112-rac2.localdomain (192.168.0.112): icmp_seq=1 ttl=64 time=19.3 ms --- ol6-112-rac2.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 19ms rtt min/avg/max/mdev = 19.309/19.309/19.309/0.000 ms [oracle@ol6-112-rac1 logs]$ ping -c 1 ol6-112-rac2-priv PING ol6-112-rac2-priv.localdomain (192.168.1.112) 56(84) bytes of data. 64 bytes from ol6-112-rac2-priv.localdomain (192.168.1.112): icmp_seq=1 ttl=64 time=22.2 ms --- ol6-112-rac2-priv.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 25ms rtt min/avg/max/mdev = 22.238/22.238/22.238/0.000 ms [oracle@ol6-112-rac1 logs]$ ssh ol6-112-rac2 hostname ol6-112-rac2.localdomain [oracle@ol6-112-rac1 logs]$ ssh ol6-112-rac2-priv hostname ol6-112-rac2.localdomain [oracle@ol6-112-rac2 ~]$ ping -c 1 ol6-112-rac1 PING ol6-112-rac1.localdomain (192.168.0.111) 56(84) bytes of data. 64 bytes from ol6-112-rac1.localdomain (192.168.0.111): icmp_seq=1 ttl=64 time=0.393 ms --- ol6-112-rac1.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 0.393/0.393/0.393/0.000 ms [oracle@ol6-112-rac2 ~]$ ping -c 1 ol6-112-rac1-priv PING ol6-112-rac1-priv.localdomain (192.168.1.111) 56(84) bytes of data. 64 bytes from ol6-112-rac1-priv.localdomain (192.168.1.111): icmp_seq=1 ttl=64 time=0.686 ms --- ol6-112-rac1-priv.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 0.686/0.686/0.686/0.000 ms [oracle@ol6-112-rac2 ~]$ ssh ol6-112-rac1 hostname ol6-112-rac1.localdomain [oracle@ol6-112-rac2 ~]$ ssh ol6-112-rac1-priv hostname ol6-112-rac1.localdomain === here is the end of my log file: INFO: Preparing to check passwordless SSH Connectivity between nodes: [ol6-112-rac1, ol6-112-rac2] INFO: Testing passwordless SSH connectivity between the selected nodes. This may take several minutes, please wait... INFO: OverallStatus of User Equivalence check using CVU is SUCCESSFUL INFO: Finding passwordless SSH connectivity setup on remote nodes INFO: Preparing remote commands to check passwordless SSH connectivity setup on remote nodes INFO: Total number of remote commands to be executed is 2 INFO: Total time taken to complete verification is 230 ms. INFO: All remote nodes are configured for passwordless SSH connectivity INFO: Validating Public nodes for user equivalence INFO: Validating Hostnames for nodes INFO: Validating node readiness INFO: Checking for node liveliness INFO: Validating Public Hosts for User Equivalence INFO: Validating for 9.2, 10gR1 or Local CSS INFO: Gathering system details... INFO: Setting public and VIP node info to the bean INFO: Validating Public And Private Interfaces Across Cluster Nodes INFO: Validating Node VIPs INFO: Collecting interface information for node ol6-112-rac1 INFO: Collecting interface information for node ol6-112-rac2 INFO: Copying oifcfg to node ol6-112-rac2 INFO: Copied oifcfg to node ol6-112-rac2 INFO: Removing oifcfg from node ol6-112-rac2 INFO: Removed oifcfg from node ol6-112-rac2 INFO: Validating Network Interfaces INFO: Validating interfaces for typical - nodes = [ol6-112-rac1, ol6-112-rac2] INFO: Validating Interface name and subnet from the default list INFO: Validating for NO Public interfaces INFO: Validating if Public and Private lists have any common interface INFO: Validating for no private interface provided INFO: Flag oracle.install.crs.allowSingleNIC=false INFO: Validating Cluster Node details SEVERE: [FATAL] [INS-41112] Specified network interface doesnt maintain connectivity across cluster nodes. CAUSE: Installer has detected that network interface eth0 does not maintain connectivity on all cluster nodes. ACTION: Ensure that the chosen interface has been configured across all cluster nodes. SEVERE: [FATAL] [INS-41112] Specified network interface doesnt maintain connectivity across cluster nodes. CAUSE: Installer has detected that network interface eth1 does not maintain connectivity on all cluster nodes. ACTION: Ensure that the chosen interface has been configured across all cluster nodes. INFO: Advice is ABORT INFO: Adding ExitStatus INVALID_USER_INPUT to the exit status set INFO: Completed validating state <ClusterInfoUI> INFO: Terminating all background operations INFO: Terminated all background operations INFO: Transition aborted INFO: Rolled back to state <ClusterInfoUI> INFO: Pause Oracle Grid Infrastructure INFO: Resume Oracle Grid Infrastructure INFO: Adding ExitStatus USER_CANCELLED_INSTALL to the exit status set INFO: Finding the most appropriate exit status for the current application INFO: Exit Status is 4 INFO: Shutdown Oracle Grid Infrastructure -- //www.freelists.org/webpage/oracle-l -- Follow this link to mark it as spam: http://mailfilter.proteus-technologies.com/cgi-bin/learn-msg.cgi?id=29C5D284AD.A17B9 -- //www.freelists.org/webpage/oracle-l