Oracle-Ninja.com Andy Colvin's Oracle Blog

14Nov/111

Exadata 11.2.2.4.0 10GbE Issue Resolved

It appears that Oracle has resolved the issue with the 10GbE drivers that were introduced in version 11.2.2.4.0.  There is an updated note (1376664.1) that includes the patch to fix it. The issue was apparently related to TCP segmentation offloading, and can be fixed by installing the patch found in the note listed above. It does not require a reboot, and is similar to the fix for the IDT switch bug fixed in 11.2.2.4.0. Note that this bug only affected X2-2 systems utilizing 10 gigabit ethernet on the compute nodes. Oracle again recommends installing the 11.2.2.4.0 minimal pack on compute nodes.

After starting the service, users should see the following:

(root)# service disable10gigtso_13083530 start
Skipping igb interface eth0 using driver version 2.1.0-k2-1 - TSO disable unnecessary
Found ixgbe interface eth4 using driver version 2.0.84-k2 - Disabling TSO ... [SUCCESS]
Found ixgbe interface eth5 using driver version 2.0.84-k2 - Disabling TSO ... [SUCCESS]
13Jun/116

Exadata Interconnect Addressing Tips

Having done a handful of Exadata implementations, there's always been one piece of the configuration that's bothered me more than anything else.  In the process of ordering an Exadata, Oracle sends the customer a "Configuration Worksheet" that asks questions about how the system should be configured.  It's standard stuff:  hostnames, DNS and NTP servers, UID and GID for the oracle/dba/oinstall (that's another sore spot) accounts, and IP addresses for the various interfaces.  The worksheet comes as a nifty PDF that the customer can modify to suit the needs of the Exadata system.

Unfortunately, the PDF does not allow the customer to modify the IP range used for the IB network.  The only option from this form is to use the network 192.168.8.0/22 with the hosts using 192.168.10.1 - 192.168.10.22 (for a full rack).  Why the /22 you might ask?  Oracle recommends using a subnet of 255.255.252.0 so that multiple Exadata systems can be connected, along with an Exalogic, and whatever other products they have down the line that will connect with Exadata on the IB network.  It would be nice if Oracle would allow customers to define this network range themselves, instead of sticking everybody in the 192.168.8.0/22 network.  Some say that it won't be a problem, because the interconnect is non-routable, but I disagree. Find out why after the jump