You Buy a NUMA System, Oracle Says Disable NUMA

  




Linux AS 5.3 64bit,  Oracle 10.2.0.4  64bit ,  4 Node RAC .

在其中一個平時負載比較高的節點上 alert log中發現報錯資訊如下， 這個節點是專用於報表查詢的 ，
所以相對負載會高於其他節點 。  其他節點僅僅收到  Tue May 11 11:38:02 2010
Trace dumping is performing id=[cdmp_20100511113801]  的資訊 。   



節點 4 上的alert log  :  


Tue May 11 11:11:45 2010
Thread 4 advanced to log sequence 7945 (LGWR switch)
  Current log# 45 seq# 7945 mem# 0: /ocfs_ctrl_redo/mxdell/redo45_a.log
  Current log# 45 seq# 7945 mem# 1: /ocfs_data/mxdell/redo45_b.log
Tue May 11 11:38:01 2010
Errors in file /u01/product/admin/mxdell/udump/mxdell4_ora_2734.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:sskgxp_select failed with status: 3
ORA-27301: OS failure message: No such process
ORA-27302: failure occurred at: skgxpvfymmtu
ORA-27303: additional information: MTU could not be verified.  Did not receive valid message.
Tue May 11 11:38:01 2010
Trace dumping is performing id=[cdmp_20100511113801]
Tue May 11 11:41:49 2010
Thread 4 advanced to log sequence 7946 (LGWR switch)
  Current log# 46 seq# 7946 mem# 0: /ocfs_ctrl_redo/mxdell/redo46_a.log
  Current log# 46 seq# 7946 mem# 1: /ocfs_data/mxdell/redo46_b.log  




-----------------





Bug 6689903  Errors such as ORA-27504 using RAC on NUMA This note gives a brief overview of bug 6689903.
The content was last updated on: 12-DEC-2008
Click here for details of each of the sections below.
Affects:

Product (Component)	Oracle Server (Rdbms)
Range of versions believed to be affected	(Not specified)
Versions confirmed as being affected	10.2.0.4
Platforms affected	Generic (all / most platforms affected)

Fixed:

This issue is fixed in

10.2.0.5 (Server Patch Set)

Symptoms:	Related To:
Error May Occur ORA-27302 / ORA-27504	RAC (Real Application Clusters) / OPS NUMA Related

Description

When using NUMA and running a lot of Oracle processes, the system may run outof UDP ports used for Cache Fusion IPC. This typically results in ORA-603 - > ORA-27504 errors mentioning OS socket problem issues.eg:   ORA-00603: ORACLE server session terminated by fatal error    ORA-27504: IPC error creating OSD context    ORA-27300: OS system dependent operation:sendmsg failed with status: 95    ORA-27301: OS failure message: Socket operation on non-socket    ORA-27302: failure occurred at: sskgxpsnd1 Workaround:  Disable NUMA or decrease number concurrent processes.

Please note: The above is a summary description only. Actual symptoms can vary. Matching to any symptoms here does not confirm that you are encountering this problem. Always consult with Oracle Support for advice.

References

Bug:6689903 (This link will only work for PUBLISHED bugs)
Note:245840.1 Information on the sections in this article