IBM POWER7 AIX and Oracle Database performance considerations--10g&11g_1507249.1
IBM POWER7 AIX and Oracle Database performance considerations -- 10g & 11g (文件 ID 1507249.1)
In this Document
Applies to:AIX - Version 6.1 and later3rd-Party Hardware Oracle Database Products IBM AIX on POWER Systems (64-bit) This document is intended to provide clients with advice and website links to assist with IBM Power Systems running in an Oracle environment. It also includes information specific to POWER7 in an Oracle environment. Additional links for further reading is also provided is provided inside this PDF doc: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102171 Abstract
This document is intended to provide clients with advice and website links to assist with IBM Power Systems running in an Oracle environment. It also includes information The information also includes discussions about Oracle Non-Real Application Clusters (NON-RAC) and RAC. HistoryDocument is generated by:
IBM Oracle International Competency Center (ICC) Doc location: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102171 Details
This document is intended to provide clients with advice and website links to assist with IBM Power Systems running in an Oracle environment. It also includes
http://www.oracle.com/technetwork/indexes/documentation/index.html?ssSourceSiteId=ocomen
Above is the main Oracle page from which you can select an Oracle product for specific information on a given platform (installation information, AIX patches,
http://docs.oracle.com/cd/E11882_01/relnotes.112/e10853/toc.htm Above is the Oracle? Database Release Notes 11g Release 2 (11.2) for IBM AIX on POWER Systems (64-Bit) Part Number E23560-03
http://docs.oracle.com/cd/B19306_01/relnotes.102/b19074/toc.htm Above is the Oracle? Database Release Notes 10g Release 2 (10.2) for AIX Part Number B19074-15 Minimum Software Versions and Patches Required to Support Oracle Products on IBM Power Systems
My Oracle Support (MOS) ID 282036.1 (https://support.oracle.com)
http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP100883
Oracle Real Application Clusters on IBM AIX –Best practices in memory tuning and configuring for system stability http://www.oracle.com/technetwork/products/clusterware/overview/rac-aix-system-stability-131022.pdf Above is a RAC tuning and configuration Guide
Above is a RAC and VLAN deployment guide
Managing Raw Disks in AIX to use with Oracle Automatic Storage Management (ASM) MOS ID 1445870.1 My Oracle Support (MOS - https://support.oracle.com)
Platform Migration to AIX http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101822 Above is a cross-platform migration reference guide available on Techdocs
Must Read for Oracle 11gOracle Database Online Patching on AIX
Oracle Database Online Patching on AIX http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102085
http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102066 Addresses increased per-process memory consumption
Oracle Database 11.2.0.3 available on AIX http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102016 Above is 11.2.0.3 Certification information
Oracle DB & RAC 11gR2 on IBM AIX: Tips and Considerations http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101176 Above is 11gR2 Planning and implementing.
Oracle DB & RAC 10gR2 on IBM AIX: Tips and Considerations http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101089 10gR2 Planning and implementing
Review Recent ICC Flashes on Techdocs – the Technical Sales Library http://www-03.ibm.com/support/techdocs/atsmastr.nsf/Web/Techdocs Technical sales support database
Guide to Multiple Page Size Support on AIX 5L Version 5.3 (note: general support for 5.3 ended April 2012) http://www-03.ibm.com/systems/resources/systems_p_os_aix_whitepapers_multiple_page.pdf Useful information on large page configuration
Other: Large page size Review Oracle Large Page Usage for Larger page size has often provided performance
Existing environment statistics capture -- customers should consider creating a historical comparison baseline to aid in Customer should determine what is most applicable to capture in their environment (that is, AWR or PerfPMR types of reports)
http://www-03.ibm.com/systems/power/hardware/whitepapers/java_perf.html
Oracle DB 11gR2 best practices for IBM AIX
Detailed Oracle/AIX best practices documents, including Damir Rubic’s Oracle Architecture and Tuning on AIX version 2.20, are available on IBM Techdocs: http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP100883
The following pages discuss memory, CPU, I/O, network, and miscellaneous settings. In addition, we list the AIX APARs required for Oracle 11gR2, the Oracle patches for
Kernel Settings Kernel settings are listed in Table 2. These are commonly suggested values.
Parameter Proposed Value AIX 6.1 Default AIX 6.1 Restricted AIX 7.1 Default AIX 7.1 Restricted
maxperm% 90 90 Yes 90 Yes maxclient% 90 90 Yes 90 Yes strict_maxclient 1 1 Yes 1 Yes strict_maxperm 0 0 Yes 0 Yes lru_file_repage 0 0 Yes N/A N/A lru_poll_interval 10 10 Yes 10 Yes minfree 960 960 No 960 No maxfree 1088 1088 No 1088 No page_steal_method 1 1 Yes 1 Yes memory_affinity 1 1 Yes 1 Yes v_pinshm 0 0 No 0 No lgpg_regions 0 0 No 0 No lgpg_size 0 0 No 0 No maxpin% 80 80 No 90 No esid_allocator 1* 0 No 1 No
In general, AIX support suggests AIX 7.1 defaults for Oracle.
Spécifications for Oracle large page usage are:
· AIX 6.1 and 7.1 support three or four page sizes, depending on the hardware: 4 KB (default), 64 KB (medium), 16 MB (large), and 16 GB(huge). All four page sizes are
· Page sizes 64 KB and 16 MB have been shown to benefit Oracle performance by reducing kernel lookaside processing to resolve virtual to physical addresses. LOCK_SGA = FALSE · This is the default. This means that the SGA is not pinned in memory. · AIX performance support generally suggests not to pin SGA. · Automatic Memory Management (AMM) will use 64 KB pages for SGA if memory is available.
· This is the suggested value, since it has been found that 64 KB pages yield nearly the same performance benefit as 16 MB pages and require no special · Oracle 10.2.0.4 with Oracle patch 7226548 will also use 64 KB pages for the SGA. LOCK_SGA = TRUE · AIX parameters to enable pinned memory and 16 MB large pages: vmo –p –o v_pinshm=1 (allows pinned memory—requires reboot) vmo –p –o lgpg_size=16777216 –o gpg_regions=number_of_large_pages where number_of_large_pages=INT[SGA size -1)/16MB)]+1 (above courtesy of Damir Rubic, IBM ATS) · Capabilities required to allow Oracle to use 16 MB large pages (implement as root):
(http://www.ibm.com/developerworks/forums/servlet/JiveServlet/download/747-313057-14417535-361419/Oracle_Tuning_on_AIX.pdf and Oracle My Oracle Support note: 372157.1). · AMM can be used with pinned 16 MB pages, provided the formula for calculating the number of large pages (above) is modified to number of large pages=memory_max_target+1. · With Oracle 10.2.0.4, patch 7226548 is also required in order to use 16 MB pinned pages. Using 64 KB pages for data, text, and stack regions (applies to Oracle 10.2.0.4 as well)
· 64 KB page size for data, text, and stack regions is useful in environments with a large (for example. 64 KB+) SGA and many online transaction processing
· 64 KB page use for data, text, and stack is implemented separately from 64 KB pages for the SGA, and is done by means of an environment variable exported on · $ export LDR_CNTRL=DATAPSIZE=64K@TEXTPSIZE=64K@STACKPSIZE=64K oracle
CPU specifications are:
· Virtual processor folding: This is a feature of Power Systems in which unused virtual processors are taken offline until the demand requires that they be activated. The · Specific to POWER7 SMT4: Certain Oracle 11G parameters, including DB_WRITER_PROCESSES and PARALLEL_MAX_SERVERS, are partly derived from CPU_COUNT, and CPU_COUNT is equal by default to the number of logical CPUs. CPU_COUNT automatically adjusts to changes in virtual processor count and to SMT mode, up to three times the value on startup. Note that, when migrating from single-threaded platforms to Power Systems, or from POWER5 or POWER6 to POWER7 with SMT4, the value of CPU_COUNT will also increase, affecting DB_WRITER_PROCESSES, PARALLEL_MAX_SERVERS, and other dependent parameters. Queries that are sensitive to a degree of parallelism might change behavior as a result of migration to POWER7. We suggest reviewing the PARALLEL_MAX_SERVERS parameter after migration, but to set DB_WRITER PROCESSES to default.
· If ASM is not used, max interpolicy striping (also known as pp spreading or poor man’s striping) is suggested when logical volumes are created. To get the most benefit from spreading physical partitions across the LUNs, use a small physical partition size, for example, 32 MB or 64 MB. Async I/O is used even with Concurrent I/O (CIO)
· With AIX 6.1 and 7.1, start with the asynchronous I/O defaults. With AIX 6.1, there is a new implementation of AIO. AIO kernel extensions are loaded at system boot (always loaded), AIO servers stay active as long as there are service · Note that in AIX 6.1, there are two tunables for minservers and maxservers, aio_minservers/aio_maxservers for legacy threads, and posix_aio_minservers/posix_aio_maxservers for posix threads. Oracle uses legacy threads. · Only increase aio_maxservers or posix_aio_maxservers with ioo –p –o (the default is 30 per logical CPU) if pstat -a | fgrep aio or ps -k | fgrep aio show that you are continually using maxservers. · Oracle parameter (init.ora) · disk_asynch_io = TRUE (default value) Buffered file I/O on JFS2 · The default filesystemio_options=ASYNC · In this case all data spaces, redo log file systems, and control file systems are using the kernel buffers rather than writing directly to disk. · In this case, it does not matter whether redo log file systems and control file systems are 512 b or 4 KB block size file systems. · Oracle on AIX/Power best performance is, however, usually achieved using CIO (though there are exceptions). Concurrent I/O (CIO) on JFS2
· Set the Oracle parameter filesystemio_options=SETALL, or mount the filesystems (other than dump devices) with the CIO option. It is not necessary to
· If using CIO with SETALL, CIO mount or both, you must create separate file systems for redo logs and control files (or a single filesystem for both), with an · The ioo parameter fs_fastpath accelerates CIO. It is enabled by default in AIX 6.1 and 7.1. IBM mount advice for database files:
· Redo logs: Create with agblksize of 512 and mount with no options. With SETALL, IBM is doing direct I/O for Redo logs. · Control files: Create with agblksize of 512 and mount with no options. With SETALL, IBM is doing direct I/O for Redo logs. · Archive logs: Mount -o rbrw . Do not use CIO; use the jfs2 rbrw option · Dumps: Mount –o rbrw · The mount option noatime, suggested for Oracle 10g, is no longer required IOO tunables j2_nBufferPerPagerDevice and j2_dynamicBufferPreallocation:
· Do not change these unless there is a high delta in vmstat –v external pager filesystem I/Os blocked with no fsbuf. If this value is high, first increase j2_dynamicBufferPreallocation from 16 (16k slabs) to 32; monitor. If increasing · See help pages for information about these parameters. Do not change AIX 6.1 or 7/1 restricted tunables without the advice from IBM AIX support. In AIX 6.1, j2_nBufferPerPagerDevice is a restricted tunable, while j2_dynamicBufferPreallocation is not.
· j2_dynamicBufferPreallocation=128 · numfsbufs=1024 (legacy jfs) · maxpgahead=16 (legacy jfs) ASM considerations for standalone Oracle 11gR2: · For identifying, renaming, and securing ASM raw devices, see Managing Raw Disks in AIX to use with Oracle Automatic Storage Management (ASM). · ASM will use asynchronous I/O by default, so filesystemio_options=ASYNC (default) is appropriate. · In the standalone use of ASM, unlike RAC, hdisks and hdiskpower devices do not need to have Small Computer System Interface (SCSI) reservation disabled.
· Add 16 to the value of processes · Add an additional 600 KB to the value of large pool size · Add to shared pool size the aggregate of the values returned by these queries: · SELECT SUM(bytes)/(1024*1024*1024) FROM V$DATAFILE; · SELECT SUM(bytes)/(1024*1024*1024) FROM V$LOGFILE a, V$LOG b WHERE a.group#=b.group#; · SELECT SUM(bytes)/(1024*1024*1024) FROM V$TEMPFILE WHERE status=’ONLINE’;
· For disk groups using external redundancy, every 100 GB of space needs 1 MB of extra shared pool, plus 2 MB · For disk groups using normal redundancy, every 50 GB of space needs 1 MB · For disk groups using high redundancy, every 33 GB of space needs 1 MB of extra shared pool, plus 6 MB
· Source: http://docs.oracle.com/cd/E18283_01/server.112/e16102/asminst.htm#CHDBBIBF Network This section outlines the minimum values applicable to network configurations. Kernel configurations These values are generally suggested for Oracle, and can be considered as starting points: · sb_max >= 1MB (1048576) and must be greater than maximum tpc or udp send or recvspace (if you are using RAC and very large udp_recvspace, you might need to increase sb_max) · tcp_sendspace = 262144 · tcp_recvspace = 262144 · udp_sendspace = db_block_size * db_file_multiblock_read_count · udp_recvspace= 10 * (udp_sendspace) · rfc1323 = 1 (see Recent suggestions and open issues) · Ephemerals (non-defaults suggested for a large number of connecting hosts or a high degree of parallel query; also to avoid install-time warnings) · tcp_ephemeral_low=9000 · tcp_ephemeral_high=65500 · udp_ephemeral_low=9000 · udp_ephemeral_high=65500
Jumbo frames are Ethernet frames larger than the standard maximum transmission unit (MTU) size of 1500 bytes. They can be up to 9000 bytes. They are used to reduce the Miscellaneous Other specifications follow: ulimits (smit chuser or edit /etc/security/limits to create a stanza for Oracle) · -1 (unlimited) for everthing except core Maximum number of PROCESSES allowed per user (smit chgsys) · maxuproc >= 2048; 16 KB is a commonly suggested value for Oracle Environment variables · AIXTHREAD_SCOPE=S (set in Oracle profile). · LDR_CNTRL=DATAPSIZE=64K@TEXTPSIZE=64K@STACKPSIZE=64K $ORACLE_HOME/bin/oracle. · There is an option to ldedit the Oracle binaries so they use 64 KB pages directly. Note that whenever a patch is applied or an Oracle relink is performed, this ledit will have to be performed again. · # ldedit –btextpsize=64k –bdatapsize=64k –bstackpsize=64k $ORACLE_HOME/bin/oracle. Disk and adapter resources · Hdisk – lsattr –El hdisk<>
· Queue depth might vary among 8, 16, 20, and 24, depending on the storage vendor. A queue depth of 2 on SAN devices usually indicates a driver mismatch, but is the default for Hitachi HDS on AIX and should be increased to 8 as a · max_transfer might need to be adjusted upward depending on the largest I/O requested by Oracle · A typical starting point for Oracle on AIX is 0x100000 · FC Adapter – lsattr –El fcs<> and fcstat -e · max_xfer_size should at least equal max_transfer at the hdisk level. · num_cmd_elems might need to be increased if fcstat -e reports a persistent nonzero value for No Command Resource Count. · If fcstat –e reports a persistent, non-zero value for No DMA Resource Count contact support.
AIX fixes for Oracle 10.2.0.4 and 11gR2 follow. Note that all AIX 6.1 patches apply to these Oracle versions. · IZ88711: BIND64 CORES WITH -BLAZY OPTION ON AIX61 · IZ91983: LOCKL PERFORMANCE ISSUE · IZ94396: THERE IS A TIMING ISSUE BETWEEN THE SYNC DAEMON AND A MAPPED FILES APPLIES TO AIX 6100-06 · IZ97088: SMT4 scheduling fix / improvement included in AIX 6.1 patchset 8 · IV10172: WAITPROC IDLE LOOPING CONSUMES CPU · IV06194: SRAD LOAD BALANCING ISSUES ON SHARED LPARS · IV10259: MISCELLANEOUS DISPATCHER/SCHEDULING PERFORMANCE FIXES · IV03903: Address space lock contention issue · IZ76101: Scale Light Load borrowing (Multi-SRAD Scaling issue) included in AIX 6.1 patchset 8 · IV11857: Slow startup of AIO processes (workaround: use kernelized AIO, or increase aio_minservers and set aio_server_inactivity to 86400. · IZ71987 (AIX6.1), IZ67445 (AIX 5.3 TL12): Paging space growth may occur unexpectedly with 64 KB (medium) pages enabled
· IV11261 - SYSTEM CRASH IN AS_FORK_ALIAS IF ESID_ALLOCATOR IS ENABLED: only applies to cases in which large segment aliasing is enabled using the esid_allocator vmo parameter and, in addition, a 32-bit application such as Java is . IZ96441: LOCKL PERFORMANCE ISSUE: Oracle ASM takes a long time to initialize when there are lots of users configured. . IZ97923: SHLAP64 UNABLE TO PROCESS ORACLE REQUEST LEADING TO KERNEL HANG: shlap64 unable to process Oracle request leading to kernel hang . IV26272: REDUCE EARLY WORKING STORAGE PAGING: Paging of computational storage pages is occurring when a high percentage of memory is being used for the file cache.
Oracle patches to check in the context of AIX Oracle patches to check in the context of AIX are:
Patches for Oracle 10.2.0.4 · Oracle patch 7226548: enables 64 KB and 16 MB large page support · Bug 7568734 AIX: Sporadic spikes of 'log file sync' on AIX with heavy commit concurrency · Bug 6784747: Wasted memory in koh-kghu allocations. Free extents of memory might not get used
Patches for Oracle pre-11.1.0.7.7. · Oracle patch Bug 6784747 - WASTED SPACE - KOH-KGHU CALL ALLOCATION
Patches for Oracle 11gR2 Mutex Wait
· Master Note: WAITEVENT: "library cache: mutex X" [ID 727400.1] · Bug 12740358: DBMS_UTILITY.FORMAT_CALL_STACK is still slower than 10 GB. This issue can be observed in AIX as a high number of system calls – millions – to functions like “sigaction()”. · Bug 9842771: Wrong SREADTIM and MREADTIM statistics in AUX_STATS$ · Bug 12596494: Generally higher CPU Usage in 11.2.0.2 than 10.2.0.4 · Bug 12412983 - AIX -"asynch descriptor resize" wait not necessary on AIX; Please also review Metalink note id - 1318709.1 - Things to check when seeing long log file sync wait times · Bug 11689561: Hash join consumes more CPU in IBM AIX. The issue is fixed in 11.2.0.4 (future patchset) · Bug 13877328: Database performance slows down steadily over time (Reference Metalink Note 1467807.1: Performance diminishes over time on AIX 7.1 due to Large Segment Aliasing) · Bug 13840529: Database hang on cache buffer chains and row cache objects (generic bug affecting all platforms) · Bug 9495594: PERFORMANCE DEGRADATION RUNNING ANONYMOUS PLSQL BLOCKS IN 11.2 VS 10.2 (generic bug affecting all platforms) · Bug 13354348: UNACCOUNTED GAP BETWEEN ELAPSED TO CPU TIME ON 11.2 IN AIX (fixed in 11.2.0.3) · Oracle 11.2.0.2, 11.2.0.3 required USLA Heap patch: · Bug 13443029: (requires AIX 6.1 TL07 SP2 or AIX 7.1 TL01 SP2) OR · Bug 10190759 (disables hot patching)
Recent suggestions and open issues are:
· Hardware prefetch: The POWER7 chip has the ability to recognize streaming memory access patterns with a unit stride or stride N, and initiate the dcbt, or dcbtst prefetch instructions automatically. It controls how aggressive the hardware will · Large segment aliasing allows each memory segment lookaside buffer to address up to 1 TB of memory, reducing segment lookaside buffer faults and improving memory access. This is enabled by default on AIX 7.1, and is enabled using "vmo –p –o esid_allocator=1" in AIX 6.1. A recently discovered problem with Oracle 11GR2 and large segment aliasing concerning a related tunable, shm_1tb_unsh_enable is currently being addressed. This problem is specific to Oracle 11.2.0.3 on AIX 6.1 and AIX 7.1 and is addressed in Bug 13877328.
· noatime file system mount option: The Oracle/AIX bug (9548634: IBM/AIX: EXPENSIVE GETCWD() CALLS FROM SNLFNCDIR() ) which necessitated the mount option has been fixed in 11.2.0.2. The current suggestion is to use the noatime · rfc1323=1 is a long-standing network tuning suggestion for Oracle on AIX, although the default remains 0 in AIX 6.1 and 7.1. A network retransmission latency issue has recently been discovered when rfc1323=1 on AIX 6.1 TL6 and APAR IV00755 is also present.
This Technical Note was authored by Peter Barnett, Sanjay Ruprell and Wolfgang Tertel, all from IBM. This document will be a chapter in a planned new publication from the IBM ITSO organization. It will be published as an ITSO Redbook (http://www.redbooks.ibm.com/). For more information on this Technical Note, please send your questions to the IBM Oracle International Competency Center at ibmoracle@us.ibm.com
|
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/17252115/viewspace-1324546/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- IBM /AIX 環境快速部署MySQLIBMAIMySql
- IBM AIX儲存層結構分析+aix常用命令IBMAI
- ORACLE database vaultOracleDatabase
- Oracle clone databaseOracleDatabase
- oracle xtts遷移 AIX to LinuxOracleTTSAILinux
- Oracle Database Cloud - Database as a Service Quick StartOracleDatabaseCloudUI
- oracle.Performance.Tuning筆記OracleORM筆記
- Oracle Advanced Performance Tuning Scripts(轉)OracleORM
- aix安裝oracle客戶端AIOracle客戶端
- Oracle Database Scheduler整理OracleDatabase
- Oracle Physical Database LimitsOracleDatabaseMIT
- ORACLE for aix 11.2.0.1 DATAPUMP expdp之BUG 9470768OracleAI
- Oracle 12.2 使用Database Link優化Standby Database WorkloadOracleDatabase優化
- Oracle Performance Tuning 11g2 (2)OracleORM
- Oracle ASM磁碟組擴容(AIX7.1)OracleASMAI
- Oracle 19c Concepts(01):Introduction to Oracle DatabaseOracleDatabase
- Oracle 19c Concepts(13):Oracle Database InstanceOracleDatabase
- Oracle OCP(35):Database 安裝OracleDatabase
- oracle 10g flashback databaseOracle 10gDatabase
- Oracle DG Standby Database型別OracleDatabase型別
- Oracle DG建立Physical Standby DatabaseOracleDatabase
- Oracle DG建立Logical Standby DatabaseOracleDatabase
- Oracle 12C Database File Mapping for Oracle ASM FilesOracleDatabaseAPPASM
- Oracle OCP(38):Database 物理結構OracleDatabase
- 關於Oracle Database Vault介紹OracleDatabase
- Scheduler in Oracle Database 10g(轉)OracleDatabase
- [翻譯]-Detect And Repair Corruption in an Oracle DatabaseAIOracleDatabase
- Oracle 19c Database Management ToolsOracleDatabase
- ORACLE---Aix7.1 安裝Oracle11.2.0.4版本資料庫OracleAI資料庫
- Oracle 19c Concepts(00):Changes in This Release for Oracle Database ConceptsOracleDatabase
- 【Oracle】Windows安裝oracle11gR1 database 11.1.0.6OracleWindowsDatabase
- oracle aix平臺19c rac互信不通案例OracleAI
- 【AIX】AIX程式監控工具AI
- Oracle OCP(37):Database 體系結構OracleDatabase
- Converting Oracle Database from Linux to Windows using RMANOracleDatabaseLinuxWindows
- Oracle database 升級(文件)to 10.2.0.4 from 10.2.0.1OracleDatabase
- Migration Of An Oracle Database Across OS Platforms [ID 733205.1]OracleDatabaseROSPlatform
- Sqlcl 連線Oracle DataBase 19cSQLOracleDatabase
- 1 Oracle Database 19c 新特性OracleDatabase