聊聊jvm的Code Cache

go4it發表於2019-03-30

序

本文主要研究一下jvm的Code Cache

Code Cache

JVM生成的native code存放的記憶體空間稱之為Code Cache；JIT編譯、JNI等都會編譯程式碼到native code，其中JIT生成的native code佔用了Code Cache的絕大部分空間

檢視Code Cache的使用情況

-XX:+PrintCodeCache

CodeHeap 'non-profiled nmethods': size=120032Kb used=2154Kb max_used=2160Kb free=117877Kb
 bounds [0x00000001178ea000, 0x0000000117b5a000, 0x000000011ee22000]
CodeHeap 'profiled nmethods': size=120028Kb used=10849Kb max_used=11005Kb free=109178Kb
 bounds [0x00000001103b3000, 0x0000000110e73000, 0x00000001178ea000]
CodeHeap 'non-nmethods': size=5700Kb used=1177Kb max_used=1239Kb free=4522Kb
 bounds [0x000000010fe22000, 0x0000000110092000, 0x00000001103b3000]
 total_blobs=5638 nmethods=4183 adapters=435
 compilation: enabled
              stopped_count=0, restarted_count=0
 full_count=0
複製程式碼

jvm啟動引數加上-XX:+PrintCodeCache，可以在jvm關閉時輸出code cache的使用情況
這裡分了non-profiled nmethods、profiled nmethods、non-nmethods三部分來展示
其中size就是限制的最大大小，used表示實際使用量，max_used就是使用大小的high water mark，free由size-used得來

jcmd pid Compiler.codecache

/ # jcmd 1 Compiler.codecache
1:
CodeHeap 'non-profiled nmethods': size=120036Kb used=1582Kb max_used=1582Kb free=118453Kb
 bounds [0x00007f1e42226000, 0x00007f1e42496000, 0x00007f1e4975f000]
CodeHeap 'profiled nmethods': size=120032Kb used=9621Kb max_used=9621Kb free=110410Kb
 bounds [0x00007f1e3acee000, 0x00007f1e3b65e000, 0x00007f1e42226000]
CodeHeap 'non-nmethods': size=5692Kb used=1150Kb max_used=1198Kb free=4541Kb
 bounds [0x00007f1e3a75f000, 0x00007f1e3a9cf000, 0x00007f1e3acee000]
 total_blobs=5610 nmethods=4369 adapters=412
 compilation: enabled
              stopped_count=0, restarted_count=0
 full_count=0
複製程式碼

使用jcmd的Compiler.codecache也可以檢視code cache的使用情況，輸出跟-XX:+PrintCodeCache相同

jcmd pid VM.native_memory

/ # jcmd 1 VM.native_memory
1:

Native Memory Tracking:

Total: reserved=1928023KB, committed=231182KB
-                 Java Heap (reserved=511488KB, committed=140288KB)
                            (mmap: reserved=511488KB, committed=140288KB)

-                     Class (reserved=1090832KB, committed=46608KB)
                            (classes #8218)
                            (  instance classes #7678, array classes #540)
                            (malloc=1296KB #19778)
                            (mmap: reserved=1089536KB, committed=45312KB)
                            (  Metadata:   )
                            (    reserved=40960KB, committed=39680KB)
                            (    used=38821KB)
                            (    free=859KB)
                            (    waste=0KB =0.00%)
                            (  Class space:)
                            (    reserved=1048576KB, committed=5632KB)
                            (    used=5190KB)
                            (    free=442KB)
                            (    waste=0KB =0.00%)

-                    Thread (reserved=37130KB, committed=2806KB)
                            (thread #36)
                            (stack: reserved=36961KB, committed=2636KB)
                            (malloc=127KB #189)
                            (arena=42KB #70)

-                      Code (reserved=248651KB, committed=15351KB)
                            (malloc=963KB #4600)
                            (mmap: reserved=247688KB, committed=14388KB)

-                        GC (reserved=21403KB, committed=7611KB)
                            (malloc=5419KB #9458)
                            (mmap: reserved=15984KB, committed=2192KB)

-                  Compiler (reserved=150KB, committed=150KB)
                            (malloc=20KB #447)
                            (arena=131KB #5)

-                  Internal (reserved=3744KB, committed=3744KB)
                            (malloc=1696KB #6416)
                            (mmap: reserved=2048KB, committed=2048KB)

-                     Other (reserved=24KB, committed=24KB)
                            (malloc=24KB #2)

-                    Symbol (reserved=10094KB, committed=10094KB)
                            (malloc=7305KB #219914)
                            (arena=2789KB #1)

-    Native Memory Tracking (reserved=4130KB, committed=4130KB)
                            (malloc=12KB #158)
                            (tracking overhead=4119KB)

-               Arena Chunk (reserved=177KB, committed=177KB)
                            (malloc=177KB)

-                   Logging (reserved=7KB, committed=7KB)
                            (malloc=7KB #264)

-                 Arguments (reserved=18KB, committed=18KB)
                            (malloc=18KB #500)

-                    Module (reserved=165KB, committed=165KB)
                            (malloc=165KB #1699)

-                 Safepoint (reserved=4KB, committed=4KB)
                            (mmap: reserved=4KB, committed=4KB)

-                   Unknown (reserved=4KB, committed=4KB)
                            (mmap: reserved=4KB, committed=4KB)
複製程式碼

使用jcmd的VM.native_memory也可以檢視code cache的使用情況(Code部分)，Compiler部分為Memory tracking used by the compiler when generating code

使用MemoryPoolMXBean檢視

    @Test
    public void testGetCodeCacheUsage(){
        ManagementFactory.getPlatformMXBeans(MemoryPoolMXBean.class)
                .stream()
                .filter(e -> MemoryType.NON_HEAP == e.getType())
                .filter(e -> e.getName().startsWith("CodeHeap"))
                .forEach(e -> {
                    LOGGER.info("name:{},info:{}",e.getName(),e.getUsage());
                });
    }
複製程式碼

MemoryPoolMXBean包含了HEAP及NON_HEAP，其中code cache屬於NON_HEAP，其輸出如下：

12:21:10.728 [main] INFO com.example.CodeCacheTest - name:CodeHeap 'non-nmethods',info:init = 2555904(2496K) used = 1117696(1091K) committed = 2555904(2496K) max = 5836800(5700K)
12:21:10.743 [main] INFO com.example.CodeCacheTest - name:CodeHeap 'profiled nmethods',info:init = 2555904(2496K) used = 1543808(1507K) committed = 2555904(2496K) max = 122908672(120028K)
12:21:10.743 [main] INFO com.example.CodeCacheTest - name:CodeHeap 'non-profiled nmethods',info:init = 2555904(2496K) used = 319616(312K) committed = 2555904(2496K) max = 122912768(120032K)
複製程式碼

spring boot應用檢視

/ # curl -i "http://localhost:8080/actuator/metrics/jvm.memory.used?tag=area:nonheap"
HTTP/1.1 200
Content-Disposition: inline;filename=f.txt
Content-Type: application/vnd.spring-boot.actuator.v2+json;charset=UTF-8
Transfer-Encoding: chunked
Date: Sat, 30 Mar 2019 04:26:39 GMT

{"name":"jvm.memory.used","description":"The amount of used memory","baseUnit":"bytes","measurements":[{"statistic":"VALUE","value":6.5295408E7}],"availableTags":[{"tag":"id","values":["CodeHeap 'non-profiled nmethods'","CodeHeap 'profiled nmethods'","Compressed Class Space","Metaspace","CodeHeap 'non-nmethods'"]}]}

/ # curl -i "http://localhost:8080/actuator/metrics/jvm.memory.used?tag=area:nonheap&tag=id:CodeHeap%20%27non-profiled
%20nmethods%27"
HTTP/1.1 200
Content-Disposition: inline;filename=f.txt
Content-Type: application/vnd.spring-boot.actuator.v2+json;charset=UTF-8
Transfer-Encoding: chunked
Date: Sat, 30 Mar 2019 04:24:58 GMT

{"name":"jvm.memory.used","description":"The amount of used memory","baseUnit":"bytes","measurements":[{"statistic":"VALUE","value":1592448.0}],"availableTags":[]}
複製程式碼

springboot使用micrometer，通過/actuator/metrics介面提供相關指標查詢功能，其中code cache在jvm.memory.used這個metric中它是基於MemoryPoolMXBean來實現的，具體詳見micrometer-core-1.1.3-sources.jar!/io/micrometer/core/instrument/binder/jvm/JvmMemoryMetrics.java

小結

JVM生成的native code存放的記憶體空間稱之為Code Cache；JIT編譯、JNI等都會編譯程式碼到native code，其中JIT生成的native code佔用了Code Cache的絕大部分空間
-XX:ReservedCodeCacheSize用於設定Reserved code cache的最大大小，通常預設是240M；對於有些應用來說240M可能太大，code cache可能都填不滿，相當於unconstrained，此時JIT就會繼續編譯任何它認為可以編譯的code
檢視Code Cache的記憶體使用情況有好幾種方法：
- jvm啟動引數加上-XX:+PrintCodeCache，可以在jvm關閉時輸出code cache的使用情況
- 使用jcmd的Compiler.codecache，其輸出跟-XX:+PrintCodeCache相同；
- 使用jcmd的VM.native_memory也可以檢視code cache的使用情況(Code部分)
- 使用JMX來獲取NON_HEAP型別中的name為CodeHeap開頭的MemoryPoolMXBean可以得到code cache的使用情況
- 如果是springboot應用，它使用micrometer，通過/actuator/metrics介面提供相關指標查詢功能，其中code cache在jvm.memory.used這個metric中

doc

[轉帖]深入JVM - Code Cache記憶體池
2024-05-05
JVM記憶體
聊聊jvm的CompressedClassSpace
2019-03-31
JVM
聊聊 clean code
2019-02-22
聊聊jvm的StringTable及SymbolTable
2019-04-08
JVMSymbol
聊聊JVM的垃圾回收機制GC
2018-06-25
JVMGC
Code Cache滿導致應用效能降低
2018-05-04
瞭解Java物件，簡單聊聊JVM調優分析
2020-12-15
Java物件JVM
Service Worker Cache 和 HTTP Cache 的區別
2022-08-04
HTTP
【Cache】將常用的“小表”快取到Buffer Cache
2024-04-02
快取
Client Side Cache 和 Server Side Cache 的區別
2021-10-13
clientIDEServer
重新認識下JVM級別的本地快取框架Guava Cache——優秀從何而來
2022-11-22
JVM快取框架Guava
Library Cache最佳化篇（一）降低library cache lock和library cache pin的方法
2023-03-29
mybatis原始碼學習------cache-ref和cache的解析
2020-11-02
MyBatis原始碼
Service Worker cache 相比 HTTP cache 的一些優點
2022-08-04
HTTP
VS Code 中的增強 code CLI
2022-12-28
今我們們來聊聊JVM 堆外記憶體洩露的BUG是如何查詢的
2018-04-24
JVM記憶體洩露
cache2k:Guava Cache及Caffeine之外的新選擇
2023-05-12
Guava
library cache pin和library cache lock(一)
2019-07-20
library cache pin和library cache lock (zt)
2019-06-21
library cache pin和library cache lock(二)
2019-03-25
33、buffer_cache_3（redo的產生、LRBA、buffer cache裡的等待事件）
2024-11-22
事件
Service Worker Cache 和 HTTP Cache 聯合使用的場景討論
2022-08-04
HTTP
Guava Cache
2019-03-01
Guava
Spring Cache
2024-10-30
Spring
Linux Buffer/Cache 的區別
2018-09-09
Linux
buffer與cache的區別
2024-02-10
springboot啟動時報異常Class not found so assuming code is running on a pre-Java 9 JVM
2020-12-22
Spring BootJavaJVM
MySQL：Table_open_cache_hits/Table_open_cache_misses/Table_open_cache_overflows
2020-03-02
MySql
我的VS CODE
2019-02-16
【ASK_ORACLE】Library Cache概念篇（二）之Library Cache Pin的定義
2023-03-27
Oracle
重新認識下JVM級別的本地快取框架Guava Cache(3)——探尋實現細節與核心機制
2022-11-28
JVM快取框架Guava
PWA(Progressive Web App)入門系列：Cache Storage & Cache
2019-02-21
WebAPP
library cache lock和library cache bin實驗_2.0
2018-06-22
Cache Aside Pattern
2018-11-06
IDE
torrent cache website
2024-03-09
Web
CSAPP Cache Lab
2024-03-22
APP
Oracle Library cache
2019-04-28
Oracle
Leetcode LRU Cache
2019-06-01
LeetCode

聊聊jvm的Code Cache

序

Code Cache

相關引數

Codecache Size Options

Codecache Flush Options

Compilation Policy Options

Compilation Limit Options

Diagnostic Options

檢視Code Cache的使用情況

-XX:+PrintCodeCache

jcmd pid Compiler.codecache

jcmd pid VM.native_memory

使用MemoryPoolMXBean檢視

spring boot應用檢視

小結

doc

相關文章