CCAH-CCA-500-6題:You want YARN to launch no more than 16 containers per node.
6.What should you do?
Each node in your Hadoop cluster, running YARN, has 64GB memory and 24 cores.
Your yarn.site.xml has the following configuration:
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>32768</value>
</property>
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>12</value>
</property>
You want YARN to launch no more than 16 containers per node. What should you do?
A.
Modify yarn-site.xml with the following property:
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>2048</value>
B.
Modify yarn-sites.xml with the following property:
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>4096</value>
C.
Modify yarn-site.xml with the following property:
<name>yarn.nodemanager.resource.cpu-vccores</name>
D.
No action is needed: YARN’s dynamic resource allocation automatically optimizes the node
memory and cores
問題:
Hadoop叢集的每臺節點記憶體64G,CPU 24核。當前一個節點可分配的實體記憶體總量是32768M(32G),可分配的虛擬cpu總個數是12。
那麼yarn在每個節點上,發起不超過16個容器,我們應該怎樣配置?
分析:A
yarn.scheduler.minimum-allocation-mb:最小可申請記憶體量,預設是1024,我們設定2048M,見如下計算公式
Maximum memory YARN can utilize on the node
————————————————————————————————————————————— = minimum memory per container
Number of containers
配置檔案 配置項名稱 配置項值
yarn-site.xml yarn.nodemanager.resource.memory-mb = Containers個數* 每個Container記憶體
yarn-site.xml yarn.scheduler.minimum-allocation-mb = 每個Container記憶體
yarn-site.xml yarn.scheduler.maximum-allocation-mb = Containers個數* 每個Container記憶體
mapred-site.xml mapreduce.map.memory.mb = 每個Container記憶體
mapred-site.xml mapreduce.reduce.memory.mb = 2 * 每個Container記憶體
mapred-site.xml mapreduce.map.java.opts = 0.8 * 每個Container記憶體
mapred-site.xml mapreduce.reduce.java.opts = 0.8 * 2 * 每個Container記憶體
yarn-site.xml (check) yarn.app.mapreduce.am.resource.mb = 2 * 每個Container記憶體
yarn-site.xml (check) yarn.app.mapreduce.am.command-opts = 0.8 * 2 * 每個Container記憶體
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/30089851/viewspace-2096676/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- Banq, I want to talk with you for a projectProject
- DNS: More than just namesDNS
- For example, when you want to get the ball to the ground
- You want to use parallel processes for a client copy.Parallelclient
- yarn-per-job提交流程Yarn
- Unlearn What You Want to Forget Efficient Unlearning for LLMs
- More than one file was found with OS independent path
- 【OCP最新題庫解析(052)--題9】You want to install Oracle 11g databaseOracleDatabase
- auto assign ipv6 for more than /64 prefix, subnet for /112 #164
- 16-containers-ImagesAI
- OpenKruise 2021 規劃曝光:More than workloadsUI
- android: ADB錯誤“more than one device and emulator”Androiddev
- Clock in a Linux Guest Runs More Slowly or Quickly Than Real TimeLinuxUI
- 2008 5 5: I want to get know you better
- Spark 異常:Trying to write more fields than contained in rowSparkAI
- JDBC:The server time zone value '�й���ʱ��' is unrecognized or represents more than one time zone.JDBCServerZed
- 異常解決——The server time zone value 'Öйú±ê׼ʱ¼ä' is unrecognized or represents more than oneServerZed
- ORA-00494: enqueue [CF] held for too long (more than 900 seconds)ENQ
- ORA-00494: enqueue [CF] held for too long (more than 900 seconds) -RACENQ
- mysql執行報The server time zone value 'Öйú±ê׼ʱ¼ä' is unrecognized or represents more than one tim......MySqlServerZed
- Granules of pga_aggregate_target 494 cannot be more than memory_target (497)
- Oracle 11G靜默安裝報錯Oracle recommends that if you want to keep this log...Oracle
- Linux AS4.0下登入提示“Do you want to choose a different one? [n] ” 處理方法Linux
- Java新增構造方法異常異常——Could not autowire. there is more than one bean of '' typeJava構造方法Bean
- As per AIAI
- Hadoop面試題(四)——YARNHadoop面試題Yarn
- java.sql.SQLException: Prepared or callable statement has more than 2000 parameter markers及解決方案JavaSQLException
- IMP Takes More Time To Import The Constraints (Doc ID 166887.1)ImportAI
- Guru of the Week 條款16:具有最大可複用性的通用Containers (轉)AI
- [英文版]專訪《AngularJS 2權威教程》作者Nate Murray: Code is More of A Graph Than A Document (圖靈訪談)AngularJS圖靈
- STS中maven專案打包報錯: No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK? 問題的解決方案MavenCompileIDEJDK
- Docker remove all containersDockerREMAI
- [leetcode] 1642. Furthest Building You Can ReachLeetCodeUI
- Yarn篇--搭建yarn叢集Yarn
- MapInfo is no moreAPI
- 2.4.2 Connections to Containers in a CDBAI
- 2.3.1 About Application ContainersAPPAI
- Per指令碼學習指令碼