CentOS6.5基於Hadoop使用者的Yarn偽分散式部署(a Single Node Cluster)
yran on a single node cluster
官網參考:
1.修改mapred-site.xml檔案,沒有建立
[hadoop@hadoop001 hadoop]$ pwd
/opt/software/hadoop-2.8.1/etc/hadoop
[hadoop@hadoop001 hadoop]$ cp mapred-site.xml.template mapred-site.xml
[hadoop@hadoop001 hadoop]$ vim mapred-site.xml -- 新增<property>
2.修改etc/hadoop/yarn-site.xml
3.Start Stop ResourceManager daemon and NodeManager daemon
[hadoop@hadoop001 sbin]$ ./start-yarn.sh
[hadoop@hadoop001 sbin]$ ./stop-yarn.sh
4.初次啟動專案yarn啟動失敗,檢視啟動該日誌
[hadoop@hadoop001 sbin]$ jps
18704 Jps
13767 SecondaryNameNode
13595 DataNode
13454 NameNode
[hadoop@hadoop001 sbin]$ cat /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
[Fatal Error] mapred-site.xml:24:1: The end-tag for element type "property" must end with a '>' delimiter.
檢查發現發現mapred-site.xml裡>缺少 > 結束箭頭
5.再次啟動yarn 啟動成功
[hadoop@hadoop001 sbin]$ ./start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
192.168.0.129: starting nodemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-nodemanager-hadoop001.out
[hadoop@hadoop001 sbin]$ jps
18883 NodeManager
18918 Jps
13767 SecondaryNameNode
18776 ResourceManager
13595 DataNode
13454 NameNode
6.啟動控制檯啟動埠8088
官網參考:
1.修改mapred-site.xml檔案,沒有建立
[hadoop@hadoop001 hadoop]$ pwd
/opt/software/hadoop-2.8.1/etc/hadoop
[hadoop@hadoop001 hadoop]$ cp mapred-site.xml.template mapred-site.xml
[hadoop@hadoop001 hadoop]$ vim mapred-site.xml -- 新增<property>
-
<configuration>
-
<property>
-
<name>mapreduce.framework.name</name>
-
<value>yarn</value>
-
</property>
- </configuration>
2.修改etc/hadoop/yarn-site.xml
-
<configuration>
-
<property>
-
<name>yarn.nodemanager.aux-services</name>
-
<value>mapreduce_shuffle</value>
-
</property>
- </configuration>
3.Start Stop ResourceManager daemon and NodeManager daemon
[hadoop@hadoop001 sbin]$ ./start-yarn.sh
[hadoop@hadoop001 sbin]$ ./stop-yarn.sh
4.初次啟動專案yarn啟動失敗,檢視啟動該日誌
[hadoop@hadoop001 sbin]$ jps
18704 Jps
13767 SecondaryNameNode
13595 DataNode
13454 NameNode
[hadoop@hadoop001 sbin]$ cat /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
[Fatal Error] mapred-site.xml:24:1: The end-tag for element type "property" must end with a '>' delimiter.
檢查發現發現mapred-site.xml裡>缺少 > 結束箭頭
5.再次啟動yarn 啟動成功
[hadoop@hadoop001 sbin]$ ./start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
192.168.0.129: starting nodemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-nodemanager-hadoop001.out
[hadoop@hadoop001 sbin]$ jps
18883 NodeManager
18918 Jps
13767 SecondaryNameNode
18776 ResourceManager
13595 DataNode
13454 NameNode
6.啟動控制檯啟動埠8088
-
ResourceManager - 8088/
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/31441024/viewspace-2154780/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- CentOS6.5基於Hadoop使用者的HDFS偽分散式部署(a Single Node Cluster)CentOSHadoop分散式
- CentOS6.5基於ROOT使用者的HDFS偽分散式部署(a Single Node Cluster)CentOS分散式
- Hadoop偽分散式安裝(MapReduce+Yarn)Hadoop分散式Yarn
- CentOS6.5實現Hadoop_2.8.1編譯及HDFS偽分散式部署CentOSHadoop編譯分散式
- Mac部署hadoop3(偽分散式)MacHadoop分散式
- 3.Hadoop Single Node Cluster安裝Hadoop
- hadoop偽分散式安裝Hadoop分散式
- hadoop+spark偽分散式HadoopSpark分散式
- Hadoop yarn完全分散式安裝筆記HadoopYarn分散式筆記
- 4.hadoop之偽分散式模式Hadoop分散式模式
- hadoop 2.8.5偽分散式環境搭建Hadoop分散式
- hadoop2.2.0偽分散式安裝Hadoop分散式
- 構建Hadoop偽分散式環境Hadoop分散式
- [hadoop] hadoop-all-in-one-偽分散式安裝Hadoop分散式
- Redis 偽分散式安裝部署配置Redis分散式
- 大資料之Hadoop偽分散式的搭建大資料Hadoop分散式
- Dockerfile完成Hadoop2.6的偽分散式搭建DockerHadoop分散式
- 在 Ubuntu 22 的基礎上進行 Hadoop 偽分散式(HDFS)的搭建UbuntuHadoop分散式
- hadoop 偽分散式模式學習筆記Hadoop分散式模式筆記
- Hadoop3偽分散式安裝指南Hadoop分散式
- CentOS7 hadoop3.3.1安裝(單機分散式、偽分散式、分散式)CentOSHadoop分散式
- Hadoop入門(一)之Hadoop偽分散式環境搭建Hadoop分散式
- hadoop官網翻譯第二天Setting up a Single Node Cluster.Hadoop
- hadoop 0.20.2偽分散式安裝詳解Hadoop分散式
- hadoop叢集搭建——單節點(偽分散式)Hadoop分散式
- 基於hadoop_yarn的資源隔離配置HadoopYarn
- Ubuntu下偽分散式模式Hadoop的安裝及配置Ubuntu分散式模式Hadoop
- HDP2.4基於Ambari的分散式安裝部署分散式
- Flume+Kafka+Strom基於偽分散式環境的結合使用Kafka分散式
- hadoop3.1.0 HDFS快速搭建偽分散式環境Hadoop分散式
- hadoop偽分散式叢集的安裝(不是單機版)Hadoop分散式
- 大資料2-Hadoop偽分散式+ZK+HDFS大資料Hadoop分散式
- centOS 7-Hadoop3.3.0完全分散式部署CentOSHadoop分散式
- Hadoop叢集完全分散式模式環境部署Hadoop分散式模式
- CentOS7 Hadoop-2.7.4 分散式部署CentOSHadoop分散式
- 大規模MySQL運維陷阱之基於MyCat的偽分散式架構MySql運維分散式架構
- Yarn-cluster 與 Yarn-client的區別Yarnclient
- Hadoop3.0完全分散式叢集安裝部署Hadoop分散式