離線安裝Cloudera Manager 5和CDH5(最新版5.9.3) 完全教程（七）介面安裝

weixin_34198881發表於2018-08-13

CloudH5

一、安裝過程

1.1　登入

1.2　接受許可協議

1.3　選擇免費版本

1.4　選擇下一步

1.5　選擇當前管理的主機

1.6　選擇使用Parcel安裝，選擇CDH版本，點選繼續

1.7　等待安裝

此處安裝需要等待一段時間，請耐心等待，安裝過程可能需要30分鐘時間，這和物理機器的磁碟讀寫速度和機器效能有關，如果中斷請繼續之前的步驟重新操作，下圖是安裝成功介面

1.8　叢集檢測

檢測全部通過

1.9　選擇自定義服務，選擇要安裝的元件

1.10　分配角色

1.11　資料庫設定

選擇對應的資料庫，點選測試連線，通過之後，繼續

1.12　叢集設定

使用預設設定即可

1.13　首次安裝元件

1.14　安裝Spark報錯

檢視stderr檢視報錯資訊，發現找不到JAVA_HOME

解決方法：需要每個節點都操作

在以下檔案中手工新增JAVA_HOME

[root@master soft]# cd /opt/cloudera-manager/cm-5.9.3/lib64/cmf/service/client/
[root@master client]# vi deploy-cc.sh

儲存之後

[root@master client]# cat /etc/environment

點選重試

1.15　安裝Hive報錯

檢視stderr檢視報錯資訊，發現hive初始化失敗

處理過程：

（1）拷貝jdbc驅動包

[root@master ~]# cp /root/soft/mysql-connector-java-5.1.26-bin.jar /opt/cloudera/parcels/CDH-5.9.3-1.cdh5.9.3.p0.4/lib/hive/lib/

點選重試，仍舊報錯

點選檢視完整日誌

點選連結

在搜尋框中搜尋hive.metastore.schema.verification，把勾選去掉，儲存更改，返回安裝介面點選重試

繼續報錯，檢視完整日誌

  1 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
  2 Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
  3 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
  4 javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 
  5     at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549)
  6     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732)
  7     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)
  8     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317)
  9     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211)
 10     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186)
 11     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 12     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 13     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 14     at java.lang.reflect.Method.invoke(Method.java:498)
 15     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103)
 16     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
 17     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627)
 18     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679)
 19     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484)
 20     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
 21     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
 22     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950)
 23     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945)
 24     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197)
 25     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122)
 26     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 27     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 28     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 29     at java.lang.reflect.Method.invoke(Method.java:498)
 30     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
 31     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
 32 NestedThrowablesStackTrace:
 33 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 
 34 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 
 35     at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:261)
 36     at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:162)
 37     at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:197)
 38     at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:105)
 39     at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:2005)
 40     at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1386)
 41     at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827)
 42     at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571)
 43     at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:513)
 44     at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:232)
 45     at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:1414)
 46     at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2218)
 47     at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065)
 48     at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913)
 49     at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217)
 50     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727)
 51     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)
 52     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317)
 53     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211)
 54     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186)
 55     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 56     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 57     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 58     at java.lang.reflect.Method.invoke(Method.java:498)
 59     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103)
 60     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
 61     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627)
 62     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679)
 63     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484)
 64     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
 65     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
 66     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950)
 67     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945)
 68     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197)
 69     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122)
 70     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 71     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 72     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 73     at java.lang.reflect.Method.invoke(Method.java:498)
 74     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
 75     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
 76 Exception in thread "main" javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 
 77     at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549)
 78     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732)
 79     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)
 80     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317)
 81     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211)
 82     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186)
 83     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 84     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 85     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 86     at java.lang.reflect.Method.invoke(Method.java:498)
 87     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103)
 88     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
 89     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627)
 90     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679)
 91     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484)
 92     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
 93     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
 94     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950)
 95     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945)
 96     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197)
 97     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122)
 98     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 99     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
100     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
101     at java.lang.reflect.Method.invoke(Method.java:498)
102     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
103     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
104 NestedThrowablesStackTrace:
105 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 
106 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 
107     at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:261)
108     at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:162)
109     at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:197)
110     at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:105)
111     at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:2005)
112     at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1386)
113     at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827)
114     at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571)
115     at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:513)
116     at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:232)
117     at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:1414)
118     at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2218)
119     at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065)
120     at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913)
121     at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217)
122     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727)
123     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)
124     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317)
125     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211)
126     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186)
127     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
128     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
129     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
130     at java.lang.reflect.Method.invoke(Method.java:498)
131     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103)
132     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
133     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627)
134     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679)
135     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484)
136     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
137     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
138     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950)
139     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945)
140     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197)
141     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122)
142     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
143     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
144     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
145     at java.lang.reflect.Method.invoke(Method.java:498)
146     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
147     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)