hdp zeppelin 資料視覺化分析配置

hdp版本：

執行：hdp-select status hadoop-client | sed 's/hadoop-client - \(.*\)/\1/'
2.4.0.0-169

zeppelin安裝（摘錄官網）：

(Optional) Installing Zeppelin Manually

The Zeppelin Technical Preview is available as an HDP package compiled against Spark 1.6.

To install the Zeppelin Technical Preview manually (instead of using Ambari), complete the following steps as user root.

1. Install the Zeppelin service:

   yum install zeppelin

2. Make a copy of zeppelin-env.sh:

   cd /usr/hdp/current/zeppelin-server/lib
   cp conf/zeppelin-env.sh.template conf/zeppelin-env.sh

3. In the zeppelin-env.sh file, export the following three values.
   Note: you will use PORT to access the Zeppelin Web UI. corresponds to the version of HDP where you are installing Zeppelin; for example, 2.4.0.0-169.

   export HADOOP_CONF_DIR=/etc/hadoop/conf export ZEPPELIN_PORT=9995 export ZEPPELIN_JAVA_OPTS="-Dhdp.version="

4. To obtain the HDP version for your HDP cluster, run the following command:

   hdp-select status hadoop-client | sed 's/hadoop-client - (.*)/1/'

5. Copy hive-site.xml to Zeppelin’s conf directory:

   cd /usr/hdp/current/zeppelin-server/lib
   cp /etc/hive/conf/hive-site.xml conf/

6. Remove “s” from the values of hive.metastore.client.connect.retry.delay and hive.metastore.client.socket.timeout, in the hive-site.xml file in zeppelin/conf dir. (This will avoid a number format exception.)
7. Create a root user in HDFS:

   su hdfs
   hdfs dfs -mkdir /user/root
   hdfs dfs -chown root /user/root

To launch Zeppelin, run the following commands:

cd /usr/hdp/current/zeppelin-server/lib
bin/zeppelin-daemon.sh start

訪問：

zeppelin spark配置： 

1）點選Interpreters ：

master           yarn-client
spark.home       /usr/hdp/current/spark-client
spark.yarn.jar   /usr/hdp/current/spark-client/lib/spark-assembly-1.6.0.2.4.0.0-169-hadoop2.7.1.2.4.0.0-169.jar
spark.driver.extraJavaOptions -Dhdp.version=2.4.0.0-169
spark.yarn.am.extraJavaOptions -Dhdp.version=2.4.0.0-169
spark.executor.instances executor個數（預設2個）

2）conf/zeppelin-env.sh配置：

export HADOOP_CONF_DIR=/etc/hadoop/conf
export SPARK_HOME=/usr/hdp/2.4.0.0-169/spark
export ZEPPELIN_PORT=9995
export ZEPPELIN_JAVA_OPTS="-Dhdp.version=2.4.0.0-169"

new note ...