centos7.3下 greenplum-db 安裝、配置文件
一.系統要求
- 1.系統版本要求:
根據官方文件： greenplumd-b支援以下幾種linux系統:
SUSE Linux Enterprise Server 64-bit 12 SP2 or SP3, with kernel 4.4.73-5.1 or newer
SUSE Linux Enterprise Server 64-bit 11 SP4
CentOS 64-bit 6.x or 7.x
Red Hat Enterprise Linux (RHEL) 64-bit 6.x or 7.x- 2.檔案系統要求:
資料儲存目錄為 xfs檔案系統
二. centos7.3下安裝greenplum-db
-
gp伺服器列表
144.131.252.198 mdw master 主節點 144.131.252.199 sdw1-1 資料節點1 144.131.252.144 sdw2-1 資料節點2 144.131.252.195 sdw3-1 主節點切換備用節點 -
1.修改系統配置項
1.1 關閉SELINUX
vi /etc/selinux/configSELINUX=disabled1.2 關閉防火牆
systemctl status firewalld systemctl stop firewalld.service systemctl disable firewalld.service iptable -L -n1.3
修改核心配置引數,並執行 sysctl -p使之生效
vi /etc/sysctl.confkernel.shmmax = 500000000 kernel.shmmni = 4096 kernel.shmall = 4000000000 kernel.sem = 2000 4096000 2000 2048 kernel.sysrq = 1 kernel.core_uses_pid = 1 kernel.msgmnb = 65536 kernel.msgmax = 65536 kernel.msgmni = 2048 net.ipv4.tcp_syncookies = 1 net.ipv4.ip_forward = 0 net.ipv4.conf.default.accept_source_route = 0 net.ipv4.tcp_tw_recycle = 1 net.ipv4.tcp_max_syn_backlog = 4096 net.ipv4.conf.all.arp_filter = 1 net.ipv4.ip_local_port_range = 1025 65535 net.core.netdev_max_backlog = 10000 net.core.rmem_max = 2097152 net.core.wmem_max = 2097152 vm.overcommit_memory = 21.4
vi /etc/security/limits.conf* soft nofile 65536 * hard nofile 65536 * soft nproc 131072 * hard nproc 1310721.5
配置叢集中各節點hosts資訊
vi /etc/hosts
144.131.252.198 mdw # master node
144.131.252.199 sdw1-1 # segment node 1
144.131.252.144 sdw2-1 # segment node 2
144.131.252.195 sdw3-1 # segment node 3
2 安裝greenplum-db
2.1 從https://network.pivotal.io/pr…
greenplum-db-5.4.0-rhel7-x86_64.rpm
greenplum-cc-web-3.3.1-LINUX-x86_64.zip
拷貝至mdw(144.131.252.198)主節點/opt目錄下
執行
tar -xzvf greenplum-cc-web-3.3.1-LINUX-x86_64.zip
rpm -ivh greenplum-db-5.4.0-rhel7-x86_64.rpm
unzip greenplum-db-5.4.0-rhel7-x86_64.zip
./greenplum-db-5.4.0-rhel7-x86_64.bin2.2 按照提示輸入安裝目錄
/opt/greenplum-db
執行
./greenplum-cc-web-3.3.1-LINUX-x86_64.bin
按照提示輸入安裝目錄
/opt/greenplum-cc-web
解壓完成後建立gpadmin使用者和組，用來管理greenplum-db
groupadd gpadmin # 建立分組
useradd gpadmin -g gpadmin # 建立使用者並分配組
passwd gpadmin # 為gpadmin分配密碼
cd /opt/greenplum-db
chown -R gpadmin:gpadmin greenplum-db/
chown -R gpadmin:gpadmin greenplum-cc-web/2.3 切換到gpadmin使用者下：
su - gpadmin
mkdir -p /opt/greenplum-db/gpconfigs
cd /opt/greenplum-db/gpconfigs建立配置檔案
vim hostfile_exkeys mdw
sdw1-1
sdw2-1
sdw3-1vi hostfile sdw1-1
sdw2-1
sdw3-12.4 在gpadmin使用者下新增環境變數
vi ~/.bashrc #新增以下內容
export LD_LIBRARY_PATH=$GPHOME/lib
export MASTER_DATA_DIRECTORY=/home/gpadmin/gpdata/master/gpseg-1
. /opt/greenplum-db/greenplum_path.sh
. /opt/greenplum-cc-web/gpcc_path.sh source ~/.bashrc切換到root使用者下，匯出環境變數
su - root
vi ~/.bashrc #新增以下內容
export LD_LIBRARY_PATH=$GPHOME/lib
export MASTER_DATA_DIRECTORY=/home/gpadmin/gpdata/master/gpseg-1
. /opt/greenplum-db/greenplum_path.sh
. /opt/greenplum-cc-web/gpcc_path.sh執行
source ~/.bashrc
gpssh-exkeys -f hostfile_exkeys #拷貝mster節點公鑰至各segment節點
gpseginstall -f /opt/greenplum-db/gpconfigs/hostfile_exkeys -p gpadmin 注:
gpssh-exkeys -f hostfile_exkeys
將會在master節點生成公私鑰，並拷貝至hostfile_exkeys各segment節點，實現後續無金鑰登陸
gpseginstall -f /opt/greenplum-db/gpconfigs/hostfile_exkeys -p gpadmin
使用預設使用者名稱(gpadmin) 、密碼：gpadmin 在各segment節點安裝Greenplum—Db
2.5 在master及各segment節點建立資料儲存目錄
mkdir /home/gpadmin/gpdata/master
cd /home/gpadmin/
chown -R gpadmin:gpadmin gpdata/master
gpssh -f /opt/greenplum-db/gpconfigs/hostfile -e "mkdir -p /home/gpadmin/gpdata/data1/primary;mkdir -p /home/gpadmin/gpdata/data2/primary”
gpssh -f /opt/greenplum-db/gpconfigs/hostfile -e "mkdir -p /home/gpadmin/gpdata/data1/mirror;mkdir -p /home/gpadmin/gpdata/data2/mirror"
gpssh -f /opt/greenplum-db/gpconfigs/hostfile -e "chown -R gpadmin:gpadmin /home/gpadmin/gpdata"
gpssh -f /opt/greenplum-db/gpconfigs/hostfile_exkeys -v -e `ntpd`切換到gpadmin使用者下,初始化資料庫叢集
su - gpadmin
cd /opt/greenplum-db/
cp /opt/greenplum-db/docs/cli_help/gpconfigs/gpinitsystem_config /opt/greenplum-db/gpconfigs/gpinitsystem_config
vi /opt/greenplum-db/gpconfigs/gpinitsystem_config###修改以下內容
MASTER_HOSTNAME=mdw
PORT_BASE=40000
declare -a DATA_DIRECTORY=(/home/gpadmin/gpdata/data1/primary /home/gpadmin/gpdata/data1/primary /home/gpadmin/gpdata/data2/primary /home/gpadmin/gpdata/data2/primary)
MASTER_DIRECTORY=/home/gpadmin/gpdata/master
MASTER_PORT=5432
MIRROR_PORT_BASE=50000
REPLICATION_PORT_BASE=41000
MIRROR_REPLICATION_PORT_BASE=51000
declare -a MIRROR_DATA_DIRECTORY=(/home/gpadmin/gpdata/data1/mirror /home/gpadmin/gpdata/data1/mirror /home/gpadmin/gpdata/data2/mirror /home/gpadmin/gpdata/data2/mirror)
DATABASE_NAME=gpdb
MACHINE_LIST_FILE=/opt/greenplum-db/gpconfigs/hostfile2.6 配置修改完成之後，執行以下命令初始化資料庫
gpinitsystem -c gpconfigs/gpinitsystem_config -h gpconfigs/hostfile按照提示輸入相應資訊，初始化完成後修改master節點：
vi /home/gpadmin/gpdata/master/gpseg-/pg_hba.conf #新增以下內容(允許172.16網段通過密碼登陸)
host all gpadmin 172.16.1.1/16 md5psql修改資料庫密碼:
psql -d gpdb
gpdb=# alter user gpadmin with password `gpadmin`
gpdb=# q
重啟greenplumdb叢集gpstop -a
gpstart -a2.7 啟動greenplum-db commond center(gpcc)
gpperfmon_install --enable --port 5432 --password gpadmin重啟greenplumdb叢集，載入gpperfmon_install採集資料
gpstop -a
gpstart -a啟動web控制檯介面
gpcmdr --setup按照提示輸入例項名、監聽埠資訊等
#Please enter the instance name
gpcc
#Press ENTER to use instance name
gpcc
#Is the master host for the Greenplum Database remote? Yy/Nn (default=N)
N
#What port does the Greenplum Database use? (default=5432)
5432
#Enable kerberos login for this instance? Yy/Nn (default=N)
N
#What port would you like the new web server to use for this instance? (default=28080)
28080啟動、停止
gpcmdr --start #啟動
gpcmdr --stop #停止