### 歡迎訪問我的GitHub
> 這裡分類和彙總了欣宸的全部原創(含配套原始碼)：[https://github.com/zq2599/blog_demos](https://github.com/zq2599/blog_demos)

### 關於kubespray
- Kubespray是開源的kubernetes部署工具，整合了ansible，可以方便的部署高可用叢集環境，官網地址：https://github.com/kubernetes-sigs/kubespray ，本文是用kubespray2.11版本部署kubernetes1.15版本的實戰；
### 重要前提
- 本次實戰採用官方推薦的線上安裝，因此會去谷歌映象倉庫下載映象， **需要您的網路可以訪問谷歌服務** ；
### 機器資訊
- 本次實戰共計四臺機器，它們的主機名、IP地址和作用描述如下：

| 主機名 | IP地址 | 作用 |
|--|--|--|
| ansible | 192.168.133.134 | ansible主機 |
| a001 | 192.168.133.139 | k8s叢集的一號工作節點 |
| a002 | 192.168.133.140 | k8s叢集的二號工作節點 |
| a003 | 192.168.133.141 | k8s叢集的三號工作節點 |

### 標準化設定
- 本次實戰的所有機器都要做以下設定：
- 作業系統：CentOS Linux release 7.7.1908
- 所以操作都是root賬號執行的
- 關閉防火牆：
```shell
systemctl stop firewalld && systemctl disable firewalld
```
- 關閉selinux：
```shell
setenforce 0
sed -i --follow-symlinks 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/sysconfig/selinux
```
- ipv4網路設定：
```shell
modprobe br_netfilter
echo '1' > /proc/sys/net/bridge/bridge-nf-call-iptables
sysctl -w net.ipv4.ip_forward=1
```
### ansible主機免密碼ssh登入a001、a002、a003
- ssh登入ansible主機；
- 生成ssh公私鑰，輸入命令 **ssh-keygen** ，然後連續四次回車：
```shell
[root@ansible ~]# ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa): 
Created directory '/root/.ssh'.
Enter passphrase (empty for no passphrase): 
Enter same passphrase again: 
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:Empen3/RfLndRkS8mKfkq6a2IXtSdqwK7TqKNoHkNEU root@ansible
The key's randomart image is:
+---[RSA 2048]----+
|  .E           . |
|   .            o|
|  .   .       o..|
| +   . .     + o.|
|= . o o S . ooo..|
|.o o ..o + o.oo.o|
|  . .. o=.o  ..o+|
| o.  .o.o=.... .+|
|......o+=o=o.  . |
+----[SHA256]-----+
```
- 輸入命令 **ssh-copy-id root@192.168.133.139** ，將ansible的ssh分發給a001主機，會要求輸入 **yes** 和a001主機的root賬號的密碼，完成輸入後，以後ansible就可以免密碼ssh登入a001主機了：
```shell
[root@ansible ~]# ssh-copy-id root@192.168.133.139
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
The authenticity of host '192.168.133.139 (192.168.133.139)' can't be established.
ECDSA key fingerprint is SHA256:DPE2nldWHiOhC4DB9doy7jPWNZVup6XFZ+sR2i1gqz8.
ECDSA key fingerprint is MD5:fc:21:f7:7f:e8:cd:1a:76:d7:fb:cc:d4:28:91:f3:5a.
Are you sure you want to continue connecting (yes/no)? yes
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@192.168.133.139's password:

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@192.168.133.139'"
and check to make sure that only the key(s) you wanted were added.
```
- 繼續輸入命令 **ssh-copy-id root@192.168.133.140** 和 **ssh-copy-id root@192.168.133.141** ，使得ansible主機可以免密碼登入a002和a003；
- 至此，ansible主機可以用命令 **ssh root@192.168.133.139** 、 **ssh root@192.168.133.140** 、 **ssh root@192.168.133.141** 免密碼登入a001、a002、a003了；
### ansible主機操作
- ssh登入ansible主機；
- 安裝ansible應用：
```shell
yum install -y epel-release ansible
```
- 安裝pip：
```shell
easy_install pip
```
- 透過pip安裝jinja2：
```shell
pip2 install jinja2 --upgrade
```
- 安裝python36：
```shell
yum install python36 -y
```
- 建立工作目錄，進入工作目錄：
```shell
mkdir /usr/local/kubespray && cd /usr/local/kubespray/
```
- 下載kubespray，我這裡下載的是 **v2.11.0** 版本：
```shell
wget https://github.com/kubernetes-sigs/kubespray/archive/v2.11.0.tar.gz
```
- 解壓：
```shell
tar -zxvf v2.11.0.tar.gz
```
- 進入解壓後的目錄：
```shell
cd kubespray-2.11.0/
```
- 安裝kubespray所需的應用(注意是 **pip3** )：
```shell
pip3 install -r requirements.txt
```
- 複製一份demo配置資訊到目錄 **inventory/mycluster** ：
```shell
cp -rfp inventory/sample inventory/mycluster
```
- 進去看一下，可見mycluster目錄下複製了很多檔案：
```shell
[root@ansible kubespray-2.11.0]# tree inventory/
inventory/
├── local
│   ├── group_vars -> ../sample/group_vars
│   └── hosts.ini
├── mycluster
│   ├── group_vars
│   │   ├── all
│   │   │   ├── all.yml
│   │   │   ├── azure.yml
│   │   │   ├── coreos.yml
│   │   │   ├── docker.yml
│   │   │   ├── oci.yml
│   │   │   └── openstack.yml
│   │   ├── etcd.yml
│   │   └── k8s-cluster
│   │       ├── addons.yml
│   │       ├── k8s-cluster.yml
│   │       ├── k8s-net-calico.yml
│   │       ├── k8s-net-canal.yml
│   │       ├── k8s-net-cilium.yml
│   │       ├── k8s-net-contiv.yml
│   │       ├── k8s-net-flannel.yml
│   │       ├── k8s-net-kube-router.yml
│   │       ├── k8s-net-macvlan.yml
│   │       └── k8s-net-weave.yml
│   └── inventory.ini
```
- 設定叢集資訊(當前目錄仍舊是kubespray-2.11.0)：
```shell
declare -a IPS=(192.168.133.139 192.168.133.140 192.168.133.141)
```
- 配置ansible：
```shell
CONFIG_FILE=inventory/mycluster/hosts.yml python3 contrib/inventory_builder/inventory.py ${IPS[@]}
```
- 此時kubespray的指令碼根據輸入的IP資訊做好了叢集規劃，具體資訊可見 **inventory/mycluster/hosts.yml** ，如下所示，您也可以自行修改此檔案：
```yml
all:
  hosts:
    node1:
      ansible_host: 192.168.133.139
      ip: 192.168.133.139
      access_ip: 192.168.133.139
    node2:
      ansible_host: 192.168.133.140
      ip: 192.168.133.140
      access_ip: 192.168.133.140
    node3:
      ansible_host: 192.168.133.141
      ip: 192.168.133.141
      access_ip: 192.168.133.141
  children:
    kube-master:
      hosts:
        node1:
        node2:
    kube-node:
      hosts:
        node1:
        node2:
        node3:
    etcd:
      hosts:
        node1:
        node2:
        node3:
    k8s-cluster:
      children:
        kube-master:
        kube-node:
    calico-rr:
      hosts: {}
```
- 執行以下命令即可開始安裝，線上安裝比較耗時請耐心等待：
```shell
ansible-playbook -i inventory/mycluster/hosts.yml --become --become-user=root cluster.yml
```
- 安裝完成時控制檯輸出類似如下的資訊：
```shell
PLAY RECAP ********************************************************************************************************************************************************************************
localhost                  : ok=1    changed=0    unreachable=0    failed=0   
node1                      : ok=658  changed=95   unreachable=0    failed=0   
node2                      : ok=566  changed=77   unreachable=0    failed=0   
node3                      : ok=475  changed=66   unreachable=0    failed=0

Sunday 17 November 2019  17:31:19 +0800 (0:00:00.064)       0:09:56.193 ******* 
=============================================================================== 
kubernetes/master : kubeadm | Init other uninitialized masters -------------------------------------------------------------------------------------------------------------------- 94.91s
kubernetes/master : kubeadm | Initialize first master ----------------------------------------------------------------------------------------------------------------------------- 42.95s
etcd : Install | Copy etcdctl binary from docker container ------------------------------------------------------------------------------------------------------------------------ 14.26s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------ 12.87s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------ 12.28s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------ 10.79s
etcd : reload etcd ---------------------------------------------------------------------------------------------------------------------------------------------------------------- 10.71s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 9.71s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 9.48s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 8.02s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 7.88s
etcd : wait for etcd up ------------------------------------------------------------------------------------------------------------------------------------------------------------ 7.16s
etcd : Gen_certs | Write etcd master certs ----------------------------------------------------------------------------------------------------------------------------------------- 6.39s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 5.75s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 5.53s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 5.42s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 5.41s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 5.06s
download : download_container | Download image if required ------------------------------------------------------------------------------------------------------------------------- 4.87s
kubernetes-apps/ansible : Kubernetes Apps | Start Resources ------------------------------------------------------------------------------------------------------------------------ 4.78s
```
- 至此，kubernetes叢集環境部署完成，接下來簡單驗證一下環境是否可用；
### 檢查環境
- ssh登入a001機器；
- 檢視節點、service、pod：
```shell
[root@node1 ~]# kubectl get nodes
NAME    STATUS   ROLES    AGE   VERSION
node1   Ready    master   25m   v1.15.3
node2   Ready    master   23m   v1.15.3
node3   Ready    <none>   23m   v1.15.3
[root@node1 ~]# kubectl get services --all-namespaces
NAMESPACE     NAME                   TYPE        CLUSTER-IP    EXTERNAL-IP   PORT(S)                  AGE
default       kubernetes             ClusterIP   10.233.0.1    <none>        443/TCP                  25m
kube-system   coredns                ClusterIP   10.233.0.3    <none>        53/UDP,53/TCP,9153/TCP   22m
kube-system   kubernetes-dashboard   ClusterIP   10.233.35.1   <none>        443/TCP                  22m
[root@node1 ~]# kubectl get pods --all-namespaces
NAMESPACE     NAME                                      READY   STATUS    RESTARTS   AGE
kube-system   calico-kube-controllers-c6fb79b8b-v24nq   1/1     Running   0          22m
kube-system   calico-node-46s8t                         1/1     Running   0          23m
kube-system   calico-node-mcjfs                         1/1     Running   0          23m
kube-system   calico-node-q989m                         1/1     Running   1          23m
kube-system   coredns-74c9d4d795-4xz6s                  1/1     Running   0          22m
kube-system   coredns-74c9d4d795-kh6vl                  1/1     Running   0          22m
kube-system   dns-autoscaler-7d95989447-gmcrl           1/1     Running   0          22m
kube-system   kube-apiserver-node1                      1/1     Running   0          24m
kube-system   kube-apiserver-node2                      1/1     Running   0          23m
kube-system   kube-controller-manager-node1             1/1     Running   0          24m
kube-system   kube-controller-manager-node2             1/1     Running   0          23m
kube-system   kube-proxy-2zhwn                          1/1     Running   0          23m
kube-system   kube-proxy-59qx8                          1/1     Running   0          23m
kube-system   kube-proxy-fgpx6                          1/1     Running   0          23m
kube-system   kube-scheduler-node1                      1/1     Running   0          24m
kube-system   kube-scheduler-node2                      1/1     Running   0          23m
kube-system   kubernetes-dashboard-7c547b4c64-x7nfq     1/1     Running   0          22m
kube-system   nginx-proxy-node3                         1/1     Running   0          23m
kube-system   nodelocaldns-8khfq                        1/1     Running   0          22m
kube-system   nodelocaldns-pzx2p                        1/1     Running   0          22m
kube-system   nodelocaldns-s5kcd                        1/1     Running   0          22m
```
### 訪問dashboard
- dashboard可以檢視kubernetes系統的整體情況，為了訪問dashboard頁面，需要增加RBAC：
- ssh登入a001機器；
- 執行以下命令，建立檔案 **admin-user.yaml** ：
```shell
tee admin-user.yaml < [學習路上，你不孤單，欣宸原創一路相伴...](http://blog.itpub.net/70017844/)</none></none></none></none>

kubespray2.11安裝kubernetes1.15

相關文章