如何配置極狐GitLab Runner 幫助映象

极狐GitLab發表於2024-03-19

本文作者：徐曉偉

GitLab 是一個全球知名的一體化 DevOps 平臺，很多人都透過私有化部署 GitLab 來進行原始碼託管。極狐GitLab 是 GitLab 在中國的發行版，專門為中國程式設計師服務。可以一鍵式部署極狐GitLab。

本文用於處理預設幫助映象無法下載的問題。

如果能下載預設幫助映象，請忽略此配置，除非預設幫助映象無法滿足你的需求。

配置

檢視正在執行的 job

[root@anolis-7-9 ~]# kubectl -n gitlab-test get pod | grep runner
my-gitlab-gitlab-runner-69b59f46f-h4h9s              1/1     Running     0              17m
runner-lvpqhqhw-project-1-concurrent-0-oi5so634      2/2     Running     0              14s
[root@anolis-7-9 ~]#

檢視一個 job 的詳情

[root@anolis-7-9 ~]# kubectl -n gitlab-test describe pod runner-lvpqhqhw-project-1-concurrent-0-oi5so634
Name:             runner-lvpqhqhw-project-1-concurrent-0-oi5so634
Namespace:        gitlab-test
Priority:         0
Service Account:  default
Node:             anolis-7-7/172.25.25.31
Start Time:       Fri, 22 Dec 2023 16:48:21 +0800
Labels:           pod=runner-lvpqhqhw-project-1-concurrent-0
Annotations:      cni.projectcalico.org/containerID: 0c9dc8d8fcdea6d6bd725f19fdc4930031037be39913471979465bc9f3b0e7a8
cni.projectcalico.org/podIP: 192.168.240.102/32
cni.projectcalico.org/podIPs: 192.168.240.102/32
job.runner.gitlab.com/before_sha: 0000000000000000000000000000000000000000
job.runner.gitlab.com/id: 3
job.runner.gitlab.com/name: build-job
job.runner.gitlab.com/ref: main
job.runner.gitlab.com/sha: 1989c02f32ea5d2a2d06630711c5a3b895e0ad1e
job.runner.gitlab.com/url: https://gitlab.test.helm.xuxiaowei.cn/xuxiaowei/sleep/-/jobs/3
project.runner.gitlab.com/id: 1
Status:           Running
IP:               192.168.240.102
IPs:
IP:  192.168.240.102
Init Containers:
init-permissions:
Container ID:  containerd://5f54744ab81f83c2bb74e3db512eef7400a6c90c8b605d8c845c6917781355db
Image:         registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a
Image ID:      registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper@sha256:8c79152aed93973ee94ff532e32dab167ef5ce34ec0aef072f07097d587821a8
Port:          <none>
Host Port:     <none>
Command:
sh
-c
touch /logs-1-3/output.log && (chmod 777 /logs-1-3/output.log || exit 0)
State:          Terminated
Reason:       Completed
Exit Code:    0
Started:      Fri, 22 Dec 2023 16:48:21 +0800
Finished:     Fri, 22 Dec 2023 16:48:21 +0800
Ready:          True
Restart Count:  0
Environment:    <none>
Mounts:
/builds from repo (rw)
/logs-1-3 from logs (rw)
/scripts-1-3 from scripts (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5dxbx (ro)
Containers:
build:
Container ID:  containerd://c0aff1274b672583a549eaa9c435c0ef92d21fb96ffe5adfea82d3b4b84dd69a
Image:         ubuntu:22.04
Image ID:      docker.io/library/ubuntu@sha256:6042500cf4b44023ea1894effe7890666b0c5c7871ed83a97c36c76ae560bb9b
Port:          <none>
Host Port:     <none>
Command:
sh
-c
if [ -x /usr/local/bin/bash ]; then
exec /usr/local/bin/bash
elif [ -x /usr/bin/bash ]; then
exec /usr/bin/bash
elif [ -x /bin/bash ]; then
exec /bin/bash
elif [ -x /usr/local/bin/sh ]; then
exec /usr/local/bin/sh
elif [ -x /usr/bin/sh ]; then
exec /usr/bin/sh
elif [ -x /bin/sh ]; then
exec /bin/sh
elif [ -x /busybox/sh ]; then
exec /busybox/sh
else
echo shell not found
exit 1
fi


    State:          Running
      Started:      Fri, 22 Dec 2023 16:48:22 +0800
    Ready:          True
    Restart Count:  0
    Environment:
      FF_CMD_DISABLE_DELAYED_ERROR_LEVEL_EXPANSION:  false
      FF_NETWORK_PER_BUILD:                          false
      FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY:   false
      FF_USE_DIRECT_DOWNLOAD:                        true
      FF_SKIP_NOOP_BUILD_STAGES:                     true
      FF_USE_FASTZIP:                                false
      FF_DISABLE_UMASK_FOR_DOCKER_EXECUTOR:          false
      FF_ENABLE_BASH_EXIT_CODE_CHECK:                false
      FF_USE_WINDOWS_LEGACY_PROCESS_STRATEGY:        true
      FF_USE_NEW_BASH_EVAL_STRATEGY:                 false
      FF_USE_POWERSHELL_PATH_RESOLVER:               false
      FF_USE_DYNAMIC_TRACE_FORCE_SEND_INTERVAL:      false
      FF_SCRIPT_SECTIONS:                            false
      FF_USE_NEW_SHELL_ESCAPE:                       false
      FF_ENABLE_JOB_CLEANUP:                         false
      FF_KUBERNETES_HONOR_ENTRYPOINT:                false
      FF_POSIXLY_CORRECT_ESCAPES:                    false
      FF_USE_IMPROVED_URL_MASKING:                   false
      FF_RESOLVE_FULL_TLS_CHAIN:                     false
      FF_DISABLE_POWERSHELL_STDIN:                   false
      FF_USE_POD_ACTIVE_DEADLINE_SECONDS:            true
      FF_USE_ADVANCED_POD_SPEC_CONFIGURATION:        false
      FF_SET_PERMISSIONS_BEFORE_CLEANUP:             true
      FF_SECRET_RESOLVING_FAILS_IF_MISSING:          true
      FF_RETRIEVE_POD_WARNING_EVENTS:                false
      FF_PRINT_POD_EVENTS:                           false
      FF_USE_GIT_BUNDLE_URIS:                        true
      FF_USE_DUMB_INIT_WITH_KUBERNETES_EXECUTOR:     false
      FF_USE_INIT_WITH_DOCKER_EXECUTOR:              false
      CI_RUNNER_SHORT_TOKEN:                         LVPqHQhW
      CI_BUILDS_DIR:                                 /builds
      CI_PROJECT_DIR:                                /builds/xuxiaowei/sleep
      CI_CONCURRENT_ID:                              0
      CI_CONCURRENT_PROJECT_ID:                      0
      CI_SERVER:                                     yes
      CI_JOB_STATUS:                                 running
      CI_JOB_TIMEOUT:                                3600
      CI_SERVER_TLS_CA_FILE:                         /builds/xuxiaowei/sleep.tmp/CI_SERVER_TLS_CA_FILE
      CI_PIPELINE_ID:                                2
      CI_PIPELINE_URL:                               https://gitlab.test.helm.xuxiaowei.cn/xuxiaowei/sleep/-/pipelines/2
      CI_JOB_ID:                                     3
      CI_JOB_URL:                                    https://gitlab.test.helm.xuxiaowei.cn/xuxiaowei/sleep/-/jobs/3
      CI_JOB_STARTED_AT:                             2023-12-22T16:48:20+08:00
      CI_REGISTRY_USER:                              gitlab-ci-token
      CI_JOB_NAME:                                   build-job
      CI_JOB_NAME_SLUG:                              build-job
      CI_JOB_STAGE:                                  build
      CI_NODE_TOTAL:                                 1
      CI:                                            true
      GITLAB_CI:                                     true
      CI_SERVER_URL:                                 https://gitlab.test.helm.xuxiaowei.cn
      CI_SERVER_HOST:                                gitlab.test.helm.xuxiaowei.cn
      CI_SERVER_PORT:                                443
      CI_SERVER_PROTOCOL:                            https
      CI_SERVER_SHELL_SSH_HOST:                      gitlab.test.helm.xuxiaowei.cn
      CI_SERVER_SHELL_SSH_PORT:                      22
      CI_SERVER_NAME:                                GitLab
      CI_SERVER_VERSION:                             16.7.0-ee
      CI_SERVER_VERSION_MAJOR:                       16
      CI_SERVER_VERSION_MINOR:                       7
      CI_SERVER_VERSION_PATCH:                       0
      CI_SERVER_REVISION:                            9e7d34f7ff1
      GITLAB_FEATURES:                               
      CI_PROJECT_ID:                                 1
      CI_PROJECT_NAME:                               sleep
      CI_PROJECT_TITLE:                              sleep
      CI_PROJECT_DESCRIPTION:                        
      CI_PROJECT_PATH:                               xuxiaowei/sleep
      CI_PROJECT_PATH_SLUG:                          xuxiaowei-sleep
      CI_PROJECT_NAMESPACE:                          xuxiaowei
      CI_PROJECT_NAMESPACE_ID:                       2
      CI_PROJECT_ROOT_NAMESPACE:                     xuxiaowei
      CI_PROJECT_URL:                                https://gitlab.test.helm.xuxiaowei.cn/xuxiaowei/sleep
      CI_PROJECT_VISIBILITY:                         private
      CI_PROJECT_REPOSITORY_LANGUAGES:               
      CI_PROJECT_CLASSIFICATION_LABEL:               
      CI_DEFAULT_BRANCH:                             main
      CI_CONFIG_PATH:                                .gitlab-ci.yml
      CI_PAGES_DOMAIN:                               pages.test.helm.xuxiaowei.cn
      CI_PAGES_URL:                                  https://xuxiaowei.pages.test.helm.xuxiaowei.cn/sleep
      CI_REGISTRY:                                   registry.test.helm.xuxiaowei.cn
      CI_REGISTRY_IMAGE:                             registry.test.helm.xuxiaowei.cn/xuxiaowei/sleep
      CI_API_V4_URL:                                 https://gitlab.test.helm.xuxiaowei.cn/api/v4
      CI_API_GRAPHQL_URL:                            https://gitlab.test.helm.xuxiaowei.cn/api/graphql
      CI_TEMPLATE_REGISTRY_HOST:                     registry.gitlab.com
      CI_PIPELINE_IID:                               2
      CI_PIPELINE_SOURCE:                            web
      CI_PIPELINE_CREATED_AT:                        2023-12-22T16:47:55+08:00
      CI_PIPELINE_NAME:                              
      CI_COMMIT_SHA:                                 1989c02f32ea5d2a2d06630711c5a3b895e0ad1e
      CI_COMMIT_SHORT_SHA:                           1989c02f
      CI_COMMIT_BEFORE_SHA:                          0000000000000000000000000000000000000000
      CI_COMMIT_REF_NAME:                            main
      CI_COMMIT_REF_SLUG:                            main
      CI_COMMIT_BRANCH:                              main
      CI_COMMIT_MESSAGE:                             add .gitlab-ci.yml
      CI_COMMIT_TITLE:                               add .gitlab-ci.yml
      CI_COMMIT_DESCRIPTION:                         
      CI_COMMIT_REF_PROTECTED:                       true
      CI_COMMIT_TIMESTAMP:                           2023-12-22T08:04:07+00:00
      CI_COMMIT_AUTHOR:                              徐曉偉 <xuxiaowei@xuxiaowei.com.cn>
      CI_RUNNER_ID:                                  3
      CI_RUNNER_DESCRIPTION:                         my-gitlab-gitlab-runner-69b59f46f-h4h9s
      CI_RUNNER_TAGS:                                []
      SLEEP_TIME:                                    600
      GITLAB_USER_ID:                                2
      GITLAB_USER_EMAIL:                             xuxiaowei@xuxiaowei.com.cn
      GITLAB_USER_LOGIN:                             xuxiaowei
      GITLAB_USER_NAME:                              xuxiaowei
      CI_DISPOSABLE_ENVIRONMENT:                     true
      CI_RUNNER_VERSION:                             16.6.1
      CI_RUNNER_REVISION:                            f5da3c5a
      CI_RUNNER_EXECUTABLE_ARCH:                     linux/amd64
      RUNNER_TEMP_PROJECT_DIR:                       /builds/xuxiaowei/sleep.tmp
    Mounts:
      /builds from repo (rw)
      /logs-1-3 from logs (rw)
      /scripts-1-3 from scripts (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5dxbx (ro)
helper:
Container ID:  containerd://caeed8435cd7cf9a2a1950f00aafcfae42c49e1c4d0e057a03e544bcfe9e4ddb
Image:         registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a
Image ID:      registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper@sha256:8c79152aed93973ee94ff532e32dab167ef5ce34ec0aef072f07097d587821a8
Port:          <none>
Host Port:     <none>
Command:
sh
-c
if [ -x /usr/local/bin/bash ]; then
exec /usr/local/bin/bash
elif [ -x /usr/bin/bash ]; then
exec /usr/bin/bash
elif [ -x /bin/bash ]; then
exec /bin/bash
elif [ -x /usr/local/bin/sh ]; then
exec /usr/local/bin/sh
elif [ -x /usr/bin/sh ]; then
exec /usr/bin/sh
elif [ -x /bin/sh ]; then
exec /bin/sh
elif [ -x /busybox/sh ]; then
exec /busybox/sh
else
echo shell not found
exit 1
fi


    State:          Running
      Started:      Fri, 22 Dec 2023 16:48:22 +0800
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /builds from repo (rw)
      /logs-1-3 from logs (rw)
      /scripts-1-3 from scripts (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5dxbx (ro)
Conditions:
Type              Status
Initialized       True
Ready             True
ContainersReady   True
PodScheduled      True
Volumes:
repo:
Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:     
SizeLimit:  <unset>
scripts:
Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:     
SizeLimit:  <unset>
logs:
Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:     
SizeLimit:  <unset>
kube-api-access-5dxbx:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
ConfigMapOptional:       <nil>
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type    Reason     Age   From               Message
  ----    ------     ----  ----               -------
Normal  Scheduled  118s  default-scheduler  Successfully assigned gitlab-test/runner-lvpqhqhw-project-1-concurrent-0-oi5so634 to anolis-7-7
Normal  Pulled     118s  kubelet            Container image "registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a" already present on machine
Normal  Created    118s  kubelet            Created container init-permissions
Normal  Started    118s  kubelet            Started container init-permissions
Normal  Pulled     117s  kubelet            Container image "ubuntu:22.04" already present on machine
Normal  Created    117s  kubelet            Created container build
Normal  Started    117s  kubelet            Started container build
Normal  Pulled     117s  kubelet            Container image "registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a" already present on machine
Normal  Created    117s  kubelet            Created container helper
Normal  Started    117s  kubelet            Started container helper
[root@anolis-7-9 ~]#

根據日誌中的事件可知，使用的幫助映象是 registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a，有可能會拉取失敗，可以自定義拉取映象名稱。

如果無法訪問 registry.gitlab.com 域名或拉取映象速度較慢，可使用 docker hub 映象、作者 docker hub 映象

其中映象標籤 f5da3c5a 代表提交的 SHA 值，可透過網址 https://gitlab.com/gitlab-org/gitlab-runner/-/tags 檢視語義化版本號，一般可直接使用與 gitlab 相近的 gitlab 幫助映象版本

file

匯出 helm gitlab 配置

# 將已配置的值匯出到檔案中
helm -n gitlab-test get values my-gitlab > my-gitlab.yaml

檢視極狐gitlab runner 預設配置

# 此處為節選，不同版本可能會存在差異，請以 https://artifacthub.io/packages/helm/gitlab/gitlab?modal=values 中的配置為準
gitlab-runner:
  runners:
    config: |
      [[runners]]
        [runners.kubernetes]
        image = "ubuntu:22.04"
        {{- if .Values.global.minio.enabled }}
        [runners.cache]
          Type = "s3"
          Path = "gitlab-runner"
          Shared = true
          [runners.cache.s3]
            ServerAddress = {{ include "gitlab-runner.cache-tpl.s3ServerAddress" . }}
            BucketName = "runner-cache"
            BucketLocation = "us-east-1"
            Insecure = false
        {{ end }}

自定義幫助映象

gitlab-runner:
  runners:
    config: |
      [[runners]]
        [runners.kubernetes]
        image = "ubuntu:22.04"
        # 由上文可知
        helper_image = "gitlab/gitlab-runner:v16.6.1"
        {{- if .Values.global.minio.enabled }}
        [runners.cache]
          Type = "s3"
          Path = "gitlab-runner"
          Shared = true
          [runners.cache.s3]
            ServerAddress = {{ include "gitlab-runner.cache-tpl.s3ServerAddress" . }}
            BucketName = "runner-cache"
            BucketLocation = "us-east-1"
            Insecure = false
        {{ end }}

更新 helm gitlab 配置

helm upgrade -n gitlab-test --install my-gitlab gitlab/gitlab -f my-gitlab.yaml --timeout 600s --version 7.7.0

等待所有 gitlab-runner 舊 pod 刪除完成，新 pod 正常執行時，重試流水線，檢視一個 job 的詳情

[root@anolis-7-9 ~]# kubectl -n gitlab-test get pod | grep runner
my-gitlab-gitlab-runner-5787986c8-bqp29              1/1     Running     0              5m10s
runner-kfhsaz5h-project-1-concurrent-0-zsd6i493      2/2     Running     0              2m38s
[root@anolis-7-9 ~]#

[root@anolis-7-9 ~]# kubectl -n gitlab-test describe pod runner-kfhsaz5h-project-1-concurrent-0-zsd6i493
# 節選
Events:
  Type    Reason     Age   From               Message
  ----    ------     ----  ----               -------
  Normal  Scheduled  2m7s  default-scheduler  Successfully assigned gitlab-test/runner-kfhsaz5h-project-1-concurrent-0-zsd6i493 to anolis-7-7
  Normal  Pulling    2m6s  kubelet            Pulling image "gitlab/gitlab-runner:v16.6.1"
  Normal  Pulled     76s   kubelet            Successfully pulled image "gitlab/gitlab-runner:v16.6.1" in 50.091s (50.091s including waiting)
  Normal  Created    76s   kubelet            Created container init-permissions
  Normal  Started    76s   kubelet            Started container init-permissions
  Normal  Pulled     75s   kubelet            Container image "ubuntu:22.04" already present on machine
  Normal  Created    75s   kubelet            Created container build
  Normal  Started    75s   kubelet            Started container build
  Normal  Pulled     75s   kubelet            Container image "gitlab/gitlab-runner:v16.6.1" already present on machine
  Normal  Created    75s   kubelet            Created container helper
  Normal  Started    75s   kubelet            Started container helper
[root@anolis-7-9 ~]#

更多關於極狐GitLab 的最佳實踐，請搜尋關注【極狐GitLab】公眾號或者登入極狐GitLab 官網 https://gitlab.cn 進行學習。

如何配置極狐GitLab Runner Cache 快取
2024-03-13
Gitlab快取
如何部署極狐GitLab Runner Cache 快取配置？
2024-03-07
Gitlab快取
極狐GitLab Runner 新增極狐GitLab 域名 host
2024-03-01
Gitlab
如何在CentOS 安裝極狐GitLab Runner？
2024-03-08
CentOSGitlab
如何配置極狐GitLab Docker 容器映象倉庫
2024-03-07
GitlabDocker
如何在Anolis 8 安裝極狐GitLab Runner
2024-03-12
Gitlab
如何在極狐GitLab Runner Job 新增域名 host？
2024-03-19
Gitlab
極狐GitLab Runner 信任域名證書
2024-03-04
Gitlab
如何給極狐GitLab Runner 新增 MinIO 域名 host
2024-03-21
Gitlab
如何使用極狐GitLab Runner 修改日誌大小限制
2024-03-22
Gitlab
如何極狐GitLab Runner 使用特權身份執行
2024-03-25
Gitlab
極狐GitLab Runner Kubernetes（k8s）配置
2024-03-06
GitlabK8S
如何在極狐GitLab Runner 新增信任快取域名證書
2024-03-21
Gitlab快取
極狐GitLab 如何配置多個 LDAP？
2024-02-19
GitlabLDA
如何配置極狐GitLab Maven 倉庫
2024-03-08
GitlabMaven
如何在極狐GitLab 配置郵件功能
2024-03-29
Gitlab
極狐GitLab怎麼樣？如何利用極狐GitLab CI提高生產力？
2021-07-19
Gitlab
開個腦洞，帶你寫一個自己的極狐GitLab CI Runner
2022-12-29
Gitlab
如何使用極狐GitLab 自定義 Pages 根域名
2024-03-27
Gitlab
如何依賴機器人安裝極狐GitLab
2024-03-14
機器人Gitlab
如何啟動極狐GitLab 靜態網站Pages功能
2024-03-26
Gitlab網站
如何在極狐GitLab 自定義 Pages 域名、SSL/TLS 證書
2024-03-28
GitlabTLS
極狐GitLab小課堂|如何利用DevOps來償還技術負債？
2021-08-21
Gitlabdev
三個技巧幫助Docker映象瘦身
2020-08-01
Docker
極狐GitLab怎麼樣？幾大解決方案解密來了
2021-08-14
Gitlab解密
極狐GitLab|雲原生時代，關於GitOps你知道多少？
2021-08-28
Gitlab
GitLab CI持續整合-GitLab Runner
2019-03-17
Gitlab
使用 KubeSphere 和極狐GitLab 打造雲原生持續交付系統
2022-06-01
Gitlab
伺服器配置gitlab-runner流程問題總結
2021-12-22
伺服器Gitlab
eclipse中配置jdk幫助
2010-11-18
EclipseJDK
極狐GitLab好用嗎|五種方式降低“開放式DevOps平臺”成本
2021-06-26
Gitlabdev
支援“中國芯”，極狐GitLab助力AI晶片企業DevOps體系建設
2021-09-11
GitlabAI晶片dev
Gitlab自動部署之二：安裝GITLAB-RUNNER
2019-04-19
Gitlab
K8s 部署 Gitlab CI Runner
2021-08-22
K8SGitlab
GitLab Runner部署(kubernetes環境)
2020-12-28
Gitlab
gitlab-runner 中的 Docker-in-Docker
2023-05-17
GitlabDocker
ONES 與極狐(GitLab)戰略合作，強強聯手推動 DevOps 發展
2021-12-07
Gitlabdev
Gitlab CI持續整合 - GitLab Runner 安裝與註冊
2019-03-18
Gitlab

如何配置極狐GitLab Runner 幫助映象

配置

相關文章