-
Choerodon平台版本: 0.24
-
遇到问题的执行步骤:
kubectl describe pod -n c7n-system gitlab-service-85fbd4f9b6-998s2
Events:
Type Reason Age From Message
Normal Scheduled 18m default-scheduler Successfully assigned c7n-system/gitlab-service-85fbd4f9b6-998s2 to mdos-devops-3
Normal Pulling 18m kubelet Pulling image “registry.cn-shanghai.aliyuncs.com/c7n/skywalking-agent:6.5.0”
Normal Pulled 18m kubelet Successfully pulled image “registry.cn-shanghai.aliyuncs.com/c7n/skywalking-agent:6.5.0” in 4.340969408s
Normal Created 18m kubelet Created container skywalking-agent
Normal Started 18m kubelet Started container skywalking-agent
Normal Pulling 18m kubelet Pulling image “registry.cn-shanghai.aliyuncs.com/c7n/gitlab-service:0.24.0”
Normal Pulled 17m kubelet Successfully pulled image “registry.cn-shanghai.aliyuncs.com/c7n/gitlab-service:0.24.0” in 20.644203519s
Normal Created 17m kubelet Created container gitlab-service
Normal Started 17m kubelet Started container gitlab-service
Warning Unhealthy 14m (x2 over 14m) kubelet Liveness probe failed:
Warning Unhealthy 3m16s (x59 over 17m) kubelet Readiness probe failed:
gitlab-service pod日志
2021-02-04 15:59:30.993 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: updateUsingPUT_4
2021-02-04 15:59:31.015 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: createUsingPOST_7
2021-02-04 15:59:31.041 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: queryUsingGET_5
2021-02-04 15:59:31.077 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: batchDeleteVariableUsingDELETE_1
2021-02-04 15:59:31.104 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: createUsingPOST_8
2021-02-04 15:59:31.133 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: createUsingPOST_9
2021-02-04 15:59:31.145 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: createMemberUsingPOST_1
2021-02-04 15:59:31.172 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: deleteUsingDELETE_5
2021-02-04 15:59:31.183 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: deleteUsingDELETE_6
2021-02-04 15:59:31.205 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: deleteMemberUsingDELETE_1
2021-02-04 15:59:31.333 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: updateUsingPUT_5
2021-02-04 15:59:31.546 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: createUsingPOST_10
2021-02-04 15:59:31.581 INFO 7 — [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: listUsingGET_8
2021-02-04 15:59:31.696 INFO 7 — [ main] f.a.AutowiredAnnotationBeanPostProcessor : JSR-330 ‘javax.inject.Inject’ annotation found and supported for autowiring
2021-02-04 15:59:31.709 INFO 7 — [ main] o.s.b.w.e.u.UndertowServletWebServer : Undertow started on port(s) 8070 (http) with context path ‘’
2021-02-04 15:59:31.711 INFO 7 — [ main] i.c.gitlab.GitlabServiceApplication : Started GitlabServiceApplication in 16.061 seconds (JVM running for 17.023)
2021-02-04 15:59:33.062 INFO 7 — [ XNIO-2 task-1] io.undertow.servlet : Initializing Spring FrameworkServlet ‘dispatcherServlet’
2021-02-04 15:59:33.063 INFO 7 — [ XNIO-2 task-1] o.s.web.servlet.DispatcherServlet : FrameworkServlet ‘dispatcherServlet’: initialization started
2021-02-04 15:59:33.081 INFO 7 — [ XNIO-2 task-1] o.s.web.servlet.DispatcherServlet : FrameworkServlet ‘dispatcherServlet’: initialization completed in 18 ms
2021-02-04 15:59:33.122 INFO 7 — [ XNIO-2 task-1] i.c.g.infra.common.config.GitlabHealthy : 健康检查探测
2021-02-04 15:59:37.824 INFO 7 — [ XNIO-3 task-1] io.undertow.servlet : Initializing Spring FrameworkServlet ‘dispatcherServlet’
2021-02-04 15:59:37.825 INFO 7 — [ XNIO-3 task-1] o.s.web.servlet.DispatcherServlet : FrameworkServlet ‘dispatcherServlet’: initialization started
2021-02-04 15:59:37.834 INFO 7 — [ XNIO-3 task-1] o.s.web.servlet.DispatcherServlet : FrameworkServlet ‘dispatcherServlet’: initialization completed in 9 ms
2021-02-04 15:59:44.042 INFO 7 — [ XNIO-2 task-4] i.c.g.infra.common.config.GitlabHealthy : 健康检查探测
2021-02-04 15:59:46.097 INFO 7 — [ XNIO-2 task-5] i.c.g.infra.common.config.GitlabHealthy : 健康检查探测
2021-02-04 15:59:59.029 INFO 7 — [ XNIO-2 task-6] i.c.g.infra.common.config.GitlabHealthy : 健康检查探测
2021-02-04 16:00:06.092 INFO 7 — [ XNIO-2 task-7] i.c.g.infra.common.config.GitlabHealthy : 健康检查探测
-
文档地址:
-
环境信息(如:节点信息):
-
报错日志:
ingress 日志报错
2021/02/04 08:02:46 [error] 1134#1134: *1394 open() “/etc/nginx/html/api/v4/user” failed (2: No such file or directory), client: 10.186.140.147, server: gitlab.mdos.cn, request: “GET /api/v4/user HTTP/1.1”, host: “gitlab.mdos.cn”
2021/02/04 08:02:59 [error] 1134#1134: *1395 open() “/etc/nginx/html/api/v4/user” failed (2: No such file or directory), client: 10.186.140.147, server: gitlab.mdos.cn, request: “GET /api/v4/user HTTP/1.1”, host: “gitlab.mdos.cn”
10.186.140.147 - - [04/Feb/2021:08:02:59 +0000] “GET /api/v4/user HTTP/1.1” 404 153 “-” “Jersey/2.26 (HttpUrlConnection 1.8.0_242)” “-”
10.186.140.147 - - [04/Feb/2021:08:03:06 +0000] “GET /api/v4/user HTTP/1.1” 404 153 “-” “Jersey/2.26 (HttpUrlConnection 1.8.0_242)” “-”
2021/02/04 08:03:06 [error] 1134#1134: *1396 open() “/etc/nginx/html/api/v4/user” failed (2: No such file or directory), client: 10.186.140.147, server: gitlab.mdos.cn, request: “GET /api/v4/user HTTP/1.1”, host: “gitlab.mdos.cn”
10.186.140.147 - - [04/Feb/2021:08:03:14 +0000] “GET /api/v4/user HTTP/1.1” 404 153 “-” “Jersey/2.26 (HttpUrlConnection 1.8.0_242)” “-”
2021/02/04 08:03:14 [error] 1134#1134: *1397 open() “/etc/nginx/html/api/v4/user” failed (2: No such file or directory), client: 10.186.140.147, server: gitlab.mdos.cn, request: “GET /api/v4/user HTTP/1.1”, host: “gitlab.mdos.cn”
10.186.140.147 - - [04/Feb/2021:08:03:14 +0000] “GET /api/v4/user HTTP/1.1” 404 153 “-” “Jersey/2.26 (HttpUrlConnection 1.8.0_242)” “-”
2021/02/04 08:03:14 [error] 1134#1134: *1397 open() “/etc/nginx/html/api/v4/user” failed (2: No such file or directory), client: 10.186.140.147, server: gitlab.mdos.cn, request: “GET /api/v4/user HTTP/1.1”, host: “gitlab.mdos.cn” -
原因分析:
提出您分析问题的过程,以便我们能更准确的找到问题所在
gitlab-service readiness 就绪检查失败 一直反复重启 -
疑问:
提出您对于遇到和解决该问题时的疑问