Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docker compose方式启动Higress需要增加nacos日志的自动轮转 #1594

Open
abclint opened this issue Dec 16, 2024 · 9 comments · Fixed by higress-group/higress-standalone#116
Assignees

Comments

@abclint
Copy link

abclint commented Dec 16, 2024

Ⅰ. Issue Description

docker compose方式启动Higress,apiserver磁盘占用82G(nacos日志)

Ⅱ. Describe what happened

docker compose方式启动Higress,apiserver磁盘占用82G(nacos日志)
image
image

nacos端口访问正常
nacos版本:2.4.3 (standalone模式)

image
@CH3CHO CH3CHO self-assigned this Dec 16, 2024
@CH3CHO
Copy link
Collaborator

CH3CHO commented Dec 16, 2024

看了一下 nacos client 的代码,这个报错就代表请求 nacos 失败了。但它这里没有把原始的错误信息记录下来。

这个 docker compose 实例方便重启一下吗?可以看看重启会不会有什么问题

@CH3CHO
Copy link
Collaborator

CH3CHO commented Dec 16, 2024

针对这个报错,我现在看不出是什么原因。但我们下个版本可以在 API Server 里对 nacos 日志做个 rolling,避免占用过多空间。

@johnlanni johnlanni changed the title docker compose方式启动Higress,apiserver磁盘占用82G(nacos日志) docker compose方式启动Higress需要增加nacos日志的自动轮转 Dec 16, 2024
@github-project-automation github-project-automation bot moved this to Todo in Higress Dec 16, 2024
@github-project-automation github-project-automation bot moved this from Todo to Done in Higress Dec 16, 2024
@CH3CHO
Copy link
Collaborator

CH3CHO commented Dec 16, 2024

@abclint ,你可以修改 compose/.env 文件,把 API Server 的镜像 tag 改成 0.0.17。这个版本是增加了日志滚动功能的,最多会同时存在 4 个 30 MB 的日志文件。

@CH3CHO CH3CHO reopened this Dec 16, 2024
@github-project-automation github-project-automation bot moved this from Done to In Progress in Higress Dec 16, 2024
@abclint
Copy link
Author

abclint commented Dec 17, 2024

看了一下 nacos client 的代码,这个报错就代表请求 nacos 失败了。但它这里没有把原始的错误信息记录下来。

这个 docker compose 实例方便重启一下吗?可以看看重启会不会有什么问题

重启没看到有异常信息(API Server 的镜像 tag 已经改成了 0.0.17):

I1217 03:29:32.988036       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/etc/api/server.crt::/etc/api/server.key"
I1217 03:29:32.988569       1 secure_serving.go:213] Serving securely on [::]:8443
I1217 03:29:32.988634       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1217 03:29:34.481236       1 nacos_rest.go:214] [mcpbridges.networking.higress.io] higress-system/default got
I1217 03:29:34.512021       1 nacos_rest.go:214] [configmaps] higress-system/higress-config got
I1217 03:29:34.544569       1 nacos_rest.go:214] [configmaps] higress-system/higress-config got
I1217 03:29:34.594479       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:29:34.648551       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:29:34.693067       1 nacos_rest.go:214] [services] higress-system/higress-gateway got
I1217 03:29:34.742174       1 nacos_rest.go:214] [gatewayclasses.gateway.networking.k8s.io] /higress-gateway got
I1217 03:29:34.776339       1 nacos_rest.go:214] [gateways.gateway.networking.k8s.io] higress-system/higress-gateway got
I1217 03:29:35.357450       1 nacos_rest.go:214] [configmaps] higress-system/higress-https got
I1217 03:29:35.374862       1 nacos_rest.go:255] [namespaces]  list count=0
I1217 03:29:35.375146       1 nacos_rest.go:255] [ingressclasses.networking.k8s.io]  list count=0
I1217 03:29:35.375539       1 nacos_rest.go:255] [httproutes.gateway.networking.k8s.io]  list count=0
I1217 03:29:35.376521       1 nacos_rest.go:255] [referencegrants.gateway.networking.k8s.io]  list count=0
I1217 03:29:35.378567       1 nacos_rest.go:255] [gateways.gateway.networking.k8s.io]  list count=1
I1217 03:29:35.379387       1 nacos_rest.go:255] [gatewayclasses.gateway.networking.k8s.io]  list count=4
I1217 03:29:35.383521       1 nacos_rest.go:255] [secrets]  list count=2
I1217 03:29:35.384315       1 nacos_rest.go:255] [ingressclasses.networking.k8s.io]  list count=0
I1217 03:29:35.384695       1 nacos_rest.go:255] [namespaces]  list count=0
I1217 03:29:35.387670       1 nacos_rest.go:255] [services]  list count=1
I1217 03:29:35.389037       1 nacos_rest.go:255] [ingresses.networking.k8s.io]  list count=11
I1217 03:29:35.390595       1 nacos_rest.go:255] [configmaps] higress-system list count=6
I1217 03:29:35.390755       1 nacos_rest.go:255] [httproutes.gateway.networking.k8s.io]  list count=0
I1217 03:29:35.392098       1 nacos_rest.go:255] [gatewayclasses.gateway.networking.k8s.io]  list count=4
I1217 03:29:35.395988       1 nacos_rest.go:255] [referencegrants.gateway.networking.k8s.io]  list count=0
I1217 03:29:35.398161       1 nacos_rest.go:255] [services]  list count=1
I1217 03:29:35.398726       1 nacos_rest.go:255] [gateways.gateway.networking.k8s.io]  list count=1
I1217 03:29:35.400710       1 nacos_rest.go:255] [configmaps] higress-system list count=6
I1217 03:29:35.403244       1 nacos_rest.go:255] [secrets]  list count=2
I1217 03:29:35.409967       1 nacos_rest.go:255] [ingresses.networking.k8s.io]  list count=11
I1217 03:29:35.474037       1 nacos_rest.go:255] [mcpbridges.networking.higress.io]  list count=1
I1217 03:29:35.476055       1 nacos_rest.go:255] [wasmplugins.extensions.higress.io]  list count=2
I1217 03:29:35.476742       1 nacos_rest.go:255] [http2rpcs.networking.higress.io]  list count=0
I1217 03:29:35.483528       1 nacos_rest.go:255] [http2rpcs.networking.higress.io]  list count=0
I1217 03:29:35.484933       1 nacos_rest.go:255] [mcpbridges.networking.higress.io]  list count=1
I1217 03:29:35.490247       1 nacos_rest.go:255] [wasmplugins.extensions.higress.io]  list count=2
I1217 03:29:35.684903       1 nacos_rest.go:214] [configmaps] higress-system/higress-https got
I1217 03:29:37.484469       1 nacos_rest.go:214] [configmaps] higress-system/higress-https got
W1217 03:29:37.805331       1 nacos_rest.go:211] configmaps higress-system/istio-sidecar-injector not found
I1217 03:29:37.830144       1 nacos_rest.go:255] [namespaces]  list count=0
I1217 03:29:37.850763       1 nacos_rest.go:255] [pods]  list count=0
I1217 03:29:37.855378       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:29:37.854730       1 nacos_rest.go:255] [namespaces]  list count=0
I1217 03:29:37.856826       1 nacos_rest.go:255] [nodes]  list count=0
I1217 03:29:37.860767       1 nacos_rest.go:255] [endpoints]  list count=0
I1217 03:29:37.861094       1 nacos_rest.go:255] [envoyfilters.networking.istio.io]  list count=0
I1217 03:29:37.861108       1 nacos_rest.go:255] [validatingwebhookconfigurations.admissionregistration.k8s.io]  list count=0
I1217 03:29:37.879861       1 nacos_rest.go:255] [httproutes.gateway.networking.k8s.io]  list count=0
I1217 03:29:37.880296       1 nacos_rest.go:255] [pods]  list count=0
I1217 03:29:37.880478       1 nacos_rest.go:255] [mutatingwebhookconfigurations.admissionregistration.k8s.io]  list count=0
I1217 03:29:37.880880       1 nacos_rest.go:255] [referencegrants.gateway.networking.k8s.io]  list count=0
I1217 03:29:37.881274       1 nacos_rest.go:255] [gatewayclasses.gateway.networking.k8s.io]  list count=4
I1217 03:29:37.883983       1 nacos_rest.go:255] [endpoints]  list count=0
I1217 03:29:37.885738       1 nacos_rest.go:255] [gateways.gateway.networking.k8s.io]  list count=1
I1217 03:29:37.886774       1 nacos_rest.go:255] [services]  list count=1
I1217 03:29:37.887470       1 nacos_rest.go:255] [envoyfilters.networking.istio.io]  list count=0
I1217 03:29:37.888211       1 nacos_rest.go:255] [nodes]  list count=0
I1217 03:29:37.888435       1 nacos_rest.go:255] [validatingwebhookconfigurations.admissionregistration.k8s.io]  list count=0
I1217 03:29:37.888764       1 nacos_rest.go:255] [referencegrants.gateway.networking.k8s.io]  list count=0
I1217 03:29:37.889498       1 nacos_rest.go:255] [mutatingwebhookconfigurations.admissionregistration.k8s.io]  list count=0
I1217 03:29:37.889627       1 nacos_rest.go:255] [httproutes.gateway.networking.k8s.io]  list count=0
I1217 03:29:37.892168       1 nacos_rest.go:255] [secrets] higress-system list count=0
I1217 03:29:37.897982       1 nacos_rest.go:255] [gateways.gateway.networking.k8s.io]  list count=1
I1217 03:29:37.902127       1 nacos_rest.go:255] [gatewayclasses.gateway.networking.k8s.io]  list count=4
I1217 03:29:37.905888       1 nacos_rest.go:255] [services]  list count=1
I1217 03:29:37.906257       1 nacos_rest.go:255] [secrets]  list count=2
I1217 03:29:37.911070       1 nacos_rest.go:255] [secrets] higress-system list count=0
I1217 03:29:37.918254       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:29:37.920996       1 nacos_rest.go:255] [secrets]  list count=2
I1217 03:29:37.960345       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:29:37.992067       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:29:37.995822       1 nacos_rest.go:255] [configmaps]  list count=0
I1217 03:29:38.010710       1 nacos_rest.go:255] [configmaps]  list count=0
I1217 03:29:42.957201       1 nacos_rest.go:656] higress-system/services.higress-gateway is added
I1217 03:29:42.957219       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Service,APIVersion:v1,} higress-system/higress-gateway count(watcher)=2
I1217 03:29:42.966615       1 nacos_rest.go:656] higress-system/secrets.higress-console is added
I1217 03:29:42.968645       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Secret,APIVersion:v1,} higress-system/higress-console count(watcher)=2
I1217 03:29:42.968525       1 nacos_rest.go:656] higress-system/configmaps.domain-higress-default-domain is added
I1217 03:29:42.971143       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/domain-higress-default-domain count(watcher)=2
I1217 03:29:42.973736       1 nacos_rest.go:656] higress-system/configmaps.higress-config is added
I1217 03:29:42.973750       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-config count(watcher)=2
I1217 03:29:42.974084       1 nacos_rest.go:656] higress-system/configmaps.higress-console is added
I1217 03:29:42.974093       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-console count(watcher)=2
I1217 03:29:42.974335       1 nacos_rest.go:656] higress-system/configmaps.higress-gateway-status-leader is added
I1217 03:29:42.974344       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:29:42.974625       1 nacos_rest.go:656] higress-system/configmaps.higress-https is added
I1217 03:29:42.974635       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-https count(watcher)=2
I1217 03:29:42.977080       1 nacos_rest.go:656] higress-system/configmaps.higress-namespace-controller-election is added
I1217 03:29:42.977094       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:29:42.999292       1 nacos_rest.go:656] higress-system/secrets.test.ybm100.com is added
I1217 03:29:42.999306       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Secret,APIVersion:v1,} higress-system/test.ybm100.com count(watcher)=2
I1217 03:29:43.021488       1 nacos_rest.go:656] higress-system/mcpbridges.default is added
I1217 03:29:43.021604       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:McpBridge,APIVersion:networking.higress.io/v1,} higress-system/default count(watcher)=1
I1217 03:29:43.022950       1 nacos_rest.go:656] higress-system/ingresses.admin-api is added
I1217 03:29:43.025273       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/admin-api count(watcher)=1
I1217 03:29:43.026143       1 nacos_rest.go:656] higress-system/ingresses.admin-api-jwtauth is added
I1217 03:29:43.027248       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/admin-api-jwtauth count(watcher)=1
I1217 03:29:43.027981       1 nacos_rest.go:656] higress-system/ingresses.api-kernal-all is added
I1217 03:29:43.028102       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/api-kernal-all count(watcher)=1
I1217 03:29:43.029987       1 nacos_rest.go:656] higress-system/ingresses.api-kernal-all-jwtauth is added
I1217 03:29:43.032538       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/api-kernal-all-jwtauth count(watcher)=1
I1217 03:29:43.036256       1 nacos_rest.go:656] higress-system/ingresses.api-kernel-all-cxy is added
I1217 03:29:43.036370       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/api-kernel-all-cxy count(watcher)=1
I1217 03:29:43.037149       1 nacos_rest.go:656] higress-system/ingresses.api-kernel-all-xucao-jwtauth is added
I1217 03:29:43.037711       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/api-kernel-all-xucao-jwtauth count(watcher)=1
I1217 03:29:43.038785       1 nacos_rest.go:656] higress-system/ingresses.api-kernel-clint-jwtauth is added
I1217 03:29:43.038899       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/api-kernel-clint-jwtauth count(watcher)=1
I1217 03:29:43.039654       1 nacos_rest.go:656] higress-system/ingresses.app-api-kernel-all is added
I1217 03:29:43.041613       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/app-api-kernel-all count(watcher)=1
I1217 03:29:43.046079       1 nacos_rest.go:656] higress-system/ingresses.app-api-kernel-all-xucao is added
I1217 03:29:43.053053       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/app-api-kernel-all-xucao count(watcher)=1
I1217 03:29:43.054846       1 nacos_rest.go:656] higress-system/ingresses.swagger-ui is added
I1217 03:29:43.058481       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/swagger-ui count(watcher)=1
I1217 03:29:43.056251       1 nacos_rest.go:656] DEFAULT_GROUP/gatewayclasses.higress is added
I1217 03:29:43.048534       1 nacos_rest.go:670] higress-system/configmaps.domain-higress-default-domain is changed
I1217 03:29:43.052528       1 nacos_rest.go:656] higress-system/wasmplugins.cors-1.0.0 is added
I1217 03:29:43.052820       1 nacos_rest.go:656] higress-system/gateways.higress-gateway is added
I1217 03:29:43.059295       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Gateway,APIVersion:gateway.networking.k8s.io/v1beta1,} higress-system/higress-gateway count(watcher)=2
I1217 03:29:43.062842       1 nacos_rest.go:656] higress-system/ingresses.swagger-ui-kernel is added
I1217 03:29:43.062970       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/swagger-ui-kernel count(watcher)=1
I1217 03:29:43.063918       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:GatewayClass,APIVersion:gateway.networking.k8s.io/v1beta1,} /higress count(watcher)=2
I1217 03:29:43.064276       1 nacos_rest.go:656] DEFAULT_GROUP/gatewayclasses.higress-gateway is added
I1217 03:29:43.064366       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:GatewayClass,APIVersion:gateway.networking.k8s.io/v1beta1,} /higress-gateway count(watcher)=2
I1217 03:29:43.064797       1 nacos_rest.go:656] DEFAULT_GROUP/gatewayclasses.istio is added
I1217 03:29:43.064892       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:GatewayClass,APIVersion:gateway.networking.k8s.io/v1beta1,} /istio count(watcher)=2
I1217 03:29:43.065301       1 nacos_rest.go:656] DEFAULT_GROUP/gatewayclasses.istio-remote is added
I1217 03:29:43.065862       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:GatewayClass,APIVersion:gateway.networking.k8s.io/v1beta1,} /istio-remote count(watcher)=2
I1217 03:29:43.067367       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/domain-higress-default-domain count(watcher)=2
I1217 03:29:43.067806       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:WasmPlugin,APIVersion:extensions.higress.io/v1alpha1,} higress-system/cors-1.0.0 count(watcher)=1
I1217 03:29:43.070249       1 nacos_rest.go:656] higress-system/wasmplugins.jwt-auth-1.0.0 is added
I1217 03:29:43.070445       1 nacos_rest.go:179] event ADDED &TypeMeta{Kind:WasmPlugin,APIVersion:extensions.higress.io/v1alpha1,} higress-system/jwt-auth-1.0.0 count(watcher)=1
I1217 03:29:43.082433       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:29:43.083894       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:29:43.091666       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:29:43.092157       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:29:43.171945       1 nacos_rest.go:670] higress-system/ingresses.app-api-kernel-all-xucao is changed
I1217 03:29:43.174834       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/app-api-kernel-all-xucao count(watcher)=1
I1217 03:29:43.223136       1 nacos_rest.go:214] [configmaps] higress-system/higress-https got
I1217 03:29:43.242515       1 nacos_rest.go:214] [configmaps] higress-system/higress-https got
I1217 03:29:43.261953       1 nacos_rest.go:670] higress-system/ingresses.api-kernal-all-jwtauth is changed
I1217 03:29:43.262037       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/api-kernal-all-jwtauth count(watcher)=1
I1217 03:29:43.309178       1 nacos_rest.go:670] higress-system/ingresses.app-api-kernel-all is changed
I1217 03:29:43.309290       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:Ingress,APIVersion:networking.k8s.io/v1,} higress-system/app-api-kernel-all count(watcher)=1
I1217 03:29:45.441923       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:29:45.521353       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:29:45.548308       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:29:45.548327       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:29:45.642649       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:29:45.642783       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:29:52.574334       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:29:52.666047       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:29:53.000297       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:29:53.052198       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:29:53.053264       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:29:53.053284       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:29:53.058294       1 nacos_rest.go:670] higress-system/configmaps.higress-console is changed
I1217 03:29:53.058327       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-console count(watcher)=2
I1217 03:29:53.160181       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:29:53.160398       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:29:54.082939       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:00.535415       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:00.577891       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:01.169399       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:01.169447       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:01.201186       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:01.201208       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:08.063713       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:08.103879       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:08.171401       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:08.171447       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:08.175997       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:08.176014       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:15.592452       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:15.635871       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:15.691368       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:15.691468       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:15.697273       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:15.697289       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:23.122482       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:23.163514       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:23.199239       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:23.199260       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:23.313512       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:23.313530       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:30.647114       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:30.699300       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:30.721450       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:30.721468       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:30.828392       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:30.828444       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:38.180760       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:38.231810       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:38.238900       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:38.238922       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:38.349749       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:38.349933       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:39.496153       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:39.663197       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:39.690444       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:39.699783       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:39.829848       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:39.885183       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:39.893706       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:39.911368       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:45.710721       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:45.760448       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:45.762565       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:45.762598       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:45.855199       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:45.855226       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:48.223028       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:48.231259       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:48.268005       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:48.364877       1 nacos_rest.go:670] higress-system/secrets.higress-console is changed
I1217 03:30:48.364896       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:Secret,APIVersion:v1,} higress-system/higress-console count(watcher)=2
I1217 03:30:48.369222       1 nacos_rest.go:670] higress-system/configmaps.higress-console is changed
I1217 03:30:48.369238       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-console count(watcher)=2
I1217 03:30:51.628067       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:51.699964       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:51.714519       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:51.724731       1 nacos_rest.go:214] [configmaps] higress-system/higress-console got
I1217 03:30:53.242618       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:30:53.290903       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:30:53.381313       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:30:53.381331       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:30:53.390886       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:30:53.390905       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:30:54.095501       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:59.376171       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:59.388235       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:59.681553       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:30:59.857127       1 nacos_rest.go:255] [ingresses.networking.k8s.io] higress-system list count=11
I1217 03:31:00.773678       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:00.819135       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:00.914542       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:00.914559       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:00.919385       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:00.919402       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:03.023053       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:31:06.041348       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:31:06.064259       1 nacos_rest.go:255] [ingresses.networking.k8s.io] higress-system list count=11
I1217 03:31:07.625333       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:31:07.634344       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:31:07.665193       1 nacos_rest.go:255] [configmaps] higress-system list count=2
I1217 03:31:08.315927       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:08.348303       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:08.446282       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:08.446300       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:08.452492       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:08.452514       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:09.887924       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:31:09.931712       1 nacos_rest.go:214] [configmaps] higress-system/domain-higress-default-domain got
I1217 03:31:15.855638       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:15.878214       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:15.954796       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:15.954813       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:15.960178       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:15.960193       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:23.385368       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:23.411543       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:23.482212       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:23.482233       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:23.496130       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:23.496149       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:30.916035       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:30.939215       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:31.004893       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:31.004914       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:31.009016       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:31.009100       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:38.459509       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:38.474554       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:38.598631       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:38.598664       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:38.612371       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:38.612390       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:46.005228       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:46.007082       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:46.124757       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:46.124777       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:46.237478       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:46.237507       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:53.541664       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:31:53.618201       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:31:53.653298       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:31:53.653316       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:31:53.761723       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:31:53.761739       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:31:54.103225       1 nacos_rest.go:214] [secrets] higress-system/higress-console got
I1217 03:32:01.075741       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:32:01.184865       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:32:01.203300       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:32:01.203318       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:32:01.315479       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:32:01.315497       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:32:08.604703       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:32:08.722221       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:32:08.766468       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:32:08.766485       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:32:08.870401       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:32:08.870442       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:32:16.134564       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:32:16.172847       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:32:16.172865       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:32:16.255823       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:32:16.385687       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:32:16.385706       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:32:23.664493       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:32:23.783335       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:32:23.805645       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:32:23.805664       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:32:23.885463       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:32:23.885697       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2
I1217 03:32:31.199526       1 nacos_rest.go:214] [configmaps] higress-system/higress-gateway-status-leader got
I1217 03:32:31.304375       1 nacos_rest.go:670] higress-system/configmaps.higress-gateway-status-leader is changed
I1217 03:32:31.304397       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-gateway-status-leader count(watcher)=2
I1217 03:32:31.312513       1 nacos_rest.go:214] [configmaps] higress-system/higress-namespace-controller-election got
I1217 03:32:31.415753       1 nacos_rest.go:670] higress-system/configmaps.higress-namespace-controller-election is changed
I1217 03:32:31.415769       1 nacos_rest.go:179] event MODIFIED &TypeMeta{Kind:ConfigMap,APIVersion:v1,} higress-system/higress-namespace-controller-election count(watcher)=2

@abclint
Copy link
Author

abclint commented Dec 17, 2024

而且在Console编辑路由配置保存时报500:

错误
服务器内部错误
错误详情(错误码:500)
Method: put
RequestURL: http://:8080/v1/routes/admin-api
Headers: {"Accept":"application/json, text/plain, /","Content-Type":"application/json","X-XSRF-TOKEN":"
"}
Data: {"success":false,"message":"io.kubernetes.client.openapi.ApiException: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Internal error occurred: read config from both server and cache fail, err=failed to read config cache file:/tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system, cacheDir:/tmp/nacos/cache/config, err:open /tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system: no such file or directory ,dataId=ingresses.admin-api, group=higress-system, namespaceId=higress-system","reason":"InternalError","details":{"causes":[{"message":"read config from both server and cache fail, err=failed to read config cache file:/tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system, cacheDir:/tmp/nacos/cache/config, err:open /tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system: no such file or directory ,dataId=ingresses.admin-api, group=higress-system, namespaceId=higress-system"}]},"code":500}\n","data":null}

查看apiserver容器中 /tmp/nacos/cache/config目录下, 只有部分nacos配置,

@abclint
Copy link
Author

abclint commented Dec 17, 2024

而且在Console编辑路由配置保存时报500:

错误 服务器内部错误 错误详情(错误码:500) Method: put RequestURL: http://:8080/v1/routes/admin-api Headers: {"Accept":"application/json, text/plain, /","Content-Type":"application/json","X-XSRF-TOKEN":""} Data: {"success":false,"message":"io.kubernetes.client.openapi.ApiException: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Internal error occurred: read config from both server and cache fail, err=failed to read config cache file:/tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system, cacheDir:/tmp/nacos/cache/config, err:open /tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system: no such file or directory ,dataId=ingresses.admin-api, group=higress-system, namespaceId=higress-system","reason":"InternalError","details":{"causes":[{"message":"read config from both server and cache fail, err=failed to read config cache file:/tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system, cacheDir:/tmp/nacos/cache/config, err:open /tmp/nacos/cache/config/ingresses.admin-api@@higress-system@@higress-system: no such file or directory ,dataId=ingresses.admin-api, group=higress-system, namespaceId=higress-system"}]},"code":500}\n","data":null}

查看apiserver容器中 /tmp/nacos/cache/config目录下, 只有部分nacos配置,

这个找到原因了, nacos配置中行尾存在空行,nacos生成的md5和higress校验的md5不一致, 删除行尾空行,发布之后就好了

@abclint
Copy link
Author

abclint commented Dec 17, 2024

看了一下 nacos client 的代码,这个报错就代表请求 nacos 失败了。但它这里没有把原始的错误信息记录下来。

这个 docker compose 实例方便重启一下吗?可以看看重启会不会有什么问题

higress获取配置是否做了trim操作,应该需要和nacos生成md5的逻辑保持一致,这里应该是md5校验不一致,nacos服务是正常访问的

@CH3CHO
Copy link
Collaborator

CH3CHO commented Dec 17, 2024

看了一下 nacos client 的代码,这个报错就代表请求 nacos 失败了。但它这里没有把原始的错误信息记录下来。
这个 docker compose 实例方便重启一下吗?可以看看重启会不会有什么问题

higress获取配置是否做了trim操作,应该需要和nacos生成md5的逻辑保持一致,这里应该是md5校验不一致,nacos服务是正常访问的

我本地试一下。不过这里是 Nacos Go SDK 的逻辑,不是 Higress 的逻辑。

@CH3CHO
Copy link
Collaborator

CH3CHO commented Dec 21, 2024

我本地没有重现。因为这部分逻辑完全都是 nacos 的一部分,而且报错应该也是服务端返回的,不确定是否和你所使用的特定 nacos 版本有关系.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: In Progress
Development

Successfully merging a pull request may close this issue.

3 participants