Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Cannot operate normally #38894

Open
1 task done
guhezhu01 opened this issue Dec 31, 2024 · 5 comments
Open
1 task done

[Bug]: Cannot operate normally #38894

guhezhu01 opened this issue Dec 31, 2024 · 5 comments
Assignees
Labels
help wanted Extra attention is needed kind/bug Issues or changes related a bug

Comments

@guhezhu01
Copy link

guhezhu01 commented Dec 31, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:2.4.17
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Installed using the helm method, the configuration file pulled from the official website shows an error message when starting milvus

NAME READY STATUS RESTARTS AGE
my-milvus-0-datanode-69dcb8d7c7-hddbv 0/1 Running 2 (2m32s ago) 3m
my-milvus-0-etcd-0 1/1 Running 0 3m
my-milvus-0-etcd-1 1/1 Running 0 3m
my-milvus-0-etcd-2 1/1 Running 0 3m
my-milvus-0-indexnode-b4d54c48-h6z6q 1/1 Running 2 3m
my-milvus-0-minio-0 1/1 Running 0 3m
my-milvus-0-minio-1 1/1 Running 0 3m
my-milvus-0-minio-2 1/1 Running 0 3m
my-milvus-0-minio-3 1/1 Running 0 3m
my-milvus-0-mixcoord-55dd668d7-g2gxx 0/1 Running 2 (2m32s ago) 3m
my-milvus-0-proxy-f64bdf579-qw5z7 0/1 Running 2 (2m32s ago) 3m
my-milvus-0-querynode-5d866fb5c4-fhttt 1/1 Running 2 (2m32s ago) 3m

Expected Behavior

Pod has an error message, which is as follows:[2024/12/31 03:13:17.147 +00:00] [WARN] [retry/retry.go:106] ["retry func failed"] [retried=0] [error="service not ready[mixture=30]: Initializing"]
[2024/12/31 03:13:18.094 +00:00] [WARN] [retry/retry.go:46] ["retry func failed"] [retried=20] [error="WaitForComponentStates, not meet, RootCoord current state: Initializing"]
[2024/12/31 03:13:20.118 +00:00] [WARN] [retry/retry.go:106] ["retry func failed"] [retried=0] [error="service not ready[mixture=30]: Initializing"]
[2024/12/31 03:13:20.153 +00:00] [WARN] [retry/retry.go:106] ["retry func failed"] [retried=4] [error="service not ready[mixture=30]: Initializing"]
[2024/12/31 03:13:20.153 +00:00] [WARN] [grpcclient/client.go:556] ["ClientBase Call grpc call get error"] [role=rootcoord] [address=10.167.199.214:53100] [error="stack trace: /workspace/source/pkg/tracer/stack_trace.go:51 github.com/milvus-io/milvus/pkg/tracer.StackTrace\n/workspace/source/internal/util/grpcclient/client.go:555 github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).Call\n/workspace/source/internal/util/grpcclient/client.go:569 github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).ReCall\n/workspace/source/internal/dist。。。。。

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

@guhezhu01 guhezhu01 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Dec 31, 2024
@xiaofan-luan
Copy link
Collaborator

@guhezhu01
you need to offer full log.
Right not it seems mixcoord is not able to start

@guhezhu01
Copy link
Author

guhezhu01 commented Dec 31, 2024

@xiaofan-luan you need to offer full log. Right not it seems mixcoord is not able to start
log.txt

@xiaofan-luan
Copy link
Collaborator

From your log offered, it seems that rootcoord can't finish connect to pulsar.
The log don't show any error, so I guess pulsar hangs for a long time and connect can't not return.

Suggestion:
Try to use pulsarctl and check if pulsar can be inited and network is correct

@guhezhu01
Copy link
Author

From your log offered, it seems that rootcoord can't finish connect to pulsar. The log don't show any error, so I guess pulsar hangs for a long time and connect can't not return.

Suggestion: Try to use pulsarctl and check if pulsar can be inited and network is correct

How should I set it up? My configuration file has not been modified, why can't I start it directly? Download version 2.5.1 of the configuration file to run directly
milvus.zip

@yanliang567
Copy link
Contributor

/assign @LoveEachDay
please help to take a look

/unassign

@yanliang567 yanliang567 added help wanted Extra attention is needed and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed kind/bug Issues or changes related a bug
Projects
None yet
Development

No branches or pull requests

4 participants