Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [1.5.0]spark-QueueResources parameters are not being applied #5040

Closed
1 of 2 tasks
gjy1043 opened this issue Dec 13, 2023 · 1 comment · Fixed by #5045
Closed
1 of 2 tasks

[Bug] [1.5.0]spark-QueueResources parameters are not being applied #5040

gjy1043 opened this issue Dec 13, 2023 · 1 comment · Fixed by #5045
Labels
bug Something isn't working

Comments

@gjy1043
Copy link

gjy1043 commented Dec 13, 2023

Search before asking

  • I searched the issues and found no similar issues.

Linkis Component

linkis-computation-governance

Steps to reproduce

Setting wds.linkis.rm.instance=5 and then submit 10 spark tasks in parallel, but check that 10 engines are actually launched:
企业微信截图_17024606236132
企业微信截图_17024606326712

Expected behavior

setting paramaters are effective

Your environment

  • Linkis version used: 1.5.0
  • Environment name and version:
    • spark-3.2.1

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@gjy1043 gjy1043 added the bug Something isn't working label Dec 13, 2023
Copy link

😊 Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context.
We will be here shortly.

If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
👉 How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

Name Description Subscribe Unsubscribe Archive
[email protected] community activity information subscribe unsubscribe archive

@gjy1043 gjy1043 changed the title [Bug] [1.5.0]spark-QueueResources parameters is not being applied [Bug] [1.5.0]spark-QueueResources parameters are not being applied Dec 13, 2023
peacewong added a commit to WeDataSphere/linkis that referenced this issue Dec 16, 2023
casionone pushed a commit that referenced this issue Dec 17, 2023
* Fix user conf resuource are not being applied close #5040

* Fix datasource module build

* Update entrance ha default switch offf
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant