Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better scheduling and observability of the function image build process #10040

Closed
kwiatekus opened this issue Nov 25, 2020 · 0 comments
Closed
Assignees
Labels
area/serverless Issues or PRs related to serverless Epic kind/feature Categorizes issue or PR as related to a new feature. wontfix This will not be worked on
Milestone

Comments

@kwiatekus
Copy link
Contributor

kwiatekus commented Nov 25, 2020

Description

Improve function build mechanism so that it builds function images according to the configuration:

  • number of parallel builds
  • computational resources for build runner
  • target docker registry where the image should be pushed (changeable in the runtime, not at installation time)

Collect the following metrics:

  • number of builds
  • build error rate
  • max queue size (peak value)
  • average build time

Define default configuration per profile, ie:

  • single build allowed at a time in evaluation profile. Additional build requests would need to be queued.
  • 5 (?) simultaneous builds allowed in production. Anything beyond the limit goes into queue.

Build runner must not be a privileged container (see issue)

Reasons

Currently the build process execution time cannot be controlled. If 100 functions are pushed at once, all 100 build jobs will be scheduled simultaneously, trying to get computational resources.
In the future, we plan to have a central, multi-tenant build service. In order to evolve in this direction we need to introduce build scheduling already in single tenant mode inside kyma runtime.
Please keep the future vision in mind. Try to implement the build service so it would fit into multi-tenant mode.

@kwiatekus kwiatekus added kind/feature Categorizes issue or PR as related to a new feature. area/serverless Issues or PRs related to serverless labels Nov 25, 2020
@kwiatekus kwiatekus added this to the 1.19 milestone Nov 25, 2020
@kwiatekus kwiatekus added the Epic label Nov 25, 2020
@kwiatekus kwiatekus self-assigned this Nov 25, 2020
@kwiatekus kwiatekus modified the milestones: 1.19, 1.20 Dec 1, 2020
@kwiatekus kwiatekus modified the milestones: 1.20, Future Jan 21, 2021
@kwiatekus kwiatekus added the wontfix This will not be worked on label Mar 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/serverless Issues or PRs related to serverless Epic kind/feature Categorizes issue or PR as related to a new feature. wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

1 participant