Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci(build-and-test): use self hosted X64 and add ccache to -daily #9601

Merged
merged 3 commits into from
Dec 10, 2024

Conversation

xmfcx
Copy link
Contributor

@xmfcx xmfcx commented Dec 9, 2024

Description

It seems I forgot to add ccache to the daily, It uses the cache now. (Doesn't update it, since it runs daily, no need).

This PR makes:

  • build-and-test.yaml
  • build-and-test-daily.yaml
    workflows use the self hosted machines.

For now, they will use the ovh-runner-01
Specs:

 OS: Ubuntu 22.04 jammy
 Kernel: x86_64 Linux 5.15.0-126-generic
 Disk: 5.0G / 429G (2%)
 CPU: Intel Xeon D-2141I @ 16x 3GHz [28.0°C]
 RAM: 3978MiB / 31754MiB

They can also use leo-copper since it covers the same labels too.

Related links

Parent Issue:

How was this PR tested?

(Updated ✅)

Notes for reviewers

None.

Interface changes

None.

Effects on system behavior

None.

@xmfcx xmfcx requested a review from mitsudome-r December 9, 2024 22:32
@github-actions github-actions bot added the type:ci Continuous Integration (CI) processes and testing. (auto-assigned) label Dec 9, 2024
@xmfcx xmfcx self-assigned this Dec 9, 2024
Copy link

github-actions bot commented Dec 9, 2024

Thank you for contributing to the Autoware project!

🚧 If your pull request is in progress, switch it to draft mode.

Please ensure:

@xmfcx xmfcx added the run:build-and-test-differential Mark to enable build-and-test-differential workflow. (used-by-ci) label Dec 9, 2024
@xmfcx
Copy link
Contributor Author

xmfcx commented Dec 9, 2024

I forgot to add

env:
  CC: /usr/lib/ccache/gcc
  CXX: /usr/lib/ccache/g++

variables so they didn't make use of the downloaded cache. Will fix tomorrow.

Copy link

codecov bot commented Dec 10, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 29.53%. Comparing base (ca507d6) to head (c9a3b1a).
Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #9601      +/-   ##
==========================================
- Coverage   29.60%   29.53%   -0.07%     
==========================================
  Files        1443     1442       -1     
  Lines      108516   108514       -2     
  Branches    41385    41410      +25     
==========================================
- Hits        32122    32048      -74     
- Misses      72999    73349     +350     
+ Partials     3395     3117     -278     
Flag Coverage Δ
total 29.53% <ø> (-0.07%) ⬇️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Signed-off-by: M. Fatih Cırıt <[email protected]>
Signed-off-by: M. Fatih Cırıt <[email protected]>
@xmfcx
Copy link
Contributor Author

xmfcx commented Dec 10, 2024

Considering we have 10 CUDA packages:

$ grep -rl "find_package(CUDA)" src/ | awk -F'/' '{print $(NF-1)}'
autoware_shape_estimation
autoware_tensorrt_common
autoware_traffic_light_fine_detector
autoware_tensorrt_yolox
autoware_traffic_light_classifier
autoware_lidar_transfusion
autoware_lidar_centerpoint
autoware_image_projection_based_fusion
autoware_tensorrt_classifier
autoware_cuda_utils
Machine Cores Available Workflow Packages Duration Avg Time per Package
leo-copper 4c8t build-and-test-daily (humble) 287 30m 59s 6.48s
ovh-runner-01 8c16t build-and-test-daily (humble, -cuda) 297 25m 24s 5.14s
aws-codebuild 6c6t build-and-test (cuda) 297 29m 22s 5.93s

Codebuild machines seem to have good single core performance from these tests.

Also leo-copper machine was removed from the runners list.

@xmfcx xmfcx merged commit 8ba1699 into main Dec 10, 2024
36 of 37 checks passed
@xmfcx xmfcx deleted the ci/build-and-test-runner branch December 10, 2024 13:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run:build-and-test-differential Mark to enable build-and-test-differential workflow. (used-by-ci) type:ci Continuous Integration (CI) processes and testing. (auto-assigned)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants