Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add punet benchmarking to the regression suite #19088

Merged
merged 13 commits into from
Nov 13, 2024
Merged

Add punet benchmarking to the regression suite #19088

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
bfd9d56
initial testing of punet
saienduri Nov 8, 2024
e6a597d
change outputs and mlirs
saienduri Nov 9, 2024
a4d128f
lint
Nov 9, 2024
2fb0a17
add xfail for mi250 compile and change vmfb names
saienduri Nov 9, 2024
6911ec3
add back hz fusion
saienduri Nov 9, 2024
b0da27e
add fp8 benchmarks
saienduri Nov 11, 2024
c3a38e7
lint
Nov 11, 2024
acfcd6e
add timeouts and update golden values
saienduri Nov 11, 2024
ec222cf
update per test timeout
saienduri Nov 11, 2024
f255095
update fp8 dispatch count
saienduri Nov 11, 2024
8a61b66
back to 1564
saienduri Nov 11, 2024
81e5bc2
try the latest spec
saienduri Nov 12, 2024
9aaf517
update outs for fp16 and fp8
saienduri Nov 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 11 additions & 3 deletions .github/workflows/pkgci_regression_test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,7 @@ jobs:
--no-skip-tests-missing-files \
--capture=no \
--log-cli-level=info \
--timeout=1200 \
--timeout=240 \
--durations=0 \
--config-files=${MODELS_CONFIG_FILE_PATH}

Expand Down Expand Up @@ -189,7 +189,7 @@ jobs:
-rpfE \
--capture=no \
--log-cli-level=info \
--timeout=1200 \
--timeout=240 \
--durations=0
env:
ROCM_CHIP: ${{ matrix.rocm-chip }}
Expand All @@ -203,7 +203,7 @@ jobs:
-rpfE \
--capture=no \
--log-cli-level=info \
--timeout=1200 \
--timeout=240 \
--durations=0
env:
ROCM_CHIP: ${{ matrix.rocm-chip }}
Expand All @@ -227,6 +227,7 @@ jobs:
--goldensize-rocm-clip-bytes 860000 \
--goldensize-rocm-vae-bytes 840000 \
--rocm-chip gfx90a \
--timeout=240 \
--log-cli-level=info \
--retries 7
echo "$(<job_summary.md )" >> $GITHUB_STEP_SUMMARY
Expand All @@ -247,7 +248,14 @@ jobs:
--goldensize-rocm-unet-bytes 2270000 \
--goldensize-rocm-clip-bytes 860000 \
--goldensize-rocm-vae-bytes 840000 \
--goldentime-rocm-punet-int8-fp16-ms 55 \
--goldendispatch-rocm-punet-int8-fp16 1284 \
--goldensize-rocm-punet-int8-fp16-bytes 2560000 \
--goldentime-rocm-punet-int8-fp8-ms 59 \
--goldendispatch-rocm-punet-int8-fp8 1564 \
--goldensize-rocm-punet-int8-fp8-bytes 2800000 \
--rocm-chip gfx942 \
--log-cli-level=info \
--timeout=240 \
--retries 7
echo "$(<job_summary.md )" >> $GITHUB_STEP_SUMMARY
Loading
Loading