Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove obsolete 'experimentalAlignedExceptEdge' admin flag #2433

Merged
merged 3 commits into from
Mar 9, 2021

Conversation

stephenmcgruer
Copy link
Contributor

@stephenmcgruer stephenmcgruer commented Mar 4, 2021

This flag was used to fetch edge runs back when they were not tagged
with the experimental label. It is no longer useful, and is also
misleading (the name implies it might remove Edge from the default
query, which it does not do). See
#2431 (comment)

This change also makes util/populate_dev_data.go closer to what is
shipped on wpt.fyi - the flags are updated and a new Edge experimental
test run is added for the local testing sha. The data for that run is a copy
of the Edge stable data for the same sha.

Finally, the webdriver/ README.md file is extensively updated with more
description and a lot of debugging tips I've discovered over the last day!

This flag was used to fetch edge runs back when they were not tagged
with the experimental label. It is no longer useful, and is also
misleading (the name implies it might remove Edge from the default
query, which it does not do). As such, remove it.

This also makes util/populate_dev_data.go closer to what is shipped on
wpt.fyi
@stephenmcgruer
Copy link
Contributor Author

(I believe this is a real failure; can reproduce locally and it goes away when I revert. Will dig in.)

This adds a test run for edge experimental on the testing sha
24278ab. It reuses the same json results as edge[stable]. The goal is
to make the webdriver tests more like reality (e.g. there should be 4
experimental browsers by default) and to allow us to remove the obsolete
experimentalAlignedExceptEdge flag (which is off in prod/staging but
still on for the dev server!)
@stephenmcgruer stephenmcgruer force-pushed the smcgruer/remove-old-flag branch from 3a0f20e to f5d8f6c Compare March 5, 2021 15:11
@stephenmcgruer stephenmcgruer force-pushed the smcgruer/remove-old-flag branch from f5d8f6c to 42d650e Compare March 5, 2021 15:14
@stephenmcgruer stephenmcgruer requested a review from KyleJu March 5, 2021 15:16
@stephenmcgruer
Copy link
Contributor Author

@KyleJu I've made non-trivial changes, please re-review. Thanks!

@KyleJu
Copy link
Collaborator

KyleJu commented Mar 9, 2021

LGTM. Thanks Stephen!

@stephenmcgruer stephenmcgruer merged commit c2418df into main Mar 9, 2021
@stephenmcgruer stephenmcgruer deleted the smcgruer/remove-old-flag branch March 9, 2021 17:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants