Move orphaned role tests to tentative. #46769
Merged
Community-TC Integration / wpt-firefox-nightly-stability
succeeded
Jun 14, 2024 in 44m 14s
Community-TC (pull_request)
Verify that all tests affected by a pull request are stable when executed in firefox.
Details
View task in Taskcluster
View logs in Taskcluster
WPT Command: python3 ./wpt run --channel=nightly --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox
2:15.83 TEST_START: /wai-aria/role/tab-roles.html
2:15.84 INFO Closing window 0d013edd-4aa8-43c0-ba8e-9f873a8fc1e8
2:16.21 TEST_END: Test OK. Subtests passed 37/37. Unexpected 0
2:16.21 TEST_START: /wai-aria/role/tab-roles.tentative.html
2:16.21 INFO Closing window 447f87f0-a2b8-4ecc-a25c-a93c9bed582c
2:16.34 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
2:16.34 TEST_START: /wai-aria/role/table-roles.html
2:16.35 INFO Closing window c464fa55-4fe3-4ff7-b5de-3696fc6df359
2:16.47 pid:4871 [Parent 4871, Main Thread] WARNING: g_type_add_interface_static: assertion 'g_type_parent (interface_type) == G_TYPE_INTERFACE' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:187
2:16.56 TEST_END: Test OK. Subtests passed 9/9. Unexpected 0
2:16.56 TEST_START: /wai-aria/role/tree-roles.html
2:16.57 INFO Closing window 088659a6-bb9b-4389-934a-813e834156a6
2:16.77 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
2:16.77 TEST_START: /wai-aria/role/tree-roles.tentative.html
2:16.78 INFO Closing window 2c51dd9e-e840-4b28-a285-f1861b586baf
2:16.93 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
2:16.93 INFO No more tests
2:16.93 INFO No more tests
2:16.93 pid:4871 1718406322259 Marionette INFO Stopped listening on port 39361
2:17.60 INFO Browser exited with return code 0
2:17.37 INFO Closing logging queue
2:17.37 INFO queue closed
2:17.61 SUITE_END
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 1340 checks (1190 subtests, 150 tests)
Expected results: 1340
Unexpected results: 0
OK
2:17.61 INFO Got 0 unexpected results, with 0 unexpected passes
2:17.61 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
2:17.87 wptserve INFO Stopped http server on 127.0.0.1:8000
2:17.92 wptserve INFO Stopped http server on 127.0.0.1:8001
2:17.92 wptserve INFO Stopped http server on 127.0.0.1:9000
2:17.95 wptserve INFO Stopped http server on 127.0.0.1:8444
2:17.95 wptserve INFO Stopped http server on 127.0.0.1:8443
2:17.95 wptserve INFO Stopped http server on 127.0.0.1:8445
2:17.95 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
2:17.95 wptserve INFO Stopped http server on 127.0.0.1:8003
2:17.96 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
2:17.96 wptserve INFO Stopped http server on 127.0.0.1:8446
2:17.96 wptserve INFO Stopped http server on 127.0.0.1:8002
2:18.07 INFO Removed font: Ahem.ttf
2:18.10 INFO Closing logging queue
2:18.10 INFO queue closed
2:18.16 INFO ::: Ran 10 of expected 10 iterations.
2:18.16 INFO ## All results ##
2:18.16 INFO ### /html-aam/roles-generic.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `el-b` | PASS | |
2:18.16 INFO | `el-bdi` | PASS | |
2:18.16 INFO | `el-bdo` | PASS | |
2:18.16 INFO | `el-data` | PASS | |
2:18.16 INFO | `el-div` | PASS | |
2:18.16 INFO | `el-i` | PASS | |
2:18.16 INFO | `el-pre` | PASS | |
2:18.16 INFO | `el-q` | PASS | |
2:18.16 INFO | `el-samp` | PASS | |
2:18.16 INFO | `el-small` | PASS | |
2:18.16 INFO | `el-span` | PASS | |
2:18.16 INFO | `el-u` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /html-aam/roles-generic.tentative.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `el-li-orphaned` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/grid-roles.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |-------------------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `role is grid` | PASS | |
2:18.16 INFO | `role is row (in grid)` | PASS | |
2:18.16 INFO | `role is columnheader (in row, in grid)` | PASS | |
2:18.16 INFO | `role is rowheader (in row, in grid)` | PASS | |
2:18.16 INFO | `role is gridcell (in row, in grid)` | PASS | |
2:18.16 INFO | `role is rowgroup (in grid)` | PASS | |
2:18.16 INFO | `role is row (in rowgroup, in grid)` | PASS | |
2:18.16 INFO | `role is columnheader (in row, in rowgroup, in grid)` | PASS | |
2:18.16 INFO | `role is rowheader (in row, in rowgroup, in grid)` | PASS | |
2:18.16 INFO | `role is gridcell (in row, in rowgroup, in grid)` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/grid-roles.tentative.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |-----------------------------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `orphaned button with gridcell role outside the context of row` | PASS | |
2:18.16 INFO | `orphaned row outside the context of table` | PASS | |
2:18.16 INFO | `orphaned rowgroup outside the context of row` | PASS | |
2:18.16 INFO | `orphaned div with gridcell role outside the context of row` | PASS | |
2:18.16 INFO | `orphaned rowheader outside the context of row` | PASS | |
2:18.16 INFO | `orphaned columnheader outside the context of row` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/list-roles.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |-------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `first simple list` | PASS | |
2:18.16 INFO | `first simple listitem` | PASS | |
2:18.16 INFO | `last simple listitem` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/list-roles.tentative.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |---------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `orphan p with listitem role` | PASS | |
2:18.16 INFO | `orphan div with listitem role` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/listbox-roles.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |---------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `div role is listbox` | PASS | |
2:18.16 INFO | `role is option (in div listbox)` | PASS | |
2:18.16 INFO | `role is group (in div listbox)` | PASS | |
2:18.16 INFO | `role is option (in group, in div listbox)` | PASS | |
2:18.16 INFO | `ul role is listbox` | PASS | |
2:18.16 INFO | `li role is option (in ul listbox)` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/listbox-roles.tentative.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |--------------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `orphaned option outside the context of listbox` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/menu-roles.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |---------------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `role is menu` | PASS | |
2:18.16 INFO | `role is menuitem (in menu)` | PASS | |
2:18.16 INFO | `role is group (in menu)` | PASS | |
2:18.16 INFO | `role is menuitem (in group, in menu)` | PASS | |
2:18.16 INFO | `role is menuitemradio (in group, in menu)` | PASS | |
2:18.16 INFO | `role is menuitemcheckbox (in group, in menu)` | PASS | |
2:18.16 INFO | `role is menubar` | PASS | |
2:18.16 INFO | `role is menuitem (in menubar)` | PASS | |
2:18.16 INFO | `role is group (in menubar)` | PASS | |
2:18.16 INFO | `role is menuitem (in group, in menubar)` | PASS | |
2:18.16 INFO | `role is menuitemradio (in group, in menubar)` | PASS | |
2:18.16 INFO | `role is menuitemcheckbox (in group, in menubar)` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/menu-roles.tentative.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |-----------------------------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `orphaned menuitem outside the context of menu/menubar` | PASS | |
2:18.16 INFO | `orphaned menuitemradio outside the context of menu/menubar` | PASS | |
2:18.16 INFO | `orphaned menuitemcheckbox outside the context of menu/menubar` | PASS | |
2:18.16 INFO | `orphan button with menuitem role` | PASS | |
2:18.16 INFO | `orphan button with menuitemcheckbox role` | PASS | |
2:18.16 INFO | `orphan button with menuitemradio role` | PASS | |
2:18.16 INFO | `orphan div with menuitem role` | PASS | |
2:18.16 INFO | `orphan div with menuitemcheckbox role` | PASS | |
2:18.16 INFO | `orphan div with menuitemradio role` | PASS | |
2:18.16 INFO
2:18.16 INFO ### /wai-aria/role/tab-roles.html ###
2:18.16 INFO | Subtest | Results | Messages |
2:18.16 INFO |----------------------------------------------------------------------------------|---------|----------|
2:18.16 INFO | | OK | |
2:18.16 INFO | `div role is tablist` | PASS | |
2:18.16 INFO | `role is tab (in div tablist)` | PASS | |
2:18.16 INFO | `role is tabpanel (with sibling div tablist)` | PASS | |
2:18.16 INFO | `div role is tablist (with selection)` | PASS | |
2:18.16 INFO | `role is tab and tab is selected` | PASS | |
2:18.16 INFO | `role is tab and tab is not selected` | PASS | |
2:18.17 INFO | `role is tabpanel (faux selected)` | PASS | |
2:18.17 INFO | `role is tabpanel (faux unselected)` | PASS | |
2:18.17 INFO | `div role is tablist (with selection, roving tabindex)` | PASS | |
2:18.17 INFO | `role is tab, tab is selected and in tab order` | PASS | |
2:18.17 INFO | `role is tab and tab is not selected, not tabbable` | PASS | |
2:18.17 INFO | `role is tab and tab is not selected, not tabbable (duplicate)` | PASS | |
2:18.17 INFO | `role is tabpanel with selection, roving tabindex` | PASS | |
2:18.17 INFO | `role is tabpanel with selection, roving tabindex (duplicate)` | PASS | |
2:18.17 INFO | `role is tabpanel with selection, roving tabindex (duplicate 2)` | PASS | |
2:18.17 INFO | `div role is tablist (with non-empty tabpanel)` | PASS | |
2:18.17 INFO | `role is tab and tab is selected (with non-empty tabpanel content)` | PASS | |
2:18.17 INFO | `role is tab and tab is not selected (with non-empty tabpanel content)` | PASS | |
2:18.17 INFO | `role is tabpanel with selection, non-empty content` | PASS | |
2:18.17 INFO | `role is tabpanel with selection, non-empty content (duplicate)` | PASS | |
2:18.17 INFO | `div role is tablist (with non-empty tabpanel and aria-controls)` | PASS | |
2:18.17 INFO | `role is tab, tab is selected (with aria-controls)` | PASS | |
2:18.17 INFO | `role is tab, tab is not selected (with aria-controls)` | PASS | |
2:18.17 INFO | `role is tabpanel with aria-controls and non-empty content` | PASS | |
2:18.17 INFO | `role is tabpanel with aria-controls and non-empty content (duplicate)` | PASS | |
2:18.17 INFO | `div role for button parent container is tablist` | PASS | |
2:18.17 INFO | `button role is tab (in div tablist)` | PASS | |
2:18.17 INFO | `ul role is tablist` | PASS | |
2:18.17 INFO | `role is tab (within li), tab is selected and in tab order` | PASS | |
2:18.17 INFO | `role is tab (within li), tab is not selected and in tab order` | PASS | |
2:18.17 INFO | `role is tabpanel as sibling to ul` | PASS | |
2:18.17 INFO | `role is tabpanel as sibling to ul (duplicate)` | PASS | |
2:18.17 INFO | `ul role is tablist (child li have role none)` | PASS | |
2:18.17 INFO | `role is tab (within li with role none), tab is selected and in tab order` | PASS | |
2:18.17 INFO | `role is tab (within li with role none), tab is not selected and in tab order` | PASS | |
2:18.17 INFO | `role is tabpanel as sibling to ul with child role none li elements` | PASS | |
2:18.17 INFO | `role is tabpanel as sibling to ul with child role none li elements (duplicate)` | PASS | |
2:18.17 INFO
2:18.17 INFO ### /wai-aria/role/tab-roles.tentative.html ###
2:18.17 INFO | Subtest | Results | Messages |
2:18.17 INFO |-------------------------------|---------|----------|
2:18.17 INFO | | OK | |
2:18.17 INFO | `orphan button with tab role` | PASS | |
2:18.17 INFO | `orphan span with tab role` | PASS | |
2:18.17 INFO
2:18.17 INFO ### /wai-aria/role/table-roles.html ###
2:18.17 INFO | Subtest | Results | Messages |
2:18.17 INFO |-------------------------------------------------------------------------------------------------------|---------|----------|
2:18.17 INFO | | OK | |
2:18.17 INFO | `div role is caption (in div with table role)` | PASS | |
2:18.17 INFO | `orphan p role is caption` | PASS | |
2:18.17 INFO | `span role is cell (in div with row role, in div with rowgroup role, in div with table role)` | PASS | |
2:18.17 INFO | `orphan span role is cell` | PASS | |
2:18.17 INFO | `span role is columnheader (in div with row role, in div with rowgroup role, in div with table role)` | PASS | |
2:18.17 INFO | `div role is row (in div with rowgroup role, in div with table role)` | PASS | |
2:18.17 INFO | `div role is rowgroup (in div with table role)` | PASS | |
2:18.17 INFO | `role is rowheader (in div with row role, in div with rowgroup role, in div with table role)` | PASS | |
2:18.17 INFO | `div role is table` | PASS | |
2:18.17 INFO
2:18.17 INFO ### /wai-aria/role/tree-roles.html ###
2:18.17 INFO | Subtest | Results | Messages |
2:18.17 INFO |--------------------------------------------|---------|----------|
2:18.17 INFO | | OK | |
2:18.17 INFO | `role is tree` | PASS | |
2:18.17 INFO | `role is treeitem (in tree)` | PASS | |
2:18.17 INFO | `role is group (in treeitem)` | PASS | |
2:18.17 INFO | `role is treeitem (in group, in treeitem)` | PASS | |
2:18.17 INFO | `role is treegrid` | PASS | |
2:18.17 INFO | `role is row (in treegrid)` | PASS | |
2:18.17 INFO | `role is gridcell (in row, in treegrid)` | PASS | |
2:18.17 INFO
2:18.17 INFO ### /wai-aria/role/tree-roles.tentative.html ###
2:18.17 INFO | Subtest | Results | Messages |
2:18.17 INFO |-----------------------------------------------------------|---------|----------|
2:18.17 INFO | | OK | |
2:18.17 INFO | `orphaned treeitem outside the context of tree` | PASS | |
2:18.17 INFO | `orphaned button with treeitem role outside tree context` | PASS | |
2:18.17 INFO
2:18.17 INFO ::: Running tests in a loop with restarts 10 times : PASS
2:18.17 INFO :::
2:18.17 INFO ::: Test verification PASS
2:18.17 INFO :::
[taskcluster 2024-06-14 23:05:25.386Z] === Task Finished ===
[taskcluster 2024-06-14 23:05:25.758Z] Successful task run with exit code: 0 completed in 288.86 seconds
Loading