Skip to content

Adds new lint rule to detect test overlap in web feature files #58827

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
ChrisC wants to merge 3 commits into
base: master
Choose a base branch
from

silence existing overlap lint errors

5478467
Select commit
Loading
Failed to load commit list.
Draft

Adds new lint rule to detect test overlap in web feature files #58827

silence existing overlap lint errors
5478467
Select commit
Loading
Failed to load commit list.
Community-TC Integration / infrastructure/ tests (chrome) succeeded Mar 27, 2026 in 8m 37s

Community-TC (pull_request)

Smoketests for wptrunner in chrome.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-03-27T21:42:02.719Z
Resolved: 2026-03-27T21:46:57.001Z
Task Execution Time: 4 minutes, 54 seconds, 282 milliseconds
Task Status: completed
Reason Resolved: completed
TaskId: YabzujtkR46aUyEnRX7z2g
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
- public/results/wptreport-chrome.json.gz

WPT Command: python3 ./wpt run --log-tbpl=- --log-wptreport=../artifacts/wptreport-chrome.json --logcat-dir=../artifacts/ --metadata=infrastructure/metadata/ --include=infrastructure/ --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome

[taskcluster 2026-03-27 21:42:02.784Z] Task ID: YabzujtkR46aUyEnRX7z2g
[taskcluster 2026-03-27 21:42:02.784Z] Worker ID: 5481350846642606814
[taskcluster 2026-03-27 21:42:02.784Z] Worker Group: us-east1-d
[taskcluster 2026-03-27 21:42:02.784Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-03-27 21:42:02.784Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-03-27 21:42:02.784Z] Worker Version: 46.1.0
[taskcluster 2026-03-27 21:42:02.784Z] Public IP: 34.74.156.202
[taskcluster 2026-03-27 21:42:02.784Z] Hostname: proj-wpt-ci-nc859-sirpmcrmi7-ijryg

[taskcluster 2026-03-27 21:42:03.936Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(2483 lines hidden)...

TEST-PASS | /infrastructure/testdriver/click_nested_crossorigin.sub.html | TestDriver click method with multiple windows and nested iframe
 2:33.24 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_nested_crossorigin.sub.html | took 1125ms
 2:33.24 TEST_START: /infrastructure/testdriver/click_window.html
TEST-START | /infrastructure/testdriver/click_window.html
TEST-PASS | /infrastructure/testdriver/click_window.html | TestDriver click method in window
 2:33.87 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/click_window.html | took 635ms
 2:33.87 TEST_START: /infrastructure/testdriver/delete_all_cookies.html
TEST-START | /infrastructure/testdriver/delete_all_cookies.html
TEST-PASS | /infrastructure/testdriver/delete_all_cookies.html | DOM-set cookies get deleted
TEST-PASS | /infrastructure/testdriver/delete_all_cookies.html | HTTP-set cookies get deleted
 2:34.38 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/delete_all_cookies.html | took 507ms
 2:34.38 TEST_START: /infrastructure/testdriver/file_upload.sub.html
TEST-START | /infrastructure/testdriver/file_upload.sub.html
TEST-PASS | /infrastructure/testdriver/file_upload.sub.html | File upload using testdriver
 2:34.84 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/file_upload.sub.html | took 456ms
 2:34.84 TEST_START: /infrastructure/testdriver/generate_test_report.html
TEST-START | /infrastructure/testdriver/generate_test_report.html
TEST-PASS | /infrastructure/testdriver/generate_test_report.html | TestDriver generate_test_report method
 2:35.21 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/generate_test_report.html | took 372ms
 2:35.21 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.html
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.html | Get all HTTP cookies
 2:35.56 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.html | took 355ms
 2:35.56 TEST_START: /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-START | /infrastructure/testdriver/get_all_cookies.sub.https.html
TEST-PASS | /infrastructure/testdriver/get_all_cookies.sub.https.html | Get all HTTPS cookies
 2:36.00 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_all_cookies.sub.https.html | took 436ms
 2:36.00 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.html
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.html | Get Named HTTP cookie
 2:36.51 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.html | took 511ms
 2:36.51 TEST_START: /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-START | /infrastructure/testdriver/get_named_cookie.sub.https.html
TEST-PASS | /infrastructure/testdriver/get_named_cookie.sub.https.html | Get Named HTTPS cookie
 2:37.04 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/get_named_cookie.sub.https.html | took 531ms
 2:37.04 TEST_START: /infrastructure/testdriver/send_keys.html
TEST-START | /infrastructure/testdriver/send_keys.html
 2:37.50 pid:7524 [7575:7575:0327/214647.882562:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:253] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 7524 | [7575:7575:0327/214647.882562:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:253] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
 2:37.50 pid:7524 [7575:7575:0327/214647.884452:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:253] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
PID 7524 | [7575:7575:0327/214647.884452:ERROR:gpu/command_buffer/service/shared_image/shared_image_manager.cc:253] SharedImageManager::ProduceSkia: Trying to Produce a Skia representation from a non-existent mailbox.
TEST-PASS | /infrastructure/testdriver/send_keys.html | TestDriver send keys method
 2:37.54 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testdriver/send_keys.html | took 498ms
 2:37.54 TEST_START: /infrastructure/testdriver/set_get_window_rect.html
TEST-START | /infrastructure/testdriver/set_get_window_rect.html
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Position
TEST-PASS | /infrastructure/testdriver/set_get_window_rect.html | Window Size
 2:37.95 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_get_window_rect.html | took 405ms
 2:37.95 TEST_START: /infrastructure/testdriver/set_permission.https.html
TEST-START | /infrastructure/testdriver/set_permission.https.html
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Grant Permission
TEST-PASS | /infrastructure/testdriver/set_permission.https.html | Deny Permission
 2:38.30 TEST_END: Test OK. Subtests passed 2/2. Unexpected 0
TEST-OK | /infrastructure/testdriver/set_permission.https.html | took 349ms
 2:38.30 TEST_START: /infrastructure/testdriver/virtual_authenticator.html
TEST-START | /infrastructure/testdriver/virtual_authenticator.html
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can create an authenticator
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can add a credential
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can get the credentials
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a credential
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove all credentials
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can set user verified
TEST-PASS | /infrastructure/testdriver/virtual_authenticator.html | Can remove a virtual authenticator
 2:38.85 TEST_END: Test OK. Subtests passed 7/7. Unexpected 0
TEST-OK | /infrastructure/testdriver/virtual_authenticator.html | took 550ms
 2:38.85 TEST_START: /infrastructure/testharness/full.stop/full-stop.html
TEST-START | /infrastructure/testharness/full.stop/full-stop.html
TEST-PASS | /infrastructure/testharness/full.stop/full-stop.html | full-stop
 2:39.16 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/testharness/full.stop/full-stop.html | took 312ms
 2:39.16 TEST_START: /infrastructure/testharness/lone-surrogates.html
TEST-START | /infrastructure/testharness/lone-surrogates.html
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate U+d800 in name
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate U+d800 in name - assert_true: expected true got false
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:14)
    at Test.step (http://web-platform.test:8000/resources/testharness.js:2869:25)
    at test (http://web-platform.test:8000/resources/testharness.js:633:30)
    at http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:7:3
TEST-PASS | /infrastructure/testharness/lone-surrogates.html | passing test with lone surrogate in assert
TEST-FAIL | /infrastructure/testharness/lone-surrogates.html | failing test with lone surrogate in assert - assert_true: lone U+d800 surrogate expected true got false
    at Test.<anonymous> (http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:14)
    at Test.step (http://web-platform.test:8000/resources/testharness.js:2869:25)
    at test (http://web-platform.test:8000/resources/testharness.js:633:30)
    at http://web-platform.test:8000/infrastructure/testharness/lone-surrogates.html:9:3
 2:39.46 TEST_END: Test OK. Subtests passed 2/4. Unexpected 0
TEST-OK | /infrastructure/testharness/lone-surrogates.html | took 297ms
 2:39.46 TEST_START: /infrastructure/window/minimize-1.html
TEST-START | /infrastructure/window/minimize-1.html
TEST-PASS | /infrastructure/window/minimize-1.html | Minimize a window
 2:39.79 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-1.html | took 329ms
 2:39.79 TEST_START: /infrastructure/window/minimize-2.html
TEST-START | /infrastructure/window/minimize-2.html
TEST-PASS | /infrastructure/window/minimize-2.html | Use testdriver to check window is not minimized
 2:40.05 TEST_END: Test OK. Subtests passed 1/1. Unexpected 0
TEST-OK | /infrastructure/window/minimize-2.html | took 265ms
 2:40.05 INFO Restarting browser for new test group
Restarting browser for new test group
 2:40.16 INFO Closing logging queue
Closing logging queue
 2:40.16 INFO queue closed
queue closed
 2:40.25 INFO Starting WebDriver: /home/test/web-platform-tests/_venv3/bin/chrome/chromedriver --port=40601 --ignore-explicit-port --url-base=/ --enable-chrome-logs --disable-build-check
Starting WebDriver: /home/test/web-platform-tests/_venv3/bin/chrome/chromedriver --port=40601 --ignore-explicit-port --url-base=/ --enable-chrome-logs --disable-build-check
 2:40.27 INFO Got WebDriver port 46699
Got WebDriver port 46699
 2:40.36 pid:8199 Full command: /home/test/web-platform-tests/_venv3/bin/chrome/chromedriver --port=40601 --ignore-explicit-port --url-base=/ --enable-chrome-logs --disable-build-check
pid:8199 Starting ChromeDriver 148.0.7758.0 (7953318737967d7f49171580097aa6111c04e339-refs/branch-heads/7758@{#1}) on port 0
PID 8199 | Starting ChromeDriver 148.0.7758.0 (7953318737967d7f49171580097aa6111c04e339-refs/branch-heads/7758@{#1}) on port 0
 2:40.36 pid:8199 Only local connections are allowed.
PID 8199 | Only local connections are allowed.
 2:40.36 pid:8199 Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
PID 8199 | Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
 2:40.36 pid:8199 ChromeDriver was started successfully on port 46699.
PID 8199 | ChromeDriver was started successfully on port 46699.
 2:40.36 INFO Webdriver started successfully.
Webdriver started successfully.
 2:40.36 INFO Starting runner
Starting runner
 2:41.13 pid:8199 [8251:8251:0327/214651.509944:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
PID 8199 | [8251:8251:0327/214651.509944:WARNING:sandbox/policy/linux/sandbox_linux.cc:404] InitializeSandbox() called with multiple threads in process gpu-process.
 2:41.13 pid:8199 [8251:8251:0327/214651.515473:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
PID 8199 | [8251:8251:0327/214651.515473:WARNING:ui/gfx/linux/gbm_support_x11.cc:48] dri3 extension not supported.
 2:41.17 pid:8199 [1774648011.549][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
PID 8199 | [1774648011.549][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 2:41.34 pid:8199 [8216:8216:0327/214651.721034:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
PID 8199 | [8216:8216:0327/214651.721034:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= /org/freedesktop/UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 2:41.34 pid:8199 [8216:8216:0327/214651.721050:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
PID 8199 | [8216:8216:0327/214651.721050:WARNING:dbus/property.cc:174] GetAll request failed for: org.freedesktop.UPower.Device
 2:41.35 pid:8199 [8216:8216:0327/214651.733899:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
PID 8199 | [8216:8216:0327/214651.733899:WARNING:ui/base/idle/idle_linux.cc:111] None of the known D-Bus ScreenSaver services could be used.
 2:41.51 TEST_START: /infrastructure/crashtests/example.html
TEST-START | /infrastructure/crashtests/example.html
 2:41.89 TEST_END: PASS
TEST-PASS | /infrastructure/crashtests/example.html | took 383ms
 2:41.89 TEST_START: /infrastructure/crashtests/testdriver.html
TEST-START | /infrastructure/crashtests/testdriver.html
 2:42.06 TEST_END: PASS
TEST-PASS | /infrastructure/crashtests/testdriver.html | took 167ms
 2:42.06 INFO No more tests
No more tests
 2:42.11 INFO Closing logging queue
Closing logging queue
 2:42.11 INFO queue closed
queue closed
 2:42.20 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 443 checks (254 subtests, 189 tests)
Expected results: 441
Skipped: 2 tests
Unexpected results: 0
OK
SUITE-END | took 147s
 2:42.20 INFO Got 0 unexpected results, with 0 unexpected passes
Got 0 unexpected results, with 0 unexpected passes
 2:42.20 wptserve INFO Stopped http server on 127.0.0.1:8002
wptserve Stopped http server on 127.0.0.1:8002
 2:42.20 wptserve INFO Stopped http server on 127.0.0.1:8001
wptserve Stopped http server on 127.0.0.1:8001
 2:42.20 wptserve INFO Stopped http server on 127.0.0.1:8000
wptserve Stopped http server on 127.0.0.1:8000
 2:42.20 wptserve INFO Stopped http server on 127.0.0.1:8003
wptserve Stopped http server on 127.0.0.1:8003
 2:42.21 wptserve INFO Stopped http server on 127.0.0.1:8443
wptserve Stopped http server on 127.0.0.1:8443
 2:42.22 wptserve INFO Stopped http server on 127.0.0.1:8445
wptserve Stopped http server on 127.0.0.1:8445
 2:42.22 wptserve INFO Stopped http server on 127.0.0.1:8446
wptserve Stopped http server on 127.0.0.1:8446
 2:42.22 wptserve INFO Stopped http server on 127.0.0.1:8444
wptserve Stopped http server on 127.0.0.1:8444
 2:42.22 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 2:42.25 wptserve INFO Stopped http server on 127.0.0.1:9000
wptserve Stopped http server on 127.0.0.1:9000
 2:42.35 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 2:42.62 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 2:42.66 INFO Removed font: Ahem.ttf
Removed font: Ahem.ttf
 2:42.69 INFO Closing logging queue
Closing logging queue
 2:42.69 INFO queue closed
queue closed
[taskcluster 2026-03-27 21:46:54.389Z] === Task Finished ===
[taskcluster 2026-03-27 21:46:55.105Z] Successful task run with exit code: 0 completed in 292.322 seconds
View more details on Community-TC Integration