Issue 1507761 in chromium: WPT private-access-network are flaky

[phao via monorail]

Updates:
Cc: jap...@chromium.org blink-ne...@chromium.org

Comment #32 on issue 1507761 by ph...@chromium.org: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c32

Issue 1502533 has been merged into this issue.

--
You received this message because:
1. You were specifically CC'd on the issue

You may adjust your notification preferences at:
https://bugs.chromium.org/hosting/settings

Reply to this email to add a comment or make updates.

[shameerd via monorail]

Updates:
Labels: -Top-Flakes Was-Top-Flakes

Comment #33 on issue 1507761 by sham...@google.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c33

We did not see more build failure caused by this cluster in the past 7 days. But it's still flaky, please continue working on the bug to help improve the stability of Chrome CI/CQ.

[luci-analysis-service via monorail]

Updates:
Status: Verified

Comment #34 on issue 1507761 by luci-analy...@luci-analysis.iam.gserviceaccount.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c34

Because the following problem(s) have stopped:
- many gardened builders are failing (P1)
The bug has been verified.

Why issues are verified: https://luci-analysis.appspot.com/help#bug-verified
See failure impact and configure the failure association rule for this bug at: https://luci-analysis.appspot.com/p/chromium/rules/d49c7936f9f4d371117694216b89fc19

[hayato via monorail]

Updates:
Status: Assigned

Comment #35 on issue 1507761 by hay...@chromium.org: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c35

Gardening:

Sheriff-o-matic still reports that the external/wpt/fetch/private-network-access/top-location.tentative.https.window.html is flaky.

Probably these failures are related to this issue. Let me re-open this issue.

external/wpt/fetch/private-network-access/top-location.tentative.https.window.html?include=from-treat-as-public
virtual/pna-navigations-enabled/external/wpt/fetch/private-network-access/top-location.tentative.window.html
virtual/pna-navigations-warning/external/wpt/fetch/private-network-access/top-location.tentative.https.window.html?include=from-treat-as-public
virtual/pna-permission/external/wpt/fetch/private-network-access/top-location.tentative.window.html
virtual/pna-workers-disabled/external/wpt/fetch/private-network-access/top-location.tentative.window.html
virtual/pna-workers-enabled/external/wpt/fetch/private-network-access/location.tentative.https.window.html?include=from-treat-as-public
virtual/pna-workers-enabled/external/wpt/fetch/private-network-access/location.tentative.window.html
virtual/produce-compile-hints/external/wpt/fetch/private-network-access/top-location.tentative.window.html

[luci-analysis-service via monorail]

Updates:
Status: Verified

Comment #36 on issue 1507761 by luci-analy...@luci-analysis.iam.gserviceaccount.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c36

Because the following problem(s) have stopped:
- many gardened builders are failing (P1)
The bug has been verified.

Why issues are verified: https://luci-analysis.appspot.com/help#bug-verified
See failure impact and configure the failure association rule for this bug at: https://luci-analysis.appspot.com/p/chromium/rules/d49c7936f9f4d371117694216b89fc19

[hayato via monorail]

Comment #37 on issue 1507761 by hay...@chromium.org: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c37

Gardening: https://crrev.com/c/5186198 is disabling external/wpt/fetch/private-network-access/top-location.tentative.https.window.html?include=from-treat-as-public

[sadapala via monorail]

Comment #38 on issue 1507761 by sada...@google.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c38

virtual/pna-workers-disabled/external/wpt/fetch/private-network-access/top-location.tentative.window.html

Text Failure on Linux Tests (dbg)(1) builder

Test History Link:
https://ci.chromium.org/ui/test/chromium%3Aci/ninja%3A%2F%2F%3Ablink_wpt_tests%2Fvirtual%2Fpna-workers-disabled%2Fexternal%2Fwpt%2Ffetch%2Fprivate-network-access%2Ftop-location.tentative.window.html?q=VHASH%3A6002b55d65708e28

Dashboard:
https://data.corp.google.com/sites/chrome_generic_flakiness_dashboard_datasite/top_flakes/?f=test_id:eq:ninja:%2F%2F:blink_wpt_tests%2Fvirtual%2Fpna-workers-disabled%2Fexternal%2Fwpt%2Ffetch%2Fprivate-network-access%2Ftop-location.tentative.window.html&f=realm:in:(null)&f=variant_test_suite:in:blink_wpt_tests&can=2

and average 31.58% flaky rate in runs mostly on Linux builders

virtual/pna-permission/external/wpt/fetch/private-network-access/top-location.tentative.window.html

Text Failure on Linux Tests (dbg)(1) builder

Test history link:
https://ci.chromium.org/ui/test/chromium%3Aci/ninja%3A%2F%2F%3Ablink_wpt_tests%2Fvirtual%2Fpna-permission%2Fexternal%2Fwpt%2Ffetch%2Fprivate-network-access%2Ftop-location.tentative.window.html?q=VHASH%3A6002b55d65708e28

Dashboard:https://data.corp.google.com/sites/chrome_generic_flakiness_dashboard_datasite/top_flakes/?f=test_id:eq:ninja:%2F%2F:blink_wpt_tests%2Fvirtual%2Fpna-permission%2Fexternal%2Fwpt%2Ffetch%2Fprivate-network-access%2Ftop-location.tentative.window.html&f=realm:in:(null)&f=variant_test_suite:in:blink_wpt_tests&can=2

and average 28.42% flaky rate in runs mostly on Linux builders

virtual/pna-permission/external/wpt/fetch/private-network-access/location.tentative.window.html

Text Failure on Linux Tests (dbg)(1) builder

Test history Link:
https://ci.chromium.org/ui/test/chromium%3Aci/ninja%3A%2F%2F%3Ablink_wpt_tests%2Fvirtual%2Fpna-permission%2Fexternal%2Fwpt%2Ffetch%2Fprivate-network-access%2Flocation.tentative.window.html?q=VHASH%3A6002b55d65708e28

Dashboard:
https://data.corp.google.com/sites/chrome_generic_flakiness_dashboard_datasite/top_flakes/?f=test_id:eq:ninja:%2F%2F:blink_wpt_tests%2Fvirtual%2Fpna-permission%2Fexternal%2Fwpt%2Ffetch%2Fprivate-network-access%2Flocation.tentative.window.html&f=realm:in:(null)&f=variant_test_suite:in:blink_wpt_tests&can=2

and average 30.65% flaky rate in runs mostly on Linux builders

[luci-analysis-service via monorail]

Updates:
Status: Verified

Comment #41 on issue 1507761 by luci-analy...@luci-analysis.iam.gserviceaccount.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c41

Because the following problem(s) have stopped:
- many gardened builders are failing (P1)
The bug has been verified.

Why issues are verified: https://luci-analysis.appspot.com/help#bug-verified
See failure impact and configure the failure association rule for this bug at: https://luci-analysis.appspot.com/p/chromium/rules/d49c7936f9f4d371117694216b89fc19

[luci-analysis-service via monorail]

Updates:
Status: Assigned

Comment #42 on issue 1507761 by luci-analy...@luci-analysis.iam.gserviceaccount.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c42

Because the following problem(s) have started:

- many gardened builders are failing (P1)

The bug has been re-opened.

Why issues are re-opened: https://luci-analysis.appspot.com/help#bug-reopened

[horo via monorail]

Comment #43 on issue 1507761 by ho...@chromium.org: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c43

Issue 1517712 has been merged into this issue.

[horo via monorail]

Updates:
Owner: l...@chromium.org

Comment #44 on issue 1507761 by ho...@chromium.org: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c44

[Chromium Gardener]

lyf@
Hi, I noticed you tried to fix the flakiness of Private Network Access related tests.
https://chromium-review.googlesource.com/c/chromium/src/+/5119462

But I think there are still flaky tests.
Are you still working on fixing this flakiness?

[Git Watcher via monorail]

Comment #45 on issue 1507761 by Git Watcher: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c45

The following revision refers to this bug:
https://chromium.googlesource.com/chromium/src/+/27f8150e85f47f716cb895cd4d5d53e51ac1a4e7

commit 27f8150e85f47f716cb895cd4d5d53e51ac1a4e7
Author: Tsuyoshi Horo <ho...@chromium.org>
Date: Wed Jan 17 05:50:41 2024

Mark some Private Network Access WTP flaky

Bug: 1507761
Change-Id: I20b5d488f69534efcbaf394b8f8ba31cb4c77bb1
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/5202353
Commit-Queue: Tsuyoshi Horo <ho...@chromium.org>
Reviewed-by: Hayato Ito <hay...@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1247978}

[modify] https://crrev.com/27f8150e85f47f716cb895cd4d5d53e51ac1a4e7/third_party/blink/web_tests/TestExpectations

[luci-analysis-service via monorail]

Updates:
Status: Verified

Comment #46 on issue 1507761 by luci-analy...@luci-analysis.iam.gserviceaccount.com: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c46

Because the following problem(s) have stopped:

- many gardened builders are failing (P1)

The bug has been verified.

Why issues are verified: https://luci-analysis.appspot.com/help#bug-verified

See failure impact and configure the failure association rule for this bug at: https://luci-analysis.appspot.com/p/chromium/rules/d49c7936f9f4d371117694216b89fc19

[Git Watcher via monorail]

Comment #47 on issue 1507761 by Git Watcher: WPT private-access-network are flaky
https://bugs.chromium.org/p/chromium/issues/detail?id=1507761#c47

The following revision refers to this bug:

https://chromium.googlesource.com/chromium/src/+/91afd5efcd8a7fc416a3794cdd61f422d8b3f52a

commit 91afd5efcd8a7fc416a3794cdd61f422d8b3f52a
Author: Expectation File Editor <chrome-automat...@chops-service-accounts.iam.gserviceaccount.com>
Date: Sat Jan 27 13:32:25 2024

Remove stale Blink expectations

Autogenerated CL from running:

//third_party/blink/tools/remove_stale_expectations.py --project chrome-unexpected-pass-data --remove-stale-expectations --narrow-semi-stale-expectation-scope --large-query-mode --num-samples 200 --jobs 2 --no-auto-close-bugs

Affected bugs for CL description:

R=rubber-...@appspot.gserviceaccount.com

Bug: 1010170, 1081534, 1310326, 1407078, 1465321
Bug: 1494119, 1496281, 1507152, 1507761, 626703
Bug: 73609, 893490
Bug: 1456636, 1470474
Change-Id: Ieefac97ecfe14ff3d0045cc37d36fa9161d7531f
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/5242343
Auto-Submit: chrome-automat...@chops-service-accounts.iam.gserviceaccount.com <chrome-automat...@chops-service-accounts.iam.gserviceaccount.com>
Commit-Queue: Rubber Stamper <rubber-...@appspot.gserviceaccount.com>
Bot-Commit: Rubber Stamper <rubber-...@appspot.gserviceaccount.com>
Cr-Commit-Position: refs/heads/main@{#1253039}

[modify] https://crrev.com/91afd5efcd8a7fc416a3794cdd61f422d8b3f52a/third_party/blink/web_tests/FlagExpectations/disable-site-isolation-trials
[modify] https://crrev.com/91afd5efcd8a7fc416a3794cdd61f422d8b3f52a/third_party/blink/web_tests/TestExpectations
[modify] https://crrev.com/91afd5efcd8a7fc416a3794cdd61f422d8b3f52a/third_party/blink/web_tests/SlowTests
[modify] https://crrev.com/91afd5efcd8a7fc416a3794cdd61f422d8b3f52a/third_party/blink/web_tests/FlagExpectations/enable-skia-graphite