[perf] Deschedule outdated octane and speedometer benchmark variants [chromium/src : main]

0 views
Skip to first unread message

Camillo Bruni (Gerrit)

unread,
Feb 11, 2026, 12:47:33 PM (14 days ago) Feb 11
to Wenbin Zhang, John Chen, chromium...@chromium.org, Zijie He, fuchsia...@chromium.org, telemetr...@chromium.org
Attention needed from John Chen

Camillo Bruni voted Commit-Queue+2

Commit-Queue+2
Open in Gerrit

Related details

Attention is currently required from:
  • John Chen
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement satisfiedCode-Owners
  • requirement satisfiedCode-Review
  • requirement satisfiedReview-Enforcement
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: comment
Gerrit-Project: chromium/src
Gerrit-Branch: main
Gerrit-Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
Gerrit-Change-Number: 7567245
Gerrit-PatchSet: 6
Gerrit-Owner: Camillo Bruni <cbr...@chromium.org>
Gerrit-Reviewer: Camillo Bruni <cbr...@chromium.org>
Gerrit-Reviewer: John Chen <john...@chromium.org>
Gerrit-Reviewer: Wenbin Zhang <wenbi...@google.com>
Gerrit-CC: Zijie He <zij...@google.com>
Gerrit-Attention: John Chen <john...@chromium.org>
Gerrit-Comment-Date: Wed, 11 Feb 2026 17:47:20 +0000
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
satisfied_requirement
open
diffy

John Chen (Gerrit)

unread,
Feb 11, 2026, 12:49:33 PM (14 days ago) Feb 11
to Camillo Bruni, Chromium LUCI CQ, Wenbin Zhang, chromium...@chromium.org, Zijie He, fuchsia...@chromium.org, telemetr...@chromium.org
Attention needed from Camillo Bruni

John Chen voted and added 1 comment

Votes added by John Chen

Code-Review+1
Commit-Queue+2

1 comment

Patchset-level comments
File-level comment, Patchset 5:
Camillo Bruni . resolved

marking speedometer2 as SCHEDULED=False was the easiest choice here.
I can alternatively remove it from the OFFICIAL_BENCHMARKS.

John Chen

I agree that SCHEDULED=False is the best approach.

Open in Gerrit

Related details

Attention is currently required from:
  • Camillo Bruni
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement satisfiedCode-Owners
  • requirement satisfiedCode-Review
  • requirement satisfiedReview-Enforcement
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: comment
Gerrit-Project: chromium/src
Gerrit-Branch: main
Gerrit-Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
Gerrit-Change-Number: 7567245
Gerrit-PatchSet: 6
Gerrit-Owner: Camillo Bruni <cbr...@chromium.org>
Gerrit-Reviewer: Camillo Bruni <cbr...@chromium.org>
Gerrit-Reviewer: John Chen <john...@chromium.org>
Gerrit-Reviewer: Wenbin Zhang <wenbi...@google.com>
Gerrit-CC: Zijie He <zij...@google.com>
Gerrit-Attention: Camillo Bruni <cbr...@chromium.org>
Gerrit-Comment-Date: Wed, 11 Feb 2026 17:49:24 +0000
Gerrit-HasComments: Yes
Gerrit-Has-Labels: Yes
Comment-In-Reply-To: Camillo Bruni <cbr...@chromium.org>
satisfied_requirement
open
diffy

John Chen (Gerrit)

unread,
Feb 11, 2026, 2:54:52 PM (13 days ago) Feb 11
to Camillo Bruni, Chromium LUCI CQ, Wenbin Zhang, chromium...@chromium.org, Zijie He, fuchsia...@chromium.org, telemetr...@chromium.org
Attention needed from Camillo Bruni

John Chen added 1 comment

Patchset-level comments
File-level comment, Patchset 6 (Latest):
John Chen . resolved

The merge conflict is my fault. Sorry about that. Please rebase and regenerate the shard maps, or simply revert the changes to win-arm64-snapdragon-elite-perf_timing.json, as it has no real changes.

Gerrit-Comment-Date: Wed, 11 Feb 2026 19:54:41 +0000
Gerrit-HasComments: Yes
Gerrit-Has-Labels: No
satisfied_requirement
open
diffy

Camillo Bruni (Gerrit)

unread,
Feb 23, 2026, 12:25:50 PM (2 days ago) Feb 23
to AyeAye, John Chen, Chromium LUCI CQ, Wenbin Zhang, chromium...@chromium.org, Zijie He, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com, gavin...@chromium.org, jorgel...@chromium.org, net-r...@chromium.org, fuzzin...@chromium.org, crmulli...@chromium.org, chromotin...@chromium.org, ramyagopa...@google.com, devtools...@chromium.org, nicolas...@chromium.org, tburkar...@chromium.org, prerenderi...@chromium.org, fuchsia...@chromium.org, telemetr...@chromium.org
Attention needed from John Chen and Wenbin Zhang

Camillo Bruni added 1 comment

Patchset-level comments
File-level comment, Patchset 10 (Latest):
Camillo Bruni . resolved

PTAL again

Open in Gerrit

Related details

Attention is currently required from:
  • John Chen
  • Wenbin Zhang
Submit Requirements:
    • requirement satisfiedCode-Coverage
    • requirement satisfiedCode-Owners
    • requirement is not satisfiedCode-Review
    • requirement is not satisfiedReview-Enforcement
    Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
    Gerrit-MessageType: comment
    Gerrit-Project: chromium/src
    Gerrit-Branch: main
    Gerrit-Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
    Gerrit-Change-Number: 7567245
    Gerrit-PatchSet: 10
    Gerrit-Owner: Camillo Bruni <cbr...@chromium.org>
    Gerrit-Reviewer: Camillo Bruni <cbr...@chromium.org>
    Gerrit-Reviewer: John Chen <john...@chromium.org>
    Gerrit-Reviewer: Wenbin Zhang <wenbi...@google.com>
    Gerrit-CC: Zijie He <zij...@google.com>
    Gerrit-Attention: John Chen <john...@chromium.org>
    Gerrit-Attention: Wenbin Zhang <wenbi...@google.com>
    Gerrit-Comment-Date: Mon, 23 Feb 2026 17:25:30 +0000
    Gerrit-HasComments: Yes
    Gerrit-Has-Labels: No
    satisfied_requirement
    unsatisfied_requirement
    open
    diffy

    John Chen (Gerrit)

    unread,
    Feb 23, 2026, 1:40:55 PM (2 days ago) Feb 23
    to Camillo Bruni, AyeAye, Chromium LUCI CQ, Wenbin Zhang, chromium...@chromium.org, Zijie He, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com, gavin...@chromium.org, jorgel...@chromium.org, net-r...@chromium.org, fuzzin...@chromium.org, crmulli...@chromium.org, chromotin...@chromium.org, ramyagopa...@google.com, devtools...@chromium.org, nicolas...@chromium.org, tburkar...@chromium.org, prerenderi...@chromium.org, fuchsia...@chromium.org, telemetr...@chromium.org
    Attention needed from Camillo Bruni and Wenbin Zhang

    John Chen voted Code-Review+1

    Code-Review+1
    Open in Gerrit

    Related details

    Attention is currently required from:
    • Camillo Bruni
    • Wenbin Zhang
    Submit Requirements:
      • requirement satisfiedCode-Coverage
      • requirement satisfiedCode-Owners
      • requirement satisfiedCode-Review
      • requirement satisfiedReview-Enforcement
      Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
      Gerrit-MessageType: comment
      Gerrit-Project: chromium/src
      Gerrit-Branch: main
      Gerrit-Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
      Gerrit-Change-Number: 7567245
      Gerrit-PatchSet: 10
      Gerrit-Owner: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Reviewer: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Reviewer: John Chen <john...@chromium.org>
      Gerrit-Reviewer: Wenbin Zhang <wenbi...@google.com>
      Gerrit-CC: Zijie He <zij...@google.com>
      Gerrit-Attention: Wenbin Zhang <wenbi...@google.com>
      Gerrit-Attention: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Comment-Date: Mon, 23 Feb 2026 18:40:47 +0000
      Gerrit-HasComments: No
      Gerrit-Has-Labels: Yes
      satisfied_requirement
      open
      diffy

      Camillo Bruni (Gerrit)

      unread,
      Feb 23, 2026, 1:41:43 PM (2 days ago) Feb 23
      to John Chen, AyeAye, Chromium LUCI CQ, Wenbin Zhang, chromium...@chromium.org, Zijie He, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com, gavin...@chromium.org, jorgel...@chromium.org, net-r...@chromium.org, fuzzin...@chromium.org, crmulli...@chromium.org, chromotin...@chromium.org, ramyagopa...@google.com, devtools...@chromium.org, nicolas...@chromium.org, tburkar...@chromium.org, prerenderi...@chromium.org, fuchsia...@chromium.org, telemetr...@chromium.org
      Attention needed from Wenbin Zhang

      Camillo Bruni voted Commit-Queue+2

      Commit-Queue+2
      Open in Gerrit

      Related details

      Attention is currently required from:
      • Wenbin Zhang
      Submit Requirements:
      • requirement satisfiedCode-Coverage
      • requirement satisfiedCode-Owners
      • requirement satisfiedCode-Review
      • requirement satisfiedReview-Enforcement
      Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
      Gerrit-MessageType: comment
      Gerrit-Project: chromium/src
      Gerrit-Branch: main
      Gerrit-Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
      Gerrit-Change-Number: 7567245
      Gerrit-PatchSet: 10
      Gerrit-Owner: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Reviewer: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Reviewer: John Chen <john...@chromium.org>
      Gerrit-Reviewer: Wenbin Zhang <wenbi...@google.com>
      Gerrit-CC: Zijie He <zij...@google.com>
      Gerrit-Attention: Wenbin Zhang <wenbi...@google.com>
      Gerrit-Comment-Date: Mon, 23 Feb 2026 18:41:23 +0000
      Gerrit-HasComments: No
      Gerrit-Has-Labels: Yes
      satisfied_requirement
      open
      diffy

      Chromium LUCI CQ (Gerrit)

      unread,
      Feb 23, 2026, 3:22:02 PM (2 days ago) Feb 23
      to Camillo Bruni, John Chen, AyeAye, Wenbin Zhang, chromium...@chromium.org, Zijie He, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com, gavin...@chromium.org, jorgel...@chromium.org, net-r...@chromium.org, fuzzin...@chromium.org, crmulli...@chromium.org, chromotin...@chromium.org, ramyagopa...@google.com, devtools...@chromium.org, nicolas...@chromium.org, tburkar...@chromium.org, prerenderi...@chromium.org, fuchsia...@chromium.org, telemetr...@chromium.org

      Chromium LUCI CQ submitted the change

      Change information

      Commit message:
      [perf] Deschedule outdated octane and speedometer benchmark variants

      - Octane is very outdated and jetstream2 and jetstream3 provide much
        better coverage
      - Speedometer 1 is very outdated and provides little to no value to
        us v3 is the current version
      - speedometer2 should only be explicitly enabled on a few
        platforms
      - Speedometer predictable variants were previously removed but
        not fully descheduled
      Bug: 397149441
      Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
      Reviewed-by: John Chen <john...@chromium.org>
      Commit-Queue: Camillo Bruni <cbr...@chromium.org>
      Cr-Commit-Position: refs/heads/main@{#1588861}
      Files:
      • M tools/perf/benchmark.csv
      • M tools/perf/benchmarks/octane.py
      • M tools/perf/benchmarks/speedometer1.py
      • M tools/perf/benchmarks/speedometer2.py
      • M tools/perf/benchmarks/speedometer3.py
      • M tools/perf/core/shard_maps/android-pixel-fold-perf_map.json
      • M tools/perf/core/shard_maps/android-pixel-tangor-perf_map.json
      • M tools/perf/core/shard_maps/android-pixel4-perf-pgo_map.json
      • M tools/perf/core/shard_maps/android-pixel4-perf_map.json
      • M tools/perf/core/shard_maps/android-pixel4_webview-perf-pgo_map.json
      • M tools/perf/core/shard_maps/android-pixel4_webview-perf_map.json
      • M tools/perf/core/shard_maps/android-pixel6-perf_map.json
      • M tools/perf/core/shard_maps/android-pixel6-pro-perf-pgo_map.json
      • M tools/perf/core/shard_maps/android-pixel6-pro-perf_map.json
      • M tools/perf/core/shard_maps/linux-perf-pgo_map.json
      • M tools/perf/core/shard_maps/linux-r350-perf_map.json
      • M tools/perf/core/shard_maps/mac-intel-perf_map.json
      • M tools/perf/core/shard_maps/mac-m1_mini_2020-perf_map.json
      • M tools/perf/core/shard_maps/mac-m2-pro-perf_map.json
      • M tools/perf/core/shard_maps/mac-m4-mini-perf_map.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel-fold-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel-tangor-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel4-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel4_webview-perf-pgo_timing.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel4_webview-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel6-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/android-pixel6-pro-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/linux-r350-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/mac-intel-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/mac-m1_mini_2020-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/mac-m2-pro-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/mac-m4-mini-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/win-10-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/win-10_laptop_low_end-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/win-11-perf_timing.json
      • M tools/perf/core/shard_maps/timing_data/win-arm64-snapdragon-elite-perf_timing.json
      • M tools/perf/core/shard_maps/win-10-perf-pgo_map.json
      • M tools/perf/core/shard_maps/win-10-perf_map.json
      • M tools/perf/core/shard_maps/win-10_amd_laptop-perf-pgo_map.json
      • M tools/perf/core/shard_maps/win-10_laptop_low_end-perf-pgo_map.json
      • M tools/perf/core/shard_maps/win-10_laptop_low_end-perf_map.json
      • M tools/perf/core/shard_maps/win-11-perf-pgo_map.json
      • M tools/perf/core/shard_maps/win-11-perf_map.json
      • M tools/perf/core/shard_maps/win-arm64-snapdragon-elite-perf_map.json
      Change size: XL
      Delta: 44 files changed, 35 insertions(+), 1513 deletions(-)
      Branch: refs/heads/main
      Submit Requirements:
      • requirement satisfiedCode-Review: +1 by John Chen
      Open in Gerrit
      Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
      Gerrit-MessageType: merged
      Gerrit-Project: chromium/src
      Gerrit-Branch: main
      Gerrit-Change-Id: I6da1e65dfba4d1c3d8da6efb03d426d6f05e897a
      Gerrit-Change-Number: 7567245
      Gerrit-PatchSet: 11
      Gerrit-Owner: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Reviewer: Camillo Bruni <cbr...@chromium.org>
      Gerrit-Reviewer: Chromium LUCI CQ <chromiu...@luci-project-accounts.iam.gserviceaccount.com>
      Gerrit-Reviewer: John Chen <john...@chromium.org>
      Gerrit-Reviewer: Wenbin Zhang <wenbi...@google.com>
      open
      diffy
      satisfied_requirement
      Reply all
      Reply to author
      Forward
      0 new messages