on_device_model: Add vram_mb to model descriptor. [chromium/src : main]

0 views
Skip to first unread message

Alan Ding (Gerrit)

unread,
Jul 15, 2026, 10:20:33 PM (9 days ago) Jul 15
to Nathan Memmott, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
Attention needed from Chi Yo Tsai and Nathan Memmott

Alan Ding voted Commit-Queue+1

Commit-Queue+1
Open in Gerrit

Related details

Attention is currently required from:
  • Chi Yo Tsai
  • Nathan Memmott
Submit Requirements:
  • requirement satisfiedCode-Coverage
  • requirement is not satisfiedCode-Owners
  • requirement is not satisfiedCode-Review
  • requirement is not satisfiedReview-Enforcement
Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
Gerrit-MessageType: comment
Gerrit-Project: chromium/src
Gerrit-Branch: main
Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
Gerrit-Change-Number: 8105139
Gerrit-PatchSet: 1
Gerrit-Owner: Alan Ding <alan...@chromium.org>
Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
Gerrit-CC: Mike Wasserman <m...@chromium.org>
Gerrit-Attention: Chi Yo Tsai <chiy...@google.com>
Gerrit-Attention: Nathan Memmott <mem...@chromium.org>
Gerrit-Comment-Date: Thu, 16 Jul 2026 02:20:20 +0000
Gerrit-HasComments: No
Gerrit-Has-Labels: Yes
satisfied_requirement
unsatisfied_requirement
open
diffy

Nathan Memmott (Gerrit)

unread,
Jul 16, 2026, 1:24:08 PM (9 days ago) Jul 16
to Alan Ding, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
Attention needed from Alan Ding and Chi Yo Tsai

Nathan Memmott added 1 comment

File services/on_device_model/ml/chrome_ml_api.h
Line 99, Patchset 2 (Latest): uint64_t vram_mb = 0;
Nathan Memmott . unresolved

Placing this here is causing the optimization guide internal bots to fail. You can move it to the end to make them happy.

Open in Gerrit

Related details

Attention is currently required from:
  • Alan Ding
  • Chi Yo Tsai
Submit Requirements:
    • requirement satisfiedCode-Coverage
    • requirement is not satisfiedCode-Owners
    • requirement is not satisfiedCode-Review
    • requirement is not satisfiedNo-Unresolved-Comments
    • requirement is not satisfiedReview-Enforcement
    Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
    Gerrit-MessageType: comment
    Gerrit-Project: chromium/src
    Gerrit-Branch: main
    Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
    Gerrit-Change-Number: 8105139
    Gerrit-PatchSet: 2
    Gerrit-Owner: Alan Ding <alan...@chromium.org>
    Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
    Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
    Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
    Gerrit-Attention: Chi Yo Tsai <chiy...@google.com>
    Gerrit-Attention: Alan Ding <alan...@chromium.org>
    Gerrit-Comment-Date: Thu, 16 Jul 2026 17:23:54 +0000
    Gerrit-HasComments: Yes
    Gerrit-Has-Labels: No
    satisfied_requirement
    unsatisfied_requirement
    open
    diffy

    Nathan Memmott (Gerrit)

    unread,
    Jul 16, 2026, 3:46:29 PM (9 days ago) Jul 16
    to Alan Ding, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
    Attention needed from Alan Ding and Chi Yo Tsai

    Nathan Memmott added 1 comment

    File services/on_device_model/ml/on_device_model_executor.cc
    Line 799, Patchset 2 (Latest): ml::GetDeviceAndPerformanceInfo(*chrome_ml_);
    Nathan Memmott . unresolved

    It looks like this will trigger a benchmark to run, but all we need vram_mb?

    Gerrit-Comment-Date: Thu, 16 Jul 2026 19:46:16 +0000
    Gerrit-HasComments: Yes
    Gerrit-Has-Labels: No
    satisfied_requirement
    unsatisfied_requirement
    open
    diffy

    Chi Yo Tsai (Gerrit)

    unread,
    Jul 16, 2026, 3:50:46 PM (9 days ago) Jul 16
    to Alan Ding, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Nathan Memmott, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
    Attention needed from Alan Ding

    Chi Yo Tsai added 1 comment

    File services/on_device_model/ml/on_device_model_executor.cc
    Line 799, Patchset 2 (Latest): ml::GetDeviceAndPerformanceInfo(*chrome_ml_);
    Nathan Memmott . unresolved

    It looks like this will trigger a benchmark to run, but all we need vram_mb?

    Chi Yo Tsai

    Currently our VRAM fetching is tied to our micro benchmark. Probably something that we should fix. Otherwise overriding the performance class blocks anything that depends on a VRAM check

    Open in Gerrit

    Related details

    Attention is currently required from:
    • Alan Ding
    Submit Requirements:
    • requirement satisfiedCode-Coverage
    • requirement is not satisfiedCode-Owners
    • requirement is not satisfiedCode-Review
    • requirement is not satisfiedNo-Unresolved-Comments
    • requirement is not satisfiedReview-Enforcement
    Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
    Gerrit-MessageType: comment
    Gerrit-Project: chromium/src
    Gerrit-Branch: main
    Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
    Gerrit-Change-Number: 8105139
    Gerrit-PatchSet: 2
    Gerrit-Owner: Alan Ding <alan...@chromium.org>
    Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
    Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
    Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
    Gerrit-CC: Mike Wasserman <m...@chromium.org>
    Gerrit-Attention: Alan Ding <alan...@chromium.org>
    Gerrit-Comment-Date: Thu, 16 Jul 2026 19:50:31 +0000
    Gerrit-HasComments: Yes
    Gerrit-Has-Labels: No
    Comment-In-Reply-To: Nathan Memmott <mem...@chromium.org>
    satisfied_requirement
    unsatisfied_requirement
    open
    diffy

    Nathan Memmott (Gerrit)

    unread,
    Jul 16, 2026, 5:40:49 PM (8 days ago) Jul 16
    to Alan Ding, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
    Attention needed from Alan Ding

    Nathan Memmott added 1 comment

    File services/on_device_model/ml/on_device_model_executor.cc
    Line 799, Patchset 2 (Latest): ml::GetDeviceAndPerformanceInfo(*chrome_ml_);
    Nathan Memmott . unresolved

    It looks like this will trigger a benchmark to run, but all we need vram_mb?

    Chi Yo Tsai

    Currently our VRAM fetching is tied to our micro benchmark. Probably something that we should fix. Otherwise overriding the performance class blocks anything that depends on a VRAM check

    Nathan Memmott

    Could we pass in the already calculated vram from the browser process? It's saved in components/optimization_guide/core/model_execution/performance_class.cc to the local state preference model_execution::prefs::localstate::kOnDeviceVramMb. We could retrieve it from the `PerformanceClassifier` and pass it through the `LoadModelParams`.

    Gerrit-Comment-Date: Thu, 16 Jul 2026 21:40:40 +0000
    Gerrit-HasComments: Yes
    Gerrit-Has-Labels: No
    Comment-In-Reply-To: Chi Yo Tsai <chiy...@google.com>
    Comment-In-Reply-To: Nathan Memmott <mem...@chromium.org>
    satisfied_requirement
    unsatisfied_requirement
    open
    diffy

    Alan Ding (Gerrit)

    unread,
    Jul 20, 2026, 9:19:38 PM (4 days ago) Jul 20
    to android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Nathan Memmott, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
    Attention needed from Chi Yo Tsai and Nathan Memmott

    Alan Ding added 2 comments

    File services/on_device_model/ml/chrome_ml_api.h
    Line 99, Patchset 2: uint64_t vram_mb = 0;
    Nathan Memmott . resolved

    Placing this here is causing the optimization guide internal bots to fail. You can move it to the end to make them happy.

    Alan Ding

    Done

    File services/on_device_model/ml/on_device_model_executor.cc
    Line 799, Patchset 2: ml::GetDeviceAndPerformanceInfo(*chrome_ml_);
    Nathan Memmott . resolved

    It looks like this will trigger a benchmark to run, but all we need vram_mb?

    Chi Yo Tsai

    Currently our VRAM fetching is tied to our micro benchmark. Probably something that we should fix. Otherwise overriding the performance class blocks anything that depends on a VRAM check

    Nathan Memmott

    Could we pass in the already calculated vram from the browser process? It's saved in components/optimization_guide/core/model_execution/performance_class.cc to the local state preference model_execution::prefs::localstate::kOnDeviceVramMb. We could retrieve it from the `PerformanceClassifier` and pass it through the `LoadModelParams`.

    Alan Ding

    This is more efficient, but a lot more code. Done.

    Open in Gerrit

    Related details

    Attention is currently required from:
    • Chi Yo Tsai
    • Nathan Memmott
    Submit Requirements:
      • requirement satisfiedCode-Coverage
      • requirement is not satisfiedCode-Owners
      • requirement is not satisfiedCode-Review
      • requirement is not satisfiedReview-Enforcement
      Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
      Gerrit-MessageType: comment
      Gerrit-Project: chromium/src
      Gerrit-Branch: main
      Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
      Gerrit-Change-Number: 8105139
      Gerrit-PatchSet: 4
      Gerrit-Owner: Alan Ding <alan...@chromium.org>
      Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
      Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
      Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
      Gerrit-CC: Mike Wasserman <m...@chromium.org>
      Gerrit-Attention: Chi Yo Tsai <chiy...@google.com>
      Gerrit-Attention: Nathan Memmott <mem...@chromium.org>
      Gerrit-Comment-Date: Tue, 21 Jul 2026 01:19:23 +0000
      satisfied_requirement
      unsatisfied_requirement
      open
      diffy

      Nathan Memmott (Gerrit)

      unread,
      Jul 20, 2026, 10:32:07 PM (4 days ago) Jul 20
      to Alan Ding, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
      Attention needed from Alan Ding and Chi Yo Tsai

      Nathan Memmott voted and added 1 comment

      Votes added by Nathan Memmott

      Code-Review+1

      1 comment

      Patchset-level comments
      File-level comment, Patchset 4 (Latest):
      Nathan Memmott . resolved

      LGTM

      Open in Gerrit

      Related details

      Attention is currently required from:
      • Alan Ding
      • Chi Yo Tsai
      Submit Requirements:
        • requirement satisfiedCode-Coverage
        • requirement is not satisfiedCode-Owners
        • requirement satisfiedCode-Review
        • requirement satisfiedReview-Enforcement
        Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
        Gerrit-MessageType: comment
        Gerrit-Project: chromium/src
        Gerrit-Branch: main
        Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
        Gerrit-Change-Number: 8105139
        Gerrit-PatchSet: 4
        Gerrit-Owner: Alan Ding <alan...@chromium.org>
        Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
        Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
        Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
        Gerrit-CC: Mike Wasserman <m...@chromium.org>
        Gerrit-Attention: Chi Yo Tsai <chiy...@google.com>
        Gerrit-Attention: Alan Ding <alan...@chromium.org>
        Gerrit-Comment-Date: Tue, 21 Jul 2026 02:31:52 +0000
        Gerrit-HasComments: Yes
        Gerrit-Has-Labels: Yes
        satisfied_requirement
        unsatisfied_requirement
        open
        diffy

        gwsq (Gerrit)

        unread,
        Jul 21, 2026, 5:42:50 PM (3 days ago) Jul 21
        to Alan Ding, Chromium IPC Reviews, Daniel Cheng, Steven Holte, Nathan Memmott, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
        Attention needed from Chi Yo Tsai, Daniel Cheng and Steven Holte

        Message from gwsq

        From googleclient/chrome/chromium_gwsq/ipc/config.gwsq:
        IPC: dch...@chromium.org

        📎 It looks like you’re making a possibly security-sensitive change! 📎 IPC security review isn’t a rubberstamp, so your friendly security reviewer will need a fair amount of context to review your CL effectively. Please review your CL description and code comments to make sure they provide context for someone unfamiliar with your project/area. Pay special attention to where data comes from and which processes it flows between (and their privilege levels). Feel free to point your security reviewer at design docs, bugs, or other links if you can’t reasonably make a self-contained CL description. (Also see https://cbea.ms/git-commit/).

        IPC reviewer(s): dch...@chromium.org


        Reviewer source(s):
        dch...@chromium.org is from context(googleclient/chrome/chromium_gwsq/ipc/config.gwsq)

        Open in Gerrit

        Related details

        Attention is currently required from:
        • Chi Yo Tsai
        • Daniel Cheng
        • Steven Holte
        Submit Requirements:
        • requirement satisfiedCode-Coverage
        • requirement is not satisfiedCode-Owners
        • requirement satisfiedCode-Review
        • requirement satisfiedReview-Enforcement
        Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
        Gerrit-MessageType: comment
        Gerrit-Project: chromium/src
        Gerrit-Branch: main
        Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
        Gerrit-Change-Number: 8105139
        Gerrit-PatchSet: 4
        Gerrit-Owner: Alan Ding <alan...@chromium.org>
        Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
        Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
        Gerrit-Reviewer: Daniel Cheng <dch...@chromium.org>
        Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
        Gerrit-Reviewer: Steven Holte <ho...@chromium.org>
        Gerrit-CC: Chromium IPC Reviews <chrome-ip...@google.com>
        Gerrit-CC: gwsq
        Gerrit-Attention: Chi Yo Tsai <chiy...@google.com>
        Gerrit-Attention: Steven Holte <ho...@chromium.org>
        Gerrit-Attention: Daniel Cheng <dch...@chromium.org>
        Gerrit-Comment-Date: Tue, 21 Jul 2026 21:42:37 +0000
        Gerrit-HasComments: No
        Gerrit-Has-Labels: No
        satisfied_requirement
        unsatisfied_requirement
        open
        diffy

        Daniel Cheng (Gerrit)

        unread,
        Jul 21, 2026, 6:22:34 PM (3 days ago) Jul 21
        to Alan Ding, Daniel Cheng, Chromium IPC Reviews, Steven Holte, Nathan Memmott, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
        Attention needed from Alan Ding, Chi Yo Tsai and Steven Holte

        Daniel Cheng voted and added 1 comment

        Votes added by Daniel Cheng

        Code-Review+1

        1 comment

        Patchset-level comments
        Daniel Cheng . resolved

        LGTM

        Open in Gerrit

        Related details

        Attention is currently required from:
        • Alan Ding
        • Chi Yo Tsai
        • Steven Holte
        Gerrit-Attention: Alan Ding <alan...@chromium.org>
        Gerrit-Comment-Date: Tue, 21 Jul 2026 22:22:19 +0000
        Gerrit-HasComments: Yes
        Gerrit-Has-Labels: Yes
        satisfied_requirement
        unsatisfied_requirement
        open
        diffy

        Steven Holte (Gerrit)

        unread,
        Jul 22, 2026, 7:12:58 PM (2 days ago) Jul 22
        to Alan Ding, Steven Holte, Daniel Cheng, Chromium IPC Reviews, Nathan Memmott, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
        Attention needed from Alan Ding and Chi Yo Tsai

        Steven Holte voted Code-Review+1

        Code-Review+1
        Open in Gerrit

        Related details

        Attention is currently required from:
        • Alan Ding
        • Chi Yo Tsai
        Submit Requirements:
        • requirement satisfiedCode-Coverage
        • requirement satisfiedCode-Owners
        • requirement satisfiedCode-Review
        • requirement satisfiedReview-Enforcement
        Inspect html for hidden footers to help with email filtering. To unsubscribe visit settings. DiffyGerrit
        Gerrit-MessageType: comment
        Gerrit-Project: chromium/src
        Gerrit-Branch: main
        Gerrit-Change-Id: Ia52ed685be895d18e85fb49b3f4bd67d7a8ce500
        Gerrit-Change-Number: 8105139
        Gerrit-PatchSet: 4
        Gerrit-Owner: Alan Ding <alan...@chromium.org>
        Gerrit-Reviewer: Alan Ding <alan...@chromium.org>
        Gerrit-Reviewer: Chi Yo Tsai <chiy...@google.com>
        Gerrit-Reviewer: Daniel Cheng <dch...@chromium.org>
        Gerrit-Reviewer: Nathan Memmott <mem...@chromium.org>
        Gerrit-Reviewer: Steven Holte <ho...@chromium.org>
        Gerrit-CC: Chromium IPC Reviews <chrome-ip...@google.com>
        Gerrit-CC: Mike Wasserman <m...@chromium.org>
        Gerrit-CC: gwsq
        Gerrit-Attention: Chi Yo Tsai <chiy...@google.com>
        Gerrit-Attention: Alan Ding <alan...@chromium.org>
        Gerrit-Comment-Date: Wed, 22 Jul 2026 23:12:41 +0000
        Gerrit-HasComments: No
        Gerrit-Has-Labels: Yes
        satisfied_requirement
        open
        diffy

        Alan Ding (Gerrit)

        unread,
        12:23 AM (4 hours ago) 12:23 AM
        to Steven Holte, Daniel Cheng, Chromium IPC Reviews, Nathan Memmott, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
        Attention needed from Chi Yo Tsai

        Alan Ding voted and added 1 comment

        Votes added by Alan Ding

        Commit-Queue+2

        1 comment

        Patchset-level comments
        Alan Ding . resolved

        Thanks for the reviews!

        Open in Gerrit

        Related details

        Attention is currently required from:
        • Chi Yo Tsai
        Gerrit-Comment-Date: Sat, 25 Jul 2026 04:23:16 +0000
        Gerrit-HasComments: Yes
        Gerrit-Has-Labels: Yes
        satisfied_requirement
        open
        diffy

        Alan Ding (Gerrit)

        unread,
        4:18 AM (now) 4:18 AM
        to Steven Holte, Daniel Cheng, Chromium IPC Reviews, Nathan Memmott, android-bu...@system.gserviceaccount.com, Chromium LUCI CQ, Chi Yo Tsai, Mike Wasserman, chromium...@chromium.org, chrome-intell...@chromium.org, chrome-intelligence-te...@google.com
        Attention needed from Chi Yo Tsai

        Alan Ding voted Commit-Queue+2

        Commit-Queue+2
        Gerrit-Comment-Date: Sat, 25 Jul 2026 08:18:42 +0000
        Gerrit-HasComments: No
        Gerrit-Has-Labels: Yes
        satisfied_requirement
        open
        diffy
        Reply all
        Reply to author
        Forward
        0 new messages