Device Requirements? "your device is unable to run it" (Summarization Model)

[Robert Oschler]

When I try to use the summarization API Playground:

https://chrome.dev/web-ai-demos/summarization-api-playground/

I get this message:

The Summarization API is available, but your device is unable to run it. Check device requirements in the Early Preview Program documentation.

I am running Canary version:

132.0.6811.0 (Official Build) canary (64-bit)

I looked in DevTools console and it says:

"summarization-api-playground/:1 There was no model available."

I'm guessing this is a GPU complaint?  I looked around the EPP docs but I don't see anything related to minimum system requirements.  I'm running on an older PC but it still is a decent 4-core with an AMD rx580 8GB graphics card so I'm wondering if this is a CUDA thing or the like.

Is this fixable?  If so, how?

[Robert Oschler]

Note, I did try anilkumarum's  solution by enabling:

chrome://flags/#optimization-guide-on-device-model

But that did not help.

[Robert Oschler]

The problem (I thought) was that I had the "metered connection" flag set on my Internet connection.  As soon as I turned it off I was able to load the Summarization page without the error for the first time, but I am not sure now if it really was fixed or not.

I put some text in and it said "Generating summary...".  After several minutes of nothing happening after that, I looked in the DevTools screen and I saw errors in the Console.  I am wondering if it hasn't downloaded the models yet and if so, do I need to do something to make that happen?  I can't paste a screenshot, Groups won't let me, but basically I see these errors:

Failed to load resource: the server responded with a status of 404 () --- /vite.svg:1
! There was no model available
Uncaught (in promise) Error: AI Summarization is not supported --- ubdex-DQt6vB J.js:1
  at v (index-DQt6vB J.js:1:1204)
  at async index-DQt6vB J.js:1:1655

Also, if I refresh the screen it goes back to the old situation where I get the "The Summarization API is available, but your device is unable to run it. Check device requirements in the Early Preview Program documentation." message with "There was no model available" showing in the console again.  If I completely exit Canary and relaunch, then I get the behavior above, but again, with the errors mentioned and refreshing the screen puts me back in "not available" land. 

On Friday, November 1, 2024 at 3:31:01 PM UTC-4 Robert Oschler wrote:

[Robert Oschler]

I found the updated instructions:

https://docs.google.com/document/d/1VG8HIyz361zGduWgNG7R_R8Xkv0OOJ8b5C9QKeCjU0c/edit?tab=t.0

However this did not work for me:

await ai.languageModel.create();

So I followed the next instruction and went to:

chrome://components

Here I discovered that although there was an entry for Optimization Guide on Device Model, it was listed with Version 0.0.0.0

I Clicked on the Check for Update button and now it says "Downloading".  However, there is no progress bar or any other discernible activity.  I'll just leave it like this in its downloading that 22 GB mentioned in the docs, but if I should be seeing some other activity on the screen or in DevTools, please let me know.

[Robert Oschler]

The model downloaded and updated.  It looks like I've got the "execution config" not available error.  I will wait until tomorrow to see if it gets fetched as the docs say happens only once a day, and see if I'm up and running.  

Obvious suggestion, but it would be great if there was a button, perhaps in the "components" section, to force an immediate fetch.

[Thomas Steiner]

Hi Robert,

I think you got it working now, as per the other thread. Sorry for the involved setup. This will get easier once we enter the origin trial stage for the various APIs. 

Cheers,

Tom

--
You received this message because you are subscribed to the Google Groups "Chrome Built-in AI Early Preview Program Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chrome-ai-dev-previe...@chromium.org.
To view this discussion visit https://groups.google.com/a/chromium.org/d/msgid/chrome-ai-dev-preview-discuss/f1dce0a3-cc13-4101-8230-405627c943c7n%40chromium.org.