Summarizer Expert model issue

[Raymond Camden]

I'm trying to test the new Summarizer option and running into an issue. Here's how I'm defining it:

summarizer_speedy = await window.Summarizer.create({
preference:'speed',
type:'tldr',
length:'medium',
format:'markdown',
monitor(m) {
  m.addEventListener("downloadprogress", e => {
if(e.loaded === 0 || e.loaded === 1) return;
$output.innerHTML = `Downloading the Summary model, currently at ${Math.floor(e.loaded * 100)}%`;
});
}
});

According to the doc, https://docs.google.com/document/d/1RnSlXRAy8ffdbehvCcH7msBwmTvsxHJJQiwcw374tMw/edit?tab=t.0, this should work but I'm getting:

Uncaught (in promise) NotSupportedError: The specified options are not supported with the 'speed' performance preference.

[Thomas Steiner]

Hi Ray,

You're missing the output language:

await window.Summarizer.create({
preference:'speed',
type:'tldr',
length:'medium',

outputLanguage: 'en',

format:'markdown',
monitor(m) {
m.addEventListener("downloadprogress", e => {
if(e.loaded === 0 || e.loaded === 1) return;
$output.innerHTML = `Downloading the Summary model, currently at ${Math.floor(e.loaded * 100)}%`;
});
}
});

The smaller model only supports English at the moment, so explicitly setting this parameter is required (and recommended in the general case).

Cheers,

Tom

--
You received this message because you are subscribed to the Google Groups "Chrome Built-in AI Early Preview Program Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chrome-ai-dev-previe...@chromium.org.
To view this discussion visit https://groups.google.com/a/chromium.org/d/msgid/chrome-ai-dev-preview-discuss/a814ff57-1308-40c8-a908-0c6014e712c1n%40chromium.org.

--

Thomas Steiner, PhD—Developer Relations Engineer (blog.tomayac.com, toot.cafe/@tomayac)

Google Spain, S.L.U.

Torre Picasso, Pl. Pablo Ruiz Picasso, 1, Tetuán, 28020 Madrid, Spain

CIF: B63272603

Inscrita en el Registro Mercantil de Madrid, sección 8, Hoja M­-435397 Tomo 24227 Folio 25

----- BEGIN PGP SIGNATURE -----

Version: GnuPG v2.4.8 (GNU/Linux)

iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck

0fjumBl3DCharaCTersAttH3b0ttom.xKcd.cOm/1181.

----- END PGP SIGNATURE -----

[Raymond Camden]

That did the trick, but I've run into a new issue. I'm building a simple demo to let you paste in content and then summarize using the "old" more indepth model and the new speedy one.

As part of my demo, I ran into the issue of needing a user gesture when availability is downloadable/downloading. I added a check for that, but didn't pass the options in. So that's my fault, and in a real project I don't think you would do both. 

But as a followup - if I I modify my availability() call to check for performance:speed, it would NOT correctly handle a case where the *default* Summarizer model is downloaded - and I'd need to handle _both_ cases... correct?

--

===========================================================================
Raymond Camden

Email : raymon...@gmail.com
Blog : www.raymondcamden.com

[Thomas Steiner]

I think if you chain your calls to the same user gesture, it could work, as long as the `then()` chain isn't interrupted. 

Haven't checked if I do that correctly here, but just in case it could be an inspiration: https://googlechrome.github.io/samples/summarizer-preference-benchmark/

[Raymond Camden]

Hah, it helps in terms of me not needing to build my demo anymore. ;) I'll just point to this in my next presentation - and heck, I wasn't going to show timings so this is even better. Thanks!