Intent to Prototype: Summarizer API performance preference

20 views
Skip to first unread message

Chromestatus

unread,
1:30 PM (6 hours ago) 1:30 PM
to blin...@chromium.org, dbo...@google.com, jin...@google.com, mem...@google.com, m...@google.com, jae...@google.com
Contact emails
jae...@google.com

Explainer
https://github.com/webmachinelearning/writing-assistance-apis/issues/96

Specification
https://webmachinelearning.github.io/writing-assistance-apis/#the-summarizer-class

Summary
The current Summarizer (https://chromestatus.com/feature/5193953788559360) relies on large on-device models, which can imply high latency, high resource usage, and limited device compatibility. We propose adding a preference parameter to SummarizerCreateCoreOptions, enabling developers to explicitly balance model capabilities against performance and broader device support.

Blink component
Blink>AI>Writing Assistance

Web Feature ID
summarizer

Motivation
The current Summarizer largely relies on powerful, high-parameter count on-device models. While these models offer high-quality outputs and a broad feature set, they come with significant "pain points" for web adoption such as: high resource requirements, limited device coverage, and performance latency. Currently, developers have no way to signal to the browser that they are willing to trade off some output quality or specific advanced features for faster execution or broader device compatibility.

Initial public proposal
https://github.com/webmachinelearning/writing-assistance-apis/issues/96

Requires code in //chrome?
True

Tracking bug
http://crbug.com/486970516

Estimated milestones
DevTrial on desktop148


Link to entry on the Chrome Platform Status
https://chromestatus.com/feature/6309243756085248?gate=5158459320434688

This intent message was generated by Chrome Platform Status.
Reply all
Reply to author
Forward
0 new messages