2 questions regarding Summaries

[Raymond Camden]

One easy, one maybe not so easy. ;) I just built a demo (https://www.raymondcamden.com/2025/02/19/quick-demo-of-chromes-summarization-genai-upcoming-api) for the Summary API so I could easily see the differences in the type value. This brought up two things:

1) Headline... what exactly is the intent here? I had assumed it would be like a title, a one sentence, well, headline. ;) But it's more like the teaser. 

2) This one's a bit more high level and I don't think there's a clear right or wrong here. I address this in the post as well. For my sample input, I'm using the Gettysburg Address. In many of the results, the model returned context about the text itself, ie, saying who gave the address, when, and why. 

That's all 100% valid, and I can see a summary including that, but there's a part of me that wonders if that's a bit wrong in terms of "summary". Ie, should the result include the context of the text, or *just* focus on the text. In the real world, context is crucial of course, but in the case where I'm asking the model to summarize the text, I could see *not* wanting the context brought up. 

Like I said, I don't have a strong feeling either way, but it surprised me when I saw it in the results. 

[Thomas Steiner]

Hi Ray,

On Wed, Feb 19, 2025 at 5:51 PM Raymond Camden <raymon...@gmail.com> wrote:

One easy, one maybe not so easy. ;) I just built a demo (https://www.raymondcamden.com/2025/02/19/quick-demo-of-chromes-summarization-genai-upcoming-api) for the Summary API so I could easily see the differences in the type value. This brought up two things:

1) Headline... what exactly is the intent here? I had assumed it would be like a title, a one sentence, well, headline. ;) But it's more like the teaser. 

This is formally specified now:

"headline" →  "The summary should effectively contain the main point of the input in a single sentence, in the format of an article headline."

If you have cases where this is not the output, please file a new Chromium bug with the exact input.  

2) This one's a bit more high level and I don't think there's a clear right or wrong here. I address this in the post as well. For my sample input, I'm using the Gettysburg Address. In many of the results, the model returned context about the text itself, ie, saying who gave the address, when, and why. 

That's all 100% valid, and I can see a summary including that, but there's a part of me that wonders if that's a bit wrong in terms of "summary". Ie, should the result include the context of the text, or *just* focus on the text. In the real world, context is crucial of course, but in the case where I'm asking the model to summarize the text, I could see *not* wanting the context brought up. 

Like I said, I don't have a strong feeling either way, but it surprised me when I saw it in the results. 

If you have purely provided the address, cutting any leading text, as, for example, it can be found on this website, I agree that this is a bit unexpected. Please file a new Chromium bug with the exact input.  

Thank you!

Cheers,

Tom

--

Thomas Steiner, PhD—Developer Relations Engineer (blog.tomayac.com, toot.cafe/@tomayac)

Google Germany GmbH, ABC-Str. 19, 20354 Hamburg, Germany
Geschäftsführer: Paul Manicle, Liana Sebastian
Registergericht und -nummer: Hamburg, HRB 86891

----- BEGIN PGP SIGNATURE -----

Version: GnuPG v2.4.3 (GNU/Linux)

iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck

0fjumBl3DCharaCTersAttH3b0ttom.xKcd.cOm/1181.

----- END PGP SIGNATURE -----

[Raymond Camden]

1) Hmmm, so why am I seeing multiple sentences for headline?

2) Will do.

--

===========================================================================
Raymond Camden

Email : raymon...@gmail.com
Blog : www.raymondcamden.com
Twitter: raymondcamden

[黃水泉]

https://about.google/belonging/#700-00113540063769-build-with-us-anchor

#［🪙*700|00113540063769|<黃水泉>📱💯🆕🌥️🚫<✓30000™>］

--
You received this message because you are subscribed to the Google Groups "Chrome Built-in AI Early Preview Program Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to chrome-ai-dev-previe...@chromium.org.
To view this discussion visit https://groups.google.com/a/chromium.org/d/msgid/chrome-ai-dev-preview-discuss/5eae7433-6d88-4629-8a65-02087f57e6dan%40chromium.org.

[Raymond Camden]

Eh?

[Thomas Steiner]

On Wed, Feb 19, 2025 at 6:00 PM Raymond Camden <raymon...@gmail.com> wrote:

1) Hmmm, so why am I seeing multiple sentences for headline?

Definitely not something that should happen. Please file a bug.

 

2) Will do.

Thank you!