5x better! Many, many thanks

[Tim Allison]

Apologies for being late to the game, but I'm THRILLED that as of the March crawl you've bumped the max bytes to 5MiB from 1MiB.

Thank you!

Best,

         Tim

[1] https://commoncrawl.org/blog/march-2025-crawl-archive-now-available

[Greg Lindahl]

On Mon, Apr 07, 2025 at 10:24:25AM -0700, Tim Allison wrote:
> Apologies for being late to the game, but I'm THRILLED that as of the March
> crawl you've bumped the max bytes to 5MiB from 1MiB.

Tim,

Glad to hear from you! You were part of the motivation for this
change -- you had to do a fair amount of extra crawling to create
your PDF dataset because of the large number of truncations.

-- greg