Oliver Smallwood
unread,Jul 16, 2026, 11:17:52 AM (2 days ago) Jul 16Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Guardian Open Platform API Forum
Hi,
I'm an MSc Economics student at the University of Warwick. My dissertation is using a measure of how much UK newspaper coverage there was about the cost of living in each quarter from 2001 to 2025, and I'm using the Content API to count the articles and read their headlines. The Open Platform is credited as the source.
I'm 72 quarters into 100. Finishing takes roughly 300 more requests, so I'll get there on the normal allowance. I'm not stuck, and this isn't a super urgent request.
What I'd like, if it's possible, is a bit of slack for the next few weeks. I'm still checking whether my search terms pick up the right articles, and if they turn out not to, I have to collect the whole thing again — about 640 requests, or two days at 500/day. I have a draft due soon, and it's losing two days to a re-run I could otherwise do in an afternoon that I'm trying to avoid. Something like 2,000/day until early August would cover it comfortably.
If that's more than you'd want to hand out, genuinely no problem — I'll work within the normal limit and just plan around it. In that case please take this as a heads-up that the key will be busy for a few weeks, and that there's a dissertation behind it rather than anything suspicious.
On the mechanics: the script waits 1.2 seconds between requests, backs off when it gets a 429, and saves each quarter to disk as it finishes, so it never asks for the same thing twice. The text stays on my machine, isn't shared or used to train anything, and what ends up in the dissertation is quarterly aggregates plus the occasional headline and URL.
Thank you,
Oliver