Broken internal links e-mails
Luke Plant
live site, but they are incorrect -- sometimes the 'Referrer' URL
doesn't even exist. I suspect it is some rather broken bot making all
kinds of random requests, so I'd like to add 'User agent' to the
information that is sent in the e-mail, so I could filter these. Is
this OK? Is there any other information that other people would find
helpful?
Thanks,
Luke
--
Parenthetical remarks (however relevant) are unnecessary
Luke Plant || L.Plant.98 (at) cantab.net || http://lukeplant.me.uk/
Adrian Holovaty
> I'm currently getting tons of 'Broken INTERNAL link' e-mails from my
> live site, but they are incorrect -- sometimes the 'Referrer' URL
> doesn't even exist. I suspect it is some rather broken bot making all
> kinds of random requests, so I'd like to add 'User agent' to the
> information that is sent in the e-mail, so I could filter these. Is
> this OK? Is there any other information that other people would find
> helpful?
That's cool by me -- there's a patch at
http://code.djangoproject.com/ticket/2602 . The patch looks OK to me
as is, other than the fact that there's no space after
"request.get_full_path(),". (Can you tell I'm anal?)
Adrian
--
Adrian Holovaty
holovaty.com | djangoproject.com
Ian Holsman
other things which *may* be useful might be the auth_user_id and
session_key of the request record.
FWIW.. there is a rouge bot going round in Australia which 'guesses'
URLs based on what it sees in javascript.
and i've also seen some spam bots guessing urls to add comments/
trackbacks as well.
regards
Ian
--
Ian Holsman
I...@Holsman.net
http://garden-gossip.com/ -- what's in your garden?
Luke Plant
> FWIW.. there is a rouge bot going round in Australia
Since bots don't normally have colours, I'm guessing that must mean a
Communist bot. No doubt it's part of some international plan to
undermine capitalism, those pesky Communists at it again... :-)