Recaptcha is down?

612 views
Skip to first unread message

John

unread,
Sep 17, 2010, 4:00:42 PM9/17/10
to reCAPTCHA
When I download the ajax JS file, it returns a 1-line blank file.
http://www.google.com/recaptcha/api/js/recaptcha_ajax.js

This is killing site traffic. :(

Do you guys have a status page?

reCAPTCHA Support

unread,
Sep 17, 2010, 4:29:49 PM9/17/10
to reca...@googlegroups.com
Hi,

Bad push on our end; we're currently reverting it.

> --
> You received this message because you are subscribed to the Google Groups "reCAPTCHA" group.
> To post to this group, send email to reca...@googlegroups.com.
> To unsubscribe from this group, send email to recaptcha+...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/recaptcha?hl=en.
>
>

--
reCAPTCHA: stop spam, read books
http://recaptcha.net

Matt G.

unread,
Sep 17, 2010, 4:35:47 PM9/17/10
to reCAPTCHA
Do you have an estimate when the revert will be complete and visible
to clients? My team is weighing the cost/risk of temporarily removing
reCAPTCHA from all affected sites until this is resolved. It would be
helpful to know if we can expect corrected JS in 10 minutes, one hour,
etc.

Thank you for correcting this issue.

On Sep 17, 3:29 pm, reCAPTCHA Support <supp...@recaptcha.net> wrote:
> Hi,
>
> Bad push on our end; we're currently reverting it.
>
> On Fri, Sep 17, 2010 at 4:00 PM, John <sma...@gmail.com> wrote:
> > When I download the ajax JS file, it returns a 1-line blank file.
> >http://www.google.com/recaptcha/api/js/recaptcha_ajax.js
>
> > This is killing site traffic. :(
>
> > Do you guys have a status page?
>
> > --
> > You received this message because you are subscribed to the Google Groups "reCAPTCHA" group.
> > To post to this group, send email to reca...@googlegroups.com.
> > To unsubscribe from this group, send email to recaptcha+...@googlegroups.com.
> > For more options, visit this group athttp://groups.google.com/group/recaptcha?hl=en.
>
> --
> reCAPTCHA: stop spam, read bookshttp://recaptcha.net

--
Matt

reCAPTCHA Support

unread,
Sep 17, 2010, 4:44:33 PM9/17/10
to reca...@googlegroups.com
Our ETA is roughly 15-30 minutes. I'll update if my estimate turns
out to be in error.

Colin

> For more options, visit this group at http://groups.google.com/group/recaptcha?hl=en.

reCAPTCHA Support

unread,
Sep 17, 2010, 5:01:46 PM9/17/10
to reca...@googlegroups.com
Hi,

All should be back to normal now. We'll continue to keep an eye on
it, but please let me know if you see any persisting issues with the
reCAPTCHA AJAX API.

Some browsers may have cached the empty version of recaptcha_ajax.js,
but if those folks hit shift-reload all should be fine.

Thanks,
Colin

Bill Orcutt

unread,
Sep 17, 2010, 5:11:15 PM9/17/10
to reCAPTCHA
I'm still seeing an empty response

http://www.google.com/recaptcha/api/js/recaptcha_ajax.js

reCAPTCHA Support

unread,
Sep 17, 2010, 5:14:27 PM9/17/10
to reca...@googlegroups.com
Hi,

Can you please try:

1) Going to http://www.google.com/recaptcha/api/js/recaptcha_ajax.js
and holding down "shift" while hitting the reload button?
2) Going to https://www.google.com/recaptcha/api/js/recaptcha_ajax.js
and seeing if you get a non-blank page.

Are you behind any proxies or anything else that might be erroneously
caching the blank version of the Javascript?

Thanks!

Colin

Ed

unread,
Sep 17, 2010, 5:13:29 PM9/17/10
to reCAPTCHA
This does not seem to be working for me either.
i tried a forced refresh as well

Bill Orcutt

unread,
Sep 17, 2010, 5:17:22 PM9/17/10
to reCAPTCHA
I'm seeing a blank response for both http & https. Not behind a proxy.
Seeing a 200 response code from both.

On Sep 17, 2:14 pm, reCAPTCHA Support <supp...@recaptcha.net> wrote:
> Hi,
>
> Can you please try:
>
> 1) Going tohttp://www.google.com/recaptcha/api/js/recaptcha_ajax.js
> and holding down "shift" while hitting the reload button?
> 2) Going tohttps://www.google.com/recaptcha/api/js/recaptcha_ajax.js
> and seeing if you get a non-blank page.
>
> Are you behind any proxies or anything else that might be erroneously
> caching the blank version of the Javascript?
>
> Thanks!
>
> Colin
>
>
>
>
>
> On Fri, Sep 17, 2010 at 5:11 PM, Bill Orcutt <orc...@gmail.com> wrote:
> > I'm still seeing an empty response
>
> >http://www.google.com/recaptcha/api/js/recaptcha_ajax.js
>
> > On Sep 17, 2:01 pm, reCAPTCHA Support <supp...@recaptcha.net> wrote:
> >> Hi,
>
> >> All should be back to normal now.  We'll continue to keep an eye on
> >> it, but please let me know if you see any persisting issues with the
> >> reCAPTCHA AJAX API.
>
> >> Some browsers may have cached the empty version of recaptcha_ajax.js,
> >> but if those folks hit shift-reload all should be fine.
>
> >> Thanks,
> >> Colin
>
> > --
> > You received this message because you are subscribed to the Google Groups "reCAPTCHA" group.
> > To post to this group, send email to reca...@googlegroups.com.
> > To unsubscribe from this group, send email to recaptcha+...@googlegroups.com.
> > For more options, visit this group athttp://groups.google.com/group/recaptcha?hl=en.

jennyw

unread,
Sep 17, 2010, 5:20:01 PM9/17/10
to reCAPTCHA
If you cache bust it, like:

http://www.google.com/recaptcha/api/js/recaptcha_ajax.js?234

It brings up code. Not sure if it works … we're going to try it out
soon.

Ed

unread,
Sep 17, 2010, 5:20:51 PM9/17/10
to reCAPTCHA
I get a blank page on both of these steps.


On Sep 17, 2:14 pm, reCAPTCHA Support <supp...@recaptcha.net> wrote:
> Hi,
>
> Can you please try:
>
> 1) Going tohttp://www.google.com/recaptcha/api/js/recaptcha_ajax.js
> and holding down "shift" while hitting the reload button?
> 2) Going tohttps://www.google.com/recaptcha/api/js/recaptcha_ajax.js
> and seeing if you get a non-blank page.
>
> Are you behind any proxies or anything else that might be erroneously
> caching the blank version of the Javascript?
>
> Thanks!
>
> Colin
>
>
>
> On Fri, Sep 17, 2010 at 5:11 PM, Bill Orcutt <orc...@gmail.com> wrote:
> > I'm still seeing an empty response
>
> >http://www.google.com/recaptcha/api/js/recaptcha_ajax.js
>
> > On Sep 17, 2:01 pm, reCAPTCHA Support <supp...@recaptcha.net> wrote:
> >> Hi,
>
> >> All should be back to normal now.  We'll continue to keep an eye on
> >> it, but please let me know if you see any persisting issues with the
> >> reCAPTCHA AJAX API.
>
> >> Some browsers may have cached the empty version of recaptcha_ajax.js,
> >> but if those folks hit shift-reload all should be fine.
>
> >> Thanks,
> >> Colin
>
> > --
> > You received this message because you are subscribed to the Google Groups "reCAPTCHA" group.
> > To post to this group, send email to reca...@googlegroups.com.
> > To unsubscribe from this group, send email to recaptcha+...@googlegroups.com.
> > For more options, visit this group athttp://groups.google.com/group/recaptcha?hl=en.

reCAPTCHA Support

unread,
Sep 17, 2010, 5:22:49 PM9/17/10
to reca...@googlegroups.com
To those for whom the JS is still empty, it would help if I knew:

1) What country are you located in?
2) What browser / OS are you using?
3) Do you get a non-blank page if you do Jenny's trick:
http://www.google.com/recaptcha/api/js/recaptcha_ajax.js?1234

Thanks,
Colin

> For more options, visit this group at http://groups.google.com/group/recaptcha?hl=en.

Mark Ketchum

unread,
Sep 17, 2010, 5:24:04 PM9/17/10
to reCAPTCHA
Eggzactly the same here as reported by Bill Orcutt. Still nothing.

Ed

unread,
Sep 17, 2010, 5:23:59 PM9/17/10
to reCAPTCHA
if i chace-bust the ajax links, i get the code
if i cache bust my site, captcha still does not appear

reCAPTCHA Support

unread,
Sep 17, 2010, 5:25:43 PM9/17/10
to reca...@googlegroups.com
Hi Ed,

After cache-busting the ajax link and then shift-reloading your site,
does it show up? Can you send a link to your site that shows an AJAX
reCAPTCHA so I can take a look at it? Thanks.

Colin

> For more options, visit this group at http://groups.google.com/group/recaptcha?hl=en.

Mark Ketchum

unread,
Sep 17, 2010, 5:28:20 PM9/17/10
to reCAPTCHA
Still blank response on http://www.google.com/recaptcha/api/js/recaptcha_ajax.js

1. U.S.A. (San Francisco, CA)
2. Win7/64 & Ubuntu ??, Firefox 3.6.8, IE 8.0, Chrome 6.0
3. Jenny's trick works but normal still comes up blank

Ed

unread,
Sep 17, 2010, 5:31:38 PM9/17/10
to reCAPTCHA
US
Firefox & IE7 / windows xp

Bill Orcutt

unread,
Sep 17, 2010, 5:39:27 PM9/17/10
to reCAPTCHA
Still blank response on http://www.google.com/recaptcha/api/js/recaptcha_ajax.js

1. U.S.A. (San Francisco, CA)
2. Mac OSX
3. Jenny's trick works but normal still comes up blank

Mark Ketchum

unread,
Sep 17, 2010, 5:46:14 PM9/17/10
to reCAPTCHA
Put Jenny's trick on my website and it works now.

On Sep 17, 2:39 pm, Bill Orcutt <orc...@gmail.com> wrote:
> Still blank response onhttp://www.google.com/recaptcha/api/js/recaptcha_ajax.js

ajc

unread,
Sep 17, 2010, 6:12:36 PM9/17/10
to reCAPTCHA
Jenny's trick works, but I don't want to do a push to production for
this if I don't have to. Will this be fixed sometime soon?

Adam

reCAPTCHA Support

unread,
Sep 17, 2010, 6:25:46 PM9/17/10
to reca...@googlegroups.com
Update: As far as I can tell, the issue should be fixed, but I'm still
looking into possible issues with caching on our (reCAPTCHA's) end.
In the worst case, the browsers should only cache the faulty JS file
for one hour (according to our cache-control headers), but not all
browsers are well-behaved...

Anyhow, I'm still looking into it but don't have anything concrete to
report at the moment.

Colin

> For more options, visit this group at http://groups.google.com/group/recaptcha?hl=en.

cali_jonny

unread,
Sep 17, 2010, 6:30:00 PM9/17/10
to reCAPTCHA

Bill Orcutt

unread,
Sep 17, 2010, 6:32:30 PM9/17/10
to reca...@googlegroups.com
Yeah, it's definitely not a browser caching issue.

ajc

unread,
Sep 17, 2010, 6:39:39 PM9/17/10
to reCAPTCHA
I cleared my browser cache and I am still getting an empty
recaptcha_ajax.js file. I agree that this is not a browser caching
issue. I would guess that the file is cached on content distribution
servers.

reCAPTCHA Support

unread,
Sep 17, 2010, 6:48:30 PM9/17/10
to reca...@googlegroups.com
> I cleared my browser cache and I am still getting an empty
> recaptcha_ajax.js file. I agree that this is not a browser caching
> issue. I would guess that the file is cached on content distribution
> servers.

That's my best guess as well, but I actually can't make that change
myself. I've escalated to the folks at Google who handle that sort of
stuff, and will update here when I get an ETA from them or
confirmation that it's been cleared from all the caches on Google's
end.

In the meantime, if this is still affecting your site, changing your
code to add the ?1234 to the end of the recaptcha_ajax.js URL (as
suggested earlier in the thread) is a suitable workaround.

Colin

Mark Ketchum

unread,
Sep 17, 2010, 6:49:37 PM9/17/10
to reCAPTCHA
So with fear & trepidation I pushed Jenny's trick to production (as
reported an hour ago) and it still works. The original code (still up
on a test server) remains non-working.

What is the risk that the tricked code is gonna break when a real fix
is made? I'd rather leave this alone for a while.

And someone responded to me instead of the list:
>RO (Bv) - Win7 32 / WinXP 32 / Win2003 64 - IE6/IE7IE8/Firefox 3.5
>Http return empty file
>Https work fine
>Trick work fine
But https does NOT work for me.

reCAPTCHA Support

unread,
Sep 17, 2010, 6:52:29 PM9/17/10
to reca...@googlegroups.com
> What is the risk that the tricked code is gonna break when a real fix
> is made? I'd rather leave this alone for a while.

The "tricked code" won't break when the real fix is made. Adding the
?1234 at the end just gets the latest version of the file (as opposed
to the version which is cached somewhere).

Colin

vegan...@gmail.com

unread,
Sep 17, 2010, 7:39:13 PM9/17/10
to reca...@googlegroups.com, reca...@googlegroups.com
I haven't really looked into this, but my guess would be that the url with the cache busting param is also cached, but with a different expiry. To play nice with google's cdn it'd probably be best to change the URL back sometime in the future and rewrite your code to have a test for and fallback in case the recaptcha js cannot be loaded.

Sent from a mobile device ... Please excuse typos

reCAPTCHA Support

unread,
Sep 17, 2010, 7:43:18 PM9/17/10
to reca...@googlegroups.com
Hi all,

We pushed a change a short while ago that fixes the issue if you are
using the legacy recaptcha.net JavaScript URL
(http://api.recaptcha.net/js/recaptcha_ajax.js). If you are using the
recaptcha.net URL for your Javascript, all should now be working fine.
The change for www.google.com/recaptcha/api/js/recaptcha_ajax.js will
take longer; still no ETA on that (sorry.)

In the meantime, if you're still using the broken URL, the fix
presented earlier in this thread will work (link to
http://www.google.com/recaptcha/api/js/recaptcha_ajax.js?1234) or you
can change your link to the older URL
(http://api.recaptcha.net/js/recaptcha_ajax.js if your site uses HTTP,
https://api-secure.recaptcha.net/js/recaptcha_ajax.js if your site
uses HTTPS.)

Thanks everyone for your understanding.

Colin

--

Ed

unread,
Sep 17, 2010, 7:57:12 PM9/17/10
to reCAPTCHA
my captcha is back
thanks

GB

unread,
Sep 18, 2010, 12:15:52 AM9/18/10
to reCAPTCHA
My reCaptcha seems to be down aswell, I'm using the PHP API and it is
returning a blank page.
-GB.

i-imagine

unread,
Sep 18, 2010, 7:32:14 AM9/18/10
to reCAPTCHA
7 am 2010-09-18 on the eastern US coast on a Verizon connection.

ReCAPTCHA does NOT return ANYTHING. from:
http://www.google.com/recaptcha/api/js/recaptcha_ajax.js

But it works FINE using:
http://api.recaptcha.net/js/recaptcha_ajax.js

YES! I AM SHOUTING AS LOUDLY AS POSSIBLE WITH THIS FORUM'S FORMATTING!

reCaptcha is now looking like an amateurish, part-time, casual
project.that was acquired for the sole interest of collecting more
data on web surfer's habits.

Free or paid, in today's world if the uptime and reliability isn't
maintained then it is clear that the owners have abandoned it. What a
shame.

It is very possible that 100's of websites are using AJAX recaptcha
with my Coppermine Photo Gallery plugins. Gee...I can not wait until
those trouble reports start rolling in.
What do I tell them? Unreadable characters one week - unreachable
servers in the next weeks? What surprises will be next?

If the owners TRULY have no interest, then they should make their
intention clear instead of recaptcha being left to die slowly.....

THIS IS UNACCEPTABLE

Joe Carver

reCAPTCHA Support

unread,
Sep 18, 2010, 9:15:08 AM9/18/10
to reca...@googlegroups.com
> reCaptcha is now looking like an amateurish, part-time, casual
> project.that was acquired for the sole interest of collecting more
> data on web surfer's habits.

Please don't assume malicious things about us! Our privacy policy as
a Google product is actually significantly stronger than it was when
we were an independent project.

Please see: http://www.google.com/recaptcha/policy

"Other than these end-user-supplied solutions, any data collected from
the sites that use reCAPTCHA will be used only to provide, maintain,
protect, and improve reCAPTCHA and other Google anti-spam services."

In non-lawyer-speak, that basically means "we don't share data with
anyone else at Google except for spam-prevention".

I've been working on reCAPTCHA full-time for over three years, and do
still care strongly about reCAPTCHA; however with the change to Google
infrastructure, there are now some things that are out of our control,
and unfortunately this is one of those things, so it's just as
frustrating to *me* that this hasn't been fixed sooner.

> Free or paid, in today's world if the uptime and reliability isn't
> maintained then it is clear that the owners have abandoned it. What a
> shame.

From our own end we provided a workaround rapidly; unfortunately the
bad code is cached in Google's CDN and we don't have the permission to
flush it out. Unfortunately, the CDN issue probably won't be fixed
till Monday. :( I'm sorry to be the bearer of bad news, so for now
please use the workaround if you can. After implementing the
workaround for api.recaptcha.net/js/recaptcha_ajax.js, we fixed the
issue for >90% of the AJAX API users (who in turn are a small fraction
of reCAPTCHA's overall users).

We'll be adding tests in the future so that it's not possible for us
to push a binary with empty Javascript files. (We're still not sure
how this happened in the first place, since we've not touched the
Javascript files in over a month; something really bizarre must have
happened.)

Colin

i-imagine

unread,
Sep 18, 2010, 10:06:44 AM9/18/10
to reCAPTCHA
"Please don't assume malicious things about us! Our privacy policy
as
a Google product is actually significantly stronger than it was when
we were an independent project"

That was not intended to be malicious at all. In my opinion there
would be
nothing wrong with complementing a businesses' interest with the offer
of
a free service on the side as long as the interest was made clear.

It is frustrating to see a once rock solid, reliable service go awry.
I am sure best efforts are being made. I plan to still use and promote
the use of reCaptcha.

d07.RiV

unread,
Sep 18, 2010, 11:49:19 AM9/18/10
to reCAPTCHA
https and ?123 both work for me, but http://www.google.com/recaptcha/api/js/recaptcha_ajax.js
still returns blank.
I'm using Chrome, but Firefox is giving the same error (and clearing
cache doesn't help). Is there a possibility that the page was cached
somewhere deeper in the system?
I do not own the website I'm trying to post at so I can't change the
site code (and I can't post on their support forums for the same
reason).

Bill Orcutt

unread,
Sep 18, 2010, 12:00:29 PM9/18/10
to reca...@googlegroups.com

Mark Ketchum

unread,
Sep 18, 2010, 12:56:19 PM9/18/10
to reCAPTCHA
So, all this (~18 hours of unreliability?) because we are not supposed
to host that bit of javascript on our own servers, and are advised to
rely on third-party (reCaptcha.net, now Google) servers? And the no-
self-hosting advisory is supposedly to assure better reliability? This
doesn't add up.

Maybe after this incident, the powers-that-be could re-evaluate the
hosting advice on that bit of script.

Cuz it seems to me right now, that the obvious way to improve chances
of a good copy of the google-hosted script is to use
"recaptcha_ajax.js?[server-generated-random-number]" for grabbing the
copy.

On Sep 18, 9:00 am, Bill Orcutt <orc...@gmail.com> wrote:
> http://www.google.com/recaptcha/api/js/recaptcha_ajax.jsis working now for me...
>
> On Sep 18, 2010, at 8:49 AM, d07.RiV wrote:
>
> > https and ?123 both work for me, buthttp://www.google.com/recaptcha/api/js/recaptcha_ajax.js

GB

unread,
Sep 18, 2010, 3:59:13 PM9/18/10
to reCAPTCHA
The PHP API still does not work for me.
It returns a blank page.
-GB.

reCAPTCHA Support

unread,
Sep 19, 2010, 6:12:40 PM9/19/10
to reca...@googlegroups.com
Hi all,

www.google.com/recaptcha/api/js/recaptcha_ajax.js should now be the
correct (non-empty) file everywhere; the bad entry is finally cleared
out of the cache. Let us know if you're still experiencing any sort
of problem.

We've added testing code that will ensure that this problem won't
recur in the future.

(If you're interested, the root cause was a change in our JavaScript
compiler; the JS compiler created a blank output file for our input
file, without giving any sort of warning. We added a unit test which
sanity-checks the compiler output. Also, we've fixed the caching so
that any bad push in the future won't cache a bad file for a
potentially-indefinite period of time.)

Sorry again to everyone who was affected by this issue.

Colin

Reply all
Reply to author
Forward
0 new messages