I just did a test of your image based reCAPTCHA. (actually I was trying to submit a post elsewhere and after a handful of tries I noticed a problem, so I started to take notes)
After 30+ attempts (again, I counted 30 tries AFTER I had already regenerated the reCAPTCHA a handful of times), I was unable to find a single example where there was not at least 1 ambiguous image in the set of 9. In hindsight I should have started taking screenshots, but words will have to suffice.
I found the ambiguity to fall under 3 groups. I saw all types pretty equally (with some sets falling into more than one type below). I'll give an example or 2 for each.
- Unrecognizable images: Some are poorly framed to remove context. Some were terribly lit. Some had TERRIBLE artifacting. In all cases this made it impossible to tell what was in the image.
- "OK find the Plants. Is that a mushroom? No it looks more like a lady-bug. Or is it an umbrella? It does looks like a mushroom though..."
- Background items that CLEARLY meet the requirements, or pictures with FAR to many items that MIGHT meet the requirements.
- I was asked to pick photos with French Fries. One of the images showed a plate with a steak and broccoli. However, The person sitting ACROSS the table had a steak with French Fries. The second plate was obviously not the subject of the photo, but the photo DID clearly have the required items in it.
- I was asked to pick photos with Motorcycles. One of the images was of a GIANT parking lot in front of a super-store. There were almost certainly motorcycles in it but there were literally hundreds of vehicles, including trucks pulling trailers with boats, and even some golf carts.
- I was asked to pick photos with Doughnuts. One image showed a table with desserts. This was a 25+ foot table PACKED with what appeared to be every dough or batter based food ever created. There were clearly doughnuts on the table, but you would probably miss them if you only glanced at it.
- Items that may or may not fall into the required group.
- I was asked to pick photos with Motorcycles. There was a picture with a sport bike, a picture with a child riding a dirt bike, a picture with a Vespa style scooter, and a picture with a mountain bike. The sport bike is clearly a motorcycle, and the mountain bike is clearly not, but what about the middle two? I'm not sure where I'm supposed to draw the line.
- I was asked to pick photos with Commercial Vehicles twice. Among the possible choices were a yellow taxi, a pizza delivery scooter, a pickup truck with a decal for a landscaping business, a tractor, and a school bus. What definition of "Commercial Vehicle" and I supposed to be using here?
Now, normally in a case like this, I assume that I am the one with the problem. I must be over-thinking it. This service exists, and people use it. I don't see 100 other posts here about this problem.
But 100% of the cases I looked at? That just seems SO FAR off that I had to come tell someone about it.
Ian