Scraping NBA.com

[Harrison Brown]

I'm trying to scrape some shot-log data from the NBA website using Python + requests, and I'm getting an error:

requests.exceptions.ConnectionError: HTTPConnectionPool(host='stats.nba.com', port=80): Max retries exceeded with url: [insert long url here] (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)

Which is confusing and weird but apparently means the server is refusing my connection. Is this because it thinks I'm flooding it? If so, how long should I wait between requests? Or is it blocking me because of a no-scraping policy I'm unaware of? Any help would be appreciated.

[Evan Zamir]

Can you show the code in a gist? Hard to diagnose otherwise.

--
You received this message because you are subscribed to the Google Groups "nbawowy forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nbawowy+u...@googlegroups.com.
To post to this group, send email to nba...@googlegroups.com.
Visit this group at http://groups.google.com/group/nbawowy.
To view this discussion on the web visit https://groups.google.com/d/msgid/nbawowy/CAOw8zE8SUCCMOitRX0Nto%2BWTYJayjtF8-6B%2B%2BTTDfXb%2Bj%2B%3DEcw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Seth Partnow]

Break it into smaller bites? I've had problems with timing out when I try to grab all the logs in one big jump, so I go by player ID (though Nick Calathes is broken)

To view this discussion on the web visit https://groups.google.com/d/msgid/nbawowy/1420683531793.4d16246b%40Nodemailer.

[Harrison Brown]

Eh, it worked when I tried it a third time, I guess it was just a temporary IP block or something of that sort. Who knows.

[Chase Caudill]

I have been unable to run queries for the past 3 days, has anyone else ran into this problem? None of the names show up in the results table, it's just headings.

Thanks and Regards,

Sent from my iPhone

To view this discussion on the web visit https://groups.google.com/d/msgid/nbawowy/CAOw8zE9VNdKZOqBTq9W4fjtzex6tWwWfDzjHpJR81by_TKF2gA%40mail.gmail.com.

[Evan Zamir]

So there's been some oddities with some of the JS libraries I've been using. It's working for me intermittently if I click on a couple different teams and then run a query. If you click in the player selection boxes and see a list of players it should work, but if you don't see any players there, try clicking on another team.

Hopefully I can figure out what's really going on and fix it.

To view this discussion on the web visit https://groups.google.com/d/msgid/nbawowy/3B897B02-08E0-4409-9155-ABBAC48F27AF%40gmail.com.