HELP! Proxies/Scraping Amazon based on current location

89 views
Skip to first unread message

Nicole

unread,
Oct 1, 2021, 8:27:23 AM10/1/21
to Web Scraping
Hi. I’m having trouble figuring out how proxies work. When I run a project to scrape delivery dates from Amazon in TEST mode, it returns the information I expect (based on my NYC location). However, when I do a REAL run it returns different information (I assume because it is using the parsehub IP addresses that are outside of NYC). 

My questions:
1) What exactly do I need to do/set in the advanced > network > connection settings to get the REAL run to use MY ip address (so the output looks like the TEST run)?

2) I researched some free NYC proxies (http://free-proxy.cz/en/proxylist/region/New%20York/all/ping). Would using one of these fix my problem? How exactly would I set these up in the advanced > network > connection settings?

Thank you!
Nicole

Andrew11

unread,
Oct 1, 2021, 9:28:28 AM10/1/21
to Web Scraping
I think the advanced->network settings only affect your Test Run, not the real run. The only thing to change would be in the Project settings where you enter your proxy IP address(es) after checking Rotate IP.

Andrew11

unread,
Oct 1, 2021, 9:34:11 AM10/1/21
to Web Scraping
However there might be a way you don't need proxies. At the top left of the Amazon page when you're not signed in, there's a map pointer where you can enter a custom zip code in NY. You'd still need IP rotation, and I recommend against signing in using your Amazon account because they might hold the scraping against you.

sh...@parsehub.com

unread,
Oct 4, 2021, 11:06:41 AM10/4/21
to Web Scraping

Hi,

To use custom proxies in your ParseHub runs the feature will first need to be enabled from your account. Once enabled, you can add your proxies to a field in the project settings tab. Any changes you rare making the the ParseHub application settings will only effect your local machine. 

This guide shows you how to format and add your custom proxies for use within ParseHub. Note: This feature is included with all of our paid plans.

Cheers,
Shan
Reply all
Reply to author
Forward
0 new messages