Parsehub stuck on "Adding"

609 views
Skip to first unread message

Mark Runge

unread,
Apr 19, 2021, 9:06:44 PM4/19/21
to Web Scraping
Hi
I'm a newbie doing my first scrape.
Please check out the attached screen-shot.
Parsehub on my 16GB Corei7 10th Gen Windows 10 machine has been stuck like this for 4 hours now.
Do I just keep waiting?
Many thanks for any advise.
Mark.
Untitled.png

Andrew11

unread,
Apr 19, 2021, 9:41:18 PM4/19/21
to Web Scraping
ParseHub's got its bad points, including freezing and crashes. You kind of have to work around them. Save your project after every significant change, turn off Visuals enabled (see bottom middle of your screenshot) when possible, and use targeted selections like CSS or XPath over ParseHub auto select. I usually give up on it after 15 minutes when it's frozen.

Mark Runge

unread,
Apr 19, 2021, 11:50:17 PM4/19/21
to Web Scraping
Hi Andrew
Many thanks for your advice.
Regards, Mark.

b...@parsehub.com

unread,
Apr 20, 2021, 3:24:10 PM4/20/21
to Web Scraping
Hi! 
This sometimes happens when you try to modify an existing select command by making a new selection. Parsehub will try to make a selection node that reconciles the two selections, which can cause it to select every element on the page, causing Parsehub to run out of memory and freeze. To avoid this, you will have to delete the selection and add a new one.
In your case, this is happening because you are making too large of a selection for Parsehub to handle. If your selection will have 1000+ elements, it is possible that Parsehub will run out of memory. If it is possible to apply filters so as to not load all of these listings on the page at once, Parsehub will have a much easier time selecting a smaller number.
Let me know if you have any questions about this!
Cheers,
Ben

Mark Runge

unread,
Apr 20, 2021, 3:29:51 PM4/20/21
to Web Scraping
Hi Ben
I solved the problem by switching to Browse mode and filtering the list.
That meant the selection was small when training Parsehub so it didn't hang.
Obviously when I run it live the list is not filtered so I get the full results I need.
Thanks, Mark.

Andrew11

unread,
Apr 20, 2021, 3:31:26 PM4/20/21
to Web Scraping
I'll remember this the next time someone asks. Thanks for posting your strategy!
Reply all
Reply to author
Forward
0 new messages