website does not have pagination just long scroll bar

[scraper]

The site I want to scrape has a scroll bar including over 200 companies listed. To get to the email address each one has to be selected then the next page has the email address. 

As I understand it you select all contacts on the main page then setup a pagination link for it to continue the process automatically on subsequent pages. 

In this case the site has no pages just a long scroll bar that shows all results 1-200. 

Is there a way to get the system to automatically select the full list without selecting all 200?

[Andrew11]

It sounds like this tutorial page might give you what you need:

https://help.parsehub.com/hc/en-us/articles/360008937774-Looping-through-pages-that-use-AJAX-clicks

If you still have problems post the URL to the index page and I'll try to figure it out.

[James Cooper]

Hello and thank you for reaching out to us! Can you provide the URL of the page you are trying to scrape, or the email address your Parsehub account is registered with? Different websites will have different solutions. For example, you can collect all of the results for some websites by simply inserting a 'Scroll' command at the beginning of a template and instructing it to repeat a few times and that works fine, however, other websites will remove elements from the page as soon as you are not looking at them, which would require a different approach. Once I know more I would be happy to investigate!

James

Parsehub

[scraper]

I've private messaged you the links and the account

[scraper]

Here is the link, https://www.homehardware.ca/en/store-locator the infinite scroll seems like it's the one I need at https://help.parsehub.com/hc/en-us/articles/218187257-Infinite-Scroll.

 It's a bit complicated to understand is there a pre-created template I can modify to scrape this page?

[Andrew11]

It looks like the Store details links can be opened in a new page and have the email address (if any). Does that work on your end?

[scraper]

yes, i can get the info from the next page the problem is that  this is a scroll bar page with 78 entries and has no pages.  

How do I retrieve all the data without manually selecting each entry?

[Andrew11]

Oh, that's not technically "infinite scroll" -- those are the kinds of pages where when you scroll down to the bottom of the page, it loads more results. This one should work with a Select command using the CSS:

.store-locator-results a.link

[scraper]

Thanks, I'm not sure how to implement this can you reply with a link to a  tutorial ?

[Andrew11]

Sure, try this one and let me know if you get stuck:

https://help.parsehub.com/hc/en-us/articles/221197507-Scrape-product-details-ecommerce-website-

[Andrew11]

..,but with the Select command, there's a button that says "ParseHub" or something like that and you can click it to change to "CSS", then add in the statement above.

[scraper]

test run produces results,  however run produces empty results

[Andrew11]

You might need to add a step that fills in the city / province and clicks submit, then check the "Wait X seconds for elements to appear" on the Select.