I would like to use nokogiri to scrape data from the Wta website.
The information I am looking for concerns single rankings and single road rankings.
Rankings are accessible through the following link:
http://www.wtatennis.com/rankingsJust below the pictures portraying the first single ranked player and the first single road ranked player, there is a menu for accessing the related categories: single, doubles, road singles, road doubles. The problem is that clicking on these links the url in the address bar of the browser does not change. Web inspector shows that these links are all created with the same <a> tag with href="#".
The link
http://www.wtatennis.com/rankings however belongs to the single rankings page, so I assume there should be a hidden link for the road rankings page.
Web inspector shows that they are two different documents, they are not included in the same web document.
Other urls I would need are those allowing to access pagination, in order to get information about players ranked above number 100.
The corresponding numbered links are below the list of the players.
These links are also stubbed out with ’#’:
<a class="footable-page-link" href="#">1</a>
<a class="footable-page-link" href="#">2</a>
<a class="footable-page-link" href="#">3</a>
...
Is there any way to get access to these urls?
I have no idea how they are generated. At first I thought about tabbed-navigation, but there should be a unique page divided in sections accessible through a unique id.