Any guide on how to scrape from leaflet maps

44 views
Skip to first unread message

Vaidya

unread,
Dec 12, 2022, 4:06:44 AM12/12/22
to data...@googlegroups.com
Am trying to get data of STP locations from this site:
http://stpp.bwssb.gov.in/default.aspx

Has anyone tried scraping from leaflet maps into shape files and written a guide?

Thanks,
Vaidya

Devdatta Tengshe

unread,
Dec 12, 2022, 4:13:45 AM12/12/22
to data...@googlegroups.com
Hi Vaidya,

There isn't a single way to send data to a map built with leaflet, and there could be several different ways this could be done.

Looking at the page you have mentioned, they have hardcoded the data in hidden input tags in the HTML itself, it should be straightforward to copy the data to a text file, and get the locations.

Look in the source code for hidden input tags with names such as hid_1, hid_2 and so on.


Regards,
Devdatta


--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAHVy6PEnvZ%2Bt4qhODXmRgrrXrhHR5aAQR9OP3e_6TFauPvB3pg%40mail.gmail.com.

Vaidya

unread,
Dec 12, 2022, 4:18:32 AM12/12/22
to data...@googlegroups.com

Vivek Matthew

unread,
Jan 22, 2023, 11:16:58 PM1/22/23
to datameet
Hi Vaidya,

I had come across this BWSSB site a couple of weeks back and found that it's missing a couple of STPs, including large ones like the 60MLD Hebbal STP and smaller ones like the one near Halasuru. From what I've seen, OpenStreetMap has better coverage of STP locations (and in some cases internal details) in the BWSSB region, so if you're still interested in BWSSB STP data, you might want to check the data on OpenStreetMap. This Overpass query should get you all the STPs in the BMRDA region: https://overpass-turbo.eu/s/1qto

Regards,
Vivek

Reply all
Reply to author
Forward
0 new messages