Data scrape help from PMFBY dashboard

167 views
Skip to first unread message

Anand Dubey

unread,
Jun 2, 2024, 1:47:55 PM6/2/24
to datameet
Hello everyone, 

I want to scrape PMBFY dashboard (https://pmfby.gov.in/adminStatistics/dashboard) for village level data provided there under  State Wise Report section (top right hand corner). Since village level data provided are in format which I haven't delt with earlier, so I don't know how to go about scraping it. 

It would be immensely helpful if any one of could suggest me the way to proceed in the following case. 

Thanks!!

Gautam Doshi

unread,
Jul 1, 2024, 1:00:11 AM7/1/24
to datameet
You can try using "Beautiful Soup" package in Python. 

Gora Mohanty

unread,
Jul 2, 2024, 12:07:11 AM7/2/24
to data...@googlegroups.com
On Mon, 1 Jul 2024 at 10:30, Gautam Doshi <gautam....@gmail.com> wrote:
You can try using "Beautiful Soup" package in Python.

?

Please check the site. It is built with Javascript, and BeautufulSoup cannot parse it

Regards,
Gora

Rahul Gupta

unread,
Jul 2, 2024, 12:12:25 AM7/2/24
to data...@googlegroups.com
In that case usually scraping w/ Selenium works.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAAY8Q7WPgOuDs4v-s%2BTvEHKi0BbJY5rqoHyf9ZuRvKLxAkfS4w%40mail.gmail.com.

Gora Mohanty

unread,
Jul 9, 2024, 9:50:16 PM7/9/24
to data...@googlegroups.com
On Tue, 2 Jul 2024 at 09:42, Rahul Gupta <rahulgu...@gmail.com> wrote:
In that case usually scraping w/ Selenium works.

I had suggested that in my original reply, along with a  StackOverflow link. There are better tools than Selenium now, but that will also do the job.

Regards,
Gora

Anand Dubey

unread,
Jul 9, 2024, 9:50:22 PM7/9/24
to data...@googlegroups.com

Thanks a lot everyone for responding.  I have figured this out.


Aayush Malik

unread,
Aug 11, 2024, 10:38:58 PM8/11/24
to datameet
How did you finally do it?
Reply all
Reply to author
Forward
0 new messages