UDISE districts

[Thejesh GN]

Hi All,

I am trying to make sense of UDISE wrt administrative boundaries. 

UDISE has data at the state level, districts and blocks. 

Their state code matches the Local government state code. I think they share the same boundary. 

But their udise district and blocks are different.

In the case of udise districts (Educational districts), most of them match the name of administrative districts ( I am not sure about the area or boundary). But there are some differences, Like

• BELAGAVI was bifurcated into BELAGAVI and BELAGAVI CHIKKODI
• BELAGAVI CHIKKODI is not an admin district
• I belive udise(BELAGAVI and BELAGAVI CHIKKODI) == admin(BELAGAVI)
• UTTARA KANNADA was bifurcated into UTTARA KANNADA and UTTARA KANNADA SIRSI
• TUMAKURU into TUMAKURU and TUMAKURU MADHUGIRI
• SILIGURI is an educational district but not an administrative district. In terms of administration, it has areas from two admin districts.

The educational districts don't cross the state administrative boundaries.

So here are my questions:

1. If I want to compare state-wise; its easy

2. If I want to compare district-wise, I should ideally map Admin Districts to Educational Districts. Is that even possible? Is it worth the effort?

3. From what I have seen, educational blocks are entirely different from statistical blocks. I don't have much info. Do you have any?

4. Is there any documentation about this? 

Here is the list of educational districts of India. There are 734 of them.

https://india-local-government-directory.glitch.me/india-local-government-directory/udise_districts

Just refresh the above URL if it doesn't open the first time.

Thej
--
Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

[Gautam John]

Hi Thej:

> I am trying to make sense of UDISE wrt administrative boundaries.

There isn't any linkage - they are completely independent at least
when I last checked in 2016. What we did was to collect the lat/long
for schools so we could plot them to administrative and electoral
boundaries. And infer educational boundaries from the school points we
had and since we knew ed boundary each school belonged to.

See: https://dise.klp.org.in/about/

I wonder if Sajjad might have any of those scripts handy.

[Emmerich Davies]

Hi Thej and Gautam,

From what I know, Gautam is exactly right.  For example, in Delhi, the Directorate of Education maintains 13 education districts that do not correspond to the 10 administrative districts for Delhi. They are for management and administrative purposes within the Directorate of Education (see here: http://www.edudel.nic.in/mis/schoolplant/school_information.htm and look at by district).  I'm not sure if they maintain maps of these boundaries.

I can't speak for any other states.

Adding to Gautam and others approach beyond KA, you can also get lat/long for a lot of schools from here: https://schoolgis.nic.in/. I believe many on here have also pointed to that site. Scraping that data and matching to DISE data gets you ~85% of the schools.  DISE school codes minus the last two digits gets you villages, so you can then get another couple of percent by matching any schools with missing lat/longs that are in the same village as schools with lat/longs.

From there you could aggregate up to the administrative district.

hth,

Emmerich

[Thejesh GN]

Thanks Gautam and Emmerich.

Here[1] is the summary of everything I know until now, including the list of current UDISE Districts and Blocks along with codes.

I am planning to scrape https://schoolgis.nic.in/. But it seems to be down most of the time. Has anyone here tried scraping it before?

I have not looked at data.gov.in for school list. May be I should check that too.

- [1] https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/

[Devdatta Tengshe]

Hi Thej,

What do you want to scrape from this site? 

I have scraped some of the school locations from this site, but have not tried scraping the school reports.

I also found that the location of many schools is incorrect. ( Schools tagged with Punjab appear in MP and so on)

Regards,

Devdatta

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com.

[Thejesh GN]

I was planning to scrape the location  and school codes.

Reports, may be later.

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com.

[Rahul Gupta]

Hi Tej,

I had scraped district level information earlier. Will share a sample for everyone to have a look at.

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com.

[Thejesh GN]

Devdatta,

Do you have for more than one state. So we can see the extent of error? Even if the error rate is 10% it's not a bad idea to have that data.

Also do school info have meta data like district or taluk? Because they do collect that kind of data from schools in their form. or may be its part of school reports.

Rahul,

Thank you.

Thej
--
Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAKxLuZf4MQJEk4BYvX-0qbQmTbTQaMM5GsowzCt5kpKcqrShQA%40mail.gmail.com.

[Devdatta Tengshe]

Hi Thej

I am attaching a sample of the data in GeoJSON format.

This data is coming from an ArcGIS Server, with the endpoint: https://geoportal.nic.in/nicgis/rest/services/SCHOOLGIS/Schooldata/MapServer/0/

This REST API is documented here https://developers.arcgis.com/rest/services-reference/enterprise/query-map-service-layer-.htm

Regards,

Devdatta

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com.

[Rahul Gupta]

Hi Thej,

Attaching a few sample files for districts in Andhra Pradesh. This is the data I was able to scrape. Let me know if this helps.

Thanks & Regards

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsUTTeKP8LSN-QUq9Y1AkoPZYZbTwZdY2AaTP%3DO%3Dw0e7zw%40mail.gmail.com.

[Thejesh GN]

1. Thanks Dev. I was able to get the school list of all of India. Currently raw GeoJSON is at https://github.com/datameet/udise_schools

2. I will try and flatten the data and do some initial analysis

3. Rahul Gupta - the excel looks good. The udise school code in excel is can be matched map files. Can you add this to a repo? Also for which year is this?  I see that they publish 2013 to 2018 data online.

Thej
--
Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAKxLuZe%3DHBBwx7oNf7TnZajf0ytp3J%2B15cyD5Fd%3DQkW9_gmZ6A%40mail.gmail.com.

[Rahul Gupta]

Hi Thej,

I will try and find some time to work this out in a repo. The data was collection from the following portal - http://src.udiseplus.gov.in/locateSchool/schoolSearch;jsessionid=119CB599B756F0A04673A6F303998B4A.app1Worker

As far as I know, it was for AY 2018-2019. If there is any latest source available, I will be happy to write a scraper and share it with everyone.

Thanks & Regards-

Rahul Gupta

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com.

[Abhilash Chowdhary]

Hi Thejesh,

Thanks for the efforts in collating all this in a GeoJSON file. However, looks like the repository is private. The page returns a 404 for me.

Abhilash

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsWeAOCKPzkyJzj6RVEoK2oev9PSeHv_9_6D4OuPcXxb4A%40mail.gmail.com.

[Thejesh GN]

Sorry, its public now.

I will add readme and other information.

Thej
--
Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAA%2BkmBAGWe2ct3EOq55sHYc5DczXBUb7vrn0rP%2B9go_NZZjz2Q%40mail.gmail.com.

[Abhilash Chowdhary]

Thanks Thejesh. Super helpful!

Abhilash

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsVhf%2BHza8h1gtK9KrDik8S5O%2BrurS2q998UyLDkFjCJpw%40mail.gmail.com.

[Thejesh GN]

I have converted it into a CSV

https://github.com/datameet/udise_schools/tree/master/data

It has about 14 Lakh + schools.

I will do some initial analysis over the weekend. But I am happy to listen. I am guessing this data is at the least 2 years old.

Thej
--
Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAA%2BkmBBzhEeO4ikFfrM45N5Vr-MF2ws%2B0p2GXc_w9VPjHMZYeQ%40mail.gmail.com.

[Apurva Dalwadi]

It has 10 lakh records

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsWGHb-3UVh0yeayfs5HVR%3DYfLmq6_OR9J-57ggu2V8gjQ%40mail.gmail.com.

[Thejesh GN]

I imported the CSV into SQLite. I can see 1450490 rows.

Here is the quick screen-cast on how to do it -> https://www.youtube.com/watch?v=rodMh6wGnoA

The tool I used for SQlite is called https://sqlitebrowser.org/  

Its free and open source. It's available for all three platforms.

Thej
--
Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAD2K3bA0-qwKBZ8BnRPJ87%2BDqsEcC_GcK_HryspruTwZN3GnVg%40mail.gmail.com.

[Akshit Shah]

Hi Rahul,

Since you have already scraped data from <https://src.udiseplus.gov.in/locateSchool/schoolSearch;jsessionid=44DA6E7BC5EA403EAC38ECF43E93098F.app1Worker>,

Can you provide the latest data available for AY 2019-20 to the group?

Also is it possible to get a few attributes from 'School Report Card'? (a pop-up button is made available on the page which opens a PDF)

Kindly upload state wise csv files, so that it is consumable.

Warm Regards,

                                                                        

Akshit Shah

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsWiQoP3b_4DM8g3bBFvatmnNyPZay16zkixuUo91uTwgg%40mail.gmail.com.