India 2001 census data village-wise

[Fenella C]

Hello everyone, 

I am wondering if any of you have the village-wise 2001 Indian census data in a spreadsheet (or similar) format? I am basically looking for information at the village level from the 2001 census (e.g., population of the village, number of households in the village, etc.)

The data is available online at the census website here http://www.censusindia.gov.in/Census_Data_2001/Village_Directory/View_data/Village_Profile.aspx but it is not available in a spreadsheet. I have already tried web scraping the data, but it is painfully slow, so I'm wondering if I can find it elsewhere.

Many thanks,

Fenella

[Pravin Carvalho]

Well, the excel files can be purchased from them but they typically give it in a CD. 

--
For more details about this list
http://datameet.org/discussions/
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Fenella Carpena]

Hi Raphael and all,

Thanks for the response. Unfortunately that link was for 2011, but I need 2001 data. Any ideas?

Fenella

On Friday, February 28, 2014, Raphael Susewind <li...@raphael-susewind.de> wrote:

Hey,

this was sent over the list a few days ago:

Hi all,

I know some census 2011 data has been posted already, but I thought I'd
share the primary abstract data I have down to the town/village level.
You can download it here: http://journeyman-data.com/census2011/. Please
see the variable list/readme for details.

Best,
Eric Dodge

> --
> For more details about this list
> http://datameet.org/discussions/
> ---
> You received this message because you are subscribed to the Google
> Groups "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to datameet+u...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.

--
Raphael Susewind | BGHS Bielefeld University, CSASP University of Oxford
      Snail Mail | Melanchthonstr. 4a, 33615 Bielefeld, Germany
   Papers & Blog | http://www.raphael-susewind.de

Please do consider http://www.gnupg.org for encryption (key id A5ED49AE)

[Raphael Susewind]

Hey,

this was sent over the list a few days ago:

Hi all,

I know some census 2011 data has been posted already, but I thought I'd
share the primary abstract data I have down to the town/village level.
You can download it here: http://journeyman-data.com/census2011/. Please
see the variable list/readme for details.

Best,
Eric Dodge

On 01.03.2014 06:23, Fenella C wrote:

[Eric Dodge]

I realize I have the 2001 data but only down to sub-districts and towns, not for villages.

[Nisha Thompson]

Hey,

I have some 2001 data.  Take a look see if it is helpful

https://drive.google.com/folderview?id=0B9MvDRHquaP6TFlmcUhjY2VwalE&usp=sharing

Nisha Thompson
Mobile: 962-061-2245

[Sumit Mishra]

I have received some of the Census'01 village level data that you're looking for. Can send once the entire dataset is available. Let me know if you still need the dataset.

[Rick Morgan]

Hello, 

Are you still looking for this data? With a rather complex Python code I scraped  http://www.censusindia.gov.in/Census_Data_2001/Village_Directory/View_data/Village_Profile.aspx and collected about 90% of all the records over the course of 6 months... The other 10% are corrupt or otherwise missing. I had to move to other tasks, so I walked away, but I plan to collect the remaining records within the next few months.

I have 473,514 complete records. Currently, the majority are in *.html format. The file is rather large, so I will have to send it over in batches. My current project focuses on Assam, so I have parsed this data already and have it in *.csv. It is attached. If interested, I can send the parsing code as well (did that through R bc Python was acting up). Please email me directly at rick[dot]morgan2{at}gmail for the bulk data. This represents a termendous amount of work (and patience) and would appreciate it if you directed other people who are interested in these data to me directly. Thanks.   

 

Maybe you might be able to help me. I am looking for CD Block shapefiles. Any suggestions? 

Cheers, 

Rick Morgan

richardkmorgan.net

[Sharad Lele]

Dear Rick:

Thanks for doing this. Although Census 2001 village amenities data (as these are called) are available also on CDs from Census of India (on small payment), it is great to have them all in one file.

I am looking for taluka/CD block level shapefile for Assam. In the meanwhile, I found this on the Census website itself. It is in pdf form, but might be of some help.

Sharad

[Sharad Lele]

I remembered that Justin had made available an all India taluka/CD block shapefile.

Sharad

[Anand Chitipothu]

On Tue, Dec 16, 2014 at 11:56 AM, Rick Morgan <rick.m...@gmail.com> wrote:

Hello, 

Are you still looking for this data? With a rather complex Python code I scraped  http://www.censusindia.gov.in/Census_Data_2001/Village_Directory/View_data/Village_Profile.aspx and collected about 90% of all the records over the course of 6 months... The other 10% are corrupt or otherwise missing. I had to move to other tasks, so I walked away, but I plan to collect the remaining records within the next few months.

I have 473,514 complete records. Currently, the majority are in *.html format. The file is rather large, so I will have to send it over in batches.

You could upload them to archive.org and share a link here.

Anand

[Rick Morgan]

There are over +400,000 records, so the upload will take a very long time and will require more RAM than I can currently spare. (I have a rather extensive Bayesian measurement model running right now that take priority). Do you know Python? I could give you my scrapping code.  

[Rick Morgan]

Here. Is the code. If you want the *.html and JSON data you can scrape it with this. That said, I will work on converting it all to *.csv as soon as my R console is free. I hope this helps. Cheers. 

On Saturday, March 1, 2014 12:23:17 AM UTC-5, Fenella C wrote:

[Rick Morgan]

Yeah. I found that late last night I am not sure what projection it is on, as the borders are shifted from my known-good district map. I am going to play with this a bit more. He mentioned that he got it from the DevInfo program. When you export the *.kmz and overlay it in google earth, the problem remains. I might end up going through a handful of CRS/projections, those that I know are often used for India, to see if this helps. 

That discussion was a bit heated. I am going to assume that this is not the norm. 

Cheers,
Rick Morgan

On Tue, Dec 16, 2014 at 9:52 PM, Sharad Lele <shara...@gmail.com> wrote:

I remembered that Justin had made available an all India taluka/CD block shapefile.

Sharad

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

["Sharad Lele [शरच्चंद्र लेले]"]

No problem at all. There is no hurry on this whatsoever. I should mention that I already have purchased CDs for 2001 data for several states where I do my research.

Sharad

--

[mukesh ray]

Hello everyone,

                        I was wondering if anyone has access to the village amenities data for 2001. The data for 2011 is available online, but the data for 2001 does not seem to be available online anywhere. I saw this thread of discussion online and I hope someone could help me with the datasets.

Thanks

Mukesh

["Sharad Lele [शरच्चंद्र लेले]"]

Depends upon which state you want them for. Many of us purchased the 2001 datasets at some point, and I would certainly be happy to share what I have because I believe the data should be in the public domain just like 2011 data are ....

Sharad

--

[mukesh ray]

Hi Sharad,

                I wanted data for UP, Uttarakhand, Jharkhand, Bihar, MP and Chhattisgarh. It would be very helpful, if you have them and can share them with me

Thanks

Mukesh

["Sharad Lele [शरच्चंद्र लेले]"]

Mukesh:

I have 2001 data only for MP, and then maybe for Uttarakhand (have to check). Will try to track this down and send via dropbox or something in next few days...

Sharad

[mukesh ray]

Thank you Sharad

To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe.

To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mukesh Ray

["Sharad Lele [शरच्चंद्र लेले]"]

Note that there is a commercial source who sells 2001 CDs. So although it burns me up to have to pay for this data that ought to be in the public domain, if you have the money and your need is urgent...

Contact: bookwe...@gmail.com
M.S. Khurana
Bookwell
3/79, Nirankari Colony,
Delhi-110009
Ph: 011-27601283, Mob: 9810043240


Sharad

[mukesh ray]

Thanks Sharad for the information. I would definitely try to go there, when I visit Delhi, or ask some friend to get it for me.

["Sharad Lele [शरच्चंद्र लेले]"]

Mukesh and others:

Data for Madhya Pradesh Village Amenities 2001 (just the table) has been uploaded here:

https://www.dropbox.com/s/bazvdg9ikxufnz4/MP%20Village%20Amenities%202001.zip?dl=0

Sharad

On 28-11-2016 00:24, mukesh ray wrote:

[mukesh ray]

Thanks Sharad for the data. The data that you sent had information at the District and Tehsil level, but not at the village level. 

To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe.

To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mukesh Ray

["Sharad Lele [शरच्चंद्र लेले]"]

Oops! Sorry, Mukesh, the file name misled me. These look like housing census amenities summaries.

I do have the 2001 village amenities files somewhere, but not able to locate right away. Could take me some time to track them down (several weeks or more).  Will keep you posted.

Sharad

[Chitra Jogani]

Hi Mukesh,

I do have this data, I could make it available to you within a day or so if not a problem.

Thanks,

Chitra

[mukesh ray]

That would be a great help Chitra.

Thanks

Mukesh

To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mukesh Ray

["Sharad Lele [शरच्चंद्र लेले]"]

Chitra:

If you have this data for several of the states requested by Mukesh, I would also be interested in getting a copy.

Sharad

[mukesh ray]

Dear Chitra,

                  Could you please upload the data if you get time.

thanks

Mukesh

On Sun, Nov 27, 2016 at 9:09 PM, Chitra Jogani <chit...@gmail.com> wrote:

To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Mukesh Ray

[Rohit Chand]

Hi All,

Can anyone guide me how to get India 2001 census data village-wise data CD ? 
I need it for a college project. 

Thank you,

[AVANI DARE]

Hi,

The Census Data Village Directory for 2001 of all States is provided in Census Digital Library. Data which you will download is in Excel Format only. Hope this will help you.Check this link http://www.censusindia.gov.in/DigitalLibrary/MFTableSeries.aspx

Warm Regard

Avani Dare
Special Project Associate
Indian Institute of Forest Management, Bhopal

[Nadine K.J.]

Hi everyone,

I am looking for the population for each village according to 2001 census and 2011 census. The links here above in this thread are no longer working.

I looked at: https://censusindia.gov.in/nada/index.php/catalog/?page=1&sk=village%20directory&tag%5B%5D=Census-2001&sort_by=popularity&sort_order=desc&ps=15

and there you can search for each STATE + DISTRICT separately to obtain a VILLAGE DIRECTORY.

However, I wonder if someone has the village population data in one excel sheet of India 2001 and 2011 census.

Thank you so much!

Nadine

[Shiv Hastawala]

Hi Nadine 

It is available here:

https://www.devdatalab.org/shrug_download/

Thanks and regards.

Yours sincerely

Shiv Hastawala

(He/His/Him)

Doctoral Student

Department of Economics

Binghamton University (State University of New York)

Zoom ID: 201 717 2613

www.shivhastawala.com

--

Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---

You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/acaa6132-235a-4535-8104-945673c2c771n%40googlegroups.com.

[Nadine K.J.]

Hi Shiv,

Thank you so much!

Is it also possible to obtain the rural_population per district? (I recall that Census displays also the breakdown of urban/rural population)

Kind regards,

Nadine

[Shiv Hastawala]

Hi Nadine

You can find that in Table A01 of both the 2001 and 2011 Censuses. You can access those tables here:

https://censusindia.gov.in/census.website/data/census-tables#

You will need to select the census year on the left to get the tables from that year.

Thanks and regards.

Yours sincerely

Shiv Hastawala

(He/His/Him)

Doctoral Student

Department of Economics

Binghamton University (State University of New York)

Zoom ID: 201 717 2613

www.shivhastawala.com

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/51100090-e1bd-4311-85a3-15603375ca70n%40googlegroups.com.

[Nadine K.J.]

Hi Shiv,

Thanks again!

In the SHRUG data there are no village names in the Census village files. It appears that the numbers are a collection of the total villages in that State,District combination. I require those for matching, how can I get the names?

Kind regards,

Nadine

[Shiv Hastawala]

Actually all place names are available in the file 'shrid_loc_names'. Please go through their documentation to understand how they define a SHRID. It is basically a village, but you will get the nuances from their docs. 

Thanks and regards.

Yours sincerely

Shiv Hastawala

(He/His/Him)

Doctoral Student

Department of Economics

Binghamton University (State University of New York)

Zoom ID: 201 717 2613

www.shivhastawala.com

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/a52b4f68-ca6e-4496-8480-4e5b97d93a05n%40googlegroups.com.

[Nadine K.J.]

Thanks Shiv!!

Yes I had read the documentation/user manual but was unable to locate it (I didn't think it would be written in the FAQ ;) ). 

If anyone wonders the same: go to "Core Keys" on the download page. 

Thanks for your help and patience :)

Kind regards,

Nadine

[Shiv Hastawala]

My pleasure!

Thanks and regards.

Yours sincerely

Shiv Hastawala

(He/His/Him)

Doctoral Student

Department of Economics

Binghamton University (State University of New York)

Zoom ID: 201 717 2613

www.shivhastawala.com

To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/d0a158d5-8c89-448e-9e82-6d5a3935dd79n%40googlegroups.com.

[S]

Hi everyone,

Does anyone have the consolidated Census 2011 villages amenities dataset?

SHRUG is fantastic, but does not work for my purpose since I need the unit of observation to be exactly per the Census 2011 and not at the level of the shrug ID (which is the lowest common denominator across the 1991, 2001 and 2011 censuses).

Many thanks,

Swetha

[Shiv Hastawala]

Hi Shwetha

If I correctly understand what you need, then I believe you should be able to find it somewhere on this link:

https://censusindia.gov.in/census.website/data/tables

Now, since I am not physically in India, the link doesn't open for me. Funnily enough, it doesn't work with an Indian VPN server either. But I'm pretty sure you will be able to access it if you are in India. However, a caveat is that I last accessed it (using help from a friend in India) around May 2024; so I'm not sure if the link is actually broken right now. If that is the case, then I apologize in advance.

Anyway, if it does work for you, a little word of caution: each census year on this link consists of hundreds (or maybe a little over 1000) of data files, and the search tool sucks quite a bit, with only 10 or so results showing up on each page (I think they deliberately make it difficult for some reason). So you may have to do a lot of manual work to find the right files. Unless you know how to automate the process using python or something.

By the way, this just gave me an idea: does anyone want to voluntarily create a dump of all these files on GitHub so that they are easily accessible to anyone who needs them? I would urge some of the senior members of the group to volunteer for this effort. I think it would be extremely useful for all of us.

Thanks and regards.

Yours sincerely

Shiv Hastawala

(He/His/Him)

Doctoral Graduate

Department of Economics

Binghamton University (State University of New York)

Email ID: shastaw1[at]binghamton[dot]edu

Zoom ID: 201 717 2613

www.shivhastawala.com

To view this discussion visit https://groups.google.com/d/msgid/datameet/1008d60b-c2ce-4ad4-8c2b-e209b86576ben%40googlegroups.com.

[Sharad Lele (शरच्चंद्र लेले)]

Depends on what Shwetha wants:

village-wise primary census abstracts? village amenities tables (now called village amenities directory)? Or something else?

Typically the above data are one file per state, so that should not be so bulky.

Sharad

You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/datameet/CAGiG-AxZOGq_j1ti5jm0omKH76_jArqCVAfvttorKHCCAXOzrQ%40mail.gmail.com.

[Swetha S]

Hi Shiv and Sharad,

Thanks for your responses.

- I was hoping someone might have already consolidated the town and village amenities tables from the states into one dataset.

- Shiv, the links to the tables on the page you shared do not work from India either. So far the best way to locate the files seems to be to search for "district census handbook" on https://censusindia.gov.in/nada/index.php/catalog/. The title is at odds with the content - the district census handbooks bring up the village and town amenities Excel files for that state.

A public repository of all the files would be a much-needed public good. I'm surprised there isn't one already. 

Best,

Swetha

To view this discussion visit https://groups.google.com/d/msgid/datameet/CAGiG-AxZOGq_j1ti5jm0omKH76_jArqCVAfvttorKHCCAXOzrQ%40mail.gmail.com.

[Sharad Lele (शरच्चंद्र लेले)]

Hi Shwetha:

I have uploaded the rural and urban 'directories' (amenities directories) for all states here. Please check and see if this is what you want.And if any state is missing.

I don't think I have PCA data for all states already downloaded but will check. Am sure there are others in datameet who are better at scraping the current (totally messed up and user un-friendly Census website). But i thought we can make a start here.

Sharad

You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/datameet/CAH9LZCVkD5PgAF4uhFsEh8JLkk1cY%2B%2B0VV8vT8UPH%2BOJo%3DFhGg%40mail.gmail.com.

[Sharad Lele]

And since I was cursing the census website, I found that they have another website which is more user friendly in terms of finding and downloading data tables:

https://censusindia.gov.in/census.website/data/census-tables

I am downloading all Primary Census Abstracts from here and will post them soon in the same link as above

Sharad

[Swetha S]

Thanks a lot! This is helpful - especially because I couldn't find the town/village directories 5 states/UTs on the census site.

The town amenities directories in your folder look complete. But I think the village file is missing for Gujarat (state 24)

[Sharad Lele (शरच्चंद्र लेले)]

Gujarat file is sitting outside the zip file. Also Maharashtra.

[Sharad Lele]

I have now also uploaded a zip file with all PCA 2011 data. The files are unfortunately district-wise, but hopefully easy to integrate. There is one catch, however: Only 640 files were available on the website, although I think there should be 662. Perhaps PCA was not available for those 22 districts? Can someone throw some light on this? Or locate them separately and send to me to upload here?

[Devdatta Tengshe]

Hi Sharad,

Why do you think there should be 622 files for the 2011 census? I recollect that the Census 2011 had only 640 districts.

Regards,

Devdatta

To view this discussion visit https://groups.google.com/d/msgid/datameet/69cd0a66-c431-469d-9764-22bf55792013n%40googlegroups.com.

[Sharad Lele]

Somewhere in my download it send 662 files but then only 640 were downloaded. So I formed the impression that there should be 662 (not 622). Anyway, if 640 is correct, great!

[Sharad Lele]

I have now managed to locate the full Primary Census Abstract for India (Rural) as a SINGLE FILE. Uploading the same, in addition to the zip file which contains districtwise files.