#COVID19 mohfw data

644 views
Skip to first unread message

Thejesh GN

unread,
Mar 13, 2020, 8:06:23 AM3/13/20
to datameet

- I have been scraping and diffing the #COVID19 data at https://t.co/qhdbOGGaeh  every 12 hours

- Converting them into clean JSON and made a simple API

- You can use the below URL if you like

https://data.thejeshgn.com/covid19/_design/india/_view/incidents?include_docs=true&limit=5&descending=true



Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Guneet Narula

unread,
Mar 14, 2020, 1:25:33 AM3/14/20
to datameet
This is great, thanks!

Thejesh GN

unread,
Mar 14, 2020, 3:18:43 PM3/14/20
to datameet
Some interesting data work

Growth of cases: How long did it take for the number of confirmed cases to double?



Thej
--

Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/5de81071-deeb-461c-b2e6-81668d8b290c%40googlegroups.com.

Thejesh GN

unread,
Mar 15, 2020, 3:01:17 AM3/15/20
to datameet
The data on http://www.mohfw.gov.in/ is getting updated very slowly and there are some changes

- They have renamed Cured to Discharged
- Discharged number is reduced to 10 from 9.  Don't know why. At 14.03.2020 at 04:55 PM it was 10 and 15.03.2020 at 08:55 AM its 9.  UP had 5 as discharged and now its 3. Don't know what happened "2"


On my side
- I am also to backup raw html - https://github.com/datameet/covid19



Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Guneet Narula

unread,
Mar 15, 2020, 4:12:28 AM3/15/20
to data...@googlegroups.com

A growth chart of total number of cases based on the data you are parsing would be very useful. I'll see if I can put something together, working on a district wise reports map for now. I think more granularity in terms of location will be useful in the coming weeks (?), although it requires quite a bit of news media research to get the numbers correct.

Also, about the MoHFW numbers: I am assuming total active cases will be confirmed cases (indians) + foreigners - discharged - deaths. Right?

- Guneet

You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsV8RXJaZjwYyNnbtb%3DUiAyMBeAj05ucLqef4%3DzxjtHLVA%40mail.gmail.com.
-- 
sputznik.com / 9717664996
keybase.io/guneetnarula

Thejesh GN

unread,
Mar 15, 2020, 5:55:13 AM3/15/20
to datameet
>>> Also, about the MoHFW numbers: I am assuming total active cases will be confirmed cases (indians) + foreigners - discharged - deaths. Right?
I would say yes.

But I don't see them officially publishing total ACTIVE cases. They publish only total confirmed cases.

Total confirmed cases = Total Confirmed cases (Indian National) + Total Confirmed cases ( Foreign National )


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Manish Gupte

unread,
Mar 15, 2020, 6:01:49 AM3/15/20
to datameet
According to the our world in data link that you sent:

"However, in an ongoing outbreak the final outcomes (death or recovery) for all cases is not yet known. The time from symptom onset to death ranges from 2 to 8 weeks for COVID-19.10 This means there are individuals who are in the early or mid-stages of infection who will die at a later date.

We therefore cannot give a definitive figure for the mortality risk of the disease."

Manish


Thejesh GN

unread,
Mar 15, 2020, 6:28:19 AM3/15/20
to datameet
Guneet,

Here is the API endpoint if you like to use


Returns

{
"total_rows":90,
"offset":0,
"rows":[
{
"id":"2020-03-15T12:00:00.00+05:30|up",
"key":"2020-03-15T12:00:00.00+05:30|up",
"value":{
"_id":"2020-03-15T12:00:00.00+05:30|up",
"_rev":"1-db2db4604d0ae6e545b0557697a4e866",
"state":"up",
"report_time":"2020-03-15T12:00:00.00+05:30",
"confirmed_india":11,
"confirmed_foreign":1,
"cured":3,
"death":0
}
}
]
}



- Play with limit and offset to get more data.
- Cache locally as much as possible
- No Guarantees

I will also try and do some growth map.

Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Sunil Prabhakar

unread,
Mar 15, 2020, 10:09:45 AM3/15/20
to data...@googlegroups.com
Dear All,
Pl see.these websites. They might be helpful to you. I can send some additional resources too if required.

Thejesh GN

unread,
Mar 16, 2020, 8:28:51 AM3/16/20
to datameet
Extracted some more from archive.org and added them to the list. So now we have data from 10th March.

I also have a JSON dump for download at


You can download and host it on your server if you like.

Also here is aggregation. It took about 5 days to double. At the same rate we will cross 200 by 20th.

{"rows":[
{"key":["2020-03-10T12:00:00.00+05:30","total_confirmed"],"value":47},
{"key":["2020-03-11T17:30:00.00+05:30","total_confirmed"],"value":60},
{"key":["2020-03-12T11:00:00.00+05:30","total_confirmed"],"value":73},
{"key":["2020-03-12T18:00:00.00+05:30","total_confirmed"],"value":74},
{"key":["2020-03-13T10:00:00.00+05:30","total_confirmed"],"value":75},
{"key":["2020-03-13T22:15:00.00+05:30","total_confirmed"],"value":79},
{"key":["2020-03-14T09:00:00.00+05:30","total_confirmed"],"value":83},
{"key":["2020-03-14T16:55:00.00+05:30","total_confirmed"],"value":84},
{"key":["2020-03-15T08:55:00.00+05:30","total_confirmed"],"value":93},
{"key":["2020-03-15T12:00:00.00+05:30","total_confirmed"],"value":107},
{"key":["2020-03-15T17:00:00.00+05:30","total_confirmed"],"value":107},
{"key":["2020-03-15T23:30:00.00+05:30","total_confirmed"],"value":110},
{"key":["2020-03-16T16:00:00.00+05:30","total_confirmed"],"value":114}
]}







Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Thejesh GN

unread,
Mar 16, 2020, 11:51:54 AM3/16/20
to datameet
I wrote about it so people can find it easily on Google. 

https://thejeshgn.com/2020/03/16/novel-corona-virus-covid19-archive-api-india-data/



Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Guneet Narula

unread,
Mar 16, 2020, 3:35:19 PM3/16/20
to data...@googlegroups.com

Amazing, thanks Thej. I am going to get to it in sometime.

Just put this district-wise map together https://fieldmaps.in/covid19/ based on news reports. Data comes from a google sheet https://docs.google.com/spreadsheets/d/e/2PACX-1vRlSCAn1nS4h9n9Fp25iuOsH54RfMUjj3xX5CZqjGUqYCVXgwgtJojuqVeqekazs2TkSJ95Jwplo7lL/pubhtml#

Some issues:

- I am using the district shapefiles from NIC's ArcGIS REST services at https://webgis1.nic.in/publishing/rest/services/bharatmaps it's a bit slow and sometimes just times out completely

- State shapefiles makes it even slower, so I have ignored it for now

- Code is a bit messy, and has some documentation here https://github.com/guneetnarula/covid19-in any help would be appreciated

- Coming to the data, it is not the same as the MoHFW one since it is based on news reports. If any journalists or people tracking the news closely would like to help with this, then please let me know

More updates soon.

- Guneet

You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsUd8-Ffwd0y_oQQs%2BULKQNDhPwyv9oFDrb2UnPjbQ-Y9Q%40mail.gmail.com.

Guneet Narula

unread,
Mar 16, 2020, 3:49:28 PM3/16/20
to datameet
Forgot two points:

- I have added an active cases column. Seeing this in other country dashboards/analysis that an idea of how many people have not yet recovered or are still infectious is important. Right now this is just calculated by subtracting numbers of discharged and deaths from confirmed.

- In some cases, I am not able to find the district details. So I have added them to the capital or "epicentre" of the cases in the state.

- The map is not mobile friendly as of now.

Cheers,
Guneet
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscribe@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscribe@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscribe@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+unsubscribe@googlegroups.com.

Thejesh GN

unread,
Mar 17, 2020, 4:18:38 AM3/17/20
to datameet
Looks good.

@guneet
I think it's a good idea to cache the geojson on server and on browser (like localstoreage).


Also the code for the scraper[1] is published now. Code quality isn't great but it works.



Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/7650ad9d-3136-4ab5-9c32-14a8aa0b5087%40googlegroups.com.

Guneet Narula

unread,
Mar 17, 2020, 4:32:05 AM3/17/20
to data...@googlegroups.com

Devdatta scraped it into a geojson :)

Vikram Shetty

unread,
Mar 17, 2020, 7:25:22 AM3/17/20
to data...@googlegroups.com
We are collecting the information from social media and trying to get it confirmed and publishing it here: https://www.covid19india.org/

Regards,
Vikram

Sarabjeet Matharu

unread,
Mar 17, 2020, 7:25:27 AM3/17/20
to data...@googlegroups.com
Hi

I'm new to the data meet group. Can you help me understand how I can download the COVID data?

Thanks, 
Sarabjeet

Anand Katakam

unread,
Mar 17, 2020, 8:32:03 AM3/17/20
to datameet
Hello,

Not sure if this has been shared before, but this is parsing data pretty well --> https://covidout.in/
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Souvik Sankar Mitra

unread,
Mar 17, 2020, 10:17:10 PM3/17/20
to datameet
Using the database I made it here. https://indiacorona.000webhostapp.com/

Guneet Narula

unread,
Mar 18, 2020, 1:42:34 AM3/18/20
to datameet
Thanks Vikram, this is comprehensive. Maybe we can collaborate.

- Guneet
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Thejesh GN

unread,
Mar 19, 2020, 1:31:41 AM3/19/20
to datameet
https://icmr.nic.in/node/39071

ICMR publishes no of tests done every day in the form of pdf. I will see if I can scrape them. Also if possible recover historical data.



Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/965e9075-00f4-4d9f-97f9-74616bbccd30%40googlegroups.com.

atanu...@gmail.com

unread,
Mar 19, 2020, 7:13:26 AM3/19/20
to data...@googlegroups.com

Anand Chitipothu

unread,
Mar 20, 2020, 9:22:30 PM3/20/20
to data...@googlegroups.com
On Thu, Mar 19, 2020 at 11:01 AM Thejesh GN <i...@thejeshgn.com> wrote:
https://icmr.nic.in/node/39071

ICMR publishes no of tests done every day in the form of pdf. I will see if I can scrape them. Also if possible recover historical data.

Looks like they have been publishing an update every day. I could find a link to March 17 via archive.org, but that file is not there on the server.  Good to archive it every day.


Anand

Anand Chitipothu

unread,
Mar 20, 2020, 9:26:57 PM3/20/20
to data...@googlegroups.com
On Mon, Mar 16, 2020 at 5:58 PM Thejesh GN <i...@thejeshgn.com> wrote:
Extracted some more from archive.org and added them to the list. So now we have data from 10th March.

I also have a JSON dump for download at


You can download and host it on your server if you like.

Also here is aggregation. It took about 5 days to double. At the same rate we will cross 200 by 20th.

We crossed the prediction. We are 236 as of yesterday, the 20th.

Is anyone publishing the data by city?

Anand

Saketha Ramanujam

unread,
Mar 21, 2020, 6:24:27 AM3/21/20
to data...@googlegroups.com

Neha Kulkarni

unread,
Mar 21, 2020, 9:57:08 AM3/21/20
to data...@googlegroups.com
Hi Saketh,
Would request you to please remove it if it is not from an official public source, else please quote the source. 

Regards,
Neha

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.

Thejesh GN

unread,
Mar 21, 2020, 10:35:34 AM3/21/20
to datameet
Looks like it's private. Not able to access. 


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.

Thejesh GN

unread,
Mar 21, 2020, 11:13:34 AM3/21/20
to datameet
This is a dashboard of network connections and clusters to track outbreak and transmission COVID19 in India

https://covid19india-network.now.sh/

@guneet
Can you share you Google sheet (that drives your app) ?


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Soumya Ranjan

unread,
Mar 21, 2020, 12:23:22 PM3/21/20
to datameet
Hi Everyone,

I am new to datameet!

I wanted to understand the healthcare capacity of India & how it will cope with the COVID-19 situation. I started by scraping some data from the NHRR website, I am in the process of collecting more such information.

Thanks,
Soumya Ranjan 



On Saturday, 21 March 2020 20:43:34 UTC+5:30, Thejesh GN wrote:
This is a dashboard of network connections and clusters to track outbreak and transmission COVID19 in India

https://covid19india-network.now.sh/

@guneet
Can you share you Google sheet (that drives your app) ?


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

On Sat, 21 Mar, 2020, 8:05 PM Thejesh GN, <i...@thejeshgn.com> wrote:
Looks like it's private. Not able to access. 

Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

On Sat, 21 Mar, 2020, 3:54 PM Saketha Ramanujam, <saketh.r...@gmail.com> wrote:

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

🙬 Vittala Shettigar 🙮

unread,
Mar 21, 2020, 1:25:33 PM3/21/20
to data...@googlegroups.com
Hi Then,

You can add the link to google drive and then can download by logging into your drive account.

Thejesh GN

unread,
Mar 21, 2020, 11:49:34 PM3/21/20
to datameet
Mohfw now has a small dashboard where it publishes the latest total number of confirmed cases ( state count lags behind it.). I will update my script to take this into account.

There is also a new category, called "Migrated COVID-19 Patient". Will add that to the list.


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Thejesh GN

unread,
Mar 22, 2020, 1:19:11 AM3/22/20
to datameet
They have changed the website format twice this morning breaking my scripts. But we are back.

They removed the total confimed number from the top dashboard and added "Active COVID 2019 cases*.

Thej
--

Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Thejesh GN

unread,
Mar 22, 2020, 1:20:29 AM3/22/20
to datameet

Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Guneet Narula

unread,
Mar 22, 2020, 1:29:11 AM3/22/20
to data...@googlegroups.com

For the map I am maintaining, the data comes from a google sheet https://docs.google.com/spreadsheets/d/e/2PACX-1vRlSCAn1nS4h9n9Fp25iuOsH54RfMUjj3xX5CZqjGUqYCVXgwgtJojuqVeqekazs2TkSJ95Jwplo7lL/pubhtml#

That cluster map is live here https://cluster.covid19india.org/ and is w.i.p. I might be integrating the district map to their dashboard at some point.

Thanks for working on the MoHFW data archive. Will be more and more useful in the coming weeks.

I genuinely can't believe that we went from 200k to 300k cases worldwide in such a short time.

Best,
Guneet

You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsU7d4DrUVXPMkbiF6am%3DHDuvLDDRQ%3Dm6AJ4eXtxKJ7otg%40mail.gmail.com.

Bodhisattwa Mandal

unread,
Mar 22, 2020, 2:44:26 AM3/22/20
to data...@googlegroups.com
Hi,

We are updating COVID-19 situation in India on Wikidata.


Regards,
Bodhisattwa

Vikram Shetty

unread,
Mar 22, 2020, 9:20:04 AM3/22/20
to data...@googlegroups.com
Just a small info about Migrated patient, while doing a little research for patient tracking for covid19india.org, found 8th Patient from Saket, Delhi had shifted to Singapore before the positive result came out. And he is the only migrated patient till date.

Regards,
Vikram

Thejesh GN

unread,
Mar 22, 2020, 11:35:13 AM3/22/20
to datameet
This is really good.

It would be great if you can write a short note on how to use the data from https://www.wikidata.org/wiki/Q84055514


Thej
--

Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


Thejesh GN

unread,
Mar 23, 2020, 9:10:49 AM3/23/20
to datameet
We were 236 as of 20th.  433 today.
It's almost doubling every 3-4 days now. It was 5 days before.


Its my one graph to look at.




Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Saketha Ramanujam

unread,
Mar 23, 2020, 4:37:17 PM3/23/20
to data...@googlegroups.com
Is anybody here analysing and trying to model the growth rate of number of cases?



--
Saketh

Shilpa Arora

unread,
Mar 24, 2020, 3:26:00 AM3/24/20
to data...@googlegroups.com
On Fri, Mar 13, 2020 at 5:36 PM Thejesh GN <i...@thejeshgn.com> wrote:

- I have been scraping and diffing the #COVID19 data at https://t.co/qhdbOGGaeh  every 12 hours

- Converting them into clean JSON and made a simple API

- You can use the below URL if you like

https://data.thejeshgn.com/covid19/_design/india/_view/incidents?include_docs=true&limit=5&descending=true

Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.

Souvik Sankar Mitra

unread,
Mar 24, 2020, 3:26:01 AM3/24/20
to datameet
Please update https://data.thejeshgn.com/covid19/_design/india/_view/incidents . Its is last updated in 2020-03-23T10:30:00.00+05:30
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Thejesh GN

unread,
Mar 24, 2020, 3:29:07 AM3/24/20
to datameet
Done.
It goes through cloudfront CDN.  It doesn't always clear the cache in time.


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/d6444890-bfb0-4256-9443-7c320211f98a%40googlegroups.com.

Nikhil VJ

unread,
Mar 24, 2020, 11:41:46 PM3/24/20
to datameet
Hi, came across this:

About Us & Our Vision

We are an Open Source community driven project run by enthusiastic folks like yourself who are volunteering selflessly towards a noble cause. Request you to please maintain the decorum of this group.

We are building a strong community to collaborate and support our nation during this crisis. 

For this, we have built a website to provide real time and accurate data of CoVID-19 spread in India from various reliable sources.

Rather than just the few numbers on the website, we are trying to create a rich data-set of the patients that will be helpful during containment and mitigation efforts.


The patient database is good. There is a cluster graph being created: https://cluster.covid19india.org/

--
Cheers,
Nikhil VJ
https://nikhilvj.co.in


Thejesh GN

unread,
Mar 25, 2020, 12:01:48 AM3/25/20
to datameet
I am not really sure if putting the patient details out without a safety net is a great idea, specially in a driven by mobs kind of situation.

Through I understand the need of it. We might have to go to great lengths to anonymyze it.


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Thejesh GN

unread,
Mar 25, 2020, 2:37:28 AM3/25/20
to datameet
At this point I would think the personal details of patients (or doubtful) shouldn't be shared/used outside the govt healthcare network.  There is a great chance of harassment/mob attacks. Lack of privacy law does no good. We can do a separate email chain if people want to discuss about it.




Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Anand Chitipothu

unread,
Mar 25, 2020, 4:26:33 AM3/25/20
to data...@googlegroups.com
I wrote some code to scrap the Coivd19 data displayed on The Hindu website and put it behind an API. This is live data being updated by their team and I've taken their permission to publish it.


Source Code:

Data Source:
https://www.thehindu.com/sci-tech/health/covid-19-interactive-map-confirmed-cases-in-india/article31041690.ece

I've scrapping this data periodically. Will publish a hourly feed shortly.

Anand

Nikhil VJ

unread,
Mar 25, 2020, 5:11:48 AM3/25/20
to datameet
Hi Thej,

Can you point out which are the personal details which are crossing the line for you in the project linked on https://telegra.ph/CoVID-19--India--Ops-03-21
Because I have seen that they are ensuring to not display personally identifiable information while still maintaining the location related things that are vital to establishing and tracking infections spread, for dedicating 

For example, I would find beneficial to know that a cluster of infected patients in my city all were in a tour group to a country. Does that compromise their privacy? Maybe. Might that save my family member's life? Maybe.

In any case, if the official agencies have clearly failed to do their job so far (which is why all countries are now affected and globe is getting shut down just 2/3 weeks after all the mainstream agencies and publications were insisting it's nothing compared to the regular Flu and that we are not to close down any travel and and were labelling anyone who dared suggesting that as "racist" and were trying to have the people warning about today's reality censored), and volunteers are filling in the void, then what will be won by sticking to idealistic standards in opposite-of-ideal situations, and going out of one's way to muddy the waters for the initiatives that one can merely choose to quietly not participate it, is doubtful. 

And by now we have learned the hard way that some things that feel very good (like hugging all the people coming out of an airport as was being done in Italy just a few weeks back, or like EU countries insisting they will NEVER restrict free movement of people across the eurozone just 2 weeks before the numbers across Europe exploded) may not do good in the long run, and that some things that feel bad, like a community shunning a family for some time, may be there for a reason that a generation that has lived in relative prosperity may want to sneer down upon.

It would be good to gather snapshots actually of what the dominant voices in respective countries were saying 2 weeks before their infection numbers exploded, in keeping with the well-researched data articles going around establishing the lag period between measures and outcomes.

--
Cheers,
Nikhil VJ
https://nikhilvj.co.in
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.

Thejesh GN

unread,
Mar 25, 2020, 5:31:42 AM3/25/20
to datameet
1. Added links to reference section (Anand and other projects)
2. Started downloading daily district wise reporting pds. Its not automated or parsed yet. It came in through MR. I will try and write a script later tonight.  PDFs are at https://github.com/datameet/covid19/tree/master/mohfw-backup/district_wise_cases

Contributions are more than welcome. In any format.



Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

--

Thejesh GN

unread,
Mar 25, 2020, 5:40:49 AM3/25/20
to datameet
My comment wasn't related to this effort. I saw a google sheet release by Govt dept with people's name, address, age, number etc. [1] Hence my comment was generic rather than specific to this instance.

I agree to your point -> What is good and bad is based on the context and situation.

That said we will be tested during the difficult situations. Anybody/Everyone will behave well during peacetime. We will be judged by how we behave during difficult times.

So all I am saying is -> we as a community should be very careful about personal data sharing.


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Sashikumar N

unread,
Mar 25, 2020, 7:47:41 AM3/25/20
to datameet
Dear All,
Glad to see the efforts made to collect the data from public sources. Right now Its not clear how much of spatial data is used by authorities to collate cases / status of cases. Can we make effort to do a grid based data collection / marking. What i meant is divide a geographical area like Bangalore city into number of grids say a grid of 1km x 1 km (We can think of appropriate size, or each of the 100 wards themselves can be used if its useful). Use this grid to mark the number of people quarantined / low , medium, high risk patients,Nearest Medical facility available to them etc.  It can be also used to deliver and track essentials sent to people etc. This can help us to concentrate on focus areas in the city instead of focusing entire city and without enough feedback. Right now the effort is for data collation, may be we can think of model and analysis later..

If privacy is a concern, we can limit certain detailed access info to authorities, who need them to make decisions. Since the lock down is effective there is no complexity of tracing people from zone to zone. Right now the assumption is that such a grid based framework will help decision makers.

Please share your thoughts, if its useful we can work towards that.

Some related disease modelling papers

with regards
Sashi
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Vikram Shetty

unread,
Mar 25, 2020, 8:04:15 AM3/25/20
to data...@googlegroups.com
If you are interested in collaborating with covid19india.org, Please reach out to me on Telegram: http://t.me/VikramShetty

Some of the members from here are already in dev groups.

—Vikram

Vikram Shetty

unread,
Mar 25, 2020, 8:04:16 AM3/25/20
to data...@googlegroups.com
If you look at the live database.. there is not much of personal details of patients in covid19india.org Just the age, gender, location, contracted from and travelled from details.. these high level details are sourced from news articles and even when sources have personal details, the details are not recorded to database.


—Vikram

Thejesh GN

unread,
Mar 25, 2020, 8:14:06 AM3/25/20
to datameet
Vikaram,

I have seen it. I use it. I have shared it as well.

It wasn't about this project. It was a general note.


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Sashikumar N

unread,
Mar 25, 2020, 8:54:34 AM3/25/20
to datameet
Please check out this links given below for epidemiological models, source code and documentation is available



regards
Sashi

Anand Chitipothu

unread,
Mar 25, 2020, 2:03:53 PM3/25/20
to data...@googlegroups.com
On Wed, Mar 25, 2020 at 1:56 PM Anand Chitipothu <anand...@gmail.com> wrote:
I've updated the code to include mohfw data along with an API to query for historical data, using the data published by Thejesh.

Daily cases in India:
http://covid19-india.anandology.com/cases/daily

Daily cases in Maharashtra:
http://covid19-india.anandology.com/cases/daily/mh

The API is open and documented at:

Anand

Pranit Gupta

unread,
Mar 25, 2020, 7:09:34 PM3/25/20
to datameet
Hello, I am looking for the following information by state/district: total number of tests, positive tests, negative tests. Is that information available somewhere?

Thank you!


On Friday, March 13, 2020 at 5:36:23 PM UTC+5:30, Thejesh GN wrote:

- I have been scraping and diffing the #COVID19 data at https://t.co/qhdbOGGaeh  every 12 hours

- Converting them into clean JSON and made a simple API

- You can use the below URL if you like

https://data.thejeshgn.com/covid19/_design/india/_view/incidents?include_docs=true&limit=5&descending=true



Regards,
Thej

Thejesh GN

unread,
Mar 27, 2020, 9:56:55 AM3/27/20
to datameet
From 30Th Jan to 10 March MoHFW declared numbers through press releases. I have them backed up now.


I will add it to the JSON data  later today.


Thej
--

Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/ab715892-158d-4877-9384-23735107176c%40googlegroups.com.

Bodhisattwa Mandal

unread,
Mar 28, 2020, 12:02:02 AM3/28/20
to data...@googlegroups.com
The MoHFW has removed the stat section today. Anyone have any idea, where it might be now?

Bodhisattwa

Thejesh GN

unread,
Mar 28, 2020, 12:13:14 AM3/28/20
to datameet
Back.


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Souvik Sankar Mitra

unread,
Mar 28, 2020, 1:17:45 AM3/28/20
to datameet
Data in https://data.thejeshgn.com/covid19/_design/india/_view/incidents is not getting updated. Last update 2020-03-27T09:15:00.00+05:30
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Thejesh GN

unread,
Mar 28, 2020, 1:18:46 AM3/28/20
to datameet
I have updated the gihub with latest data from MoHFW. But no data from ICMR yet.


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Thejesh GN

unread,
Mar 28, 2020, 1:22:20 AM3/28/20
to datameet
Just forgot to announce on the list, Data gets cached. So if you want to get the latest

use the format


Where change the <yyyymmddhh> with current date/hr. For example 2020032810

then url will be


And that should return you the latest.

Sorry I forgot.

Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/772fa80c-1d50-460c-9b46-2125f78fb2d8%40googlegroups.com.

Souvik Sankar Mitra

unread,
Mar 28, 2020, 1:37:24 AM3/28/20
to datameet
Thank you very much sir. 

Thejesh GN

unread,
Mar 28, 2020, 3:34:18 AM3/28/20
to datameet

Here is the note I sent to my friends today. 


Dear All,

I have been scraping the MoHFW, ICMR  data and parsing it. If you want to explore, details are at


There is also an API.

For cases by MoHFW


For tests done by icmr


nounce is current hour in yyyymmddhh

limit is how many records you want

descending true gives the latest records first.

Example dashboard I built using the APIs


Blogpost

If you use API please credit Thejesh GN and link it to https://thejeshgn.com.

Also let me know where/how you use it. I am just curious. Will share it on twitter etc

Forward if you think someone else will be interested in this.


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/8bbda7c6-3e40-4436-836f-318146eb0a40%40googlegroups.com.

hemant singh

unread,
Mar 28, 2020, 7:14:12 AM3/28/20
to data...@googlegroups.com
Hello,

Build a world dashboard for a relative comparison of the countries and their COVID19 growth.


Please let me know if anyone wants to build same for the India district level.

Thanks
Hemant

To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/8bbda7c6-3e40-4436-836f-318146eb0a40%40googlegroups.com.

H. S. Sudhira

unread,
Mar 28, 2020, 9:47:20 AM3/28/20
to datameet
Hi Thej,

Thanks for this. Is there any data on the number of tests conducted on a daily basis? Say for the past 21 days?

Thanks,
Sudhira.

Thejesh GN

unread,
Mar 28, 2020, 11:14:53 AM3/28/20
to datameet

Ajay Kelkar

unread,
Mar 29, 2020, 4:06:39 AM3/29/20
to datameet

Ajeya Raj

unread,
Mar 29, 2020, 10:07:34 AM3/29/20
to data...@googlegroups.com
https://icmr.nic.in/node/39071

Is ICMR publishing the no of tests done still? where is the link?

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

Thejesh GN

unread,
Mar 29, 2020, 10:30:23 AM3/29/20
to datameet


Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Bodhisattwa Mandal

unread,
Mar 29, 2020, 12:21:39 PM3/29/20
to data...@googlegroups.com
There are huge discrepancies in confirmed cases at district level between MoHFW, state health bulletins, media news channel, covid19india that it has now become a tiring task to verify and find the correct one. :(



Thejesh GN

unread,
Mar 29, 2020, 2:02:33 PM3/29/20
to datameet
They just removed the columns confirmed_foreign and confirmed_indians. Now it's just one total number. So I have updated the Data and API accordingly.

There is one record for each state and report_time combination.

{   "id":"2020-03-12T11:00:00.00+05:30|dl",
   "key":"2020-03-12T11:00:00.00+05:30|dl",
   "value":{
      "_id":"2020-03-12T11:00:00.00+05:30|dl",
      "_rev":"1-1b430a0a4b4a8b43fdab12d040ae8735",
      "state":"dl",
      "report_time":"2020-03-12T11:00:00.00+05:30",
      "confirmed_india":6,
      "confirmed_foreign":0,
      "confirmed": 6,
      "cured":0,
      "death":0,
      "source":"mohfw",
      "type":"cases"      
    }
}

confirmed_india and confirmed_foreign are present only when they are available. Use confirmed which is usually the addition ofconfirmed_india and confirmed_foreign


Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


Ajeya Raj

unread,
Mar 30, 2020, 7:19:04 AM3/30/20
to data...@googlegroups.com
Do we have citywise covid-19 cases data

Thejesh GN

unread,
Mar 30, 2020, 9:32:25 AM3/30/20
to datameet
No data directly from ICMR anymore. It will come from mohfw.


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Thejesh GN

unread,
Apr 1, 2020, 6:37:39 AM4/1/20
to datameet
- They keep changing the format of the page everyday. I have to fix it almost every time. Anyway latest (9am)data is up.
- No updates from ICMR yet!
- I also have a page where you can see COVID19 related but non virus deaths. Sadly even that is growing. https://thejeshgn.com/projects/covid19-india/non-virus-deaths/


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Ajeya Raj

unread,
Apr 1, 2020, 8:07:36 AM4/1/20
to data...@googlegroups.com
state wise data is not opening right now

Pooja Dantewadia

unread,
Apr 1, 2020, 8:10:31 AM4/1/20
to data...@googlegroups.com
Works on incognito mode or if the ad blocker is removed. 

Thejesh GN

unread,
Apr 5, 2020, 10:17:52 AM4/5/20
to datameet
I recorded a video yesterday, in which I go through each video explaining how they are sourced, archived and parsed. I also show some example usage


Also some of the members had questions about converting from JSON to CSV.

You can use a simple online conversion tool like this


If required. I can convert the JSON to CSV on a daily basis and commit to the github. Let me know.


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

Rithika Kumar

unread,
Apr 5, 2020, 11:34:07 AM4/5/20
to datameet
Hi everyone,

Thank you for the amazing work that all of you have put into making COVID related data accessible to the public. Is there any information on whether socio-economic and other demographic characteristics of cases/deaths in India? I am guessing this might be hard to obtain but will be interesting to see. Rithika


On Sunday, April 5, 2020 at 10:17:52 AM UTC-4, Thejesh GN wrote:
I recorded a video yesterday, in which I go through each video explaining how they are sourced, archived and parsed. I also show some example usage


Also some of the members had questions about converting from JSON to CSV.

You can use a simple online conversion tool like this


If required. I can convert the JSON to CSV on a daily basis and commit to the github. Let me know.


Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Anand Chitipothu

unread,
Apr 8, 2020, 1:11:48 AM4/8/20
to data...@googlegroups.com
On Sun, Mar 15, 2020 at 12:48 AM Thejesh GN <i...@thejeshgn.com> wrote:
Some interesting data work

Growth of cases: How long did it take for the number of confirmed cases to double?

I've tried to replicate this for all states in India.


Comments welcome!

Anand

TEJ CHAVDA

unread,
Apr 8, 2020, 8:11:47 AM4/8/20
to datameet
from where I get a list of the positive case, Reported case, negative case, home quarantine with address if possible latitude longitude also.


Tej Chavda (PG191052)

Pursuing M.Tech In Geomatics (2nd Semester),
Centre for Environmental Planning and Technology (CEPT University), 
KL Campus, University Road, Navrangpura, Ahmedabad - 380009

Contact Number : 8866440170

Email id: tejp400@gmail.com
               tej.pg191052@cept.ac.in


--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAC7wXFxNAjiKn-TK%2BsZqeUQO6e2hwTbBuzpvyVKHE%2BOycraMfA%40mail.gmail.com.

Disclaimer : The information transmitted with this email is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, re-transmission, dissemination or other use of this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer.

Sanjay Barnwal

unread,
Apr 8, 2020, 9:24:24 AM4/8/20
to data...@googlegroups.com
Hi,

I would suggest to look into this website.
https://www.finddx.org/covid-19/covid-19-backuplp/test-tracker/  check Source Tab, you will get daily wise details of Tests conducted, Positive cases, Deaths, Population country wise.

Regards,
Sanjay Barnwal 



--
Regards,
 
Sanjay Barnwal
 

Vikram Shetty

unread,
Apr 12, 2020, 9:28:36 AM4/12/20
to data...@googlegroups.com
Thejesh and all, 

MoHFW has new dashboard (https://www.mohfw.gov.in/dashboard/index.php) on site.. and now state values are now in JSON. https://www.mohfw.gov.in/dashboard/data/data.json

Hope it helps.

Regards,
Vikram

Thejesh GN

unread,
Apr 12, 2020, 11:21:29 AM4/12/20
to datameet
So there is no time of publishing in the JSON.

So I will pull the time from HTML and data from the JSON.

Otherwise I have to keep checking for the data change!

I might do hash of the JSON data as well. Every hour just to check.



Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

Pranit Gupta

unread,
Apr 15, 2020, 8:09:30 AM4/15/20
to datameet
Hey, I am trying to obtain age-wise data for covid-19 cases in India. Most crowdsourced databses have information for less than 2000 cases, any idea where I can get more recent and updated info?
Vikram

To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Saba Mundlay

unread,
Apr 26, 2020, 7:41:56 AM4/26/20
to datameet
hey! this is really great. One thing - is there an archive of this data? I only see the current day data, district wise. 

On Tuesday, March 17, 2020 at 1:05:19 AM UTC+5:30, Guneet Narula wrote:

Amazing, thanks Thej. I am going to get to it in sometime.

Just put this district-wise map together https://fieldmaps.in/covid19/ based on news reports. Data comes from a google sheet https://docs.google.com/spreadsheets/d/e/2PACX-1vRlSCAn1nS4h9n9Fp25iuOsH54RfMUjj3xX5CZqjGUqYCVXgwgtJojuqVeqekazs2TkSJ95Jwplo7lL/pubhtml#

Some issues:

- I am using the district shapefiles from NIC's ArcGIS REST services at https://webgis1.nic.in/publishing/rest/services/bharatmaps it's a bit slow and sometimes just times out completely

- State shapefiles makes it even slower, so I have ignored it for now

- Code is a bit messy, and has some documentation here https://github.com/guneetnarula/covid19-in any help would be appreciated

- Coming to the data, it is not the same as the MoHFW one since it is based on news reports. If any journalists or people tracking the news closely would like to help with this, then please let me know

More updates soon.

- Guneet


On 16/03/20 8:51 am, Thejesh GN wrote:
I wrote about it so people can find it easily on Google. 

https://thejeshgn.com/2020/03/16/novel-corona-virus-covid19-archive-api-india-data/



Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com

On Mon, 16 Mar, 2020, 5:58 PM Thejesh GN, <i...@thejeshgn.com> wrote:
Extracted some more from archive.org and added them to the list. So now we have data from 10th March.

I also have a JSON dump for download at


You can download and host it on your server if you like.

Also here is aggregation. It took about 5 days to double. At the same rate we will cross 200 by 20th.

{"rows":[
{"key":["2020-03-10T12:00:00.00+05:30","total_confirmed"],"value":47},
{"key":["2020-03-11T17:30:00.00+05:30","total_confirmed"],"value":60},
{"key":["2020-03-12T11:00:00.00+05:30","total_confirmed"],"value":73},
{"key":["2020-03-12T18:00:00.00+05:30","total_confirmed"],"value":74},
{"key":["2020-03-13T10:00:00.00+05:30","total_confirmed"],"value":75},
{"key":["2020-03-13T22:15:00.00+05:30","total_confirmed"],"value":79},
{"key":["2020-03-14T09:00:00.00+05:30","total_confirmed"],"value":83},
{"key":["2020-03-14T16:55:00.00+05:30","total_confirmed"],"value":84},
{"key":["2020-03-15T08:55:00.00+05:30","total_confirmed"],"value":93},
{"key":["2020-03-15T12:00:00.00+05:30","total_confirmed"],"value":107},
{"key":["2020-03-15T17:00:00.00+05:30","total_confirmed"],"value":107},
{"key":["2020-03-15T23:30:00.00+05:30","total_confirmed"],"value":110},
{"key":["2020-03-16T16:00:00.00+05:30","total_confirmed"],"value":114}
]}







Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Sun, 15 Mar 2020 at 19:39, Sunil Prabhakar <sunilp...@gmail.com> wrote:
Dear All,
Pl see.these websites. They might be helpful to you. I can send some additional resources too if required.

On Sun, 15 Mar 2020, 12:31 pm Thejesh GN, <i...@thejeshgn.com> wrote:
The data on http://www.mohfw.gov.in/ is getting updated very slowly and there are some changes

- They have renamed Cured to Discharged
- Discharged number is reduced to 10 from 9.  Don't know why. At 14.03.2020 at 04:55 PM it was 10 and 15.03.2020 at 08:55 AM its 9.  UP had 5 as discharged and now its 3. Don't know what happened "2"


On my side
- I am also to backup raw html - https://github.com/datameet/covid19



Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

On Sun, 15 Mar 2020 at 00:47, Thejesh GN <i...@thejeshgn.com> wrote:
Some interesting data work

Growth of cases: How long did it take for the number of confirmed cases to double?



Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Sat, 14 Mar 2020 at 10:55, Guneet Narula <guneet...@sputznik.com> wrote:
This is great, thanks!


On Friday, 13 March 2020 05:06:23 UTC-7, Thejesh GN wrote:

- I have been scraping and diffing the #COVID19 data at https://t.co/qhdbOGGaeh  every 12 hours

- Converting them into clean JSON and made a simple API

- You can use the below URL if you like

https://data.thejeshgn.com/covid19/_design/india/_view/incidents?include_docs=true&limit=5&descending=true



Regards,
Thej

Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.
--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to a topic in the Google Groups "datameet" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to data...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsUd8-Ffwd0y_oQQs%2BULKQNDhPwyv9oFDrb2UnPjbQ-Y9Q%40mail.gmail.com.
-- 
sputznik.com / 9717664996
keybase.io/guneetnarula

Souvik Sankar Mitra

unread,
May 1, 2020, 2:56:01 PM5/1/20
to datameet
Vikram

To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.


The contents of this email message and any attachments are intended solely for the addressee(s) only and contains confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message or their agent, or if this message has been addressed to you in error, please immediately alert the sender by reply email and then delete this message and any attachments thereof. Mobisy is not liable for any loss or any damage arising in any way from the use of this e-mail or its attachments.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

--
Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data...@googlegroups.com.

Thejesh GN

unread,
May 1, 2020, 4:42:21 PM5/1/20
to datameet
Thanks for letting me know Souvik. There was a bug. I have fixed it. It should be updated now.

Thej
--
Thejesh GN  ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/3b050d35-6a7b-4ca6-b230-83fb9120e325%40googlegroups.com.

Souvik Sankar Mitra

unread,
May 1, 2020, 5:05:06 PM5/1/20
to datameet
Thank you sir.. 
Reply all
Reply to author
Forward
0 new messages