OCR models in TensorFlow Lite!

31 views
Skip to first unread message

Sayak Paul

unread,
Nov 29, 2020, 8:59:30 PM11/29/20
to ML on Mobile OS Working Group, Khanh LeViet, tulasir...@gmail.com
Hi folks,

Last week Tulasi and I wrote to you regarding our work on creating text detectors in TensorFlow Lite. Tulasi extended that work and developed OCR models in TensorFlow Lite. Read further if this sounds interesting. 

Folks working in the area of OCR might already be familiar with the library called Keras OCR. He took the pre-trained models provided by them and successfully converted them to TensorFlow Lite. To my knowledge, he is probably the first one that has been able to do it. The converted TensorFlow Lite models are to be published on TensorFlow Hub (a PR is on the way). TensorFlow Lite team, hear hear!

Here's the repository of this project - https://github.com/tulasiram58827/ocr_tflite. For starters, here's a Colab Notebook that shows the end-to-end pipeline of performing OCR on images containing dense text blocks - https://colab.research.google.com/github.com/tulasiram58827/ocr_tflite/blob/main/colabs/ENDTOEND_OCR_TFLITE.ipynb (contains a small comparison and shows how to chain together two TensorFlow Lite models). Cool, eh? 

Mobile application developers, this might another excellent opportunity for you to create a sample application out of these models for demonstration purposes. 

Extensions

We now plan to extend this to support the use of machine translation and text-to-speech considering their real-world impact. If you are interested in collaborating please follow the details here and express your interest. 

Sayak Paul | sayak.dev

George Soloupis

unread,
Nov 29, 2020, 10:33:13 PM11/29/20
to Sayak Paul, ML on Mobile OS Working Group, Khanh LeViet, tulasir...@gmail.com
Hi all,

Congrats on this amazing project! Nice to see this continuous effort and collaboration. 

I have already finished the Yamnet classification android app and I have started writing a blog post. I am available for an android application with the above tflite model
Please provide your preference because as I remember you have also created EAST/CRAFT tflite models. I am really interested in these opportunities.

Thanks
George

--
You received this message because you are subscribed to the Google Groups "ML on Mobile OS Working Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mlwg-mobile...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mlwg-mobile/CAGa_XGGVyZY_-_UNzt%2BavNS2CK5TBfcGRxO%3DKSY38Q1e%2B_SZMQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Sayak Paul

unread,
Nov 29, 2020, 10:35:23 PM11/29/20
to George Soloupis, ML on Mobile OS Working Group, Khanh LeViet, tulasir...@gmail.com
Thank you, George. I think the OCR app might be more meaningful and practically useful. 
Sayak Paul | sayak.dev


George Soloupis

unread,
Nov 29, 2020, 10:38:09 PM11/29/20
to Sayak Paul, ML on Mobile OS Working Group, Khanh LeViet, tulasir...@gmail.com
Ok then!

We will be in touch.

TULASI RAM LAGHUMAVARAPU

unread,
Nov 29, 2020, 10:59:30 PM11/29/20
to George Soloupis, Sayak Paul, ML on Mobile OS Working Group, Khanh LeViet
Hi George,

Thanks for the interest. This notebook is the right place to start with

Please reach out to me in case of any queries through issues in the repo or mail.

George Soloupis

unread,
Nov 29, 2020, 11:02:21 PM11/29/20
to TULASI RAM LAGHUMAVARAPU, Sayak Paul, ML on Mobile OS Working Group, Khanh LeViet
Thanks Tulasi.

I will contact you again in the next days
Reply all
Reply to author
Forward
0 new messages