Mathpix - using sympy and deep learning to solve math from pictures of handwriting

1,036 views
Skip to first unread message

Nicolas Jimenez

unread,
Mar 12, 2016, 9:46:25 PM3/12/16
to sympy
Hi all, 

I am the lead developer for Mathpix (http://mathpix.com/).  We have developed the word's first app that can solve math by simply taking pictures of your handwriting.  We use Sympy and SympyGamma as part of our stack.  Firstly, we wanted to thank the Sympy project for making this app possible.  Secondly, if anyone is interested in helping us make the app better and contributing back to Sympy (eg. see: https://github.com/augustt198/latex2sympy), please contact me, we are venture backed and located in SF.  

Cheers, 
Nico

Harsh Gupta

unread,
Mar 13, 2016, 4:41:02 AM3/13/16
to sy...@googlegroups.com
The app looks cool, I was wondering if it is a Free Software (Free as in Free Speech). An issue I noted is that the latex2sympy repository does not mention any license, which by default means all the rights are reserved and you cannot use it without permission. You should contact the author and get a license on it to avoid possible legal trouble later. Also I would **really** like you to donate to SymPy. Most of us are volunteers here who contribute in their precious free time, it is important that the fruits of labor flows back to us [2].

--
You received this message because you are subscribed to the Google Groups "sympy" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sympy+un...@googlegroups.com.
To post to this group, send email to sy...@googlegroups.com.
Visit this group at https://groups.google.com/group/sympy.
To view this discussion on the web visit https://groups.google.com/d/msgid/sympy/081cd430-0b3f-4389-a3d9-fb87130f76b7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--
Harsh
Sent from a GNU/Linux

Nicolas Jimenez

unread,
Mar 13, 2016, 5:27:09 AM3/13/16
to sy...@googlegroups.com
Hi Harsh, 

Although Mathpix is a free software application, it is not "free software".  

latex2sympy was developed by August Trollback who is a member of the Mathpix team.  Just added the MIT license to the repo: https://github.com/augustt198/latex2sympy/blob/master/LICENSE.txt

- Nico

--
You received this message because you are subscribed to a topic in the Google Groups "sympy" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/sympy/me0oxyjj1uw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to sympy+un...@googlegroups.com.

To post to this group, send email to sy...@googlegroups.com.
Visit this group at https://groups.google.com/group/sympy.

Ondřej Čertík

unread,
Mar 14, 2016, 3:40:21 PM3/14/16
to sympy
Hi Nico,
Thanks for sharing. Nico and I talked on the phone a bit. The main
work that was done Mathpix is to take an image, and get a latex
representation back. That's a very hard problem and very difficult to
do. I would love to play with that myself, but I only have an Android
phone.

They chose to use SymPy and SymPy Gamma as the backend, that's very
exciting. Thanks also for releasing the latex -> sympy convertor as
open source under the MIT license.

Nico, as I said on the phone, if you see an area for collaboration,
definitely let us know.

Ondrej

Francesco Bonazzi

unread,
Mar 15, 2016, 4:23:37 AM3/15/16
to sympy
Hi Nicolas,

are there any chance that you adapt your algorithm to extract formulae from PDF in a desktop computer?

I'm currently aware of InftyReader, but it's extremely expensive, supports Windows only, and doesn't copy the formulae directly to a computer algebra system.

Aaron Meurer

unread,
Mar 15, 2016, 1:58:43 PM3/15/16
to sy...@googlegroups.com
I just tried using it to take some pictures of some integrals on
https://en.wikipedia.org/wiki/Lists_of_integrals and it seems to work
just fine.

Aaron Meurer
> --
> You received this message because you are subscribed to the Google Groups
> "sympy" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to sympy+un...@googlegroups.com.
> To post to this group, send email to sy...@googlegroups.com.
> Visit this group at https://groups.google.com/group/sympy.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/sympy/58f5edc5-7863-4c6a-99ed-1a1b09eaead0%40googlegroups.com.

Nicolas Jimenez

unread,
Mar 15, 2016, 2:07:25 PM3/15/16
to sy...@googlegroups.com
We are developing an app where you can take a picture of an equation and it will add it to a Latex document which you can access on your desktop.  Would such an app suit your needs?

- Best,
Nico

You received this message because you are subscribed to a topic in the Google Groups "sympy" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/sympy/me0oxyjj1uw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to sympy+un...@googlegroups.com.

To post to this group, send email to sy...@googlegroups.com.
Visit this group at https://groups.google.com/group/sympy.

Nicolas Jimenez

unread,
Mar 15, 2016, 10:20:46 PM3/15/16
to sy...@googlegroups.com
One things our users are complaining about is the lack of clarity when dealing with infinite sums.  Are there any plans in Sympy to provide this information? For example, infinite series diverge by ratio test etc.  This would be super useful for learning calculus.

Aaron Meurer

unread,
Mar 16, 2016, 5:01:55 PM3/16/16
to sy...@googlegroups.com
SymPy does have Sum.is_convergent, which is new since 1.0. It would
need to be integrated into SymPy Gamma.

Aaron Meurer
> https://groups.google.com/d/msgid/sympy/CAHdwqwcfurjU27vtfzahCVzn6%3D5VSAVi9H72CHRT7riBvji2Xw%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages