OpenRefine and the power of Jython / Python

[Thad Guidry]

Hello Refiners !

Today I spent some time creating 2 brand new tutorials on how to use the power of Python within OpenRefine ( and even extend with PIP easily ! )

https://github.com/OpenRefine/OpenRefine/wiki/Jython

Enjoy and happy polishing,

-Thad

+ThadGuidry  

[Ettore Rizza]

Thank you Thad. The integration of Jython / Python is, I think, a very powerful feature of Open Refine, but not very well documented.

 

Dare I say it? I used it for months thinking that Jython could not access any column other than the current one, before discovering (in one little line of the doc) that it was enough to use the syntax :

 

cells ['other column']['value']

 :/

[Khanh Dinh Ngoc]

Many many thanks Thad! I use python heavily in my data pipelines and sometimes the pd.read_csv wouldn't work so well if the schema is corrupted along the rows. OpenRefine API would definitely complement it.

[Ettore Rizza]

Yep, many thanks, Thad. I've finally bothered to try, the trick works perfectly. :)

Just a little tip for those who read this thread: if you already have a Python version installed, pip install <package> will install the package in your first Python distribution, not in Jython. To work around the problem, use this command instead: 

jython -m pip install <package>

Another point to report for those who know Python but not Jython: the packages compiled in C will not be installed. So no way to install pandas, LXML and many other modules often used (because they are very fast). As soon as I have two minutes, I will try to compile a list of useful Jython/Python modules for Open Refine.

Le mardi 28 février 2017 21:48:49 UTC+1, Thad Guidry a écrit :

[Thad Guidry]

Ettore,

Add that info to the wiki tutorial! That's good info!

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Julien Vallières]

Hi Ettore,

Did you had time to compile that list of useful Jython/Python modules for Open Refine you mentioned here? I, for one, am looking for something similar today!

Julien