OpenRefine 2.7 RC1 released !

116 views
Skip to first unread message

Thad Guidry

unread,
Feb 11, 2017, 2:40:51 PM2/11/17
to openrefine
Hello Refiners !

We're beginning this year with 2 feet on the gas pedal to try to move things along at a faster pace while still maintaining a sense of stability.

We're excited to announce a few new important features that have made it into this newest Release Candidate...

1. Freebase Reconcile is back !  Well, not really, but might as well be with Antonin Delpeuch's much appreciated hard work with taking on the task of building a Wikidata Reconcile API, which is now integrated and working in OpenRefine 2.7 RC1 !  And its even got a sweet Suggest API to show previews !  Lots of cool ideas are swarming around this now and more to come in later releases.  No docs or walkthroughs on our official wiki, but Antonin has most details on the API URL clickable here: https://tools.wmflabs.org/openrefine-wikidata/  And issues for the Reconcile and Suggest service can be made here: https://github.com/wetneb/openrefine-wikidata/issues  And if you love the new Wikidata Recon feature, tell him so and follow along with his contribution activity and other cool things he's working on with the Recon and Suggest service here: https://github.com/wetneb

2. Export Clusters button !  Get all that data out of the clustering dialog in a nice JSON download in 1 click !  https://github.com/OpenRefine/OpenRefine/pull/1092

Here's a quick list of some of the recent merges that made it into OpenRefine 2.7 RC1 this week:


Before you download and install, if you have some important projects, please backup your OpenRefine workspace folder, just in case.
Now go kick its tires and download OpenRefine 2.7 RC1 and let us know what you think !

Happy Refining,
-Thad

Ettore Rizza

unread,
Feb 11, 2017, 3:24:56 PM2/11/17
to OpenRefine


The reconciliation service with Wikidata is very fast and efficient, even though automatic matching can be improved.

Antonin Delpeuch (lists)

unread,
Feb 11, 2017, 11:05:03 PM2/11/17
to openr...@googlegroups.com
Yes, the matching is quite basic for now. Specific cases where it should
be improved are very welcome! It helps a lot to see what kind of data it
is used on.
I'll try to write some docs soon.

Antonin

On 11/02/2017 20:24, Ettore Rizza wrote:
> <https://lh3.googleusercontent.com/-Um-M3sr3feY/WJ9yQxktRQI/AAAAAAAATgg/8dKnrwyU2uUEGZd4tQ9wks2AoyApvFEfgCLcB/s1600/10419270.jpg>
> * Merged#1168 fix PR #1092 to work with Firefox
> <https://github.com/OpenRefine/OpenRefine/pull/1168> 6 hours ago
> * Merged#1092 Add export button to "Cluster and Edit"
> <https://github.com/OpenRefine/OpenRefine/pull/1092> 12 hours ago
> * Merged#1160 fix not working clustering functions when it select
> japanese lang.
> <https://github.com/OpenRefine/OpenRefine/pull/1160> a day ago
> * Merged#1167 Freebase cleanup
> <https://github.com/OpenRefine/OpenRefine/pull/1167> a day ago
> * Merged#1166 Change default reconciliation service to Wikidata
> <https://github.com/OpenRefine/OpenRefine/pull/1166> 3 days ago
>
>
> Before you download and install, if you have some important
> projects, please backup your OpenRefine workspace folder, just in case.
> Now go kick its tires and downloadOpenRefine 2.7 RC1
> <https://github.com/OpenRefine/OpenRefine/releases/tag/2.7-rc1> and
> let us know what you think !
>
> Happy Refining,
> -Thad
> +ThadGuidry <https://www.google.com/+ThadGuidry>
>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to openrefine+...@googlegroups.com
> <mailto:openrefine+...@googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.

Martin Magdinier

unread,
Feb 12, 2017, 5:27:04 PM2/12/17
to openrefine
On the top of the PR listed by Thad, the 2.7 also include a bug fix for the columnize by key/value fixed by Qi. 

I've  grouped all the issues and PR related to this new release under the 2.7 milestone (and remove all other unrelated tickets). 

Martin


> For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+unsubscribe@googlegroups.com.

Martin Magdinier

unread,
Feb 12, 2017, 5:47:05 PM2/12/17
to openrefine
Also forgot to mention that 2.7RC1 include a new translation: Japanese! 


Martin


Owen Stephens

unread,
Feb 14, 2017, 8:19:46 AM2/14/17
to OpenRefine
Huge thanks to everyone who contributed to this release and helped get it out.

It would be really great to build on this and get a full release of 2.7 out - so my question is, what can us non-developers do to help make this happen? 

Thanks again - this is really great work.

Owen

Thad Guidry

unread,
Feb 14, 2017, 1:59:12 PM2/14/17
to openr...@googlegroups.com
You can help by testing and using the crap out of 2.7 RC 1. :)

We'll probably push out a STABLE Release after 2-4 weeks depending on usage and testing feedback from the community.
I want to try to get STABLE Releases out the door much quicker this year, but that involves everybody, not just contributors :)

Happy bang testing !

Joe Wicentowski

unread,
Feb 14, 2017, 3:54:41 PM2/14/17
to OpenRefine
This is great news - the 2.7RC1 release, the plan to release a stable
version, the resolve to step up the pace of releases - great news all
around!

A gentle reminder that renaming the Mac version will allow me to
update the openrefine-dev version available via homebrew, which will
presumably expose more people to 2.7RC1... to test and use the crap
out of it!

Joe
> --
> You received this message because you are subscribed to the Google Groups
> "OpenRefine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to openrefine+...@googlegroups.com.

qi cui

unread,
Feb 14, 2017, 4:06:25 PM2/14/17
to OpenRefine

@Joe I found we have both tags 2.7RC1 and 2.7RC.1. So your updater should not have problem. I will remove one tag to keep consistence and will do the same going forward. 

My Mac can not boot for some reason. will remove the redundant tag once I fix it

Joe Wicentowski

unread,
Feb 14, 2017, 5:59:18 PM2/14/17
to OpenRefine
Thanks, Jacky! Since you're going to delete one of these, which one
would you recommend I use?

Owen Stephens

unread,
Feb 15, 2017, 4:36:08 AM2/15/17
to OpenRefine
Thanks Thad - will get testing!

Joe Wicentowski

unread,
Feb 15, 2017, 8:01:59 PM2/15/17
to OpenRefine
Hi Jacky,

I checked, and while I see there is now also an 2.7-rc.1 tag, there
are no DMG downloads under that tag.

For homebrew to work, I need one of the following URLs to work:

Either "2.7-rc1":

https://github.com/OpenRefine/OpenRefine/releases/download/2.7-rc1/openrefine-mac-2.7-rc1.dmg

Or "2.7-:

https://github.com/OpenRefine/OpenRefine/releases/download/2.7-rc.1/openrefine-mac-2.7-rc.1.dmg

It appears that there is only one DMG available now, and it is a mix
of the two forms, "2.7-rc1" then "2.7-rc.1":

https://github.com/OpenRefine/OpenRefine/releases/download/2.7-rc1/openrefine-mac-2.7-rc.1.dmg

Sorry for the trouble,
Joe

Thad Guidry

unread,
Feb 15, 2017, 9:48:02 PM2/15/17
to OpenRefine
Jacky,
Go ahead and just re-release under the appropriate tag so that Joe can have his cake and eat it too. :) Thats fine.
And it will make things consistent with how our previous releases were pushed out with the "dot" like

Sorry about that Joe...in the past we didn't have to worry so much, but I understand about homebrew constraints there.
I'll update all the download links on our OpenRefine.org site for 2.7 again once Jacky re-releases under the consistent tag as previous releases.


qi cui

unread,
Feb 16, 2017, 8:26:57 AM2/16/17
to OpenRefine

I deleted the tag 2.7-rc1 and kept 2.7rc.1 to keep the consistence. 

Joe Wicentowski

unread,
Feb 16, 2017, 12:14:57 PM2/16/17
to OpenRefine
Hi Jacky,

> I deleted the tag 2.7-rc1 and kept 2.7rc.1 to keep the consistence.

Thank you! This allowed me to update the homebrew cask for
openrefine-dev, and homebrew caskroom maintainers accepted my PR:

https://github.com/caskroom/homebrew-versions/pull/3319

Now OpenRefine 2.7RC1 can be installed on macOS by installing Homebrew
(directions at http://brew.sh) and running this:

brew cask install openrefine-dev

This installs OpenRefine.app in the "/Applications" folder. If an
existing OpenRefine.app is found, homebrew will not overwrite it, so
installing via homebrew requires either deleting or renaming
previously installed copies.

By the way, I'll be happy to continue maintaining OpenRefine recipes
for homebrew. Once a new stable version is released, the caskroom
approach would be as follows:

1. Add a new caskroom recipe, "openrefine" - with the current stable
version (I assume this spelling is preferable to "open-refine"?)
2. Delete "openrefine-dev" until a new RC is created, at which point
version-specific casks would be created, e.g., "openrefine-2.8"
(deleting this once 2.8 is released as stable.
3. Delete "google-refine", as this will no longer be the current
stable version of the software.

Also, I should mention for those confused by homebrew vs. caskroom,
"caskroom" is the homebrew extension project where pre-built binaries
and GUI applications go, whereas the original, plain old "homebrew"
project is reserved for command-line utilities that can be built from
source. So OpenRefine clearly belongs in caskroom.

Joe

Thad Guidry

unread,
Feb 16, 2017, 12:32:29 PM2/16/17
to openr...@googlegroups.com
Joe,

Can you update our wiki with a new "MacOS homebrew" instruction sub-section or better yet... a complete new page with your notes and just provide a link under this section ?

-Thad

Joe Wicentowski

unread,
Feb 27, 2017, 10:10:37 PM2/27/17
to OpenRefine
Hi Thad,

I've added the section and new page on homebrew directions at
https://github.com/OpenRefine/OpenRefine/wiki/Installation-Instructions#macos
and https://github.com/OpenRefine/OpenRefine/wiki/Homebrew. Is that
what you had in mind? I'm happy to make adjustments.

Joe

Thad Guidry

unread,
Feb 27, 2017, 10:42:07 PM2/27/17
to openr...@googlegroups.com
Thanks, that works.
I cleaned up the steps a bit to make it easier on the eyes.

Thanks !  Well done Joe , we love ya for this !

Joe Wicentowski

unread,
Feb 28, 2017, 11:12:45 AM2/28/17
to OpenRefine
Hi Thad,

Thanks for your kind words and the improvements - that's much better!

And congrats to you guys on the 2.7RC1 release - it's great to see.

Joe

Patrick o'leary

unread,
Mar 8, 2017, 10:59:43 AM3/8/17
to OpenRefine
Hi Joe

I just tried those instructions for homebrew without success.
This seems to find the cask

brew cask install Caskroom/versions/openrefine-dev

However it looks like it's trying to install the syslink in /Applications
==> Moving App 'OpenRefine.app' to '/Applications/OpenRefine.app'
Error: Permission denied - (/usr/local/Caskroom/openrefine-dev/2.7-rc.2/OpenRefine.app, /Applications/OpenRefine.app)
Follow the instructions here:

If this doesn’t fix the problem, please report this bug:

Brew shouldn't put anything in /Applications

Should i create this as github issue?

Thanks
Patrick

Joe Wicentowski

unread,
Mar 8, 2017, 11:09:58 AM3/8/17
to OpenRefine
Hi Patrick,

OpenRefine's installation script is part of Homebrew's Caskroom
project, whose purpose is to install binaries of GUI applications.
Caskroom won't overwrite an existing installation of an application.
So to install OpenRefine via Homebrew, first delete any previous
(non-Caskroom) installation of /Applications/OpenRefine.app, and then
run the installation command. This is all covered in the detailed
page on Homebrew on OpenRefine's wiki -
https://github.com/OpenRefine/OpenRefine/wiki/Homebrew. We could
probably put the bit about previous installations into the main
instructions at
https://github.com/OpenRefine/OpenRefine/wiki/Installation-Instructions#macos
- would that have cleared up the issue for you, do you think?

Joe

Patrick o'leary

unread,
Mar 8, 2017, 11:49:04 AM3/8/17
to OpenRefine
Hi Joe

I just managed to figure it out, Cask have updated to start using /Applications now, which is a Cask vs brew thing.
Every few releases of brew there's a path change to keep me on my toes.

So to do the install I found this worked.
  brew cask install openrefine-dev
Needed to change to 
  brew cask install Caskroom/versions/openrefine-dev

And I would suggest a note around /Applications/ permission denied to look at

Where you can install to another directory
 brew cask --appdir=~/Applications install Caskroom/versions/openrefine-dev

And with that it's working.

Thanks
Patrick
Reply all
Reply to author
Forward
0 new messages