OpenRefine and Google sheet: OAuth 2.0

[j s]

Just this week, the integration of OpenRefine with Google sheet hit a bump.

The old process of authentication is no longer available. User must go through Google API establishing project and token, etc. The instructions linked from this error page are not intuitive and hard to follow for non-IT person. Has anyone come across a better way to authenticate G account from OpenRefine?

Thank you for your help!

--Jackie

[Thad Guidry]

Hi Jackie,

Curious, are you using our new OpenRefine 3.4 version on Windows?  https://openrefine.org/download.html

Thad

https://www.linkedin.com/in/thadguidry/

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/898d97c2-02db-4388-b724-a3de26f9f28cn%40googlegroups.com.

[Shieh, Jackie]

 I am using 3.4 OpenRefine, MacOS (Catalina) via either Chrome or Firefox. My colleagues are one Windows 10, Chrome.

—Jackie

Begin forwarded message:

From: Thad Guidry <thadg...@gmail.com>

Subject: Re: [OpenRefine] OpenRefine and Google sheet: OAuth 2.0

Date: September 22, 2020 at 12:55:17 PM EDT

To: openr...@googlegroups.com

Reply-To: openr...@googlegroups.com

External Email - Exercise Caution

You received this message because you are subscribed to a topic in the Google Groups "OpenRefine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/openrefine/myrQckchpdI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to openrefine+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAChbWaNF7a8Ft2MMznPZsRPnTjNbi4vNySuJtxmNaG_36TG-tA%40mail.gmail.com.

[Thad Guidry]

Jackie,

What's the exact error or error page that you see?  Can you take a screenshot or give us a text copy/paste of the message in your reply?

Thad

https://www.linkedin.com/in/thadguidry/

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/D68EE696-8059-4649-AFE9-6375FD05D2A3%40si.edu.

[Shieh, Jackie]

Not sure the reason my attached screen shot failed to come through my gmail email. Hope it works this time. My colleagues had the same error on their Windows 10 when clicking on <sign in and authorize> from OpenRefine.

 

[Thad Guidry]

Thanks Jackie,

We see the screenshots now.  This is helpful.

Stay tuned for more info as we debug and double check a couple of things.

Thad

https://www.linkedin.com/in/thadguidry/

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/08E91C1F-BE7D-4FAF-B38B-BDBBFF15BEEE%40si.edu.

[Thad Guidry]

Hi Jackie,

OK, it looks like we do embed a client secret, but this might fail depending on usage and rights given from Google at any time.

As we note in the refine.ini file, we recommend that you use your own credentials and then add them in the refine.ini file.

Open the refine.ini file and read through the comment about that.

Then uncomment the GDATA_CLIENT_ID and GDATA_CLIENT_SECRET

And then appropriate set both of them to your own credentials that you obtain from Google.

As mentioned in the refine.ini file, we also have some more details here:
https://github.com/OpenRefine/OpenRefine/wiki/Google-Extension

Let us know your success or failures after doing that or if anything is unclear.

Thad

https://www.linkedin.com/in/thadguidry/

[Thad Guidry]

Tom and Antonin,

Regarding Jackie's problem, which I also replicated and see as well...

I personally think we should change the way we handle the Google access to that of a Web Server scenario, rather than the current Installed Application scenario.

Would it help more you think?

Thad

https://www.linkedin.com/in/thadguidry/

[Shieh, Jackie]

Sorry to be so dense about this. 

From the <Get-Extension> link, I got to <Steps to obtain OAuth>

I then clicked on <Google API Console>, was taken to this page where <Create Project> link was not visible. Where will it be? Please advise.

I personally think the OAuth process established by Wikidata was a superior experience. Much simpler for end-user. Is it not possible to have the similar experience for OpenRefine to Google sheet?

Thanks again!

—Jackie

[Thad Guidry]

Jackie,

I honestly don't know.

We'll have to wait for Tom, Antonin, or Lu Liu from our team to respond and advise us.

Thad

https://www.linkedin.com/in/thadguidry/

[Tom Morris]

All that configuration stuff is for developers not end users. None of it should be necessary for a release build. There must have been a problem with the 3.4 build, but the 3.3 release still works fine, so I would recommend falling back to that.

Tom

--

You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAChbWaMYMQ3iedu694An2wEPLJtWvCrBmnyNQv6HXMzR-VjAgw%40mail.gmail.com.

[Thad Guidry]

Thanks Tom.

Then we probably want to change that line #30 in the refine.ini file

# So if you are a user, you can just skip these configurations, but it's recommended to use your own credentials

 

Thad

https://www.linkedin.com/in/thadguidry/

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAE9vqEEkFqcWNxuLn--QqWks2FxgucuHgf_i54fbbr%2BWdRPu0w%40mail.gmail.com.

[Tom Morris]

On Tue, Sep 22, 2020 at 4:29 PM Thad Guidry <thadg...@gmail.com> wrote:

Then we probably want to change that line #30 in the refine.ini file

 

Sounds like you need two issues in the issue tracker then, one to fix the 3.4 kit and one to fix the .ini file.

https://github.com/OpenRefine/OpenRefine/issues/new/choose

Tom

[Thad Guidry]

DONE!

https://github.com/OpenRefine/OpenRefine/issues/3204
https://github.com/OpenRefine/OpenRefine/issues/3205

Thad

https://www.linkedin.com/in/thadguidry/

--

You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAE9vqEEVGXiTvuU9PEy6S1Q4tP_8hn3t%2Bn1sLXDB8_Hz18Nxgg%40mail.gmail.com.

[j s]

Hi,

Hope the description below helps your troubleshooting… Thank you. 

As requested, I removed connection between G apps and OpenRefine.  On 09/24 16:10, I have Just repeated the steps for OpenRefine v3.3 and v3.4beta2. Same error.

—Jackie

1. Disconnect from G drive apps

2. Reinstalled OR 3.3 as well as 3.4 (separate occurrences), when I used OR to connect to Google, both versions took me through the authentication process, then, error!

After receiving notification in my email about access granted, then an error message

[Thad Guidry]

Hi Jackie,

Did you get a confirmation email to verify your identity (it would have had a confirmation button for Google Drive to be allowed access for OpenRefine).

This is part of Google Drive's 2FA (2 factor) authentication that is required now.

When I tried again with OpenRefine 3.4.1 , I did receive such a confirmation email.

Check your email and try again with OpenRefine 3.4.1 version and let us know.

And thanks for using OpenRefine at the Smithsonian Libraries!

Would love to see the output of your work sometime soon!

Thad

https://www.linkedin.com/in/thadguidry/

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/553D2BF2-A9F5-4368-A61B-2CE64646F3B8%40gmail.com.

[j s]

The confirmation came in the form of popup notification (screenshot below from earlier message). I have not received a separate alert in email regarding OR and G drive for the two versions mentioned below. Previously testing on v.3.4.1 have yet to be redone since reporting the error issue since Wed 09/23 afternoon (EST). Thank you. 

—Jackie

From: Thad Guidry <thadg...@gmail.com>

Subject: Re: [OpenRefine] OpenRefine and Google sheet: OAuth 2.0

[j s]

09/29 16:35 (EST) confirming the newly downloaded 3.4.1 [437dc4d] succeed importing Google spreadsheet into OpenRefine! Now I am ready conducting reconciliation against Wikidata, SNAC and Getty vocabs! Thanks so much!

—Jackie

From: j s <aa35...@gmail.com>

Subject: Fwd: [OpenRefine] OpenRefine and Google sheet: OAuth 2.0

Date: September 25, 2020 at 12:18:44 PM EDT

To: openr...@googlegroups.com

External Email - Exercise Caution

The confirmation came in the form of popup notification (screenshot below from earlier message). I have not received a separate alert in email regarding OR and G drive for the two versions mentioned below. Previously testing on v.3.4.1 have yet to be redone since reporting the error issue since Wed 09/23 afternoon (EST). Thank you. 

[Thad Guidry]

Woohoo!!!!!!

Nice to know Jackie!  Can't wait to see the outcome of all your teams work at Smithsonian Libraries!

Thad

https://www.linkedin.com/in/thadguidry/

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/A760CB59-0F81-4164-A5CA-2FBE5AFF4AF5%40gmail.com.