New packaging process: where to store our releases?

19 views
Skip to first unread message

Antonin Delpeuch (lists)

unread,
Jun 7, 2022, 2:45:01 AM6/7/22
to openref...@googlegroups.com
Hello all,

As you might have noticed I attempted to publish a first beta in the 3.6
series, using the new packaging process. I encountered quite a few bumps
in the road so I apologize for the noise, in particular the deletion and
recreation of those releases (thank you to whoever cleaned up our
Twitter feed after that!). This should of course be a transitional
situation and not a long-term situation.

With this new release process, most of the steps are automated and are
run inside GitHub Actions. This means I do not need to fiddle with a
MacOS VM to generate the DMG file for the release, for instance. This
should make it a lot easier to publish releases, using the same process
as that for snapshot releases. This ensures that official releases and
snapshot releases are more consistent, and reduces the risk of something
breaking because of the discrepancy between the two workflows.

In this new workflow, our releases are published to Maven Central and
users can download them from there directly. So far, we were storing
them in GitHub releases. So for this release, I have manually downloaded
the four packages from Maven Central and uploaded them to GitHub
releases, but that is not something I would like to do on the long run.

So I can see a few possibilities:

* automatically upload the artifacts to the GitHub release in the GitHub
action, so that our artifacts are available both via Maven Central and
in GitHub

* stop uploading artifacts to GitHub and rely entirely on Maven Central
instead. We can put direct download links in GitHub releases just like
we do in our README.md:
https://github.com/OpenRefine/OpenRefine#snapshot-releases

* do not rely on Maven Central for official releases and only upload to
GitHub releases instead

Let me know what you think!

Antonin

Martin Magdinier

unread,
Jun 24, 2022, 9:23:37 AM6/24/22
to openref...@googlegroups.com
Antonin. 

Do you have an example of what the release would look like on maven? Does maven offer download stats per artifact?

--
You received this message because you are subscribed to the Google Groups "OpenRefine Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu.

Antonin Delpeuch (lists)

unread,
Jun 26, 2022, 11:45:03 AM6/26/22
to openref...@googlegroups.com

Hi Martin,

The release on Maven looks like this: https://mvnrepository.com/artifact/org.openrefine

I would not actually point users to that: regardless of where the binaries are stored, I would still use GitHub Releases for now (if we are to use Maven Central to store the releases, I would just add download links to the release description rather than uploading the files as attachments).

Yes we do have some download statistics there, but you need to log in to Sonatype using the credentials used for the upload (which are not my personal ones and are designed to be shared with others).

Perhaps we could try using only Maven Central for 3.6?

Best,

Antonin

Thad Guidry

unread,
Jun 26, 2022, 12:16:55 PM6/26/22
to openref...@googlegroups.com

Martin Maginier

unread,
Jun 27, 2022, 8:14:59 AM6/27/22
to openref...@googlegroups.com

Antonin, thanks for the clarification. I like the fact we are keeping GitHub release page for notification.

OK to try it for 3.6.

Martin

Tom Morris

unread,
Nov 24, 2022, 10:19:04 PM11/24/22
to openref...@googlegroups.com
One thing I noticed the other day is that the Github releases API no longer tracks our download counts since the move to Sonatype/Maven Central. Is there a replacement API to get this information? (or something easier like a CSV?)

Tom

Antonin Delpeuch (lists)

unread,
Nov 25, 2022, 2:51:50 AM11/25/22
to openref...@googlegroups.com
There are download statistics but I fear that they are only available to
the uploader, and not publicly available.

I'll ask the Gephi folks (who also use Sonatype) if they have a
workaround for this.

Best
Antonin

On 25/11/2022 04:18, Tom Morris wrote:
> One thing I noticed the other day is that the Github releases API no
> longer tracks our download counts since the move to Sonatype/Maven
> Central. Is there a replacement API to get this information? (or
> something easier like a CSV?)
>
> Tom
>
> On Mon, Jun 27, 2022 at 8:15 AM Martin Maginier
> <martin.m...@gmail.com <mailto:martin.m...@gmail.com>> wrote:
>
> Antonin, thanks for the clarification. I like the fact we are
> keeping GitHub release page for notification.
>
> OK to try it for 3.6.
>
> Martin
>
> On 2022-06-26 12:16, Thad Guidry wrote:
>> I think we should try Maven Central for 3.6
>>
>> Thad
>> https://www.linkedin.com/in/thadguidry/
>> <https://www.linkedin.com/in/thadguidry/>
>> https://calendly.com/thadguidry/ <https://calendly.com/thadguidry/>
>>
>>
>> On Sun, Jun 26, 2022 at 10:45 AM Antonin Delpeuch (lists)
>> <li...@antonin.delpeuch.eu <mailto:li...@antonin.delpeuch.eu>> wrote:
>>
>> Hi Martin,
>>
>> The release on Maven looks like this:
>> https://mvnrepository.com/artifact/org.openrefine
>> <https://mvnrepository.com/artifact/org.openrefine>
>>
>> I would not actually point users to that: regardless of where
>> the binaries are stored, I would still use GitHub Releases for
>> now (if we are to use Maven Central to store the releases, I
>> would just add download links to the release description
>> rather than uploading the files as attachments).
>>
>> Yes we do have some download statistics there, but you need to
>> log in to Sonatype using the credentials used for the upload
>> (which are not my personal ones and are designed to be shared
>> with others).
>>
>> Perhaps we could try using only Maven Central for 3.6?
>>
>> Best,
>>
>> Antonin
>>
>> On 24/06/2022 15:23, Martin Magdinier wrote:
>>> Antonin.
>>>
>>> Do you have an example of what the release would look like on
>>> maven? Does maven offer download stats per artifact?
>>>
>>> On Tue., Jun. 7, 2022, 2:45 a.m. Antonin Delpeuch (lists),
>>> <li...@antonin.delpeuch.eu
>>> https://github.com/OpenRefine/OpenRefine#snapshot-releases <https://github.com/OpenRefine/OpenRefine#snapshot-releases>
>>>
>>> * do not rely on Maven Central for official releases and
>>> only upload to
>>> GitHub releases instead
>>>
>>> Let me know what you think!
>>>
>>> Antonin
>>>
>>> --
>>> You received this message because you are subscribed to
>>> the Google Groups "OpenRefine Development" group.
>>> To unsubscribe from this group and stop receiving emails
>>> from it, send an email to
>>> openrefine-de...@googlegroups.com
>>> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu <https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu>.
>>>
>>> --
>>> You received this message because you are subscribed to the
>>> Google Groups "OpenRefine Development" group.
>>> To unsubscribe from this group and stop receiving emails from
>>> it, send an email to
>>> openrefine-de...@googlegroups.com
>>> <mailto:openrefine-de...@googlegroups.com>.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/openrefine-dev/CAO%2BzzMt_mbVKhu8-_SnnvAnRHk%3DeXixKJ%2BruBhmDt4kv3-66Gw%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAO%2BzzMt_mbVKhu8-_SnnvAnRHk%3DeXixKJ%2BruBhmDt4kv3-66Gw%40mail.gmail.com?utm_medium=email&utm_source=footer>.
>> --
>> You received this message because you are subscribed to the
>> Google Groups "OpenRefine Development" group.
>> To unsubscribe from this group and stop receiving emails from
>> it, send an email to
>> openrefine-de...@googlegroups.com
>> <mailto:openrefine-de...@googlegroups.com>.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/openrefine-dev/0aaa9eb1-ba43-96ba-7536-ab15ec641974%40antonin.delpeuch.eu <https://groups.google.com/d/msgid/openrefine-dev/0aaa9eb1-ba43-96ba-7536-ab15ec641974%40antonin.delpeuch.eu?utm_medium=email&utm_source=footer>.
>>
>> --
>> You received this message because you are subscribed to the Google
>> Groups "OpenRefine Development" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to openrefine-de...@googlegroups.com
>> <mailto:openrefine-de...@googlegroups.com>.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/openrefine-dev/CAChbWaMSaYCYcgBB_SYsKhcTXxgZ-uCyJpR_SSoHN3ChNYsTyQ%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAChbWaMSaYCYcgBB_SYsKhcTXxgZ-uCyJpR_SSoHN3ChNYsTyQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.
>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine Development" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openrefine-de...@googlegroups.com
> <mailto:openrefine-de...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/openrefine-dev/ac1aa154-c887-a6d6-3682-791ab7409b7e%40gmail.com <https://groups.google.com/d/msgid/openrefine-dev/ac1aa154-c887-a6d6-3682-791ab7409b7e%40gmail.com?utm_medium=email&utm_source=footer>.
>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine Development" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to openrefine-de...@googlegroups.com
> <mailto:openrefine-de...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHJqETENHwDVaBCyD19rh9MxzkVHka7TGxdpxrfEdGd-Q%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHJqETENHwDVaBCyD19rh9MxzkVHka7TGxdpxrfEdGd-Q%40mail.gmail.com?utm_medium=email&utm_source=footer>.

Antonin Delpeuch (lists)

unread,
Nov 25, 2022, 3:25:06 AM11/25/22
to openref...@googlegroups.com
So, it seems that even the download statistics that are available to the
uploader only count the downloads of `.jar` files, and not the packaged
versions, so those download statistics are pretty useless for us. Also
Gephi is only using Sonatype for their snapshot releases, not for stable
ones.

I think it is worth switching back to GitHub for 3.7.

Thanks for bringing that topic up again.

Antonin

Thad Guidry

unread,
Nov 25, 2022, 6:18:26 AM11/25/22
to openref...@googlegroups.com
Antonin,

Curious, What were your original concerns about GitHub releases that prompted to move to Maven releases (Sonatype)?
Could those concerns be addressed (and issues opened) during the switchback to it?
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/2405abed-e31b-ea9b-a8f8-f7dd21c153ff%40antonin.delpeuch.eu.

Antonin Delpeuch (lists)

unread,
Nov 25, 2022, 6:30:34 AM11/25/22
to openref...@googlegroups.com
Hi Thad,

No particular concerns about GitHub releases. The thought process was:
- for snapshot releases it is convenient to use Sonatype because the
upload is easy to integrate in the Maven workflow, and it avoids having
to do this complicated business of creating new releases in another
repository as we were doing before (which meant the GitHub UI was a bit
confusing there, especially with the version numbers)
- if we are using Sonatype for snapshot releases then it's easy to do
the same for actual releases (the process remains uniform, whether we
are building a snapshot or not)

Best,
Antonin

On 25/11/2022 12:18, Thad Guidry wrote:
> Antonin,
>
> Curious, What were your original concerns about GitHub releases that
> prompted to move to Maven releases (Sonatype)?
> Could those concerns be addressed (and issues opened) during the
> switchback to it?
>
> Thad
> https://www.linkedin.com/in/thadguidry/
> <mailto:martin.m...@gmail.com
> <mailto:martin.m...@gmail.com>>> wrote:
> >>
> >>     Antonin, thanks for the clarification. I like the fact we are
> >>     keeping GitHub release page for notification.
> >>
> >>     OK to try it for 3.6.
> >>
> >>     Martin
> >>
> >>     On 2022-06-26 12:16, Thad Guidry wrote:
> >>>     I think we should try Maven Central for 3.6
> >>>
> >>>     Thad
> >>> https://www.linkedin.com/in/thadguidry/
> <https://www.linkedin.com/in/thadguidry/>
> >>>     <https://www.linkedin.com/in/thadguidry/
> <https://www.linkedin.com/in/thadguidry/>>
> >>> https://calendly.com/thadguidry/
> <https://calendly.com/thadguidry/> <https://calendly.com/thadguidry/
> <https://calendly.com/thadguidry/>>
> >>>
> >>>
> >>>     On Sun, Jun 26, 2022 at 10:45 AM Antonin Delpeuch (lists)
> >>>     <li...@antonin.delpeuch.eu
> <mailto:li...@antonin.delpeuch.eu> <mailto:li...@antonin.delpeuch.eu
> >>>>         <mailto:li...@antonin.delpeuch.eu
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com
> <mailto:openrefine-dev%252Buns...@googlegroups.com>>.
> >>>>             To view this discussion on the web visit
> >>>>
> >>>>
> https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu <https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu> <https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu <https://groups.google.com/d/msgid/openrefine-dev/601a3a38-c1d6-9f79-2730-0ead04a2905d%40antonin.delpeuch.eu>>.
> >>>>
> >>>>         --         You received this message because you are
> >>>> subscribed to the
> >>>>         Google Groups "OpenRefine Development" group.
> >>>>         To unsubscribe from this group and stop receiving
> emails from
> >>>>         it, send an email to
> >>>> openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>
> >>>>         <mailto:openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>>.
> >>>>         To view this discussion on the web visit
> >>>>
> >>>>
> https://groups.google.com/d/msgid/openrefine-dev/CAO%2BzzMt_mbVKhu8-_SnnvAnRHk%3DeXixKJ%2BruBhmDt4kv3-66Gw%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAO%2BzzMt_mbVKhu8-_SnnvAnRHk%3DeXixKJ%2BruBhmDt4kv3-66Gw%40mail.gmail.com> <https://groups.google.com/d/msgid/openrefine-dev/CAO%2BzzMt_mbVKhu8-_SnnvAnRHk%3DeXixKJ%2BruBhmDt4kv3-66Gw%40mail.gmail.com?utm_medium=email&utm_source=footer <https://groups.google.com/d/msgid/openrefine-dev/CAO%2BzzMt_mbVKhu8-_SnnvAnRHk%3DeXixKJ%2BruBhmDt4kv3-66Gw%40mail.gmail.com?utm_medium=email&utm_source=footer>>.
> >>>         --         You received this message because you are
> >>> subscribed to the
> >>>         Google Groups "OpenRefine Development" group.
> >>>         To unsubscribe from this group and stop receiving
> emails from
> >>>         it, send an email to
> >>> openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>
> >>>         <mailto:openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>>.
> >>>         To view this discussion on the web visit
> >>>
> >>>
> https://groups.google.com/d/msgid/openrefine-dev/0aaa9eb1-ba43-96ba-7536-ab15ec641974%40antonin.delpeuch.eu <https://groups.google.com/d/msgid/openrefine-dev/0aaa9eb1-ba43-96ba-7536-ab15ec641974%40antonin.delpeuch.eu> <https://groups.google.com/d/msgid/openrefine-dev/0aaa9eb1-ba43-96ba-7536-ab15ec641974%40antonin.delpeuch.eu?utm_medium=email&utm_source=footer <https://groups.google.com/d/msgid/openrefine-dev/0aaa9eb1-ba43-96ba-7536-ab15ec641974%40antonin.delpeuch.eu?utm_medium=email&utm_source=footer>>.
> >>>
> >>>     --     You received this message because you are subscribed to
> >>> the Google
> >>>     Groups "OpenRefine Development" group.
> >>>     To unsubscribe from this group and stop receiving emails
> from it,
> >>>     send an email to
> openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>
> >>>     <mailto:openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>>.
> >>>     To view this discussion on the web visit
> >>>
> >>>
> https://groups.google.com/d/msgid/openrefine-dev/CAChbWaMSaYCYcgBB_SYsKhcTXxgZ-uCyJpR_SSoHN3ChNYsTyQ%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAChbWaMSaYCYcgBB_SYsKhcTXxgZ-uCyJpR_SSoHN3ChNYsTyQ%40mail.gmail.com> <https://groups.google.com/d/msgid/openrefine-dev/CAChbWaMSaYCYcgBB_SYsKhcTXxgZ-uCyJpR_SSoHN3ChNYsTyQ%40mail.gmail.com?utm_medium=email&utm_source=footer <https://groups.google.com/d/msgid/openrefine-dev/CAChbWaMSaYCYcgBB_SYsKhcTXxgZ-uCyJpR_SSoHN3ChNYsTyQ%40mail.gmail.com?utm_medium=email&utm_source=footer>>.
> >>
> >>     --     You received this message because you are subscribed
> to the
> >> Google
> >>     Groups "OpenRefine Development" group.
> >>     To unsubscribe from this group and stop receiving emails
> from it,
> >>     send an email to openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>
> >>     <mailto:openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>>.
> >>     To view this discussion on the web visit
> >>
> >>
> https://groups.google.com/d/msgid/openrefine-dev/ac1aa154-c887-a6d6-3682-791ab7409b7e%40gmail.com <https://groups.google.com/d/msgid/openrefine-dev/ac1aa154-c887-a6d6-3682-791ab7409b7e%40gmail.com> <https://groups.google.com/d/msgid/openrefine-dev/ac1aa154-c887-a6d6-3682-791ab7409b7e%40gmail.com?utm_medium=email&utm_source=footer <https://groups.google.com/d/msgid/openrefine-dev/ac1aa154-c887-a6d6-3682-791ab7409b7e%40gmail.com?utm_medium=email&utm_source=footer>>.
> >>
> >> --
> >> You received this message because you are subscribed to the Google
> >> Groups "OpenRefine Development" group.
> >> To unsubscribe from this group and stop receiving emails from
> it, send
> >> an email to openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>
> >> <mailto:openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>>.
> >> To view this discussion on the web visit
> >>
> https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHJqETENHwDVaBCyD19rh9MxzkVHka7TGxdpxrfEdGd-Q%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHJqETENHwDVaBCyD19rh9MxzkVHka7TGxdpxrfEdGd-Q%40mail.gmail.com> <https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHJqETENHwDVaBCyD19rh9MxzkVHka7TGxdpxrfEdGd-Q%40mail.gmail.com?utm_medium=email&utm_source=footer <https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHJqETENHwDVaBCyD19rh9MxzkVHka7TGxdpxrfEdGd-Q%40mail.gmail.com?utm_medium=email&utm_source=footer>>.
> >
>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine Development" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openrefine-de...@googlegroups.com
> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/openrefine-dev/2405abed-e31b-ea9b-a8f8-f7dd21c153ff%40antonin.delpeuch.eu <https://groups.google.com/d/msgid/openrefine-dev/2405abed-e31b-ea9b-a8f8-f7dd21c153ff%40antonin.delpeuch.eu>.
>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine Development" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to openrefine-de...@googlegroups.com
> <mailto:openrefine-de...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/openrefine-dev/CAChbWaNveX%2BunxxwvoV7m%2B4ZNim6q9egs8DO3zeO8i8_O7C-bw%40mail.gmail.com <https://groups.google.com/d/msgid/openrefine-dev/CAChbWaNveX%2BunxxwvoV7m%2B4ZNim6q9egs8DO3zeO8i8_O7C-bw%40mail.gmail.com?utm_medium=email&utm_source=footer>.

Reply all
Reply to author
Forward
0 new messages