Hosting OpenRefine downloads on mirrors?

[Antonin Delpeuch (lists)]

Hi all,

I was just trying to figure out if there was a problem with our
Windows+Java package (following this tweet:
https://twitter.com/miriamkp/status/1349038007291060226
<https://twitter.com/miriamkp/status/1349038007291060226>) and realized
that downloading this artifact takes ages! I have noticed in the past
that downloading artifacts from GitHub releases can be pretty slow. So I
am wondering if we should consider mirroring these files elsewhere. Does
anyone know good alternatives? Ideally, a system to find a nearby mirror
would be convenient too.

Best,

ANtonin

[Thad Guidry]

TL;DR
So I don't think it is a problem with GitHub at all (GitHub easily served it to me at my very fast rate) but perhaps your ISPs and your service plan with them or their download throttling?

I just did a download test for for this:

https://github.com/OpenRefine/OpenRefine/releases/download/3.4.1/openrefine-win-with-java-3.4.1.zip

it took 4 secs for that 152 MB file for me on gigabit fiber where my download speed is usually around 940 Mbps

So I don't think we need to worry about mirrors at all.  Besides, GitHub Releases are already mirrored around the world through Amazon S3 buckets.
Here was the server that it automatically downloaded from for me when I viewed the Network tab on Firefox when I downloaded the file and saw the request / response and the host:
  github-production-release-asset-2e65be.s3.amazonaws.com

GitHub Packages (Azure Artifacts) which are not GitHub Releases but different are pushed out to Azure CDN and Content Storage (but I think still use Amazon S3 also depending on where you live and get routed to).

Azure has locations all over as well https://status.azure.com/en-us/status

Thad

https://www.linkedin.com/in/thadguidry/

--
You received this message because you are subscribed to the Google Groups "OpenRefine Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/2c0a5f7b-23c8-7950-ca22-6cbbf28de9b3%40antonin.delpeuch.eu.

[Tom Morris]

I tried one of the Windows snapshot kits and it took 7.3 seconds on a ~300 Mb/s WiFi connection with a 5 year old laptop, so I agree that the issue is unlikely to be on the Github side of things (unless it was transient).

Tom

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine-dev/CAChbWaP7XaYPaEje2ocUiM5cZm6H_HGSrju1v_xHhSxZzWuPXg%40mail.gmail.com.

[Antonin Delpeuch (lists)]

Ok great, thanks, sorry for the noise!

Antonin

On 13/01/2021 16:10, Tom Morris wrote:
> I tried one of the Windows snapshot kits and it took 7.3 seconds on a
> ~300 Mb/s WiFi connection with a 5 year old laptop, so I agree that the
> issue is unlikely to be on the Github side of things (unless it was
> transient).
>
> Tom
>
> On Wed, Jan 13, 2021 at 8:55 AM Thad Guidry <thadg...@gmail.com
> <mailto:thadg...@gmail.com>> wrote:
>
> TL;DR
> So I don't think it is a problem with GitHub at all (GitHub easily
> served it to me at my very fast rate) but perhaps your ISPs and your
> service plan with them or their download throttling?
>
> I just did a download test for for this:
>
> https://github.com/OpenRefine/OpenRefine/releases/download/3.4.1/openrefine-win-with-java-3.4.1.zip
> <https://github.com/OpenRefine/OpenRefine/releases/download/3.4.1/openrefine-win-with-java-3.4.1.zip>
>
> it took 4 secs for that 152 MB file for me on gigabit fiber where my
> download speed is usually around 940 Mbps
>
> So I don't think we need to worry about mirrors at all.  Besides,
> GitHub Releases are already mirrored around the world through Amazon
> S3 buckets.
> Here was the server that it automatically downloaded from for me
> when I viewed the Network tab on Firefox when I downloaded the file
> and saw the request / response and the host:
>   github-production-release-asset-2e65be.s3.amazonaws.com

> <http://github-production-release-asset-2e65be.s3.amazonaws.com>

> <mailto:openrefine-dev%2Bunsu...@googlegroups.com>.

> To view this discussion on the web visit
> https://groups.google.com/d/msgid/openrefine-dev/2c0a5f7b-23c8-7950-ca22-6cbbf28de9b3%40antonin.delpeuch.eu

> <https://groups.google.com/d/msgid/openrefine-dev/2c0a5f7b-23c8-7950-ca22-6cbbf28de9b3%40antonin.delpeuch.eu>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine Development" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to openrefine-de...@googlegroups.com

> <mailto:openrefine-de...@googlegroups.com>.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/openrefine-dev/CAChbWaP7XaYPaEje2ocUiM5cZm6H_HGSrju1v_xHhSxZzWuPXg%40mail.gmail.com
> <https://groups.google.com/d/msgid/openrefine-dev/CAChbWaP7XaYPaEje2ocUiM5cZm6H_HGSrju1v_xHhSxZzWuPXg%40mail.gmail.com?utm_medium=email&utm_source=footer>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine Development" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to openrefine-de...@googlegroups.com

> <mailto:openrefine-de...@googlegroups.com>.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHpDnk3A59%3DOkFHeeNL1p9N5MOw66jNT52EdeEjAx9u%2BQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/openrefine-dev/CAE9vqEHpDnk3A59%3DOkFHeeNL1p9N5MOw66jNT52EdeEjAx9u%2BQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.