Nexus Repository Manager 3.12 & S3 blob stores

424 views
Skip to first unread message

Cliff Wakefield

unread,
May 23, 2018, 4:47:55 AM5/23/18
to Nexus Users
Hi,

Excited by the 3.12 release supporting S3 based blob stores.

But is there anyway way to migrate file based blob stores to S3 based blob stores?

Can you simply upload the files that make up the blob store to S3 manually?

-- Cliff

Daniel MD

unread,
May 23, 2018, 8:12:50 AM5/23/18
to Cliff Wakefield, Nexus Users
This is a great question. Would be great to have a migration guide. I currently also have a large 100G Blob store that I would like to migrate to AWS

If someone has the experience to share would be great :)

KR,
Dan

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.
To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/b4d9527a-df3f-4fd2-b8f0-4bf70f8cf88b%40glists.sonatype.com.
For more options, visit https://groups.google.com/a/glists.sonatype.com/d/optout.

Michael Prescott

unread,
May 24, 2018, 9:00:03 AM5/24/18
to Daniel MD, Cliff Wakefield, Nexus Users
Unfortunately, there isn't a great option yet, but we're working on making this a lot easier. We're giving blob store administration some more love in the coming months, storage is a pain point for a lot of people.

Michael

On 23 May 2018 at 08:12, Daniel MD <daniel...@gmail.com> wrote:
This is a great question. Would be great to have a migration guide. I currently also have a large 100G Blob store that I would like to migrate to AWS

If someone has the experience to share would be great :)

KR,
Dan
On Wed, May 23, 2018 at 10:47 AM Cliff Wakefield <cliff.w...@gmail.com> wrote:
Hi,

Excited by the 3.12 release supporting S3 based blob stores.

But is there anyway way to migrate file based blob stores to S3 based blob stores?

Can you simply upload the files that make up the blob store to S3 manually?

-- Cliff

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/CANZ78kfEeH-yj9484ZTvY1zXgGasH2YfFcAAv4zuDHPyHvAKow%40mail.gmail.com.

Łukasz Rżanek

unread,
May 24, 2018, 3:43:13 PM5/24/18
to mpre...@sonatype.com, daniel...@gmail.com, cliff.w...@gmail.com, nexus...@glists.sonatype.com
Is there an API to create new storage engine implementations? Sorry for bluntly asking but I had no time to look - yet I would be happy to implement Google stuff later...

Pozdrawiam serdecznie & Best Regards & Mit freundlichen Grüßen,
-- 
:: Łukasz Rżanek


czw., 24 maj 2018 o 16:00 Michael Prescott <mpre...@sonatype.com> napisał(a):
Unfortunately, there isn't a great option yet, but we're working on making this a lot easier. We're giving blob store administration some more love in the coming months, storage is a pain point for a lot of people.

Michael
On 23 May 2018 at 08:12, Daniel MD <daniel...@gmail.com> wrote:
This is a great question. Would be great to have a migration guide. I currently also have a large 100G Blob store that I would like to migrate to AWS

If someone has the experience to share would be great :)

KR,
Dan
On Wed, May 23, 2018 at 10:47 AM Cliff Wakefield <cliff.w...@gmail.com> wrote:
Hi,

Excited by the 3.12 release supporting S3 based blob stores.

But is there anyway way to migrate file based blob stores to S3 based blob stores?

Can you simply upload the files that make up the blob store to S3 manually?

-- Cliff

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/CANZ78kfEeH-yj9484ZTvY1zXgGasH2YfFcAAv4zuDHPyHvAKow%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/CAOvMkt0P1zwd9J7e8xQgD-D900UsRv47PpKb7WcVJmmfYffswg%40mail.gmail.com.

Nicholas Blair

unread,
May 24, 2018, 4:33:19 PM5/24/18
to Łukasz Rżanek, mpre...@sonatype.com, daniel...@gmail.com, cliff.w...@gmail.com, nexus...@glists.sonatype.com
Łukasz,
We have a really rough, pre-alpha level Google Cloud Storage backed implementation started already:


It's a functional starting point, but definitely nowhere near production-worthy (and not supported by Sonatype). Check the issues tab - throughput isn't great and it's missing a few features.  Give it a shot, and we'd welcome contributions!

Thanks!
Nick

To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/CAGq5L7dNuQX9A6T2qrS%3DS2na_5t8ycXRXJcPnCYFQpSJY9DuMQ%40mail.gmail.com.

Michael Prescott

unread,
May 24, 2018, 6:47:44 PM5/24/18
to Nicholas Blair, Łukasz Rżanek, Daniel MD, Cliff Wakefield, Nexus Users
Łukasz,

Out of curiosity, do you have a particular storage system in mind?

Michael

To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.

Łukasz Rżanek

unread,
May 25, 2018, 6:32:48 AM5/25/18
to mpre...@sonatype.com, nbl...@sonatype.com, daniel...@gmail.com, cliff.w...@gmail.com, nexus...@glists.sonatype.com
Actually, I wanted to implement Google Cloud Storage first - but, as it is already under active development I might join forces there. 
My second idea was to use OpenStack Swift as well as we are using OVH as a provider and they offer OVH Public Cloud SWIFT store - close to us, performant and quite flexible in use...

Let see how much time I will have ;-)

Pozdrawiam serdecznie & Best Regards & Mit freundlichen Grüßen,
-- 
:: Łukasz Rżanek

To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.
Reply all
Reply to author
Forward
0 new messages