Gerrit CI storage bucket (was Re: Change in gerrit[master]: NoteDbUpdateManager: Set reflog message and identity)

10 visningar
Hoppa till det första olästa meddelandet

Dave Borowitz

oläst,
5 jan. 2017 10:21:442017-01-05
till luca milanesio, repo-discuss
I created a GCS bucket called "gerrit-ci" where you can dump logs in any hierarchy you want.

Luca, I just need from you the Google account that you want to have write access.

I have no reason to think that the cost of maintaining this bucket will ever exceed what Google's willing to pay, but if it does, we'll take care of identifying and pruning old (hopefully much older than 1 week :) logs.

On Thu, Jan 5, 2017 at 10:15 AM, Luca Milanesio (Gerrit) <noreply-gerritcoderevie...@google.com> wrote:

Luca Milanesio posted comments on this change.

View Change

Patch set 1:

Patch Set 1:

Patch Set 1: > > Removed Verified-1 by GerritForge CI <gerri...@gmail.com> > This seems to be a real breakage in NoteDb mode. > @Luca, can't we try to preserve (or backup) CI build logs for at least a couple of weeks?

+1, I would expect these to be preserved ~forever. If it's a storage capacity thing we can talk about donating one of the GCP buckets owned & paid for by Google. We would have to run the numbers but I'm reasonably sure we can absorb this cost.

Thanks for the suggestion. There are number of problems to solve here:

  • Jenkins is inherently broken and cannot persist the logs beyond a couple of weeks. The solution here is to move away from that tool. That's what OpenStack project did. Whether it must be Zuul or just a couple of go scripts, is a different topic

Hold hold, neither Jenkins nor Zuul are distributed filesystems with archiving capabilities, isn't it? I believe Dave's suggestion is more on the problem we need to solve: storage and archiving capability.

Jenkins has the ability to store the logs somewhere else, and that's what we do but we don't publish yet, but we will.

  • Storage issue, where to upload/backup the logs

Dave's solution works well.

  • Viewer utility te retrieve the old logs and present them in browser

That's trivial.

    To view, visit this change. To unsubscribe, visit settings.

    Gerrit-Project: gerrit
    Gerrit-Branch: master
    Gerrit-MessageType: comment
    Gerrit-Change-Id: Iab0aae68d6f121829529c6714636eed90c3ba929
    Gerrit-Change-Number: 93354
    Gerrit-PatchSet: 1
    Gerrit-Owner: Dave Borowitz <dbor...@google.com>
    Gerrit-Reviewer: GerritForge CI <gerri...@gmail.com>
    Gerrit-Reviewer: Han-Wen Nienhuys <han...@google.com>
    Gerrit-Reviewer: ekempin <eke...@google.com>
    Gerrit-CC: Luca Milanesio <luca.mi...@gmail.com>
    Gerrit-Comment-Date: Thu, 05 Jan 2017 15:15:12 +0000
    Gerrit-HasComments: No

    Svara alla
    Svara författaren
    Vidarebefordra
    0 nya meddelanden