Jenkins hints for large git repos

[b o b i]

Jenkins scripted pipeline

Git repo 2.6G

Each job wants to git clone the latest commit

#Jobs x GitRepo = many GB disk space.

Do you have any hints of how to reduce the disk space usage, i.e. any hints how to deal with large git repors by many jobs ?

[Mark Waite]

I presented a 10-15 minute section called "Git in the Large - Hints for Large Git Repos" at https://youtu.be/jBGFjFc6Jf8?t=6432 .  A slightly older version on a similar theme is available at https://youtu.be/TsWkZLLU-s4?t=139 .

Slides from the second talk are available at https://jenkins.io/files/2016/jenkins-world/large-git-repos.pdf .  Slides from the first talk are available at https://www.slideshare.net/markewaite/git-inthelarge 

Short answer - use a reference repository to dramatically reduce repository disc space for multiple repositories.  Use a narrow refspec to reduce data transfer and disc space in repositories with many divergent branches.  Use a shallow clone to reduce data transfer and disc use.

Mark Waite

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/1043d9ff-586e-4fd0-8791-0d7dd2e401aa%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Thanks!

Mark Waite