Question about maximum size of svn repository (svn 1.6.1, backend as FSFS)

1,606 views
Skip to first unread message

Ravi Roy

unread,
Mar 21, 2010, 1:49:31 AM3/21/10
to us...@subversion.apache.org
Hi

I was googling if there is a limitation for the size of the subversion
repository but could not find a relevent answer..
Does somebody know about or can throw some light please ? I am using
subversion 1.6.1 ..backend as FSFS on Centos 5.2.

Thanks.

- RR

David Weintraub

unread,
Mar 21, 2010, 2:03:53 AM3/21/10
to Ravi Roy, us...@subversion.apache.org
There is no physical limitation to Subversion. There isn't a magic
number where there are more files than it can track or more
directories.

There may be limits with the actual operating system. For example,
some operating systems can't handle files larger than 2Gb. Or, Windows
having problems with directory/file names longer than 160 characters.
But, these would be true with ANY software you use.

There could be issues with speed as your repository gets bigger and
bigger, but there are sites out there running thousands of "projects"
on a single Subversion server and hundreds of users without any
problems.

How big is your project that you are worried about possible
limitations? Give us an idea of possible size issues, and someone on
the list with a similar sized project can tell you what to expect in
terms of performance.

--
David Weintraub
qaz...@gmail.com

Ravi Roy

unread,
Mar 21, 2010, 2:50:53 AM3/21/10
to us...@subversion.apache.org, David Weintraub
On Sun, Mar 21, 2010 at 12:17 PM, Ravi Roy <ravi...@gmail.com> wrote:

> On Sun, Mar 21, 2010 at 11:33 AM, David Weintraub <qaz...@gmail.com> wrote:
> How big is your project that you are worried about possible
> limitations? Give us an idea of possible size issues, and someone on
> the list with a similar sized project can tell you what to expect in
> terms of performance.
>
Thanks David for your quick answer. My repository size for a
particular project is  7.0 GB (seven) at this point of time (which is
maximum of all projects repositories I have), I want to explore the
posslibility to take an action (if there is any limitation), and
wanted to know the same in advance, so that I am not screwed up.

Thanks

-RR
>

Ryan Schmidt

unread,
Mar 21, 2010, 5:38:26 AM3/21/10
to David Weintraub, Ravi Roy, us...@subversion.apache.org

On Mar 21, 2010, at 01:03, David Weintraub wrote:

> There may be limits with the actual operating system. For example,
> some operating systems can't handle files larger than 2Gb. Or, Windows
> having problems with directory/file names longer than 160 characters.
> But, these would be true with ANY software you use.

Note that the 2GB limit would then in Subversion's case apply also to revision files, meaning if you are affected by this limit, you cannot commit more than 2GB of combined data in a single revision, no matter how many files are affected by the revision.

Note also that, independent of any OS limitation, certain versions of APR (< 1.0) have this 2GB limit as well. Build your Subversion (and Apache, if you use it) against APR >= 1.2 instead.

Note finally that the limit is 2GB (2 gigabytes), not 2Gb (2 gigabits).

Ryan Schmidt

unread,
Mar 21, 2010, 6:57:32 AM3/21/10
to Ravi Roy, Subversion Users
On Mar 21, 2010, at 05:56, Ravi Roy wrote:

> On Sun, Mar 21, 2010 at 3:08 PM, Ryan Schmidt wrote:
>
>> Note that the 2GB limit would then in Subversion's case apply also to revision files, meaning if you are affected by this limit, you cannot commit more than 2GB of combined data in a single revision, no matter how many files are affected by the revision.
>>
>> Note also that, independent of any OS limitation, certain versions of APR (< 1.0) have this 2GB limit as well. Build your Subversion (and Apache, if you use it) against APR >= 1.2 instead.
>>
>> Note finally that the limit is 2GB (2 gigabytes), not 2Gb (2 gigabits).
>

> I think this would be rare case if somebody try to commit 2GB data
> into single revision. Anyway how to check the APR version onto current
> subversion server I am running ?

You'll have to ask the server administrator what version of APR is installed there. I don't know of a way to check it remotely.

Ravi Roy

unread,
Mar 21, 2010, 7:00:01 AM3/21/10
to Ryan Schmidt, us...@subversion.apache.org
Thanks Ryan for you quick reply. I will check that.
-RR

Ravi Roy

unread,
Mar 21, 2010, 9:00:10 AM3/21/10
to Ryan Schmidt, us...@subversion.apache.org
On Sun, Mar 21, 2010 at 4:30 PM, Ravi Roy <ravi...@gmail.com> wrote:
On Sun, Mar 21, 2010 at 4:27 PM, Ryan Schmidt
> On Mar 21, 2010, at 05:56, Ravi Roy wrote:
> You'll have to ask the server administrator what version of APR is installed there. I don't know of a way to check it remotely.
>
I can see APR version in APR configuration file on my Subversion server  :
 APR_MAJOR_VERSION="1"
 APR_DOTTED_VERSION="1.3.3"
 
Which means server is not confined to 2.0 GB limitation for single revision ? Am I right ?
Thanks again!
 
-RR
 

Ryan Schmidt

unread,
Mar 21, 2010, 9:09:44 AM3/21/10
to Ravi Roy, us...@subversion.apache.org
On Mar 21, 2010, at 08:00, Ravi Roy wrote:

> I can see APR version in APR configuration file on my Subversion server :
> APR_MAJOR_VERSION="1"
> APR_DOTTED_VERSION="1.3.3"
>
> Which means server is not confined to 2.0 GB limitation for single revision ? Am I right ?

Right -- at least not due to APR. Not sure if your server's OS or filesystem might impose limitations of their own. If you think you're going to be dealing with files this big, you could do a test -- set up a throwaway repository and try to commit > 2GB to it in one revision (in several files if you like), and also try to commit a single file of > 2GB (building it up in multiple commits if you like).

Ravi Roy

unread,
Mar 21, 2010, 12:17:59 PM3/21/10
to Ryan Schmidt, us...@subversion.apache.org
On Sun, Mar 21, 2010 at 6:39 PM, Ryan Schmidt <subversi...@ryandesign.com> wrote:
On Mar 21, 2010, at 08:00, Ravi Roy wrote:
> Right -- at least not due to APR. Not sure if your server's OS or filesystem might impose limitations of their own. If you think you're going to be dealing with files this big, you could do a test -- set >up a throwaway repository and try to commit > 2GB to it in one revision (in several files if you like), and also try to commit a single file of > 2GB (building it up in multiple commits if you like).
 
Thanks Ryan for you help, since I am using Centos 5.x, so there is maximum filesize limit to 2TB in Centos 5. My server is not confined to Filesystem limits as well.
Which means there is no limit to repository size on my server, Am I right ? though big repository can cause performance issues...which is understandable..and logicall too.
 
 
Thanks again for your help!
 
- RR
 
 
 
 
 
 

David Weintraub

unread,
Mar 21, 2010, 12:32:49 PM3/21/10
to Ravi Roy
Just 7 Gigabytes? Our repository is 13 Gigabytes and I don't even
think we have that big a project. A typical checkout for us is about
700 to 800 megabytes of files and we have five major projects and
probably 5 dozen separate branches.

Subversion should be able to handle what you're doing with no problem.

On Sun, Mar 21, 2010 at 2:47 AM, Ravi Roy <ravi...@gmail.com> wrote:
> On Sun, Mar 21, 2010 at 11:33 AM, David Weintraub <qaz...@gmail.com> wrote:

>> How big is your project that you are worried about possible
>> limitations? Give us an idea of possible size issues, and someone on
>> the list with a similar sized project can tell you what to expect in
>> terms of performance.
>

> Thanks David for your quick answer. My repository size for a
> particular project is  7.0 GB (seven) at this point of time (which is
> maximum of all projects repositories I have), I want to explore the
> posslibility to take an action (if there is any limitation), and
> wanted to know the same in advance, so that I am not screwed up.
>
> Thanks
>
> -RR
>

--
David Weintraub
qaz...@gmail.com

gadamiak

unread,
Jun 19, 2013, 3:42:55 PM6/19/13
to subversi...@googlegroups.com
> Just 7 Gigabytes? Our repository is 13 Gigabytes and I don't even think we have that big a project.

Just FYI one of my repositories is now 130 Gigabytes big and is running just fine :) It has almost 94.5 thousand commits in it.
Reply all
Reply to author
Forward
0 new messages