novice - how to enable large files on hg repository

Felix Nielsen

unread,

Nov 8, 2017, 6:04:02 PM11/8/17

to scmmanager

Hi

New to scm-manager, how do I enable large file on my hg repos - running on Ubuntu

Thanks

Felix

Felix Nielsen

unread,

Nov 8, 2017, 6:14:27 PM11/8/17

to scmmanager

Hi

added the "extenstion" to "xxxx/.hg/hgrc" - but now I get this error when trying to push my repos to scm-manager :

searching for changes

abort: HTTP Error 413: FULL head

Any clues, Thanks

Felix

Felix Nielsen

unread,

Nov 8, 2017, 6:37:29 PM11/8/17

to scmmanager

Modified "server-config.xml" -> "reuestHeaderSize" - but now I get this error:

searching for changes

abort: remote error:

Mercurial/Python process ends with return code 1

(I am doing hg push from a windows to linux)

Thanks

Felix

Felix Nielsen

unread,

Nov 11, 2017, 12:49:45 AM11/11/17

to scmmanager

Not much going on here on this list :(

Gintas Grigelionis

unread,

Nov 12, 2017, 6:20:04 AM11/12/17

to scmmanager

Could you please be more specific? Are you talking about largefiles extension?

Felix Nielsen

unread,

Nov 12, 2017, 10:48:23 AM11/12/17

to scmma...@googlegroups.com

Yes

I am trying to push a quite big repos with largefiles and got to a step now where I get this error :

--
You received this message because you are subscribed to a topic in the Google Groups "scmmanager" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/scmmanager/NLVSHsH5g8A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to scmmanager+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sebastian Sdorra

unread,

Nov 12, 2017, 4:07:59 PM11/12/17

to scmma...@googlegroups.com

Hi,

Could you please post the scm-manager server log?

Sebastian

--
You received this message because you are subscribed to the Google Groups "scmmanager" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scmmanager+unsubscribe@googlegroups.com.

Felix Nielsen

unread,

Nov 12, 2017, 5:11:54 PM11/12/17

to scmma...@googlegroups.com

Hi

I seem to to have some permission issues, I tried to manually create the ".cache" folder and chown -R root:root

2017-11-12 22:10:17.422 [qtp1221555852-32] TRACE sonia.scm.web.cgi.DefaultCGIExecutor - process servlet input

2017-11-12 22:10:17.900 [cgi-pool-2] WARN sonia.scm.web.cgi.DefaultCGIExecutor - Traceback (most recent call last):

File "/var/lib/scm/lib/python/hgweb.py", line 42, in <module>

wsgicgi.launch(application)

File "/usr/lib/python2.7/dist-packages/mercurial/hgweb/wsgicgi.py", line 87, in launch

for chunk in content:

File "/usr/lib/python2.7/dist-packages/mercurial/hgweb/hgweb_mod.py", line 306, in run_wsgi

for r in self._runwsgi(req, repo):

File "/usr/lib/python2.7/dist-packages/mercurial/hgweb/hgweb_mod.py", line 346, in _runwsgi

return protocol.call(rctx.repo, req, cmd)

File "/usr/lib/python2.7/dist-packages/mercurial/hgweb/protocol.py", line 88, in call

rsp = wireproto.dispatch(repo, p, cmd)

File "/usr/lib/python2.7/dist-packages/mercurial/wireproto.py", line 481, in dispatch

return func(repo, proto, *args)

File "/usr/lib/python2.7/dist-packages/hgext/largefiles/proto.py", line 39, in putlfile

lfutil.linktousercache(repo, sha)

File "/usr/lib/python2.7/dist-packages/hgext/largefiles/lfutil.py", line 256, in linktousercache

link(storepath(repo, hash), path)

File "/usr/lib/python2.7/dist-packages/hgext/largefiles/lfutil.py", line 42, in link

util.makedirs(os.path.dirname(dest))

File "/usr/lib/python2.7/dist-packages/mercurial/util.py", line 1413, in makedirs

makedir(name, notindexed)

File "/usr/lib/python2.7/dist-packages/mercurial/posix.py", line 497, in makedir

os.mkdir(path)

OSError: [Errno 13] Permission denied: '/root/.cache/largefiles'

2017-11-12 22:10:17.900 [qtp1221555852-32] TRACE sonia.scm.web.cgi.DefaultCGIExecutor - handle status code 1 with statusCodeHandler, there are 0 bytes written to outputstream

2017-11-12 22:10:17.900 [qtp1221555852-32] WARN sonia.scm.web.HgCGIExceptionHandler - Mercurial/Python process ends with return code 1

2017-11-12 22:10:17.903 [qtp1221555852-32] DEBUG sonia.scm.web.HgCGIServlet - mercurial request finished in 482.5 ms

Sebastian Sdorra

unread,

Nov 14, 2017, 4:07:45 AM11/14/17

to scmma...@googlegroups.com

Do you have enabled the largefile extension on server and client side? Does SCM-Manager run as root?

Sebastian

Felix Nielsen

unread,

Nov 14, 2017, 4:13:24 AM11/14/17

to scmma...@googlegroups.com

Hi

Yes scm-manager is running as root - client has largefiles and is being pushed from a server that pulls daily from our HG repository runnning today.

On the server I did this :

added "extenstion" to "xxxx/.hg/hgrc"

I also tried to create .cache/largefiles manually and adding chmod 0777 and chown root:root and also tried scm:root

But the error is the same :(

Thanks

Felix

Felix Nielsen

unread,

Nov 15, 2017, 3:57:29 AM11/15/17

to scmmanager

Hi

Got a little further:

1. updated "xxxx/Shadow/.hg/hgrc" ->

[extensions]

largefiles =

[largefiles]

usercache = /srv/largefiles

2. mkdir /srv/largefiles

3. chmod -R 0777 /srv/largefiles

4. push ->

searching for changes

remote: adding changesets

remote: adding manifests

remote: adding file changes

remote: transaction abort!

remote: rollback completed

remote: stream ended unexpectedly (got 0 bytes, expected 4)

abort: push failed on remote

5. scm log ->

2017-11-15 08:35:20.763 [qtp1221555852-31] TRACE sonia.scm.web.cgi.DefaultCGIExecutor - process servlet input

2017-11-15 08:37:20.432 [qtp1221555852-31] ERROR sonia.scm.web.cgi.DefaultCGIExecutor - could not read from ServletInputStream and write to ProcessOut

putStream

java.io.IOException: Broken pipe

at java.io.FileOutputStream.writeBytes(Native Method)

at java.io.FileOutputStream.write(FileOutputStream.java:326)

at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)

at sonia.scm.util.IOUtil.copy(IOUtil.java:203)

Any clues?

Thanks

Felix

Felix Nielsen

unread,

Nov 15, 2017, 9:40:22 AM11/15/17

to scmmanager

It seems to be related to HTTP_CONTENT_LENGTH= being too high

-> HTTP_CONTENT_LENGTH=6314297259

Any hints

Felix

Gintas Grigelionis

unread,

Nov 16, 2017, 3:58:06 AM11/16/17

to scmmanager

Looks like https://bz.mercurial-scm.org/show_bug.cgi?id=4616

Which version of mercurial do you run?

Gintas

Felix Nielsen

unread,

Nov 16, 2017, 4:06:13 AM11/16/17

to scmma...@googlegroups.com

Mercurial Distributed SCM (version 3.7.3)

(see https://mercurial-scm.org for more information)

This is free software; see the source for copying conditions. There is NO

warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Felix Nielsen

unread,

Nov 16, 2017, 4:28:08 AM11/16/17

to scmmanager

I am running Mercurial 4.4.1 now and still fails the same step ->

HTTP_CONTENT_LENGTH=6314297259

SCM_HOME=/var/lib/scm

USER=scm

SCM_URL=http://192.168.183.21:8080/scm/hook/hg/

REMOTE_USER=fn

HTTP_X_HGARG_1=heads=666f726365

HTTP_HOST=192.168.183.21:8080

QUERY_STRING=cmd=unbundle

HTTP_ACCEPT=application/mercurial-0.1

NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat

HTTP_ACCEPT_ENCODING=identity

HOME=/root

2017-11-16 09:23:07.663 [qtp1221555852-32] TRACE sonia.scm.web.cgi.DefaultCGIExecutor - process servlet input

2017-11-16 09:25:10.418 [qtp1221555852-32] ERROR sonia.scm.web.cgi.DefaultCGIExecutor - could not read from ServletInputStream and write to ProcessOutputStream

java.io.IOException: Broken pipe

at java.io.FileOutputStream.writeBytes(Native Method)

at java.io.FileOutputStream.write(FileOutputStream.java:326)

at java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)

at sonia.scm.util.IOUtil.copy(IOUtil.java:203)

at sonia.scm.web.cgi.DefaultCGIExecutor.processServletInput(DefaultCGIExecutor.java:554)

at sonia.scm.web.cgi.DefaultCGIExecutor.execute(DefaultCGIExecutor.java:402)

at sonia.scm.web.cgi.DefaultCGIExecutor.execute(DefaultCGIExecutor.java:194)

at sonia.scm.web.HgCGIServlet.process(HgCGIServlet.java:294)

at sonia.scm.web.HgCGIServlet.handleRequest(HgCGIServlet.java:210)

at sonia.scm.web.HgCGIServlet.service(HgCGIServlet.java:179)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)

at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)

at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)

at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at sonia.scm.web.filter.PermissionFilter.doFilter(PermissionFilter.java:168)

at sonia.scm.web.filter.HttpFilter.doFilter(HttpFilter.java:102)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at sonia.scm.web.filter.BasicAuthenticationFilter.processRequest(BasicAuthenticationFilter.java:423)

at sonia.scm.web.filter.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:214)

at sonia.scm.web.filter.HttpFilter.doFilter(HttpFilter.java:102)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)

at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)

at sonia.scm.filter.MDCFilter.doFilter(MDCFilter.java:110)