Upload is failing

[Wim Coetzee]

Hello

I am testing Cmissync for uploading files to my Alfresco repo.

The below error keeps getting repeated for the past 15 hours in my log file.

Can you maybe shed some light on what's wrong?  I did not cancel anything?

The files I am uploading are rather large - is there some sort of limitation to file sizes?

Thanks

11:35:46 | Sync | CMIS exception while syncing:Cannot access http://*******************:8080/alfresco/cmisatom/8b59d2ef-e917-4a18-9a1a-e6beb27c6649/children?id=workspace://SpacesStore/022fa586-10a0-473a-93fa-49936d29b002: The request was aborted: The request was canceled.
11:35:46 | Sync |    at DotCMIS.Binding.Impl.HttpUtils.Invoke(UrlBuilder url, String method, String contentType, Output writer, BindingSession session, Nullable`1 offset, Nullable`1 length, IDictionary`2 headers)
   at DotCMIS.Binding.Impl.HttpUtils.InvokePOST(UrlBuilder url, String contentType, Output writer, BindingSession session)
   at DotCMIS.Binding.AtomPub.AbstractAtomPubService.Post(UrlBuilder url, String contentType, Output writer)
   at DotCMIS.Binding.AtomPub.ObjectService.CreateDocument(String repositoryId, IProperties properties, String folderId, IContentStream contentStream, Nullable`1 versioningState, IList`1 policies, IAcl addAces, IAcl removeAces, IExtensionsData extension)
   at DotCMIS.Client.Impl.Session.CreateDocument(IDictionary`2 properties, IObjectId folderId, IContentStream contentStream, Nullable`1 versioningState, IList`1 policies, IList`1 addAces, IList`1 removeAces)
   at DotCMIS.Client.Impl.Folder.CreateDocument(IDictionary`2 properties, IContentStream contentStream, Nullable`1 versioningState, IList`1 policies, IList`1 addAces, IList`1 removeAces, IOperationContext context)
   at DotCMIS.Client.Impl.Folder.CreateDocument(IDictionary`2 properties, IContentStream contentStream, Nullable`1 versioningState)
   at SparkleLib.Cmis.Cmis.UploadFile(String filePath, IFolder remoteFolder)
   at SparkleLib.Cmis.Cmis.crawlLocalFiles(String localFolder, IFolder remoteFolder, IList remoteFiles)
   at SparkleLib.Cmis.Cmis.CrawlSync(IFolder remoteFolder, String localFolder)
   at SparkleLib.Cmis.Cmis.crawlRemote(IFolder remoteFolder, String localFolder, IList remoteFiles, IList remoteFolders)
   at SparkleLib.Cmis.Cmis.CrawlSync(IFolder remoteFolder, String localFolder)
   at SparkleLib.Cmis.Cmis.crawlRemote(IFolder remoteFolder, String localFolder, IList remoteFiles, IList remoteFolders)
   at SparkleLib.Cmis.Cmis.CrawlSync(IFolder remoteFolder, String localFolder)
   at SparkleLib.Cmis.Cmis.crawlRemote(IFolder remoteFolder, String localFolder, IList remoteFiles, IList remoteFolders)
   at SparkleLib.Cmis.Cmis.CrawlSync(IFolder remoteFolder, String localFolder)
   at SparkleLib.Cmis.Cmis.Sync()
   at SparkleLib.Cmis.Cmis.<SyncInBackground>b__0(Object o, DoWorkEventArgs args)
11:35:46 | Sync |
11:35:49 | Sync | Cmis SparkleRepo HasUnsyncedChanges get
11:35:49 | Sync | Launching sync in background, so that the UI stays available.

[Nicolas Raoul]

Hello Wim,

Thanks for your feedback!
Strange indeed... is there any error in alfresco.log on the Alfresco side?
What is the size of the file that fails to upload? Has this kind of
size succeeded in the past?
Don't hesitate to use the issue tracker for this kind of issues.

I have successfully uploaded a 3GB file in the past, but I haven't
tried recently, this could be a regression, or a problem that only
happens in certain circumstances.

Cheers!
Nicolas Raoul

> --
> You received this message because you are subscribed to the Google Groups
> "CmisSync" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cmissync+u...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>

[Wim Coetzee]

Hi

Thanks you for the response.  The files are 500Mb to 1.2 Gb in size.

The guidance of looking at the log file has got me to the following:

In tomcat/logs/catalina.out:

2013-05-28 15:53:01,675  ERROR [impl.atompub.CmisAtomPubServlet] [http-apr-8080-exec-4]
 org.apache.chemistry.opencmis.commons.exceptions.CmisRuntimeException
        at org.apache.chemistry.opencmis.server.shared.Dispatcher.dispatch(Dispatcher.java:101)
        at org.apache.chemistry.opencmis.server.impl.atompub.CmisAtomPubServlet.dispatch(CmisAtomPubServlet.java:236)
        at org.apache.chemistry.opencmis.server.impl.atompub.CmisAtomPubServlet.service(CmisAtomPubServlet.java:185)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
        at org.alfresco.web.app.servlet.GlobalLocalizationFilter.doFilter(GlobalLocalizationFilter.java:61)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
        at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:929)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
        at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1002)
        at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:585)
        at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.run(AprEndpoint.java:1813)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.GeneratedMethodAccessor1194.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.chemistry.opencmis.server.shared.Dispatcher.dispatch(Dispatcher.java:94)
        ... 22 more
Caused by: java.io.IOException: Base64 input not properly padded.
        at org.apache.chemistry.opencmis.commons.impl.Base64$OutputStream.flushBase64(Base64.java:2013)
        at org.apache.chemistry.opencmis.commons.impl.Base64$OutputStream.close(Base64.java:2027)
        at org.apache.chemistry.opencmis.server.impl.atompub.AtomEntryParser.readBase64(AtomEntryParser.java:421)
        at org.apache.chemistry.opencmis.server.impl.atompub.AtomEntryParser.parseCmisContent(AtomEntryParser.java:335)
        at org.apache.chemistry.opencmis.server.impl.atompub.AtomEntryParser.parseEntry(AtomEntryParser.java:228)
        at org.apache.chemistry.opencmis.server.impl.atompub.AtomEntryParser.parse(AtomEntryParser.java:195)
        at org.apache.chemistry.opencmis.server.impl.atompub.ObjectService.create(ObjectService.java:88)
        ... 26 more

Now I'm not great at reading these kinds of things.... but should I rather look to the Alfresco community to solve this?  Or do you have any ideas?

Thanks for the help!

You received this message because you are subscribed to a topic in the Google Groups "CmisSync" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cmissync/0781lNLv84I/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to cmissync+u...@googlegroups.com.

[Nicolas Raoul]

Very interesting!
That sounds like it could be a DotCmis or OpenCmis bug.

Could you please try to upload the same file, separately? (other
computer, other Alfresco if possible), and check whether it always
happen for that file?
Or is it random, failing on any file?

Thanks a lot!
Nicolas Raoul

[Wim Coetzee]

I haven't been able to try it on another computer since CMISSync won't run on my other Win7 machine ;)  Don't know what the trouble is, but it's a different problem.

I am just testing various other things, smaller files, etc to be sure that it works.  Then I'll start adding larger and larger files to see if it's the size or what's causing the trouble.

Would any funny characters in the filename cause trouble?  This is a TIF file with & and , characters.

Will keep you posted.

[Nicolas Raoul]

Thanks a lot for the investigation!
The filename might be a reason, never know.
Looking forward to your findings,
Nicolas Raoul

[Nicolas Raoul]

Hello Wim,

It has been a long time, but could you please tell us with what version of Alfresco this is happening?

Thank you!
Nicolas Raoul
Aegif

[Wim Coetzee]

Hi Nicolas

I think it would have been Alfresco version 4.2b or c.

We have not tried again with huge files like that but all our platforms are on 4.2d presently.

Wim

--

You received this message because you are subscribed to a topic in the Google Groups "CmisSync" group.

To unsubscribe from this topic, visit https://groups.google.com/d/topic/cmissync/0781lNLv84I/unsubscribe.

To unsubscribe from this group and all its topics, send an email to cmissync+u...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

[Daniel Neil]

Hi,

one of our customers is currently getting this error for many of his files. The upload of these files fails.

CmisSync log shows a CmisRuntimeException.

Our Server log (OpenCmis 0.12.0) shows the following stacktrace:

org.apache.chemistry.opencmis.commons.exceptions.CmisRuntimeException: Base64 input not properly padded.
        at org.apache.chemistry.opencmis.server.shared.Dispatcher.dispatch(Dispatcher.java:100)[192:de.doubleslash.quala.components.cmis.web:1.4.2]
        at org.apache.chemistry.opencmis.server.impl.atompub.CmisAtomPubServlet.dispatch(CmisAtomPubServlet.java:234)[192:de.doubleslash.quala.components.cmis.web:1.4.2]
        at org.apache.chemistry.opencmis.server.impl.atompub.CmisAtomPubServlet.service(CmisAtomPubServlet.java:181)[192:de.doubleslash.quala.components.cmis.web:1.4.2]
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:668)[58:org.apache.geronimo.specs.geronimo-servlet_3.0_spec:1.0.0]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1496)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.ops4j.pax.web.service.internal.WelcomeFilesFilter.doFilter(WelcomeFilesFilter.java:185)[85:org.ops4j.pax.web.pax-web-runtime:3.1.4]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1467)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:501)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.ops4j.pax.web.service.jetty.internal.HttpServiceServletHandler.doHandle(HttpServiceServletHandler.java:69)[86:org.ops4j.pax.web.pax-web-jetty:3.1.4]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.doHandle(HttpServiceContext.java:240)[86:org.ops4j.pax.web.pax-web-jetty:3.1.4]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.ops4j.pax.web.service.jetty.internal.JettyServerHandlerCollection.handle(JettyServerHandlerCollection.java:75)[86:org.ops4j.pax.web.pax-web-jetty:3.1.4]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.Server.handle(Server.java:370)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:971)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1033)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)[64:org.eclipse.jetty.aggregate.jetty-all-server:8.1.15.v20140411]
        at java.lang.Thread.run(Thread.java:745)[:1.7.0_67]

.

Do you already have a solution to this problem?

Greets,
Daniel

[Nicolas Raoul]

Hello Daniel,

What is your server?
From the way you talk about the log file, I guess you are using either OpenCMIS Fileshare, or OpenCMIS InMemory?

Would you be able to run Woireshark and capture the CmisSync request that triggers this server error? Then please post it as a new Github issue, thanks!

Cheers!

Nicolas Raoul

CmisSync team

Aegif

--
You received this message because you are subscribed to the Google Groups "CmisSync" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cmissync+u...@googlegroups.com.

[Daniel Neil]

Hi Nicolas,

we do have a jcr repository and have our own implementation of the jcr bridge.

Also, I found this:
https://issues.apache.org/jira/browse/CMIS-863

It suggests that this problem occures because of an unreliable connection. Our customer is also behind a proxy...
It would be rather difficult to provide wireshark logs. I'll try the suggested settings for HttpUtils first.

Greets,
Daniel

[Daniel Neil]

Our customer just reported, that his problem got resolved by disabling his proxy.

[Nicolas Raoul]

Hello Daniel,

Interesting, thanks for the feedback!

So maybe it is a proxy bug, like the proxy is corrupting requests or something?

Or is there anything we could do to make CmisSync more resilient to this kind of problems?

Cheers!

Nicolas Raoul

CmisSync team

Aegif

On Thu, Apr 21, 2016 at 8:47 PM, Daniel Neil <simon....@gmail.com> wrote:

Our customer just reported, that his problem got resolved by disabling his proxy.

--

You received this message because you are subscribed to the Google Groups "CmisSync" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cmissync+u...@googlegroups.com.

[Daniel Neil]

Hi Nicolas,

I think it has to do with an unreliable connection, yes. As you said, maybe the proxy corrupts the request.

I do not think that this could be fixed in CmisSync. Maybe DotCMIS could be changed (for example try different chunk size and connection parameters as described here: https://issues.apache.org/jira/browse/CMIS-863).

Greets,
Daniel