Smuggler between - next to useless message

[Brian Schau]

Hello,

I'm smuggling between two Raven servers.

I'm using this command on srv2 - which is localhost below:

    C:\Program Files\Raven\Smuggler>Raven.Smuggler.exe between http://src1:8080/ http://localhost:8080/ --database=BriansDB --database2=BriansDB

Srv1 is Raven 3.0.30017 and runs as a standalone service on a Windows 2008R2 server.
Srv2 is Raven 3.0.30037 and runs under IIS (8.5) on a Windows 2012R2 server.

Documents seems to load fine - however, after some time smuggler bombs with this rather useless exception:

    "Got Exception during smuggler between. Exception: One or more errors occurred..    "(Thank you for not telling me what is wrong ...)"
     Done with reading attachments, total: 2048
     One or more errors occurred."

Other observances ..    If, after the bomb, I open Raven Studio on srv2 (destination server) I get a "Database not loaded" error - eventually after 10 secs or so it will come up.

I wonder if I need to tweak IIS to be able to handle smuggling?


Best regards,
Brian

[Grisha Kotler]

Hi,

How much time does it take until you see this error?

Hibernating Rhinos Ltd  

Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

RavenDB paving the way to "Data Made Simple" http://ravendb.net/

--
You received this message because you are subscribed to the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ravendb+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Brian Schau]

I haven't timed it exactly - but about 5-10 minutes I'd say.   Could it be the AppPool recycling?

[Grisha Kotler]

How big are your attachments?

It might also be a database shutdown.

You need to set Raven/Tenants/MaxIdleTimeForTenantDatabase (Default is 900). The value is in seconds.

Hibernating Rhinos Ltd  

Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

RavenDB paving the way to "Data Made Simple" http://ravendb.net/

[Brian Schau]

Normally the attachments are a couple of MBs (max).

I'll look into the value and raise it ..

--
You received this message because you are subscribed to a topic in the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ravendb/b0KayQlAByY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ravendb+u...@googlegroups.com.

[Brian Schau]

I raised the timeout to 3600 secs and ran the command again - still bombs with:

Got Exception during smuggler between. Exception: One or more errors occurred..

Done with reading attachments, total: 2048
One or more errors occurred.

Again, 2048 attachments read.  Well, that's well below our number of attachments (I'd expect around 20000-30000 attachments).

It would be lovely if you could issue a fix where you actually show the exception - that would probably give us an indication of what is wrong ...

[Oren Eini (Ayende Rahien)]

what build are you using?

Hibernating Rhinos Ltd  

Oren Eini l CEO l Mobile: + 972-52-548-6969

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

 

[Brian Schau]

Srv1 is Raven 3.0.30017 and runs as a standalone service on a Windows 2008R2 server.
Srv2 is Raven 3.0.30037 and runs under IIS (8.5) on a Windows 2012R2 server.

[Oren Eini (Ayende Rahien)]

What build of smuggler

[Brian Schau]

3.0.30037

[Oren Eini (Ayende Rahien)]

Thanks, I fixed it so it would output the full error, the next build will have it.

In the meantime, if you can use Fiddler for this, it will show you what the error is.

[Brian Schau]

Thanks - do you have an ETA on the next publicly available build?

--
You received this message because you are subscribed to a topic in the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ravendb/b0KayQlAByY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ravendb+u...@googlegroups.com.

[Oren Eini (Ayende Rahien)]

Tomorrow

[Brian Schau]

Great - thanks.  I hope whatever timezone differences will allow me to test it tomorrow and report back.

[Brian Schau]

Finally ... got a chance to run smuggler on 3.0.30054 ...:

Got Exception during smuggler between. Exception: One or more errors occurred..

Done with reading attachments, total: 2048

Raven.Abstractions.Exceptions.SmugglerExportException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> Raven.Abstractions.Connection.ErrorResponseException: <!DOCTYPE html>
<html>
    <head>
        <title>The length of the URL for this request exceeds the configured maxUrlLength value.</title>
        <meta name="viewport" content="width=device-width" />
        <style>
         body {font-family:"Verdana";font-weight:normal;font-size: .7em;color:black;}
         p {font-family:"Verdana";font-weight:normal;color:black;margin-top: -5px}
         b {font-family:"Verdana";font-weight:bold;color:black;margin-top: -5px}
         H1 { font-family:"Verdana";font-weight:normal;font-size:18pt;color:red }
         H2 { font-family:"Verdana";font-weight:normal;font-size:14pt;color:maroon }
         pre {font-family:"Consolas","Lucida Console",Monospace;font-size:11pt;margin:0;padding:0.5em;line-height:14pt}
         .marker {font-weight: bold; color: black;text-decoration: none;}
         .version {color: gray;}
         .error {margin-bottom: 10px;}
         .expandable { text-decoration:underline; font-weight:bold; color:navy; cursor:hand; }
         @media screen and (max-width: 639px) {
          pre { width: 440px; overflow: auto; white-space: pre-wrap; word-wrap: break-word; }
         }
         @media screen and (max-width: 479px) {
          pre { width: 280px; }
         }
        </style>
    </head>

    <body bgcolor="white">

            <span><H1>Server Error in '/' Application.<hr width=100% size=1 color=silver></H1>

            <h2> <i>The length of the URL for this request exceeds the configured maxUrlLength value.</i> </h2></span>

            <font face="Arial, Helvetica, Geneva, SunSans-Regular, sans-serif ">

            <b> Description: </b>An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code.

            <br><br>

            <b> Exception Details: </b>System.Web.HttpException: The length of the URL for this request exceeds the configured maxUrlLength value.<br><br>

            <b>Source Error:</b> <br><br>

            <table width=100% bgcolor="#ffffcc">
               <tr>
                  <td>
                      <code>

An unhandled exception was generated during the execution of the current web request. Information regarding the origin and location of the exception can be identified using the exception stack trace below.</code>

                  </td>
               </tr>
            </table>

            <br>

            <b>Stack Trace:</b> <br><br>

            <table width=100% bgcolor="#ffffcc">
               <tr>
                  <td>
                      <code><pre>

[HttpException (0x80004005): The length of the URL for this request exceeds the configured maxUrlLength value.]
   System.Web.HttpRequest.ValidateInputIfRequiredByConfig() +12353634
   System.Web.PipelineStepManager.ValidateHelper(HttpContext context) +166
</pre></code>

                  </td>
               </tr>
            </table>

            <br>

            <hr width=100% size=1 color=silver>

            <b>Version Information:</b>&nbsp;Microsoft .NET Framework Version:4.0.30319; ASP.NET Version:4.0.30319.34274

            </font>

    </body>
</html>
<!--
[HttpException]: The length of the URL for this request exceeds the configured maxUrlLength value.
   at System.Web.HttpRequest.ValidateInputIfRequiredByConfig()
   at System.Web.HttpApplication.PipelineStepManager.ValidateHelper(HttpContext context)
--> ---> System.InvalidOperationException: Could not parse json:
<!DOCTYPE html>
<html>
    <head>
        <title>The length of the URL for this request exceeds the configured maxUrlLength value.</title>
        <meta name="viewport" content="width=device-width" />
        <style>
         body {font-family:"Verdana";font-weight:normal;font-size: .7em;color:black;}
         p {font-family:"Verdana";font-weight:normal;color:black;margin-top: -5px}
         b {font-family:"Verdana";font-weight:bold;color:black;margin-top: -5px}
         H1 { font-family:"Verdana";font-weight:normal;font-size:18pt;color:red }
         H2 { font-family:"Verdana";font-weight:normal;font-size:14pt;color:maroon }
         pre {font-family:"Consolas","Lucida Console",Monospace;font-size:11pt;margin:0;padding:0.5em;line-height:14pt}
         .marker {font-weight: bold; color: black;text-decoration: none;}
         .version {color: gray;}
         .error {margin-bottom: 10px;}
         .expandable { text-decoration:underline; font-weight:bold; color:navy; cursor:hand; }
         @media screen and (max-width: 639px) {
          pre { width: 440px; overflow: auto; white-space: pre-wrap; word-wrap: break-word; }
         }
         @media screen and (max-width: 479px) {
          pre { width: 280px; }
         }
        </style>
    </head>

    <body bgcolor="white">

            <span><H1>Server Error in '/' Application.<hr width=100% size=1 color=silver></H1>

            <h2> <i>The length of the URL for this request exceeds the configured maxUrlLength value.</i> </h2></span>

            <font face="Arial, Helvetica, Geneva, SunSans-Regular, sans-serif ">

            <b> Description: </b>An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code.

            <br><br>

            <b> Exception Details: </b>System.Web.HttpException: The length of the URL for this request exceeds the configured maxUrlLength value.<br><br>

            <b>Source Error:</b> <br><br>

            <table width=100% bgcolor="#ffffcc">
               <tr>
                  <td>
                      <code>

An unhandled exception was generated during the execution of the current web request. Information regarding the origin and location of the exception can be identified using the exception stack trace below.</code>

                  </td>
               </tr>
            </table>

            <br>

            <b>Stack Trace:</b> <br><br>

            <table width=100% bgcolor="#ffffcc">
               <tr>
                  <td>
                      <code><pre>

[HttpException (0x80004005): The length of the URL for this request exceeds the configured maxUrlLength value.]
   System.Web.HttpRequest.ValidateInputIfRequiredByConfig() +12353634
   System.Web.PipelineStepManager.ValidateHelper(HttpContext context) +166
</pre></code>

                  </td>
               </tr>
            </table>

            <br>

            <hr width=100% size=1 color=silver>

            <b>Version Information:</b>&nbsp;Microsoft .NET Framework Version:4.0.30319; ASP.NET Version:4.0.30319.34274

            </font>

    </body>
</html>
<!--
[HttpException]: The length of the URL for this request exceeds the configured maxUrlLength value.
   at System.Web.HttpRequest.ValidateInputIfRequiredByConfig()
   at System.Web.HttpApplication.PipelineStepManager.ValidateHelper(HttpContext context)
--> ---> Raven.Imports.Newtonsoft.Json.JsonReaderException: Unexpected character encountered while parsing value: <. Path '', line 0, position 0.
   at Raven.Imports.Newtonsoft.Json.JsonTextReader.ParseValue() in c:\Builds\RavenDB-3.0-Unstable\Imports\Newtonsoft.Json\Src\Newtonsoft.Json\JsonTextReader.cs:line 1040
   at Raven.Imports.Newtonsoft.Json.JsonTextReader.ReadInternal() in c:\Builds\RavenDB-3.0-Unstable\Imports\Newtonsoft.Json\Src\Newtonsoft.Json\JsonTextReader.cs:line 393
   at Raven.Imports.Newtonsoft.Json.JsonTextReader.Read() in c:\Builds\RavenDB-3.0-Unstable\Imports\Newtonsoft.Json\Src\Newtonsoft.Json\JsonTextReader.cs:line 314
   at Raven.Json.Linq.RavenJObject.Load(JsonReader reader) in c:\Builds\RavenDB-3.0-Unstable\Raven.Abstractions\Json\Linq\RavenJObject.cs:line 191
   at Raven.Json.Linq.RavenJObject.Parse(String json) in c:\Builds\RavenDB-3.0-Unstable\Raven.Abstractions\Json\Linq\RavenJObject.cs:line 276
   --- End of inner exception stack trace ---
   at Raven.Json.Linq.RavenJObject.Parse(String json) in c:\Builds\RavenDB-3.0-Unstable\Raven.Abstractions\Json\Linq\RavenJObject.cs:line 282
   at Raven.Client.Connection.Implementation.HttpJsonRequest.<CheckForErrorsAndReturnCachedResultIfAnyAsync>d__20.MoveNext()
   --- End of inner exception stack trace ---
   at Raven.Client.Connection.Implementation.HttpJsonRequest.<CheckForErrorsAndReturnCachedResultIfAnyAsync>d__20.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Client.Connection.Implementation.HttpJsonRequest.<>c__DisplayClasse.<<SendRequestInternal>b__d>d__10.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at Raven.Client.Connection.Implementation.HttpJsonRequest.<RunWithAuthRetry>d__15`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Client.Connection.Async.AsyncServerClient.<>c__DisplayClass216.<<PutAttachmentAsync>b__215>d__218.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at Raven.Client.Connection.Async.AsyncServerClient.<>c__DisplayClass2bf.<ExecuteWithReplication>b__2be(Task t)
   at System.Threading.Tasks.ContinuationResultTaskFromTask`1.InnerInvoke()
   at System.Threading.Tasks.Task.Execute()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at Raven.Client.Connection.ReplicationInformerBase`1.<TryOperationAsync>d__29`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at Raven.Client.Connection.ReplicationInformerBase`1.<ExecuteWithReplicationAsync>d__19`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Client.Connection.Async.AsyncServerClient.<ExecuteWithReplication>d__2c2`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.SmugglerDatabaseBetweenOperation.<ExportAttachments>d__4c.MoveNext()
   --- End of inner exception stack trace ---
   at Raven.Smuggler.SmugglerDatabaseBetweenOperation.<ExportAttachments>d__4c.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at Raven.Smuggler.SmugglerDatabaseBetweenOperation.<Between>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.SmugglerDatabaseOperationDispatcher.<PerformBetweenAsync>d__c.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.SmugglerOperationDispatcher`1.<Execute>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.Program.<Parse>d__3b.MoveNext()

On Thursday, January 28, 2016 at 11:34:24 AM UTC+1, Brian Schau wrote:

[Grisha Kotler]

The issue is "The length of the URL for this request exceeds the configured maxUrlLength value."
Are you running under IIS?

[Brian Schau]

Yes, I am running under IIS.   I noted this one:

--> ---> Raven.Imports.Newtonsoft.Json.

JsonReaderException: Unexpected character encountered while parsing value: <. Path '', line 0, position 0.

[Grisha Kotler]

You need to set maxRequestLength to a higher value in the web.config.

Hibernating Rhinos Ltd  

Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

RavenDB paving the way to "Data Made Simple" http://ravendb.net/

[Brian Schau]

I had / have:

maxRequestLength="1048576"

... That should be sufficient, right?

If not - what is the ideal value?

--
You received this message because you are subscribed to a topic in the Google Groups "RavenDB - 2nd generation document database" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/ravendb/b0KayQlAByY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to ravendb+u...@googlegroups.com.

[Grisha Kotler]

It depends or your attachments ids length.

Try setting this value to 2097152.

Hibernating Rhinos Ltd  

Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

RavenDB paving the way to "Data Made Simple" http://ravendb.net/

[Brian Schau]

Hmmm - so, I've experimented a bit.  It should be said that the source server is running RavenDB as a windows server.  The destination server runs RavenDB under IIS.

I've bumped the maxRequestLength to the value suggested before and then I've been smuggling using various batch sizes (as small as 128).  Smuggler dies when fetching one specific attachment:

Downloading attachment: OcesSdos/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/9208-2002-2-491760166994
Downloading attachment: Sdos/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e
Downloading attachment: PAdES/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/Qy0tVXNlcnMtbWtsLUFwcERhdGEtTG9jYWwtTWljcm9zb2Z0LVdpbmRvd3MtVGVtcG9yYXJ5IEludGVybmV0IEZpbGVzLUNvbnRlbnQuSUU1LUFPMDc4SEJKLUJYMDA5OCAtIEJsYW5rZXQgdGlsIGJydWcgZm9yIGFubW9kbmluZyB2aWEgam9ic2tpZnRlYWZ0YWxlbi5wZGY=

Got Exception during smuggler between. Exception: One or more errors occurred..

Done with reading attachments, total: 1152
Raven.Abstractions.Exceptions.SmugglerExportException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> Raven.Abstractions.Connection.ErrorResponseException: <!DOCTYPE html>

... and ...

Downloading attachment: OcesSdos/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/9208-2002-2-491760166994
Downloading attachment: Sdos/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e
Downloading attachment: PAdES/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/Qy0tVXNlcnMtbWtsLUFwcERhdGEtTG9jYWwtTWljcm9zb2Z0LVdpbmRvd3MtVGVtcG9yYXJ5IEludGVybmV0IEZpbGVzLUNvbnRlbnQuSUU1LUFPMDc4SEJKLUJYMDA5OCAtIEJsYW5rZXQgdGlsIGJydWcgZm9yIGFubW9kbmluZyB2aWEgam9ic2tpZnRlYWZ0YWxlbi5wZGY=

Got Exception during smuggler between. Exception: One or more errors occurred..

Done with reading attachments, total: 1280
Raven.Abstractions.Exceptions.SmugglerExportException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> Raven.Abstractions.Connection.ErrorResponseException: <!DOCTYPE html>

... and ...

Downloading attachment: OcesSdos/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/9208-2002-2-491760166994
Downloading attachment: Sdos/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e
Downloading attachment: PAdES/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/Qy0tVXNlcnMtbWtsLUFwcERhdGEtTG9jYWwtTWljcm9zb2Z0LVdpbmRvd3MtVGVtcG9yYXJ5IEludGVybmV0IEZpbGVzLUNvbnRlbnQuSUU1LUFPMDc4SEJKLUJYMDA5OCAtIEJsYW5rZXQgdGlsIGJydWcgZm9yIGFubW9kbmluZyB2aWEgam9ic2tpZnRlYWZ0YWxlbi5wZGY=

Got Exception during smuggler between. Exception: One or more errors occurred..

Done with reading attachments, total: 1385
Raven.Abstractions.Exceptions.SmugglerExportException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> Raven.Abstractions.Connection.ErrorResponseException: <!DOCTYPE html>

(The first block had a batch size of 128, the second 256 and the last one had a batch size of 277 (!))

I then had a look at the attachment which I guess is the culprit - the PAdES/b7a... - it can be downloaded easily and it being a PDF file it opens in adobe reader.

I really don't know what to do here ... suggestions welcome.   I need to move the database from source to destination server as soon as possible.
However, I am in no rush - so I can debug if needed ...


/brian

On Thursday, January 28, 2016 at 11:34:24 AM UTC+1, Brian Schau wrote:

[Oren Eini (Ayende Rahien)]

Can you pipe this through fiddler and send us the Saz file?

Hibernating Rhinos Ltd  

Oren Eini l CEO l Mobile: + 972-52-548-6969

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

 

[Brian Schau]

Done.  It's a rather large file (16MB) - where should I send it?

[Grisha Kotler]

sup...@ravendb.net

Hibernating Rhinos Ltd  

Grisha Kotler l RavenDB Core Team Developer l Mobile: +972-54-586-8647

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

RavenDB paving the way to "Data Made Simple" http://ravendb.net/

[Brian Schau]

Great - file sent.

[Oren Eini (Ayende Rahien)]

Did you get the error when using Fiddler?

The Saz file shows no attachments in use.

And all requests are successufl

[Brian Schau]

The saz file is unusable - my mistake.

I run the smuggler command and fiddler on the same (destination) server.   Whenever I try to smuggle with fiddler running I get:

Done with reading indexes, total: 23
Done with reading transformers, total: 0
Exporting Documents
Streaming documents from 00000000-0000-0000-0000-000000000000
Got Exception during smuggler between. Exception: A task was canceled..
Done with reading documents, total: 0, lastEtag: 00000000-0000-0000-0000-000000000000
Raven.Abstractions.Exceptions.SmugglerExportException: A task was canceled. ---> System.Threading.Tasks.TaskCanceledException: A task was canceled.

   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Raven.Client.Connection.Implementation.HttpJsonRequest.<>c__DisplayClass58.<<ExecuteRawResponseInternalAsync>b__57>d__5a.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at Raven.Client.Connection.Implementation.HttpJsonRequest.<RunWithAuthRetry>d__15`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)

   at Raven.Client.Connection.Implementation.HttpJsonRequest.<ExecuteRawResponseInternalAsync>d__5e.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()

   at Raven.Client.Connection.Async.AsyncServerClient.<DirectStreamDocsAsync>d__26d.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()

   at Raven.Client.Connection.Async.AsyncServerClient.<StreamDocsAsync>d__26a.MoveNext()

--- End of stack trace from previous location where exception was thrown ---

   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()

   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()

   at Raven.Smuggler.SmugglerDatabaseBetweenOperation.<ExportDocuments>d__38.MoveNext()

   --- End of inner exception stack trace ---

   at Raven.Smuggler.SmugglerDatabaseBetweenOperation.<ExportDocuments>d__38.MoveNext()

--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   at Raven.Smuggler.SmugglerDatabaseBetweenOperation.<Between>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.SmugglerDatabaseOperationDispatcher.<PerformBetweenAsync>d__c.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.SmugglerOperationDispatcher`1.<Execute>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Raven.Smuggler.Program.<Parse>d__3b.MoveNext()

... closing down fiddler and then running smuggler works.

Do I need to set something in fiddler to let me proceed?


/brian

[Oren Eini (Ayende Rahien)]

That is a timeout.

Do you see anything in fiddler when this hapens?

[Brian Schau]

No - fiddler just aborts.  I'll investigate if I can raise timeouts or add extra logging.

[Brian Schau]

I've got a way larger file (almost 1GB) - I'm sending a link to your support email ...

[Oren Eini (Ayende Rahien)]

What happens when you manually (in the browser), try:

http://172.20.9.10:8080/databases/esignatur/static/PAdES/b7a0d36f-ee85-4ebd-ad1c-51455e6e764e/Qy0tVXNlcnMtbWtsLUFwcERhdGEtTG9jYWwtTWljcm9zb2Z0LVdpbmRvd3MtVGVtcG9yYXJ5IEludGVybmV0IEZpbGVzLUNvbnRlbnQuSUU1LUFPMDc4SEJKLUJYMDA5OCAtIEJsYW5rZXQgdGlsIGJydWcgZm9yIGFubW9kbmluZyB2aWEgam9ic2tpZnRlYWZ0YWxlbi5wZGY=

But in Fiddler, I don't see the failing request. Which one is it?

Hibernating Rhinos Ltd  

Oren Eini l CEO l Mobile: + 972-52-548-6969

Office: +972-4-622-7811 l Fax: +972-153-4-622-7811

 

[Oren Eini (Ayende Rahien)]

Oh, and please run this URL on both destination and source dbs.

[Brian Schau]

Yay!   Thanks for your help - you may have found the error ...!

Destination server (running in IIS) complained about the URL length exceeding some value.

So I added maxUrlLength="1024" to the  system.web/httpRuntime key in web.config and currently the smuggler process have been running for 1/2 hour and migrating 2-3 times more attachments than before.

I'll keep you updated ....

[Brian Schau]

Yep.  So, it completed after 9 hours (30000+ records, 60000 attachments) - setting the maxUrlLength was apparently the trick which saved my day ...

[Oren Eini (Ayende Rahien)]

Great :-)