64K character limit?

[Conal Elliott]

Today my gitit wiki started hanging when loading a particular page I've been adding to.  With some experimenting, I discovered that gitit hangs right around when the .page file goes over 65535 characters.  Is this limit known?  My source language is markdown+lhs and math is enabled as mathML.

Thanks,  - Conal

[fiddlosopher]

No, I have never seen this before, and I'm baffled as to what could be
causing the problem. I was able to reproduce it with a 128K file. The
math mode seems irrelevant, as it hung with math set to 'raw' as
well. But markdown+lhs is relevant; it works fine with plain
markdown. The strange thing is that pandoc has no trouble parsing the
file directly as markdown+lhs. I haven't had time to investigate
further, but suggestions are welcome.

John

[Conal Elliott]

Ah, yes. I'd forgotten to mention that I *do not* run into this problem when I run pandoc directly on the file, using markdown+lhs and -m .

When I switch from markdown+lhs to plain markdown in my git config and then restart gitit, I still hang on my 64K+ file.

BTW, there's no crisis on my end with this issue.  I've broken up my large file into a few small ones, which I'd meant to do anyway.

  - Conal

--
You received this message because you are subscribed to the Google Groups "gitit-discuss" group.
To post to this group, send email to gitit-...@googlegroups.com.
To unsubscribe from this group, send email to gitit-discus...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/gitit-discuss?hl=en.

[Gwern Branwen]

On Tue, Aug 31, 2010 at 11:24 PM, fiddlosopher <fiddlo...@gmail.com> wrote:
> No, I have never seen this before, and I'm baffled as to what could be
> causing the problem. I was able to reproduce it with a 128K file.  The
> math mode seems irrelevant, as it hung with math set to 'raw' as
> well.  But markdown+lhs is relevant; it works fine with plain
> markdown.  The strange thing is that pandoc has no trouble parsing the
> file directly as markdown+lhs.  I haven't had time to investigate
> further, but suggestions are welcome.
>
> John

I seem to have run into this problem as well with my DNB FAQ (somewhat
outdated HTML at
http://community.haskell.org/~gwern/static/N-back%20FAQ.html); it's
plain Markdown, no literate Haskell involved anywhere. It's also 128K,
as it happens. (More specifically, wc says 742 18558 128631).

Attached is the source, and the repo is at
http://community.haskell.org/~gwern/wiki/ if you want to try unpulling
patches to see where it hangs.

I've not added any unusual formatting over the past week, though, so I
strongly suspect it's a length problem in Gitit (Pandoc seems to
generate it fine, although Pandoc breaks my !Wikipedia links since it
doesn't have the interwiki plugin.)

--
gwern

[John MacFarlane]

Good news - thanks to help from Pavel Perikov, this problem has been
fixed. All you have to do is compile gitit against the latest version
of filestore (0.3.4.3), which I just uploaded to HackageDB.

John

+++ Conal Elliott [Sep 01 10 13:31 ]:

> Ah, yes. I'd forgotten to mention that I *do not* run into this problem
> when I run pandoc directly on the file, using markdown+lhs and -m .
> When I switch from markdown+lhs to plain markdown in my git config and
> then restart gitit, I still hang on my 64K+ file.
> BTW, there's no crisis on my end with this issue. I've broken up my
> large file into a few small ones, which I'd meant to do anyway.
> - Conal
>
> On Wed, Sep 1, 2010 at 12:24 PM, fiddlosopher
> <[1]fiddlo...@gmail.com> wrote:
>
> No, I have never seen this before, and I'm baffled as to what could
> be
> causing the problem. I was able to reproduce it with a 128K file.
> The
> math mode seems irrelevant, as it hung with math set to 'raw' as
> well. But markdown+lhs is relevant; it works fine with plain
> markdown. The strange thing is that pandoc has no trouble parsing
> the
> file directly as markdown+lhs. I haven't had time to investigate
> further, but suggestions are welcome.
> John
>

> On Aug 31, 1:52 am, Conal Elliott <[2]conal.elli...@gmail.com> wrote:
> > Today my gitit wiki started hanging when loading a particular page
> I've been
> > adding to. With some experimenting, I discovered that gitit hangs
> right
> > around when the .page file goes over 65535 characters. Is this limit
> > known? My source language is markdown+lhs and math is enabled as
> mathML.
> >
> > Thanks, - Conal
>
> --
> You received this message because you are subscribed to the Google
> Groups "gitit-discuss" group.
> To post to this group, send email to

> [3]gitit-...@googlegroups.com.

> To unsubscribe from this group, send email to

> [4]gitit-discus...@googlegroups.com.

> For more options, visit this group at

> [5]http://groups.google.com/group/gitit-discuss?hl=en.

>
> --
> You received this message because you are subscribed to the Google
> Groups "gitit-discuss" group.
> To post to this group, send email to gitit-...@googlegroups.com.
> To unsubscribe from this group, send email to
> gitit-discus...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/gitit-discuss?hl=en.
>

> References
>
> 1. mailto:fiddlo...@gmail.com
> 2. mailto:conal.elli...@gmail.com
> 3. mailto:gitit-...@googlegroups.com
> 4. mailto:gitit-discuss%2Bunsu...@googlegroups.com
> 5. http://groups.google.com/group/gitit-discuss?hl=en

[Conal Elliott]

Thanks, Pavel & John! - Conal

[Gwern Branwen]

On Sun, Sep 26, 2010 at 6:45 PM, Conal Elliott <co...@conal.net> wrote:
> Thanks, Pavel & John! - Conal
>
> On Sun, Sep 26, 2010 at 3:27 PM, John MacFarlane <fiddlo...@gmail.com>
> wrote:
>>
>> Good news - thanks to help from Pavel Perikov, this problem has been
>> fixed.  All you have to do is compile gitit against the latest version
>> of filestore (0.3.4.3), which I just uploaded to HackageDB.
>>
>> John

I can confirm that the problem with my FAQ has disappeared with HEAD
filesstore & gitit.

--
gwern