testing TW5

[cangaroo joe]

I tested TW5 on Firefox 26.0 and TiddlyDesktop 0.0.3. Both tests gave the same results. I generated 11664 text files each 4017 bytes and dropped 7000 files on TW5.
TW5 could import 1853 files at once, no more. After that I tried to add more smaller group of files till it created a total number of 2293 tiddlers. The saved TW5 file was 11,4Mb. How can some have 10k or 20k tiddlers in one file? To edit a tiddler took about 10 sec before saving the big file. The opening of the saved TW5 file took so much time that I stopped it.

[Jeremy Ruston]

Performance is poor because all the tiddlers get opened as a side effect of the import. It's open tiddlers that slow things down

Best wishes

Jeremy

—
jeremy...@gmail.com

On Fri, Jan 31, 2014 at 1:31 PM, cangaroo joe <canga...@gmail.com> wrote:

I tested TW5 on Firefox 26.0 and TiddlyDesktop 0.0.3. Both tests gave the same results. I generated 11664 text files each 4017 bytes and dropped 7000 files on TW5.
TW5 could import 1853 files at once, no more. After that I tried to add more smaller group of files till it created a total number of 2293 tiddlers. The saved TW5 file was 11,4Mb. How can some have 10k or 20k tiddlers in one file? To edit a tiddler took about 10 sec before saving the big file. The opening of the saved TW5 file took so much time that I stopped it.

--
You received this message because you are subscribed to the Google Groups "TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+...@googlegroups.com.
To post to this group, send email to tiddl...@googlegroups.com.
Visit this group at http://groups.google.com/group/tiddlywiki.
For more options, visit https://groups.google.com/groups/opt_out.

[Stephan Hradek]

I just went on lipsum.org and generated some lipsum text of 4071 byte length.

That's an awful lot of text. I never put that much text into 1 tiddler. 4071 bytes is the equivalent of almost 3 "Normpages". So your 11664 files are roughly the equivalent of 31236 "Normpages" or, if I can trust my internet findings, around the amount of 10 times the german bible.

I'm wondering who will ever type that much into one tiddler.

[PMario]

I did a short test. But I did create the tiddlers with the FF WebDev javascript env. shift-F4


var ntext = "" +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " +"123456789 123456789 123456789 123456789 " +
"123456789 123456789 123456789 123456789 " + "123456789 123456789 123456789 123456789 ";

var tiddler = $tw.wiki.getTiddler("HelloThere");

for (var i = 0; i<200; i++) {
   tag = "t-"+i;
   for (var k = 0; k<100; k++) {
      $tw.wiki.addTiddler(new $tw.Tiddler(tiddler, {title: "a-"+i+"-"+k, text: ntext, tags: [tag]}));
   }
}


As you can see, it creates 20.000 tiddlers with 200 different tags.
Every tiddler contains 1000 byte text

The result is a 20Mbyte html file.

- no crashes at save fromo tiddlywiki.com  ... but 3 times a slow script warning
- it needs about 13 seconds to load from disk
- and about 25 seconds to save with TiddlyFox

If the "long script warning" is not disabled with firefox setting about:config ... It crashed several times while saving
Disabling the long script warning didn't crash it.

-mario

[PMario]

On Friday, January 31, 2014 4:26:20 PM UTC+1, PMario wrote:

As you can see, it creates 20.000 tiddlers with 200 different tags.
Every tiddler contains 1000 byte text

uups its 800 byte text. copy paste error :)
-m

[cangaroo joe]

Very nice test Mario. Anyway 20k tiddlers are huge amount of data. Your method is very efficient. TW can handle tons of text information easy.

[PMario]

On Friday, January 31, 2014 3:16:28 PM UTC+1, Jeremy Ruston wrote:

Performance is poor because all the tiddlers get opened as a side effect of the import. It's open tiddlers that slow things down

@Jeremy,
With my 20'000 test tiddlers, I didn't expect, that it is usable at all.

When we reach v1.0 we may be able to do some performance optimisations. ... but imo not now.

-m

[PMario]

On Friday, January 31, 2014 4:43:28 PM UTC+1, cangaroo joe wrote:

Very nice test Mario. Anyway 20k tiddlers are huge amount of data. Your method is very efficient. TW can handle tons of text information easy.

I wanted to do some "massive tiddler" test for a while now. Especially using different tags, to test the more tabs :)
So as I wrote in my last post. There are some possibilities to make the UI faster.

I'm using codemirror for text editing now. ... So I don't have the "type panalty" in edit mode anymore. ... but I'll have an eye on it ;)

-m