How large are people's files getting?

8 views
Skip to first unread message

Mike Crowe

unread,
Jun 22, 2006, 9:58:05 AM6/22/06
to TiddlyWiki
Hi folks,

In my usual obsessive/compulsive manner, I'm already deeply in love
with TW. Some questions:

1) How large are people's files getting? I'm up > 800K. Just
wondering if I should be concerned.
2) The base seems pretty fragmented -- MPTW, Yanni's, etc. Do most
people stick with a variety and import features they need? I just
switch from MPTW GTD to Yanni's, mainly because I liked the auto-hide
features of the main-menu and his sidebar. It seems like styles are
really important, but not easy to migrate. Any thoughts?
3) Any hope of ImportTiddlers also importing dependencies when you
select a plugin to import?

TIA
Mike

LeviM

unread,
Jun 22, 2006, 5:12:59 PM6/22/06
to TiddlyWiki
Hello Mike,
I was just about to post on the same topic of size. I recently found TW
and have been spending a lot of time getting it to look and function
just as i want.
BTW In case any else wants to use it, you can find it here:
http://levim.retrobyte.net/WikiNotebook.html
Two known things I havent fixed yet, and dont want to bother until I
find out Im not wasting my time, are that the TiddlerSlice button
doesnt work, and
self-weaving "redirect" tiddler takes so long to process everything
that I need to tell
Firefox to continue processing it like 10 times before its done.
It has some of my data in it already and Ive started to notice issues.
I have a ton more data to put in, so Im worried about the file size
limitation.

The latest thread I found on this issue is this one:
http://groups.google.ca/group/TiddlyWiki/browse_thread/thread/583dd3049b77af2c/6698b127d67b5b81?q=file+size&rnum=1#6698b127d67b5b81
which has described the TWRDF solution here:
http://www.aurore.eclipse.co.uk/wiki/tiddlywiki.htm
But that only works on a web server setting. The creator mentioned
working on an offline version. Anyone know if there has been progress
on this front?

Otherwise the best solution Ive heard is having the tiddlers in a
separate database file that is accessed whenever need. Except perhaps
for the plugin and theme tiddlers.

So if anyone has any news or ideas about this Id really appreciate it.
PS, sorry to partially hijack your thread...

Yann Perrin

unread,
Jun 22, 2006, 5:59:33 PM6/22/06
to Tiddl...@googlegroups.com
Have you also imported TWkdLib ? The latest TiddlerSlicer release needs it to work properly.
you'll find it here : http://yann.perrin.googlepages.com/twkd.html#TWkdLib

2006/6/22, LeviM <levi.mee...@gmail.com>:

TiddlerSlice button doesnt work

--
Yann.
http://yann.perrin.googlepages.com

Daniel Baird

unread,
Jun 22, 2006, 8:03:25 PM6/22/06
to Tiddl...@googlegroups.com
Hi Mike.

On 6/22/06, Mike Crowe <drmik...@gmail.com> wrote:

Hi folks,

In my usual obsessive/compulsive manner, I'm already deeply in love
with TW.  Some questions:

1)  How large are people's files getting?  I'm up > 800K.  Just
wondering if I should be concerned.

TW handles big files surprisingly well.. it's usually searching, and plugins that process every tiddler, where you'll notice a performance hit first.

I've never heard of problems with TW itself due to a large file.. as far as I know noone has actually lost data or anything from having a big TW.


2)  The base seems pretty fragmented -- MPTW, Yanni's, etc.  Do most
people stick with a variety and import features they need?  I just
switch from MPTW GTD to Yanni's, mainly because I liked the auto-hide
features of the main-menu and his sidebar.  It seems like styles are
really important, but not easy to migrate.  Any thoughts?

Generally folk seem to pretty much pick a convenient starting point and add what they need.  The GTD editions seem to attract a audience that are less interested in fiddling (obviously there are exceptions), so I get the feeling that most GTD-focussed users tend to stick to what comes out of the box.

With styles, usually the more customised the layout, the more specific the style is to that layout.

If you're working with CSS it might help to download MODI from:
http://slayeroffice.com/tools/modi/v2.0/modi_help.html


3)  Any hope of ImportTiddlers also importing dependencies when you
select a plugin to import?

At the moment dependencies aren't listed in a way ImportTiddlers can discover.  However, when TW 2.1 comes out in a few weeks, it will have support for getting data out of tiddlers in a way that basically make this kind of thing possible.

Then we just need to wait for Eric to revise ImportTiddlers, then plugin authors to specify dependencies.  Not sure how long that will take :)


Cheers

;Daniel



--
Daniel Baird
http://danielbaird.com (TiddlyW;nks! :: Whiteboard Koala :: Blog :: Things That Suck)

Ken Girard

unread,
Jun 22, 2006, 10:37:30 PM6/22/06
to TiddlyWiki
At one point (2.0.1 or so) I pumped up a TW to around 3megs just to see
if it could handle it. Something like 350 tiddlers containing the same
long bit of text (I copied a big news article and then threw in a
couple of TWtables, reminders and links to tiddlers) and a bunch of
plugins. It took a long time to load, but once it was up it handled
fine, even when posted on the net.

My personal TW's are in the 800k+ range, but then I run plugin heavy as
I like to try them all out. :) I am finding that the d3 type plugins
that update multiple tiddlers at once are what slows my performance
the most once the system is up and running.

Ken Girard

stuckagain

unread,
Jun 29, 2006, 1:00:00 PM6/29/06
to TiddlyWiki
I am at 1.9 Mb with around 1600 tiddlers. It works fine

Andrew Lister

unread,
Jul 3, 2006, 9:32:40 PM7/3/06
to TiddlyWiki
I've found that turning off the self-weaving redirect speeds things up
considerably, as LeviM said. Also, Opera 9 seems to be very fast,
though there still seems to be conflict with ImportTiddlers,
ExportTiddlers, and YourSearch.

Andrew Lister

unread,
Jul 3, 2006, 10:22:45 PM7/3/06
to TiddlyWiki
Plus Opera 9 doesn't seem to be able to save changes, on my Mac, even
on an empty TW file, which is rather inconvenient.

Daniel Baird

unread,
Jul 3, 2006, 11:14:13 PM7/3/06
to Tiddl...@googlegroups.com

Hi,

Opera and some plugins:

In TiddlyWiki 2.1, soon-to-be-released, there's a fix for the problem Opera has with very long tiddlers (which is why plugins like Import/ExportTiddlers don't work in Opera -- they're huge!).

The fix is quite small and works perfectly (AFAIK) in the current TW version -- so if you want, you can patch your current TiddlyWiki to work with big tiddlers in Opera.

Go here to see the code changes required:
http://trac.tiddlywiki.org/tiddlywiki/changeset/268

..the filenames listed won't make sense, but you should be able to find the right lines of code.


Saving on Opera/Mac:

There's a known problem with getting Opera to save on a Mac: http://tiddlywiki.com/#Opera ..basically it doesn't, but it might just a matter of getting the security permissions right.

Let us know if you can get it figured out!

Cheers

;Daniel

On 7/4/06, Andrew Lister <lis...@post.queensu.ca > wrote:

Plus Opera 9 doesn't seem to be able to save changes, on my Mac, even
on an empty TW file, which is rather inconvenient.







--
Daniel Baird
http://tiddlyspot.com (free, effortless TiddlyWiki hosting)

Andrew Lister

unread,
Jul 4, 2006, 9:59:56 PM7/4/06
to TiddlyWiki
Thanks, Daniel. I found the java policy file, in the
/Library/Java/Home/lib/security folder, but the modifications I tried
(based on http://tiddlywiki.com/#Opera) seem not to have worked. I
will leave that to someone more knowledgeable, and look forward to TW
2.1.

all the best,

Andrew

Reply all
Reply to author
Forward
0 new messages