What is the max limit number of tiddlers under a node-tiddlywiki server?

[yrosgi L]

The node-tiddlywiki store separate tiddlers into the single directory "tiddlers" under the server's root.

As I know that the file system such as NTFS' maximum file number is 2^32-1, what will happen when the number of tiddlers reaches the file system limit? Will the global search function still work?

Thanks.

[Eric Shulman]

On Sunday, October 11, 2020 at 2:43:01 AM UTC-7, yrosgi L wrote:

The node-tiddlywiki store separate tiddlers into the single directory "tiddlers" under the server's root.

As I know that the file system such as NTFS' maximum file number is 2^32-1, what will happen when the number of tiddlers reaches the file system limit? Will the global search function still work?

If your system reaches 2^32-1 (4,294,967,295) *files*, then there wouldn't be any room for temporary system files, much less tiddler files.  Thus, I'd be more concerned about the whole system -- not just the browser that is running your TiddlyWiki -- failing in some strange and probably unrecoverable ways.

-e

[PMario]

Hi,

What are you trying to do? ... Considering that you create 1 file per second, you'd need about 68 years to create half of this number of files. ...

Depending on your harddisk 1 file needs about 16/32/64kByte, even if you want to store only 1 byte in it. So using 16kByte it would be about 34 Terrabyte of HD space, to store about 2 billion files.

So it would be really interesting, what you want to do?

-mario

[TW Tones]

yrosgi L,

There would be a lot of other methods need such as skinny tiddlers, etc.. to build something of the scale you ask. 

TiddlyWiki interactivity and searchability is part of its architecture, as a result I believe it has some design elements that may fight against such a large implementation.

Not withstanding these points and from Eric and Mario it is "software" and a lot can be done. for example;

• Depending on the data you could move it into data tiddlers
• Getting tiddlywiki to talk to an external database such as in NoteSelf
• Building a search index of you data and searching that instead
• If there is a lot of common words in data it can be reduced to a smaller index

If we knew more about the nature of the data that would consume so many tiddlers perhaps we could craft a solution, however just as I would not use Microsoft Excel for the data I have in my TiddlyWikis there is a point where tiddlywiki may not be suitable.

Regards

Tones

[yrosgi L]

Hi Mario,

This question actually raising when I think and care about what case will cause performance issues. For example, if my wiki has 65535 tiddlers and each tiddler near about 128KiB, will the search box still work fine? or whether the wiki start time become longer?

PS: the number 2^32-1 is just a maximum I think in theory that on my disk.

L,

[yro...@gmail.com]

Thank you, Tones.

 

It is my first time hear about the skinny tiddlers and NoteSelf. Is there any link or detail about the skinny tiddlers and how to build and use index with TiddlyWiki?

 

Thanks in advance :)

 

L,

发件人: tiddl...@googlegroups.com <tiddl...@googlegroups.com> 代表 TW Tones
发送时间: 2020年10月12日 5:24
收件人: TiddlyWiki <tiddl...@googlegroups.com>
主题: [tw5] Re: What is the max limit number of tiddlers under a node-tiddlywiki server?

--
You received this message because you are subscribed to a topic in the Google Groups "TiddlyWiki" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/tiddlywiki/6gl15O3FZk0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to tiddlywiki+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/afb24a32-97c7-4404-ba31-c26589e728b7o%40googlegroups.com.