How to categorize and do the search

Java Development

unread,

May 2, 2021, 1:08:17 PM5/2/21

to TiddlyWiki

Hi,

I have the following

English - 2,000 txt files

Hindi - 1,800 txt files

...

..

I want to import all of them but wanted to search with language specific

Also, want to expand based on language.

How to do this in tiddlywiki?

Thanks

TW Tones

unread,

May 2, 2021, 11:11:17 PM5/2/21

to TiddlyWiki

Perhaps you need to say more;

But if you imported all these files and searched for something, the search string would be in one or the other language. However you could tag each text (tiddler) with the language and limit searches to all tiddlers with that tag.

Tones

Java Development

unread,

May 2, 2021, 11:24:54 PM5/2/21

to TiddlyWiki

But the size of the tiddler increases to nearly 1 GB..What is the maximum size of the tiddler html file?

Is there a way a tiddler can be splitted into couple of html files...

like one core or main html file and it refers to others

TW Tones

unread,

May 3, 2021, 8:14:58 PM5/3/21

to TiddlyWiki

Yes,

If you use a single html file, it is loaded into browser memory, so 1GB is likely unusable. There are ways to compress text for search algorithms but I do not think this relevant here. You could look into node and bob solutions for tiddlywiki, and what we call skinny tiddlers, but I suspect this will impact the searchability.

We cant easily say what the maximum size of a tiddlywiki.html is because there are more than one way that it can get too big, browser and device limitations can also impact it.

Can I suggest you review the original idea for this project and tell us about it. We may be able to give better advice if we know what you are trying to achive.