[TW5] How to detect not imported Tiddlers

[Tristan Kohl]

Hey guys,

I am migrating from my ebook management software that I used for years to a TW what I hope makes my workflow easier. The problem I have is that I need to import around 1000 Tiddlers and while LibreOffice Calc tells me, there are 924 Tiddlers for the books (I already checked for duplicates via sorting and =IF(A2=A3,1,"")) TW only says there are just 921 Tiddlers so there are three of them lost in the process. Unfortunately I do not know a way to get TW return the names of those "bad guys" :D

I hope some of you guys got an idea how to tackle that task since sifting by hand is no option as there are over 1000 more tiddlers to import.

Cheers
Tristan

[RichardWilliamSmith]

Why would three of them get lost? Do they have duplicate titles, perhaps? Do you want to troubleshoot the import or do you really want to compare the lists from the two programs?

If I were you I think I would start from scratch and try importing a batch of say 100 entries - see if they all go across. If they do, save it and import a bigger batch next time, repeat. If they don't all go across, try a smaller batch until it works or you spot the reason why something isn't being imported.

Regards,

Richard

[Tristan Kohl]

Hi Richard,

as I said, I already checked for duplicates in Calc. I want TiddlyWiki to return a list of tiddlers that did not get imported or something similar.

Cheers,
Tristan

[Mat]

If you can note down a reproducible case, this is a typical issue to bring up on github. It is a very reasonable request.

<:-)

[RichardWilliamSmith]

Hi Tristan,

I'm sorry, I obviously don't understand the issue properly. If they have properly formed, non-duplicate titles then I'm afraid I don't know why three out of 1000 would get lost. If you only have 1000 tiddlers, I think my previous suggestion is still the quickest way to fix the problem but, as Mat says, you can raise the issue on github - Jeremy has spoken in the past about improving the feedback given by the import mechanism but I don't know if that ever got anywhere.

Regards,

Richard

edit to add: you could get the list of all tiddlers back out of tiddlywiki into your spreadsheet software and diff them in that (put them all in the same list and search for the ones that aren't duplicated)

[Duarte Farrajota Ramos]

Well one simple thing you could try is get the list of all tiddler titles directly from LibreOffice and paste them as a list of links in tiddlywiki
If there are indeed 924 Titles with links three of them are bound to be missing or dead links. You can highlight them in some way to make them standout out and easily figure out by brute force which ones did not import.

If you can't find them easily from the list of 924 links, just create a new style for it by creating a new tiddler tag it with $:/tags/Stylesheet and then paste something like this in the body

a.tc-tiddlylink-missing {
    font-style: italic;
    color: #a00;
}

adjust it to your liking

[Jeremy Ruston]

Are you importing from JSON? If so, you can try this approach to explore what is actually in the file:

* Open your JSON file in a text editor, select all the text and copy it to the clipboard

* Open the JavaScript Console in a browser

* Type `var data=` and then paste your JSON text and press enter

* Type `data` and press enter; the browser should give you a nicely formatted listing of the data for you to review

* Type `data.length`; the browser should give you the number of entries in the file

There’s actually very little that can go wrong with a JSON import besides missing titles and duplicate titles overwriting each other. The code is here for those interested:

https://github.com/Jermolene/TiddlyWiki5/blob/master/core/modules/deserializers.js#L74-L90

Best wishes

Jeremy.

On 8 Jun 2016, at 02:21, Duarte Farrajota Ramos <duarte...@gmail.com> wrote:

Well one simple thing you could try is get the list of all tiddler titles directly from LibreOffice and paste them as a list of links in tiddlywiki

If there are indeed 924 Titles with links some are bound to be missing or dead links. You can highlight them in some way to make them standout out and easily figure out by brute force which ones did not import.

If you can't find them easily from the list of 1000 tiddlers just create a new style for it by creating a new tiddler tag it with $:/tags/Stylesheet and then paste something like this in the body

a.tc-tiddlylink-missing {
    font-style: italic;
    color: #a00;
}

adjust it to your liking


On Wednesday, 8 June 2016 01:38:44 UTC+1, RichardWilliamSmith wrote:

Hi Tristan,

I'm sorry, I obviously don't understand the issue properly. If they have properly formed, non-duplicate titles then I'm afraid I don't know why three out of 1000 would get lost. If you only have 1000 tiddlers, I think my previous suggestion is still the quickest way to fix the problem but, as Mat says, you can raise the issue on github - Jeremy has spoken in the past about improving the feedback given by the import mechanism but I don't know if that ever got anywhere.

Regards,

Richard

edit to add: you could get the list of all tiddlers back out of tiddlywiki into your spreadsheet software and diff them in that (put them all in the same list and search for the ones that aren't duplicated)

--
You received this message because you are subscribed to the Google Groups "TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+...@googlegroups.com.
To post to this group, send email to tiddl...@googlegroups.com.
Visit this group at https://groups.google.com/group/tiddlywiki.
To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/1529e966-1aa9-40a0-a65a-cb87c4a987da%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Tristan Kohl]

Hey guys,

thank you all for your support and suggestions. I used the way Duarte told me and I found that three titles were indeed not imported.
I tried again to convert my .csv to .json via http://convertcsv.com/ and this time it just works, there are 924 tiddlers now... Quite wired I think. Since my programmer heart woke up about this, I will try to hunt down the problem but a quick diff between the "old" and "new" json did not result in any clarity.

@Richard: Sorry if my explanation was not that clear, my english is a little poor.

@Jeremy: I already tried the console thing and it works for the old and the new file, I will post here if I found something.

Thanks again to you all
Cheers
Tristan