[TWC] Export All Tiddlers

[TonyM]

Hi Folks,

With the time approaching for me to leave TW Classic behind I am hoping to Export all my tiddlers 16,000 or so, along with Tags in preparation for dividing them into different TW5's such as projects etc...

I am doing a course on BigData and would like to import this into an analysis tool.

Sadly the browser technology has moved on some time ago and the CSV export feature are failing on export

The export formats available are

1. TiddlyWiki HTML Document (Includes Core Code) - Don't want
   
2. TiddlyWiki "PureStore" HTML (Tiddler Data only) - No tags so don't want
   
3. TiddlyWikli Plane text TXT File (Tiddler source listing) - Working but complex to parse
4. Comma-Seperated Value (CSV) datafile - Desired not working
5. RSS NewsFee XML file - Not relavant ?

Unfortunately  Comma-Seperated Value is set the export  tiddlers button does not trigger an export.

Can anyone help please?

What other methods do I have to convert a large number of tiddlers into a CSV file?

• Could I parse the raw tiddlywiki html?
• Could I somehow Import to TW5 then export from there? (My last attempt crashed)
• Is there another TWC CSV exporter?
  

Regards

Tony

[TonyM]

PS also fields eg

- - - - - - - - - - - - - - -
|     title: Hidden Return to Shop Buttons
|   created: 8/16/2017, 6:11:00 PM
|  modified: 8/16/2017, 6:20:00 PM
| edited by: AnthonyMuscio
|      tags: .projectTask :work =WIP [[LaSource Shop]]
- - - - - - - - - - - - - - -

[Mark S.]

What were the conditions under which you attempted to import into TW5? I'm wondering if you tried it on a desktop machine with lots of RAM and a freshly loaded browser with no other tabs open whether you might have better luck.

Another possibility might be to use the --load option of tiddlywiki on node.js to load in 2.x.x tiddlers (or at least that's what the documentation claims).

Good luck,
Mark

[TonyM]

Mark,

Thanks, I do need to tackle the import process but this will be selective. My Main concern is to extract existing tiddlers as input to some BigData Tools.

The question would be can I load a large TWC into NodeJS so that I can export it in CSV?

I will give it a go with your advice, Thanks

Tony

[Dragon Cotterill]

So my first concern would be, why does export not work?

In my experience it does work once the tiddlers are selected. Unless you have got some seriously messed up field that include quotes and apostrophes etc.

Does it produce any output? An error message?

OK, I've done exports with TWCs containing about 3,500 tiddlers, not the huge numbers you're quoting. But I've never had an issue with it.

[TonyM]

Dragon,

I have had save or export issues for some time, We now depend on TiddlyFox for the save feature. The error messages sometime being thrown includes the old Netscape save message.

However in the case of the CSV export that I want to use the button simply does not respond.

I am using this Plugin http://www.tiddlytools.com/#ExportTiddlersPlugin at the latest version. If a Select a few I can export them, More than a few and the button will not respond.


Attachments included





Regards
Tony

[Dragon Cotterill]

That is very odd. That's the exact same plugin I use, also on FireFox, using TiddlyFox. Just to be sure, you're not using this from an http instance and saving to file? It will throw an error if you try that. Local file instance to file export should work though.

On my largest TWC (2185 tiddlers) I can export everything... but it throws an error "TypeError: this.source is null" at the very end. But it does actually do the export... after I have clicked the OK on the error.

I will admit, it's not the most robust of plugins, but it does seem to work sufficiently.