[tw5] Tiddlyclip plugin release - create clips of webpages

1,401 views
Skip to first unread message

BJ

unread,
Sep 9, 2014, 9:16:24 AM9/9/14
to tiddl...@googlegroups.com
I am creating a plugin and browser addon that allows clips of web pages to be collected into a tiddlywiki. It is now functional but still in development.
As it is still in development, and it modifies the contents of tiddlywikis, it is possible that the data within a tiddlywiki could be destroyed if there is a bug - it is therefore RECOMMENDED at present that tiddlyclip is only used  for experimentation in a separate tiddlywiki. The plugin along with its documentation can be found here:

Note that I have only used the plugin and firefox addon  on ubuntu 12.04.
Feedback always welcomed!
Cheers

BJ

Jeremy Ruston

unread,
Sep 9, 2014, 9:32:47 AM9/9/14
to TiddlyWiki
Hi BJ

I'm afraid the link seems to be missing - very excited to see this,

Best wishes

Jeremy

--
You received this message because you are subscribed to the Google Groups "TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+...@googlegroups.com.
To post to this group, send email to tiddl...@googlegroups.com.
Visit this group at http://groups.google.com/group/tiddlywiki.
For more options, visit https://groups.google.com/d/optout.



--
Jeremy Ruston
mailto:jeremy...@gmail.com

BJ

unread,
Sep 9, 2014, 11:38:01 AM9/9/14
to tiddl...@googlegroups.com, jeremy...@gmail.com
Oops!

It can be found here:

http://tiddlyclip.tiddlyspot.com/

cheers
BJ

Mat

unread,
Sep 9, 2014, 2:52:38 PM9/9/14
to tiddl...@googlegroups.com, jeremy...@gmail.com
Thank you! Very exciting!
I'm guessing you know of TiddlySnip, but in case you don't then maybe it's worth checking out.
<:-)

Jeremy Ruston

unread,
Sep 9, 2014, 4:27:46 PM9/9/14
to BJ, TiddlyWiki
Hi BJ

I've installed the plugin. It works great for me clipping to http://tiddlyclip.tiddlyspot.com/, but I was unable to dock with my usual test local TW (file:///Users/jeremyruston/git/jermolene/jermolene.github.com/index.html). The "dock here" menu item can be selected, but the URL doesn't subsequently appear in the "tiddlyclip sets->" menu item.

I'm very impressed at the capabilities, particularly the page thumbnails. Great stuff.

Best wishes

Jeremy

BJ

unread,
Sep 9, 2014, 4:40:09 PM9/9/14
to tiddl...@googlegroups.com, bugg...@gmail.com, jeremy...@gmail.com
Hi Jeremy,
have you installed the plugin in your tiddlywiki? its in http://tiddlyclip.tiddlyspot.com - $:/plugins/bj/tiddlyclip

cheers

BJ

BJ

unread,
Sep 9, 2014, 4:43:03 PM9/9/14
to tiddl...@googlegroups.com, jeremy...@gmail.com
Thanks Mat.
The idea for tiddlyclip came from tiddlysnip. I thought of modifying tiddlysnip, but could not get it to 'bend' to my needs.
cheers
BJ

Jeremy Ruston

unread,
Sep 9, 2014, 4:46:41 PM9/9/14
to BJ, TiddlyWiki
Hi BJ

have you installed the plugin in your tiddlywiki? its in http://tiddlyclip.tiddlyspot.com - $:/plugins/bj/tiddlyclip

Ah, thank you, I had missed that step, and it works fine now. Exploring it..

Best wishes

Jeremy 

Matabele

unread,
Sep 10, 2014, 3:36:27 AM9/10/14
to tiddl...@googlegroups.com
Hi

Works for me (Firefox in Ubuntu Trusty) -- many thanks. I can now retire my last remaining copies of TWC!

regards

Ton Gerner

unread,
Sep 10, 2014, 6:11:37 AM9/10/14
to tiddl...@googlegroups.com
Hi BJ,

A very welcome addition (I am a long-time user of TiddlySnip with TWc).

My first test with TiddlyClip was discouraging : besides the text I got a lot of CSS. Try to 'Snip' the following from [1] and see what you get. I got more CSS than text ;-)

Definition of INCONSISTENCY

1 :  an instance of being inconsistent
2 :  the quality or state of being inconsistent
     See inconsistency defined for English-language learners »
     See inconsistency defined for kids »


I tried a few other websites and 'Snipped' and 'Pinned' without the problems at [1].

I now need to explore all the possibilities of TiddlyClip.

Thanks a lot for this plugin and Firefox add-on.

Cheers,

Ton

[1] http://www.merriam-webster.com/dictionary/inconsistency



On Tuesday, September 9, 2014 3:16:24 PM UTC+2, BJ wrote:

BJ

unread,
Sep 10, 2014, 10:57:26 AM9/10/14
to tiddl...@googlegroups.com

Hi Ton,
thanks for trying tiddlyclip, and thanks very much for such an accurate bug report. I have now fixed this issue and will  release a new version of the firefox addon shortly,

cheers

BJ
Message has been deleted

BJ

unread,
Sep 10, 2014, 11:32:57 AM9/10/14
to tiddl...@googlegroups.com
I have released a new version of the firefox addon 0.0.4-alpha. The installation of the updated is the same as installing the original - just drag and drop the link to the plugin or go to my git repository and download it.  If you have not already installed the plugin you need only follow the instructions given at

http://tiddlyclip.tiddlyspot.com

the link is

https://github.com/buggyj/tiddlyclip/raw/master/tiddlyclip.xpi

project page is

http://buggyj.github.io/tiddlyclip/

cheers

BJ


On Tuesday, September 9, 2014 3:16:24 PM UTC+2, BJ wrote:

BJ

unread,
Sep 10, 2014, 11:35:13 AM9/10/14
to tiddl...@googlegroups.com
thanks Matabele,
and you can use tiddlyclip to move your tiddlers from twc to tw5,

cheers

BJ

Roger Whitehead

unread,
Sep 11, 2014, 2:31:41 AM9/11/14
to tiddl...@googlegroups.com
Sounds interesting. I can't get it to work on my system, though. I get a message when I try to install it that it's incompatible with Firefox 24.8.0, which I'm running under Windows 8.1.

I appreciate that it's an early release, so this is mainly a FYI message.

Roger

= = = = =


On Wednesday, September 10, 2014 4:32:57 PM UTC+1, BJ wrote:

    I have released a new version of the firefox addon 0.0.4-alpha...

BJ

unread,
Sep 11, 2014, 3:39:53 AM9/11/14
to tiddl...@googlegroups.com

Hi Roger,
I have now set the minimum version of ff to 20 - so now you should be able to give it a go.

I think the addon should work ok but I have not tested it with older version of ff.
cheers

BJ

Roger Whitehead

unread,
Sep 11, 2014, 7:36:36 AM9/11/14
to tiddl...@googlegroups.com
It's now saying the plug-in is corrupt.  8=(

Roger
Message has been deleted

Roger Whitehead

unread,
Sep 11, 2014, 7:42:37 AM9/11/14
to tiddl...@googlegroups.com
Belay that -- it accepted it at the third try. Will now have a play.

Thanks,

Roger

Roger Whitehead

unread,
Sep 11, 2014, 7:53:47 AM9/11/14
to tiddl...@googlegroups.com
Very nice!

Is it possible to have the Web link at the bottom of the clip or to give people the choice of position?

(Bloody users -- always asking for more.)


Roger

= = = =

BJ

unread,
Sep 11, 2014, 9:13:26 AM9/11/14
to tiddl...@googlegroups.com

Thanks Roger.
Clips are configurable. Look in the tiddler TiddlyClipConfig - each row in the table contains the setup to create a clip. In the Rule Tid column click on 'defaultSnip' which takes you to another tiddler. In the 'body' column you should see '@pagRef' and '@text'. You need to edit this tiddler and reverse the order of these two (which is a bit fiddly).
Cheers
BJ

Jeremy Ruston

unread,
Sep 11, 2014, 11:08:38 AM9/11/14
to TiddlyWiki
Hi BJ

I haven't had a great deal of time to look at the source of the TiddlyClip plugin/addon, but I did wonder about the use of tables for configuration data.

I wondered if you had considered using tiddler dictionaries for configuration. The trouble with the table approach is that we won't be able to offer a simple UI for editing those settings until/unless we have the ability to edit a table cell in place. Possibly something to discuss over in GitHub,

Best wishes

Jeremy.



--
You received this message because you are subscribed to the Google Groups "TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tiddlywiki+...@googlegroups.com.
To post to this group, send email to tiddl...@googlegroups.com.
Visit this group at http://groups.google.com/group/tiddlywiki.
For more options, visit https://groups.google.com/d/optout.

BJ

unread,
Sep 11, 2014, 12:28:47 PM9/11/14
to tiddl...@googlegroups.com
Having a editor is near the top of my list of things to do.
I'll open a thread for discussion, probably the dev forum is best.

--
You received this message because you are subscribed to a topic in the Google Groups "TiddlyWiki" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/tiddlywiki/9LoS8wLaFlI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to tiddlywiki+...@googlegroups.com.

Mark S.

unread,
Sep 16, 2014, 4:59:07 PM9/16/14
to tiddl...@googlegroups.com

It looks very promising! Getting information into a TW is half the battle sometimes.

When clipping web pages I notice that images are omitted. So if you want the images you have to go back and do it pretty much by hand. Do you think it might be possible to have a version that will be able to clip the images too?

I guess this must be technologically challenging, since I've seen commercial apps that have the same difficulty (they can clip text or images, but not at the same time).

Thanks for your work!
Mark

Danielo Rodríguez

unread,
Sep 16, 2014, 5:23:43 PM9/16/14
to tiddl...@googlegroups.com
Thank you for a new tool for TW

Glad to see that you included my context search plugin.

Mark S.

unread,
Sep 17, 2014, 1:13:21 PM9/17/14
to tiddl...@googlegroups.com
At the moment, it doesn't appear to work for snipping or pinning in Firefox 30 for Linux Mint on Linux Mint 16. It docks, and "Tid" works, but snip and pin don't.

This is using FF plugin 0.0.4alpha  and  0.0.6-alpha TW plugin.

Mark


BJ

unread,
Sep 17, 2014, 1:23:26 PM9/17/14
to tiddl...@googlegroups.com
HI Mark,

 when you say snip and pin  don't work, do you mean no tiddlers are produced or that tiddlers are produced but the content is missing or wrong in someway?

cheers BJ

BJ

unread,
Sep 17, 2014, 1:31:47 PM9/17/14
to tiddl...@googlegroups.com
two things I forgot to mention in the docs:
a 'limitation'  with tiddlyclip is that it works on a per window basic - so the source and the target tab must be in the same window.
only one copy of the target tiddlywiki (the one where the tiddlers go to) must be open within the browser.


cheers

BJ
On Wednesday, September 17, 2014 7:13:21 PM UTC+2, Mark S. wrote:

Mark S.

unread,
Sep 17, 2014, 4:28:46 PM9/17/14
to tiddl...@googlegroups.com
Ok, it's working, but differently than before (or maybe my memory failed).

Yesterday when I used the clipping, the target (docked) TW gave me an import tiddler where I could verify that what I wanted to import. Or  did I just imagine that? Maybe the tiddler only appears for tids? Today it's not asking me when web clipping -- just doing the clipping in the background silently.

Ok, seems to be working one way or the other.

Thanks!
Mark

BJ

unread,
Sep 17, 2014, 5:10:05 PM9/17/14
to tiddl...@googlegroups.com
I set the web clipping to either append the 'new' content to an existing tid or to create a new tiddler with an incrementing number on the end of the name, this means that it is not possible to overwrite existing content.
When clipping tiddlers it is possible to overwrite tiddlers with the same name - so I would like a check before they are overridden so I pass these to the import mechanism (i think I may need to add some logic to the import mechanism to do the checks for same name overwrite??

cheers

BJ

Mark S.

unread,
Sep 17, 2014, 5:19:12 PM9/17/14
to tiddl...@googlegroups.com
Looking through the TiddlyClip reference, but can't seem to find this.

Is there a way to either

  (1) Use an existing tiddler as a template for a web clipping

or

  (2) Specify user fields to be filled when web clippping

Thanks!
Mark

BJ

unread,
Sep 17, 2014, 5:22:52 PM9/17/14
to tiddl...@googlegroups.com
Thanks
I have your context search plugin in all my Tw5 wikis

BJ

BJ

unread,
Sep 17, 2014, 5:45:17 PM9/17/14
to tiddl...@googlegroups.com
Hi Mark,
you can copy text and one image with the Pin Action.
It is a difficult to retain the format of a web page (or parts of) when clipped  - it is a security risk to copy to raw html, so it is 'sanitized' which removes all the styling. The end result can be a mess, technical stuff tends to have unsophisticated layouts so these tend to have better results.

Tiddlyclip is highly configurable, I have a number of different 'Actions' that I use. I clip (sanitized) html to create lists of technical notes. I plan to add some extra rules to the demo embedding  youtube videos. I also plan to show how to clip notes and organise them into list. I also use tiddlyclip to create logbooks for my projects which I will demo as well.

cheers

BJ


On Tuesday, September 16, 2014 10:59:07 PM UTC+2, Mark S. wrote:

It looks very promising! Getting information into a TW is half the battle sometimes.

When clipping web pages I notice that images are omitted. So if you want the images you have to go back and do it pretty much by hand. Do you think it might be possible to have a version that will be able to clip the images too?

I guess this must be technologically challenging, since I've seen commercial apps that have the same difficulty (they can clip text or images, but not at the same time).

Thanks for your wo

Mark S.

unread,
Sep 18, 2014, 3:30:12 PM9/18/14
to tiddl...@googlegroups.com
When I put a line like this in the in the bottom of the configuration table in the TiddlySnip config tiddler:

  |Science|copy|Science|[[defaultSnip]]||

and then try to snip using the "Science" entry, the resulting tiddler is not tagged as Science.

FF 0.0.4alpha, TW plugin 0.0.6-alpha, FF 27 (windows) & 30 (linux).

Mark

BJ

unread,
Sep 18, 2014, 5:12:13 PM9/18/14
to tiddl...@googlegroups.com
HI Mark,
what your have typed is correct, so there is a bug. I will fix it in the next couple of days.
In the mean time you can still tag you tiddlers another way.  The rules (eg defaultSnip) also have a table entry for tags.
You can make a new rule tiddler by cloning the defaultSnip tiddler.

 If you don't have a clone icon enabled in tiddlywiki you do this by going to the ControlPanel (click the cog icon) then the Appearance tab then the Toolbars.

create then modify the clone (rename it to myRule or whatever) and put 'Science' in the tag entry.

then add this to the TiddlyClipConfig

  |Science|copy||[[myRule]]||


If you are going to add other categories like 'art' and 'music' then it is better to put a reference in the rules tag entry (instead of 'Science') like so:- ((*@category*))
that way you can reuse the new rule:

  |Science|copy||[[myRule]]||
  |music|copy||[[myRule]]||
  |art|copy||[[myRule]]||

cheers

BJ

Danielo Rodríguez

unread,
Nov 18, 2014, 2:29:00 AM11/18/14
to tiddl...@googlegroups.com

El jueves, 18 de septiembre de 2014 23:12:13 UTC+2, BJ escribió:
HI Mark,
what your have typed is correct, so there is a bug. I will fix it in the next couple of days.
 
Hello BJ,

When are you going to fix this issue?


 
In the mean time you can still tag you tiddlers another way.  The rules (eg defaultSnip) also have a table entry for tags.
You can make a new rule tiddler by cloning the defaultSnip tiddler.

 If you don't have a clone icon enabled in tiddlywiki you do this by going to the ControlPanel (click the cog icon) then the Appearance tab then the Toolbars.

How can I add more tags? In my experience what happens is the tag I specified overrides the original tag. I also tried to add a "source" field with the original url of the wiki that the tiddler belongs to but it does not work. What am I doing wrong?

 |!Title|!Body|!Tags|!Fields modifiers|!field initials|!Modes|
|||externalTiddler|{"#type":"text/x-tiddlywiki"},{"$type":"((*@classic*??*#type*??*@abort()*))"}|{"$url":"((*@pageRef*))"}}|no-textsaver|

BJ

unread,
Nov 19, 2014, 8:31:54 PM11/19/14
to tiddl...@googlegroups.com

Hi Daniel, I have fixed this issue. I am on my way to Managua and will do a release soon after I arrive.
Cheers BJ

--

BJ

unread,
Dec 2, 2014, 8:08:56 AM12/2/14
to tiddl...@googlegroups.com


On Tuesday, December 2, 2014 6:09:30 AM UTC-6, NT wrote:
BJ, excuse me please. I have an off-topic question regarding your calendar plugin, but i have found no other way to get in contact with you. So what's the best place to have a short talk about it?

Hi NT,
I think you can open a  new post - I generally check the posts daily, there is also the option within google groups to  send me a personal message as well (but I prefer to answer technical points on the group so others can see them)
Message has been deleted

Charles Ridout

unread,
Feb 27, 2016, 7:00:39 PM2/27/16
to TiddlyWiki
I recently found TiddlyClip. It is what I have been looking for. My issue is using Tiddlyclip
on my Android tablet. I am unable to "dock to my Tiddlywiki" since Android/Firefox does not appear
to support Right-Click like on the desktop.

Any thoughts or suggestions will be appreciated.

Great tool!

Charles

BJ

unread,
Feb 28, 2016, 5:42:20 AM2/28/16
to TiddlyWiki
Hi Charles,
I'm glad you like tiddlyclip.

At the moment I only use a desktop pc where tiddlyclip (with tiddlywiki) is my main notes tool. I have not looked at how to make tiddlyclip work with android (yet) as I do not use a tablet, but needless to say there will be some work before tiddlyclip is working on a smartphone.

All the best

BJ
Message has been deleted

BJ

unread,
Sep 25, 2016, 3:28:12 PM9/25/16
to tiddl...@googlegroups.com
Hi David,
did you find the signed version? I really need to update the docs!

It is mentioned in this thread.

https://groups.google.com/forum/#!searchin/tiddlywiki/tiddlyclip|sort:date/tiddlywiki/WnfHpKX9mqk/MPAKp7znBAAJ

cheers
BJ

On 25 September 2016 at 05:04, David Szego <david...@gmail.com> wrote:
Hi BJ,

Could you kindly sign your TiddlyClip extension? I'd love to be able to use it, but current FF versions block it, even with signing.required set to false.

See:

https://support.mozilla.org/en-US/kb/add-on-signing-in-firefox?as=u&utm_source=inproduct#w_what-can-i-do-if-firefox-disables-an-installed-add-on

https://developer.mozilla.org/en-US/Add-ons/Distribution

Thanks,
David.

--
You received this message because you are subscribed to a topic in the Google Groups "TiddlyWiki" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/tiddlywiki/9LoS8wLaFlI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to tiddlywiki+unsubscribe@googlegroups.com.

To post to this group, send email to tiddl...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages